Christos Athanasiadis, Damianos Galanopoulos, A. Tefas
{"title":"开放赛车模拟器的渐进式神经网络训练","authors":"Christos Athanasiadis, Damianos Galanopoulos, A. Tefas","doi":"10.1109/CIG.2012.6374146","DOIUrl":null,"url":null,"abstract":"In this paper a novel methodology for training neural networks as car racing controllers is proposed. Our effort is focused on finding a new fast and effective way to train neural networks that will avoid stacking in local minima and can learn from advanced bot-teachers to handle the basic tasks of steering and acceleration in The Open Racing Car Simulator (TORCS). The proposed approach is based on Neural Networks that learn progressively the driving behaviour of other bots. Starting with a simple rule-based decision driver, our scope is to handle its decisions with NN and increase its performance as much as possible. In order to do so, we propose a sequence of Neural networks that are gradually trained from more dexterous drivers, as well as, from the simplest to the most skillful controller. Our method is actually, an effective initialization method for Neural Networks that leads to increasingly better driving behavior. We have tested the method in several tracks of increasing difficulty. In all cases the proposed method resulted in improved bot decisions.","PeriodicalId":288052,"journal":{"name":"2012 IEEE Conference on Computational Intelligence and Games (CIG)","volume":"54 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2012-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":"{\"title\":\"Progressive neural network training for the Open Racing Car Simulator\",\"authors\":\"Christos Athanasiadis, Damianos Galanopoulos, A. Tefas\",\"doi\":\"10.1109/CIG.2012.6374146\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper a novel methodology for training neural networks as car racing controllers is proposed. Our effort is focused on finding a new fast and effective way to train neural networks that will avoid stacking in local minima and can learn from advanced bot-teachers to handle the basic tasks of steering and acceleration in The Open Racing Car Simulator (TORCS). The proposed approach is based on Neural Networks that learn progressively the driving behaviour of other bots. Starting with a simple rule-based decision driver, our scope is to handle its decisions with NN and increase its performance as much as possible. In order to do so, we propose a sequence of Neural networks that are gradually trained from more dexterous drivers, as well as, from the simplest to the most skillful controller. Our method is actually, an effective initialization method for Neural Networks that leads to increasingly better driving behavior. We have tested the method in several tracks of increasing difficulty. In all cases the proposed method resulted in improved bot decisions.\",\"PeriodicalId\":288052,\"journal\":{\"name\":\"2012 IEEE Conference on Computational Intelligence and Games (CIG)\",\"volume\":\"54 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2012-12-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"6\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2012 IEEE Conference on Computational Intelligence and Games (CIG)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CIG.2012.6374146\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2012 IEEE Conference on Computational Intelligence and Games (CIG)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CIG.2012.6374146","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Progressive neural network training for the Open Racing Car Simulator
In this paper a novel methodology for training neural networks as car racing controllers is proposed. Our effort is focused on finding a new fast and effective way to train neural networks that will avoid stacking in local minima and can learn from advanced bot-teachers to handle the basic tasks of steering and acceleration in The Open Racing Car Simulator (TORCS). The proposed approach is based on Neural Networks that learn progressively the driving behaviour of other bots. Starting with a simple rule-based decision driver, our scope is to handle its decisions with NN and increase its performance as much as possible. In order to do so, we propose a sequence of Neural networks that are gradually trained from more dexterous drivers, as well as, from the simplest to the most skillful controller. Our method is actually, an effective initialization method for Neural Networks that leads to increasingly better driving behavior. We have tested the method in several tracks of increasing difficulty. In all cases the proposed method resulted in improved bot decisions.