Pygame中基于深度强化学习的自动驾驶训练模型重用

Youtian Guo, Qi Gao, Feng Pan
{"title":"Pygame中基于深度强化学习的自动驾驶训练模型重用","authors":"Youtian Guo, Qi Gao, Feng Pan","doi":"10.23919/CCC50068.2020.9188547","DOIUrl":null,"url":null,"abstract":"Autonomous-Driving technology has begun to bring great convenience to daily trip, transportation, and surveying harsh environment. Considering that deep reinforcement learning has requirements for the convergence performance of the training results, and the actual training results sometimes cannot converge steadily or fail to reach the training goals, in this paper, the trained model reuse method was proposed, which can use the trained model generates Q(St, At) and can be used as a part of Deep Reinforcement Learning model, and this model was built based on the value function that could predict the Q value corresponding to the various actions performed in the environment state. In the Pygame platform, a simplified traffic simulation environment was set, it is observed that the Autonomous-Driving vehicle could run smoothly without collision in a fixed-length test simulation environment, and this trained model reuse method could help autonomous vehicle accelerate the learning process, obtain better simulation results during most of the training process, save simulation time and computing resources.","PeriodicalId":255872,"journal":{"name":"2020 39th Chinese Control Conference (CCC)","volume":"94 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"Trained Model Reuse of Autonomous-Driving in Pygame with Deep Reinforcement Learning\",\"authors\":\"Youtian Guo, Qi Gao, Feng Pan\",\"doi\":\"10.23919/CCC50068.2020.9188547\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Autonomous-Driving technology has begun to bring great convenience to daily trip, transportation, and surveying harsh environment. Considering that deep reinforcement learning has requirements for the convergence performance of the training results, and the actual training results sometimes cannot converge steadily or fail to reach the training goals, in this paper, the trained model reuse method was proposed, which can use the trained model generates Q(St, At) and can be used as a part of Deep Reinforcement Learning model, and this model was built based on the value function that could predict the Q value corresponding to the various actions performed in the environment state. In the Pygame platform, a simplified traffic simulation environment was set, it is observed that the Autonomous-Driving vehicle could run smoothly without collision in a fixed-length test simulation environment, and this trained model reuse method could help autonomous vehicle accelerate the learning process, obtain better simulation results during most of the training process, save simulation time and computing resources.\",\"PeriodicalId\":255872,\"journal\":{\"name\":\"2020 39th Chinese Control Conference (CCC)\",\"volume\":\"94 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 39th Chinese Control Conference (CCC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.23919/CCC50068.2020.9188547\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 39th Chinese Control Conference (CCC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23919/CCC50068.2020.9188547","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

摘要

自动驾驶技术已经开始为日常出行、交通和勘察恶劣环境带来极大的便利。考虑到深度强化学习对训练结果的收敛性能有要求,而实际训练结果有时不能稳定收敛或达不到训练目标,本文提出了训练模型重用方法,该方法可以利用训练模型生成Q(St, At),并可作为深度强化学习模型的一部分;该模型是基于能够预测环境状态下各种动作对应的Q值的值函数建立的。在Pygame平台上,设置了简化的交通仿真环境,观察到自动驾驶车辆在固定长度的测试仿真环境中可以平稳无碰撞地运行,这种训练好的模型重用方法可以帮助自动驾驶车辆加速学习过程,在大部分训练过程中获得较好的仿真结果,节省仿真时间和计算资源。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Trained Model Reuse of Autonomous-Driving in Pygame with Deep Reinforcement Learning
Autonomous-Driving technology has begun to bring great convenience to daily trip, transportation, and surveying harsh environment. Considering that deep reinforcement learning has requirements for the convergence performance of the training results, and the actual training results sometimes cannot converge steadily or fail to reach the training goals, in this paper, the trained model reuse method was proposed, which can use the trained model generates Q(St, At) and can be used as a part of Deep Reinforcement Learning model, and this model was built based on the value function that could predict the Q value corresponding to the various actions performed in the environment state. In the Pygame platform, a simplified traffic simulation environment was set, it is observed that the Autonomous-Driving vehicle could run smoothly without collision in a fixed-length test simulation environment, and this trained model reuse method could help autonomous vehicle accelerate the learning process, obtain better simulation results during most of the training process, save simulation time and computing resources.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信