Self-Parking Car Simulation using Reinforcement Learning Approach for Moderate Complexity Parking Scenario

Baramee Thunyapoo, Chatree Ratchadakorntham, Punnarai Siricharoen, Wittawin Susutti
{"title":"Self-Parking Car Simulation using Reinforcement Learning Approach for Moderate Complexity Parking Scenario","authors":"Baramee Thunyapoo, Chatree Ratchadakorntham, Punnarai Siricharoen, Wittawin Susutti","doi":"10.1109/ecti-con49241.2020.9158298","DOIUrl":null,"url":null,"abstract":"Autonomous parking system is essential in reducing time for waiting to park in the parking spaces or looking for space, particularly in the smart city. We propose the auto-parking car simulation framework using proximal policy optimization (PPO) for deep reinforcement learning in a moderately complex parking scenario which comprises basic and challenging zones for parking. Different configurations are explored including sparse and dense rewards combining with checkpoints, orientation reward and stay-in-collision punishment. It shows high success parking rate in a basic parking zone up to at more than 95%. For the more difficult parking zone, the model works better when each zone is trained separately.","PeriodicalId":371552,"journal":{"name":"2020 17th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 17th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ecti-con49241.2020.9158298","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

Abstract

Autonomous parking system is essential in reducing time for waiting to park in the parking spaces or looking for space, particularly in the smart city. We propose the auto-parking car simulation framework using proximal policy optimization (PPO) for deep reinforcement learning in a moderately complex parking scenario which comprises basic and challenging zones for parking. Different configurations are explored including sparse and dense rewards combining with checkpoints, orientation reward and stay-in-collision punishment. It shows high success parking rate in a basic parking zone up to at more than 95%. For the more difficult parking zone, the model works better when each zone is trained separately.
基于强化学习方法的中等复杂停车场景自动停车仿真
在智能城市中,自动停车系统对于减少等待停车或寻找停车位的时间至关重要。在中等复杂的停车场景中,我们提出了使用近端策略优化(PPO)进行深度强化学习的自动泊车仿真框架,其中包括基本停车区域和具有挑战性的停车区域。探索了不同的配置,包括稀疏和密集奖励结合检查点,方向奖励和保持碰撞惩罚。在基本停车区内,停车成功率高达95%以上。对于更困难的停车区域,当每个区域单独训练时,模型效果更好。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信