{"title":"基于强化学习方法的中等复杂停车场景自动停车仿真","authors":"Baramee Thunyapoo, Chatree Ratchadakorntham, Punnarai Siricharoen, Wittawin Susutti","doi":"10.1109/ecti-con49241.2020.9158298","DOIUrl":null,"url":null,"abstract":"Autonomous parking system is essential in reducing time for waiting to park in the parking spaces or looking for space, particularly in the smart city. We propose the auto-parking car simulation framework using proximal policy optimization (PPO) for deep reinforcement learning in a moderately complex parking scenario which comprises basic and challenging zones for parking. Different configurations are explored including sparse and dense rewards combining with checkpoints, orientation reward and stay-in-collision punishment. It shows high success parking rate in a basic parking zone up to at more than 95%. For the more difficult parking zone, the model works better when each zone is trained separately.","PeriodicalId":371552,"journal":{"name":"2020 17th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"Self-Parking Car Simulation using Reinforcement Learning Approach for Moderate Complexity Parking Scenario\",\"authors\":\"Baramee Thunyapoo, Chatree Ratchadakorntham, Punnarai Siricharoen, Wittawin Susutti\",\"doi\":\"10.1109/ecti-con49241.2020.9158298\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Autonomous parking system is essential in reducing time for waiting to park in the parking spaces or looking for space, particularly in the smart city. We propose the auto-parking car simulation framework using proximal policy optimization (PPO) for deep reinforcement learning in a moderately complex parking scenario which comprises basic and challenging zones for parking. Different configurations are explored including sparse and dense rewards combining with checkpoints, orientation reward and stay-in-collision punishment. It shows high success parking rate in a basic parking zone up to at more than 95%. For the more difficult parking zone, the model works better when each zone is trained separately.\",\"PeriodicalId\":371552,\"journal\":{\"name\":\"2020 17th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON)\",\"volume\":\"42 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 17th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ecti-con49241.2020.9158298\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 17th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ecti-con49241.2020.9158298","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Self-Parking Car Simulation using Reinforcement Learning Approach for Moderate Complexity Parking Scenario
Autonomous parking system is essential in reducing time for waiting to park in the parking spaces or looking for space, particularly in the smart city. We propose the auto-parking car simulation framework using proximal policy optimization (PPO) for deep reinforcement learning in a moderately complex parking scenario which comprises basic and challenging zones for parking. Different configurations are explored including sparse and dense rewards combining with checkpoints, orientation reward and stay-in-collision punishment. It shows high success parking rate in a basic parking zone up to at more than 95%. For the more difficult parking zone, the model works better when each zone is trained separately.