基于强化学习的自动驾驶车辆倒车系统

IF 2.3 4区 工程技术 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Amjed Al-Mousa, Ahmad Arrabi, Hamza Daoud
{"title":"基于强化学习的自动驾驶车辆倒车系统","authors":"Amjed Al-Mousa,&nbsp;Ahmad Arrabi,&nbsp;Hamza Daoud","doi":"10.1049/itr2.12614","DOIUrl":null,"url":null,"abstract":"<p>This work presents the design and implementation of a reinforcement learning-based autonomous parking system where an agent is trained to reverse-park in a selected parking spot. The parking procedure is divided into three stages, and each stage has its corresponding surrogate objective that contributes to the overall parking process. The model solely depends on features extracted from a top-view image of the parking space. It has the advantage of potential deployment in smart parking buildings without refitting non-autonomous cars with modern sensors. The training was conducted offline on a simulation utilizing the proximal policy optimization algorithm. The model was then transferred and tested on a hardware prototype of the parking space. The results of the system were successful as the successful parking rate reached 100% with no collisions with any objects, and the fastest parking time reached 10 s. The testing was conducted on multiple samples and scenarios of the parking setup.</p>","PeriodicalId":50381,"journal":{"name":"IET Intelligent Transport Systems","volume":"19 1","pages":""},"PeriodicalIF":2.3000,"publicationDate":"2025-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/itr2.12614","citationCount":"0","resultStr":"{\"title\":\"A reinforcement learning-based reverse-parking system for autonomous vehicles\",\"authors\":\"Amjed Al-Mousa,&nbsp;Ahmad Arrabi,&nbsp;Hamza Daoud\",\"doi\":\"10.1049/itr2.12614\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>This work presents the design and implementation of a reinforcement learning-based autonomous parking system where an agent is trained to reverse-park in a selected parking spot. The parking procedure is divided into three stages, and each stage has its corresponding surrogate objective that contributes to the overall parking process. The model solely depends on features extracted from a top-view image of the parking space. It has the advantage of potential deployment in smart parking buildings without refitting non-autonomous cars with modern sensors. The training was conducted offline on a simulation utilizing the proximal policy optimization algorithm. The model was then transferred and tested on a hardware prototype of the parking space. The results of the system were successful as the successful parking rate reached 100% with no collisions with any objects, and the fastest parking time reached 10 s. The testing was conducted on multiple samples and scenarios of the parking setup.</p>\",\"PeriodicalId\":50381,\"journal\":{\"name\":\"IET Intelligent Transport Systems\",\"volume\":\"19 1\",\"pages\":\"\"},\"PeriodicalIF\":2.3000,\"publicationDate\":\"2025-01-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1049/itr2.12614\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IET Intelligent Transport Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1049/itr2.12614\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Intelligent Transport Systems","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/itr2.12614","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

这项工作提出了一个基于强化学习的自主停车系统的设计和实现,其中一个代理被训练在选定的停车位上反向停车。停车过程分为三个阶段,每个阶段都有相应的替代目标,这些目标有助于整个停车过程。该模型完全依赖于从停车位的俯视图图像中提取的特征。它的优点是可以在智能停车场中部署,而无需为非自动驾驶汽车改装现代传感器。利用最近邻策略优化算法在模拟上进行离线训练。然后,该模型被转移并在停车位的硬件原型上进行测试。该系统的结果是成功的,停车成功率达到100%,没有碰撞任何物体,最快停车时间达到10 s。测试是在停车设置的多个样本和场景中进行的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

A reinforcement learning-based reverse-parking system for autonomous vehicles

A reinforcement learning-based reverse-parking system for autonomous vehicles

This work presents the design and implementation of a reinforcement learning-based autonomous parking system where an agent is trained to reverse-park in a selected parking spot. The parking procedure is divided into three stages, and each stage has its corresponding surrogate objective that contributes to the overall parking process. The model solely depends on features extracted from a top-view image of the parking space. It has the advantage of potential deployment in smart parking buildings without refitting non-autonomous cars with modern sensors. The training was conducted offline on a simulation utilizing the proximal policy optimization algorithm. The model was then transferred and tested on a hardware prototype of the parking space. The results of the system were successful as the successful parking rate reached 100% with no collisions with any objects, and the fastest parking time reached 10 s. The testing was conducted on multiple samples and scenarios of the parking setup.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IET Intelligent Transport Systems
IET Intelligent Transport Systems 工程技术-运输科技
CiteScore
6.50
自引率
7.40%
发文量
159
审稿时长
3 months
期刊介绍: IET Intelligent Transport Systems is an interdisciplinary journal devoted to research into the practical applications of ITS and infrastructures. The scope of the journal includes the following: Sustainable traffic solutions Deployments with enabling technologies Pervasive monitoring Applications; demonstrations and evaluation Economic and behavioural analyses of ITS services and scenario Data Integration and analytics Information collection and processing; image processing applications in ITS ITS aspects of electric vehicles Autonomous vehicles; connected vehicle systems; In-vehicle ITS, safety and vulnerable road user aspects Mobility as a service systems Traffic management and control Public transport systems technologies Fleet and public transport logistics Emergency and incident management Demand management and electronic payment systems Traffic related air pollution management Policy and institutional issues Interoperability, standards and architectures Funding scenarios Enforcement Human machine interaction Education, training and outreach Current Special Issue Call for papers: Intelligent Transportation Systems in Smart Cities for Sustainable Environment - https://digital-library.theiet.org/files/IET_ITS_CFP_ITSSCSE.pdf Sustainably Intelligent Mobility (SIM) - https://digital-library.theiet.org/files/IET_ITS_CFP_SIM.pdf Traffic Theory and Modelling in the Era of Artificial Intelligence and Big Data (in collaboration with World Congress for Transport Research, WCTR 2019) - https://digital-library.theiet.org/files/IET_ITS_CFP_WCTR.pdf
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信