{"title":"A reinforcement learning-based reverse-parking system for autonomous vehicles","authors":"Amjed Al-Mousa, Ahmad Arrabi, Hamza Daoud","doi":"10.1049/itr2.12614","DOIUrl":null,"url":null,"abstract":"<p>This work presents the design and implementation of a reinforcement learning-based autonomous parking system where an agent is trained to reverse-park in a selected parking spot. The parking procedure is divided into three stages, and each stage has its corresponding surrogate objective that contributes to the overall parking process. The model solely depends on features extracted from a top-view image of the parking space. It has the advantage of potential deployment in smart parking buildings without refitting non-autonomous cars with modern sensors. The training was conducted offline on a simulation utilizing the proximal policy optimization algorithm. The model was then transferred and tested on a hardware prototype of the parking space. The results of the system were successful as the successful parking rate reached 100% with no collisions with any objects, and the fastest parking time reached 10 s. The testing was conducted on multiple samples and scenarios of the parking setup.</p>","PeriodicalId":50381,"journal":{"name":"IET Intelligent Transport Systems","volume":"19 1","pages":""},"PeriodicalIF":2.3000,"publicationDate":"2025-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/itr2.12614","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Intelligent Transport Systems","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/itr2.12614","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
This work presents the design and implementation of a reinforcement learning-based autonomous parking system where an agent is trained to reverse-park in a selected parking spot. The parking procedure is divided into three stages, and each stage has its corresponding surrogate objective that contributes to the overall parking process. The model solely depends on features extracted from a top-view image of the parking space. It has the advantage of potential deployment in smart parking buildings without refitting non-autonomous cars with modern sensors. The training was conducted offline on a simulation utilizing the proximal policy optimization algorithm. The model was then transferred and tested on a hardware prototype of the parking space. The results of the system were successful as the successful parking rate reached 100% with no collisions with any objects, and the fastest parking time reached 10 s. The testing was conducted on multiple samples and scenarios of the parking setup.
期刊介绍:
IET Intelligent Transport Systems is an interdisciplinary journal devoted to research into the practical applications of ITS and infrastructures. The scope of the journal includes the following:
Sustainable traffic solutions
Deployments with enabling technologies
Pervasive monitoring
Applications; demonstrations and evaluation
Economic and behavioural analyses of ITS services and scenario
Data Integration and analytics
Information collection and processing; image processing applications in ITS
ITS aspects of electric vehicles
Autonomous vehicles; connected vehicle systems;
In-vehicle ITS, safety and vulnerable road user aspects
Mobility as a service systems
Traffic management and control
Public transport systems technologies
Fleet and public transport logistics
Emergency and incident management
Demand management and electronic payment systems
Traffic related air pollution management
Policy and institutional issues
Interoperability, standards and architectures
Funding scenarios
Enforcement
Human machine interaction
Education, training and outreach
Current Special Issue Call for papers:
Intelligent Transportation Systems in Smart Cities for Sustainable Environment - https://digital-library.theiet.org/files/IET_ITS_CFP_ITSSCSE.pdf
Sustainably Intelligent Mobility (SIM) - https://digital-library.theiet.org/files/IET_ITS_CFP_SIM.pdf
Traffic Theory and Modelling in the Era of Artificial Intelligence and Big Data (in collaboration with World Congress for Transport Research, WCTR 2019) - https://digital-library.theiet.org/files/IET_ITS_CFP_WCTR.pdf