{"title":"应用深度强化学习的最新进展、挑战和未来展望:路径规划中的实用视角","authors":"Ye Zhang , Wang Zhao , Jingyu Wang , Yuan Yuan","doi":"10.1016/j.neucom.2024.128423","DOIUrl":null,"url":null,"abstract":"<div><p>Path planning is one of the most crucial elements in the field of robotics, such as autonomous driving, minimally invasive surgery and logistics distribution. This review begins by summarizing the limitations of conventional path planning methods and recent work on DRL-based path planning methods. Subsequently, the paper systematically reviews the construction of key elements of DRL methods in recent work, with the aim of assisting readers in comprehending the foundation of DRL research, along with the underlying logic and considerations from a practical perspective. Facing issues of sparse rewards and the exploration–exploitation balance during the practical training process, the paper reviews enhancement methods for training efficiency and optimization results in DRL path planning. In the end, the paper summarizes the current research limitations and challenges in practical path planning applications, followed by future research directions.</p></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"608 ","pages":"Article 128423"},"PeriodicalIF":5.5000,"publicationDate":"2024-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Recent progress, challenges and future prospects of applied deep reinforcement learning : A practical perspective in path planning\",\"authors\":\"Ye Zhang , Wang Zhao , Jingyu Wang , Yuan Yuan\",\"doi\":\"10.1016/j.neucom.2024.128423\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Path planning is one of the most crucial elements in the field of robotics, such as autonomous driving, minimally invasive surgery and logistics distribution. This review begins by summarizing the limitations of conventional path planning methods and recent work on DRL-based path planning methods. Subsequently, the paper systematically reviews the construction of key elements of DRL methods in recent work, with the aim of assisting readers in comprehending the foundation of DRL research, along with the underlying logic and considerations from a practical perspective. Facing issues of sparse rewards and the exploration–exploitation balance during the practical training process, the paper reviews enhancement methods for training efficiency and optimization results in DRL path planning. In the end, the paper summarizes the current research limitations and challenges in practical path planning applications, followed by future research directions.</p></div>\",\"PeriodicalId\":19268,\"journal\":{\"name\":\"Neurocomputing\",\"volume\":\"608 \",\"pages\":\"Article 128423\"},\"PeriodicalIF\":5.5000,\"publicationDate\":\"2024-08-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neurocomputing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0925231224011949\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231224011949","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Recent progress, challenges and future prospects of applied deep reinforcement learning : A practical perspective in path planning
Path planning is one of the most crucial elements in the field of robotics, such as autonomous driving, minimally invasive surgery and logistics distribution. This review begins by summarizing the limitations of conventional path planning methods and recent work on DRL-based path planning methods. Subsequently, the paper systematically reviews the construction of key elements of DRL methods in recent work, with the aim of assisting readers in comprehending the foundation of DRL research, along with the underlying logic and considerations from a practical perspective. Facing issues of sparse rewards and the exploration–exploitation balance during the practical training process, the paper reviews enhancement methods for training efficiency and optimization results in DRL path planning. In the end, the paper summarizes the current research limitations and challenges in practical path planning applications, followed by future research directions.
期刊介绍:
Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.