{"title":"无人机着陆与强化学习:技术现状、挑战和机遇","authors":"José Amendola;Linga Reddy Cenkeramaddi;Ajit Jha","doi":"10.1109/OJITS.2024.3444487","DOIUrl":null,"url":null,"abstract":"Unmanned aerial vehicles, and special multirotor drones, have shown great relevance in a plethora of missions that require high affordance, field of view, and precision. Their limited payload capacity and autonomy make its landing a crucial task. Despite many attempts in the literature to address drone landing, challenges and open gaps still exist. Reinforcement Learning has gained notoriety in a variety of control problems, with recent proposals for drone landing applications. This work aims to present a systematic literature review on works employing Deep Reinforcement Learning for multirotor drone landing in both static and dynamic platforms. It also revisits Reinforcement Learning Algorithms, the main frameworks and simulators adopted for specific landing operations. The comprehensive analysis performed on reviewed works revealed that there are important untackled challenges when it comes to wind disturbances, unpredictability of moving landing targets, sensor latency, and sim-to-real gap. Finally, we present our critical analysis of how recent state-of-the-art deep learning concepts can be combined with reinforcement learning to leverage the latter in addressing the open gaps in future works.","PeriodicalId":100631,"journal":{"name":"IEEE Open Journal of Intelligent Transportation Systems","volume":"5 ","pages":"520-539"},"PeriodicalIF":4.6000,"publicationDate":"2024-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10637701","citationCount":"0","resultStr":"{\"title\":\"Drone Landing and Reinforcement Learning: State-of-Art, Challenges and Opportunities\",\"authors\":\"José Amendola;Linga Reddy Cenkeramaddi;Ajit Jha\",\"doi\":\"10.1109/OJITS.2024.3444487\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Unmanned aerial vehicles, and special multirotor drones, have shown great relevance in a plethora of missions that require high affordance, field of view, and precision. Their limited payload capacity and autonomy make its landing a crucial task. Despite many attempts in the literature to address drone landing, challenges and open gaps still exist. Reinforcement Learning has gained notoriety in a variety of control problems, with recent proposals for drone landing applications. This work aims to present a systematic literature review on works employing Deep Reinforcement Learning for multirotor drone landing in both static and dynamic platforms. It also revisits Reinforcement Learning Algorithms, the main frameworks and simulators adopted for specific landing operations. The comprehensive analysis performed on reviewed works revealed that there are important untackled challenges when it comes to wind disturbances, unpredictability of moving landing targets, sensor latency, and sim-to-real gap. Finally, we present our critical analysis of how recent state-of-the-art deep learning concepts can be combined with reinforcement learning to leverage the latter in addressing the open gaps in future works.\",\"PeriodicalId\":100631,\"journal\":{\"name\":\"IEEE Open Journal of Intelligent Transportation Systems\",\"volume\":\"5 \",\"pages\":\"520-539\"},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2024-08-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10637701\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Open Journal of Intelligent Transportation Systems\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10637701/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Open Journal of Intelligent Transportation Systems","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10637701/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Drone Landing and Reinforcement Learning: State-of-Art, Challenges and Opportunities
Unmanned aerial vehicles, and special multirotor drones, have shown great relevance in a plethora of missions that require high affordance, field of view, and precision. Their limited payload capacity and autonomy make its landing a crucial task. Despite many attempts in the literature to address drone landing, challenges and open gaps still exist. Reinforcement Learning has gained notoriety in a variety of control problems, with recent proposals for drone landing applications. This work aims to present a systematic literature review on works employing Deep Reinforcement Learning for multirotor drone landing in both static and dynamic platforms. It also revisits Reinforcement Learning Algorithms, the main frameworks and simulators adopted for specific landing operations. The comprehensive analysis performed on reviewed works revealed that there are important untackled challenges when it comes to wind disturbances, unpredictability of moving landing targets, sensor latency, and sim-to-real gap. Finally, we present our critical analysis of how recent state-of-the-art deep learning concepts can be combined with reinforcement learning to leverage the latter in addressing the open gaps in future works.