从多传感器数据融合的角度看基于深度强化学习的无人飞行器运动控制

IF 0.9 4区 工程技术 Q4 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE
Hongbo Wei, Xuerong Cui, Yucheng Zhang, Haihua Chen, Jingyao Zhang
{"title":"从多传感器数据融合的角度看基于深度强化学习的无人飞行器运动控制","authors":"Hongbo Wei, Xuerong Cui, Yucheng Zhang, Haihua Chen, Jingyao Zhang","doi":"10.1142/s0218126624501858","DOIUrl":null,"url":null,"abstract":"<p>In this paper, the vehicle position points obtained by multi-sensor fusion are taken as the observed values, and Kalman filter is combined with the vehicle kinematics equation to further improve the vehicle trajectory. To realize this, mathematical principles of deep reinforcement learning are analyzed, and the theoretical basis of reinforcement learning is also analyzed. It is proved that the controller based on dynamic model is better than the controller based on kinematics in deviation control, and the performance of the controller based on deep reinforcement learning is also verified. The simulation data show that the proportion integration differentiation (PID) controller has a better tracking effect, but it does not have the constraint ability, which leads to radical acceleration change, resulting in unstable acceleration and deceleration control. Therefore, the deep reinforcement learning controller is selected as the longitudinal velocity tracking controller. The effectiveness of lateral and longitudinal motion decoupling strategy is verified by simulation experiments.</p>","PeriodicalId":54866,"journal":{"name":"Journal of Circuits Systems and Computers","volume":"49 1","pages":""},"PeriodicalIF":0.9000,"publicationDate":"2024-01-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Reinforcement Learning-Based Motion Control for Unmanned Vehicles from the Perspective of Multi-Sensor Data Fusion\",\"authors\":\"Hongbo Wei, Xuerong Cui, Yucheng Zhang, Haihua Chen, Jingyao Zhang\",\"doi\":\"10.1142/s0218126624501858\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>In this paper, the vehicle position points obtained by multi-sensor fusion are taken as the observed values, and Kalman filter is combined with the vehicle kinematics equation to further improve the vehicle trajectory. To realize this, mathematical principles of deep reinforcement learning are analyzed, and the theoretical basis of reinforcement learning is also analyzed. It is proved that the controller based on dynamic model is better than the controller based on kinematics in deviation control, and the performance of the controller based on deep reinforcement learning is also verified. The simulation data show that the proportion integration differentiation (PID) controller has a better tracking effect, but it does not have the constraint ability, which leads to radical acceleration change, resulting in unstable acceleration and deceleration control. Therefore, the deep reinforcement learning controller is selected as the longitudinal velocity tracking controller. The effectiveness of lateral and longitudinal motion decoupling strategy is verified by simulation experiments.</p>\",\"PeriodicalId\":54866,\"journal\":{\"name\":\"Journal of Circuits Systems and Computers\",\"volume\":\"49 1\",\"pages\":\"\"},\"PeriodicalIF\":0.9000,\"publicationDate\":\"2024-01-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Circuits Systems and Computers\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1142/s0218126624501858\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Circuits Systems and Computers","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1142/s0218126624501858","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0

摘要

本文将多传感器融合获得的车辆位置点作为观测值,并将卡尔曼滤波与车辆运动学方程相结合,进一步改进车辆轨迹。为此,本文分析了深度强化学习的数学原理,并分析了强化学习的理论基础。实验证明,基于动态模型的控制器在偏差控制方面优于基于运动学的控制器,同时也验证了基于深度强化学习的控制器的性能。仿真数据表明,比例积分微分(PID)控制器具有较好的跟踪效果,但它不具备约束能力,导致加速度变化剧烈,造成加减速控制不稳定。因此,选择深度强化学习控制器作为纵向速度跟踪控制器。通过仿真实验验证了横向和纵向运动解耦策略的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Deep Reinforcement Learning-Based Motion Control for Unmanned Vehicles from the Perspective of Multi-Sensor Data Fusion

In this paper, the vehicle position points obtained by multi-sensor fusion are taken as the observed values, and Kalman filter is combined with the vehicle kinematics equation to further improve the vehicle trajectory. To realize this, mathematical principles of deep reinforcement learning are analyzed, and the theoretical basis of reinforcement learning is also analyzed. It is proved that the controller based on dynamic model is better than the controller based on kinematics in deviation control, and the performance of the controller based on deep reinforcement learning is also verified. The simulation data show that the proportion integration differentiation (PID) controller has a better tracking effect, but it does not have the constraint ability, which leads to radical acceleration change, resulting in unstable acceleration and deceleration control. Therefore, the deep reinforcement learning controller is selected as the longitudinal velocity tracking controller. The effectiveness of lateral and longitudinal motion decoupling strategy is verified by simulation experiments.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Circuits Systems and Computers
Journal of Circuits Systems and Computers 工程技术-工程:电子与电气
CiteScore
2.80
自引率
26.70%
发文量
350
审稿时长
5.4 months
期刊介绍: Journal of Circuits, Systems, and Computers covers a wide scope, ranging from mathematical foundations to practical engineering design in the general areas of circuits, systems, and computers with focus on their circuit aspects. Although primary emphasis will be on research papers, survey, expository and tutorial papers are also welcome. The journal consists of two sections: Papers - Contributions in this section may be of a research or tutorial nature. Research papers must be original and must not duplicate descriptions or derivations available elsewhere. The author should limit paper length whenever this can be done without impairing quality. Letters - This section provides a vehicle for speedy publication of new results and information of current interest in circuits, systems, and computers. Focus will be directed to practical design- and applications-oriented contributions, but publication in this section will not be restricted to this material. These letters are to concentrate on reporting the results obtained, their significance and the conclusions, while including only the minimum of supporting details required to understand the contribution. Publication of a manuscript in this manner does not preclude a later publication with a fully developed version.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信