基于强化学习轨迹生成与控制的无人机全方位自主攻击栖息

IF 4.8 1区 农林科学 Q1 AGRONOMY
Yu-ting Huang, Chen-Huan Pi, Stone Cheng
{"title":"基于强化学习轨迹生成与控制的无人机全方位自主攻击栖息","authors":"Yu-ting Huang, Chen-Huan Pi, Stone Cheng","doi":"10.1109/SCISISIS55246.2022.10002100","DOIUrl":null,"url":null,"abstract":"Micro aerial vehicles are widely being researched and employed due to their relative low operation costs and high flexibility in various applications. We study the under-actuated quadrotor perching problem, designing a trajectory planner and controller which generates feasible trajectories and drives quadrotors to desired state in state space. This paper proposes a trajectory generating and tracking method for quadrotor perching that takes the advantages of reinforcement learning controller and traditional controller. We demonstrate the performance of the trained reinforcement learning controller generated trajectory information and manipulated quadrotor toward the perching point (manually throwing it up in the air with an initial velocity of 1 m/s). We show that this approach permits the control structure of trajectories and controllers enabling such aggressive maneuvers perching on vertical surfaces with relatively accurate. Computation time of evaluating the policy is only 0.03 sec per trajectory, which is two orders of magnitude less than common trajectory optimization algorithms with an approximated model.","PeriodicalId":21408,"journal":{"name":"Rice","volume":"4 1","pages":"1-6"},"PeriodicalIF":4.8000,"publicationDate":"2022-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Omnidirectional Autonomous Aggressive Perching of Unmanned Aerial Vehicle using Reinforcement Learning Trajectory Generation and Control\",\"authors\":\"Yu-ting Huang, Chen-Huan Pi, Stone Cheng\",\"doi\":\"10.1109/SCISISIS55246.2022.10002100\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Micro aerial vehicles are widely being researched and employed due to their relative low operation costs and high flexibility in various applications. We study the under-actuated quadrotor perching problem, designing a trajectory planner and controller which generates feasible trajectories and drives quadrotors to desired state in state space. This paper proposes a trajectory generating and tracking method for quadrotor perching that takes the advantages of reinforcement learning controller and traditional controller. We demonstrate the performance of the trained reinforcement learning controller generated trajectory information and manipulated quadrotor toward the perching point (manually throwing it up in the air with an initial velocity of 1 m/s). We show that this approach permits the control structure of trajectories and controllers enabling such aggressive maneuvers perching on vertical surfaces with relatively accurate. Computation time of evaluating the policy is only 0.03 sec per trajectory, which is two orders of magnitude less than common trajectory optimization algorithms with an approximated model.\",\"PeriodicalId\":21408,\"journal\":{\"name\":\"Rice\",\"volume\":\"4 1\",\"pages\":\"1-6\"},\"PeriodicalIF\":4.8000,\"publicationDate\":\"2022-11-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Rice\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://doi.org/10.1109/SCISISIS55246.2022.10002100\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRONOMY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Rice","FirstCategoryId":"97","ListUrlMain":"https://doi.org/10.1109/SCISISIS55246.2022.10002100","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRONOMY","Score":null,"Total":0}
引用次数: 0

摘要

微型飞行器以其相对较低的运行成本和较高的灵活性在各种应用中得到了广泛的研究和应用。研究欠驱动四旋翼悬停问题,设计轨迹规划器和控制器,生成可行轨迹,并在状态空间中驱动四旋翼飞行器到达期望状态。结合强化学习控制器和传统控制器的优点,提出了一种四旋翼飞行器悬停轨迹生成与跟踪方法。我们演示了训练后的强化学习控制器生成轨迹信息的性能,并操纵四旋翼飞行器朝向栖息点(手动将其以1米/秒的初始速度抛向空中)。我们表明,这种方法允许轨迹和控制器的控制结构,使这种攻击性机动栖息在垂直表面相对准确。该策略每条轨迹的计算时间仅为0.03秒,比采用近似模型的一般轨迹优化算法缩短了两个数量级。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Omnidirectional Autonomous Aggressive Perching of Unmanned Aerial Vehicle using Reinforcement Learning Trajectory Generation and Control
Micro aerial vehicles are widely being researched and employed due to their relative low operation costs and high flexibility in various applications. We study the under-actuated quadrotor perching problem, designing a trajectory planner and controller which generates feasible trajectories and drives quadrotors to desired state in state space. This paper proposes a trajectory generating and tracking method for quadrotor perching that takes the advantages of reinforcement learning controller and traditional controller. We demonstrate the performance of the trained reinforcement learning controller generated trajectory information and manipulated quadrotor toward the perching point (manually throwing it up in the air with an initial velocity of 1 m/s). We show that this approach permits the control structure of trajectories and controllers enabling such aggressive maneuvers perching on vertical surfaces with relatively accurate. Computation time of evaluating the policy is only 0.03 sec per trajectory, which is two orders of magnitude less than common trajectory optimization algorithms with an approximated model.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Rice
Rice AGRONOMY-
CiteScore
10.10
自引率
3.60%
发文量
60
审稿时长
>12 weeks
期刊介绍: Rice aims to fill a glaring void in basic and applied plant science journal publishing. This journal is the world''s only high-quality serial publication for reporting current advances in rice genetics, structural and functional genomics, comparative genomics, molecular biology and physiology, molecular breeding and comparative biology. Rice welcomes review articles and original papers in all of the aforementioned areas and serves as the primary source of newly published information for researchers and students in rice and related research.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信