基于深度强化学习的四轴飞行器导航辅助系统

Tung-Cheng Wu, S. Tseng, Chin-Feng Lai, C. Ho, Ying-Hsun Lai
{"title":"基于深度强化学习的四轴飞行器导航辅助系统","authors":"Tung-Cheng Wu, S. Tseng, Chin-Feng Lai, C. Ho, Ying-Hsun Lai","doi":"10.1109/IC3.2018.00013","DOIUrl":null,"url":null,"abstract":"In this paper, we present a deep reinforcement learning method for quadcopter bypassing the obstacle on the flying path. In the past study, algorithm only control the forward direction about quadcopter. In this letter, we use two function to control quadcopter. One is quadcopter navigating function. It is based on calculating coordination point and find the straight path to goal. The other function is collision avoidance function. It is implemented by deep Q-network model. Both two function will output rotating degree, agent will combine both output and turn direct. Besides, deep Q-network can also make quadcopter fly up and down to bypass the obstacle and arrive at goal. Our experimental result shows that collision rate is 14% after 500 flights. Based on this work, we will train more complex sense and transfer model to real quadcopter.","PeriodicalId":236366,"journal":{"name":"2018 1st International Cognitive Cities Conference (IC3)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"11","resultStr":"{\"title\":\"Navigating Assistance System for Quadcopter with Deep Reinforcement Learning\",\"authors\":\"Tung-Cheng Wu, S. Tseng, Chin-Feng Lai, C. Ho, Ying-Hsun Lai\",\"doi\":\"10.1109/IC3.2018.00013\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper, we present a deep reinforcement learning method for quadcopter bypassing the obstacle on the flying path. In the past study, algorithm only control the forward direction about quadcopter. In this letter, we use two function to control quadcopter. One is quadcopter navigating function. It is based on calculating coordination point and find the straight path to goal. The other function is collision avoidance function. It is implemented by deep Q-network model. Both two function will output rotating degree, agent will combine both output and turn direct. Besides, deep Q-network can also make quadcopter fly up and down to bypass the obstacle and arrive at goal. Our experimental result shows that collision rate is 14% after 500 flights. Based on this work, we will train more complex sense and transfer model to real quadcopter.\",\"PeriodicalId\":236366,\"journal\":{\"name\":\"2018 1st International Cognitive Cities Conference (IC3)\",\"volume\":\"24 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"11\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2018 1st International Cognitive Cities Conference (IC3)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IC3.2018.00013\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 1st International Cognitive Cities Conference (IC3)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IC3.2018.00013","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 11

摘要

本文提出了一种四轴飞行器在飞行路径上绕过障碍物的深度强化学习方法。在以往的研究中,算法只控制四轴飞行器的正向。在这封信中,我们使用两个函数来控制四轴飞行器。一是四轴飞行器导航功能。它是在计算协调点的基础上,寻找到目标的直线路径。另一个功能是避碰功能。采用深度q -网络模型实现。两种功能均输出旋转度,代理将输出和旋转直接结合起来。此外,深度Q-network还可以使四轴飞行器上下飞行,绕过障碍物到达目标。实验结果表明,500次飞行后的碰撞率为14%。在此基础上,我们将训练更复杂的感知并将模型转移到真实的四轴飞行器上。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Navigating Assistance System for Quadcopter with Deep Reinforcement Learning
In this paper, we present a deep reinforcement learning method for quadcopter bypassing the obstacle on the flying path. In the past study, algorithm only control the forward direction about quadcopter. In this letter, we use two function to control quadcopter. One is quadcopter navigating function. It is based on calculating coordination point and find the straight path to goal. The other function is collision avoidance function. It is implemented by deep Q-network model. Both two function will output rotating degree, agent will combine both output and turn direct. Besides, deep Q-network can also make quadcopter fly up and down to bypass the obstacle and arrive at goal. Our experimental result shows that collision rate is 14% after 500 flights. Based on this work, we will train more complex sense and transfer model to real quadcopter.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信