Jing Yang, Yulu Yang, Han Xu, Jing Hu, Tiecheng Song
{"title":"无线传感器网络中的无人机轨迹设计:一种深度强化学习方法","authors":"Jing Yang, Yulu Yang, Han Xu, Jing Hu, Tiecheng Song","doi":"10.1117/12.2685727","DOIUrl":null,"url":null,"abstract":"Unmanned Aerial Vehicle (UAV)-powered Wireless Sensor Networks (WSNs) are considered to be a promising solution to the problem of the limited power of the Sensor Nodes (SNs). In this paper, we introduce a UAV-powered WSN system, where multi-UAVs undertake the role of remote charging stations. To optimize the overall power efficiency, we design the collaborative trajectories of the UAVs. In order to solve the problem of trajectory planning, we first model the service process as a Markov decision process (MDP), and then propose a Multi-Agent Deep Reinforcement Learning (MADRL) based algorithm named Modified Multi-agent Deep Deterministic Policy Gradient (M2DDPG), which is learned centrally and executed discretely. The simulation has demonstrated the validity, efficacy, and superior performance of the proposed M2DDPG algorithm compared to the baseline algorithm.","PeriodicalId":305812,"journal":{"name":"International Conference on Electronic Information Technology","volume":"48 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Unmanned aerial vehicle trajectory design in wireless sensor networks: a deep reinforcement learning method\",\"authors\":\"Jing Yang, Yulu Yang, Han Xu, Jing Hu, Tiecheng Song\",\"doi\":\"10.1117/12.2685727\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Unmanned Aerial Vehicle (UAV)-powered Wireless Sensor Networks (WSNs) are considered to be a promising solution to the problem of the limited power of the Sensor Nodes (SNs). In this paper, we introduce a UAV-powered WSN system, where multi-UAVs undertake the role of remote charging stations. To optimize the overall power efficiency, we design the collaborative trajectories of the UAVs. In order to solve the problem of trajectory planning, we first model the service process as a Markov decision process (MDP), and then propose a Multi-Agent Deep Reinforcement Learning (MADRL) based algorithm named Modified Multi-agent Deep Deterministic Policy Gradient (M2DDPG), which is learned centrally and executed discretely. The simulation has demonstrated the validity, efficacy, and superior performance of the proposed M2DDPG algorithm compared to the baseline algorithm.\",\"PeriodicalId\":305812,\"journal\":{\"name\":\"International Conference on Electronic Information Technology\",\"volume\":\"48 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-08-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Conference on Electronic Information Technology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2685727\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Electronic Information Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2685727","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Unmanned aerial vehicle trajectory design in wireless sensor networks: a deep reinforcement learning method
Unmanned Aerial Vehicle (UAV)-powered Wireless Sensor Networks (WSNs) are considered to be a promising solution to the problem of the limited power of the Sensor Nodes (SNs). In this paper, we introduce a UAV-powered WSN system, where multi-UAVs undertake the role of remote charging stations. To optimize the overall power efficiency, we design the collaborative trajectories of the UAVs. In order to solve the problem of trajectory planning, we first model the service process as a Markov decision process (MDP), and then propose a Multi-Agent Deep Reinforcement Learning (MADRL) based algorithm named Modified Multi-agent Deep Deterministic Policy Gradient (M2DDPG), which is learned centrally and executed discretely. The simulation has demonstrated the validity, efficacy, and superior performance of the proposed M2DDPG algorithm compared to the baseline algorithm.