Y. Jang, S. M. Raza, Hyunseung Choo, Moonseong Kim
{"title":"基于深度强化学习的无人机切换决策","authors":"Y. Jang, S. M. Raza, Hyunseung Choo, Moonseong Kim","doi":"10.1109/IMCOM53663.2022.9721627","DOIUrl":null,"url":null,"abstract":"Cellular networks provide the necessary connectivity to the Unmanned Aerial Vehicles (UAV), however, these net- works are primarily designed for ground users. The in place handover decision mechanism for ground users is inappropriate for UAV due to frequent fluctuations in signal strength. This paper proposes a Deep Reinforcement Learning (DRL) based UAV Handover Decision (UHD) scheme to determine when it is essential for UAV to execute the handover for maintaining stable connectivity. DRL framework uses Proximal Policy Optimization algorithm to dynamically learn the UHD in an emulated 3D UAV mobility environment to manage the handover decisions. Experimental results show that UHD reduces handovers up to 76% and 73% comparing to conventional and target methods, respectively, while maintaining signal strength for stable and reliable communication.","PeriodicalId":367038,"journal":{"name":"2022 16th International Conference on Ubiquitous Information Management and Communication (IMCOM)","volume":"186 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"UAVs Handover Decision using Deep Reinforcement Learning\",\"authors\":\"Y. Jang, S. M. Raza, Hyunseung Choo, Moonseong Kim\",\"doi\":\"10.1109/IMCOM53663.2022.9721627\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Cellular networks provide the necessary connectivity to the Unmanned Aerial Vehicles (UAV), however, these net- works are primarily designed for ground users. The in place handover decision mechanism for ground users is inappropriate for UAV due to frequent fluctuations in signal strength. This paper proposes a Deep Reinforcement Learning (DRL) based UAV Handover Decision (UHD) scheme to determine when it is essential for UAV to execute the handover for maintaining stable connectivity. DRL framework uses Proximal Policy Optimization algorithm to dynamically learn the UHD in an emulated 3D UAV mobility environment to manage the handover decisions. Experimental results show that UHD reduces handovers up to 76% and 73% comparing to conventional and target methods, respectively, while maintaining signal strength for stable and reliable communication.\",\"PeriodicalId\":367038,\"journal\":{\"name\":\"2022 16th International Conference on Ubiquitous Information Management and Communication (IMCOM)\",\"volume\":\"186 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-01-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 16th International Conference on Ubiquitous Information Management and Communication (IMCOM)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IMCOM53663.2022.9721627\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 16th International Conference on Ubiquitous Information Management and Communication (IMCOM)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IMCOM53663.2022.9721627","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
UAVs Handover Decision using Deep Reinforcement Learning
Cellular networks provide the necessary connectivity to the Unmanned Aerial Vehicles (UAV), however, these net- works are primarily designed for ground users. The in place handover decision mechanism for ground users is inappropriate for UAV due to frequent fluctuations in signal strength. This paper proposes a Deep Reinforcement Learning (DRL) based UAV Handover Decision (UHD) scheme to determine when it is essential for UAV to execute the handover for maintaining stable connectivity. DRL framework uses Proximal Policy Optimization algorithm to dynamically learn the UHD in an emulated 3D UAV mobility environment to manage the handover decisions. Experimental results show that UHD reduces handovers up to 76% and 73% comparing to conventional and target methods, respectively, while maintaining signal strength for stable and reliable communication.