{"title":"基于深度强化学习的NOMA资源分配","authors":"N. Iswarya, R. Venkateswari","doi":"10.1109/ICIIET55458.2022.9967604","DOIUrl":null,"url":null,"abstract":"NOMA is a novel channel accessing strategy that delivers high throughput and fairness among various users by multiplexing many users across the same frequency resource. In order to guarantee the user's fairness, minimum data rate maximization, also referred to as the max-min approach is adopted. Apparently, transmission power optimization is employed to accomplish the max-min. However, the scalability of the number of users leads the optimization to a non-convex optimization problem. Consequently, the Dueling Double Deep Q Learning(Dueling DDQL) technique, a subclass of Reinforcement Learning is proposed to solve such problem. The Deep Q-Network is used by the DDQL approach in learning the actions that are best to do to maximize user power coefficients. The Markov Decision Process (MDP) model is essential to the DDQL method's effectiveness since it trains the DQN on choosing better actions. The dueling DDQL converges to the target value for 92% of the test cases. The proposed method is compared with the benchmark algorithms and it is illustrated that the proposed algorithm outperforms those comparative algorithms.","PeriodicalId":341904,"journal":{"name":"2022 International Conference on Intelligent Innovations in Engineering and Technology (ICIIET)","volume":"137 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Deep Reinforcement Learning based Resource Allocation in NOMA\",\"authors\":\"N. Iswarya, R. Venkateswari\",\"doi\":\"10.1109/ICIIET55458.2022.9967604\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"NOMA is a novel channel accessing strategy that delivers high throughput and fairness among various users by multiplexing many users across the same frequency resource. In order to guarantee the user's fairness, minimum data rate maximization, also referred to as the max-min approach is adopted. Apparently, transmission power optimization is employed to accomplish the max-min. However, the scalability of the number of users leads the optimization to a non-convex optimization problem. Consequently, the Dueling Double Deep Q Learning(Dueling DDQL) technique, a subclass of Reinforcement Learning is proposed to solve such problem. The Deep Q-Network is used by the DDQL approach in learning the actions that are best to do to maximize user power coefficients. The Markov Decision Process (MDP) model is essential to the DDQL method's effectiveness since it trains the DQN on choosing better actions. The dueling DDQL converges to the target value for 92% of the test cases. The proposed method is compared with the benchmark algorithms and it is illustrated that the proposed algorithm outperforms those comparative algorithms.\",\"PeriodicalId\":341904,\"journal\":{\"name\":\"2022 International Conference on Intelligent Innovations in Engineering and Technology (ICIIET)\",\"volume\":\"137 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-09-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 International Conference on Intelligent Innovations in Engineering and Technology (ICIIET)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICIIET55458.2022.9967604\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Conference on Intelligent Innovations in Engineering and Technology (ICIIET)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICIIET55458.2022.9967604","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
摘要
NOMA是一种新颖的信道访问策略,通过在同一频率资源上复用许多用户,在不同用户之间提供高吞吐量和公平性。为了保证用户的公平性,采用最小数据速率最大化,也称为max-min方法。显然,传输功率优化是为了实现最大最小。然而,用户数量的可扩展性导致优化成为一个非凸优化问题。为此,提出了强化学习的一个子类Dueling Double Deep Q Learning(Dueling DDQL)技术来解决这一问题。DDQL方法使用Deep Q-Network来学习最大化用户权力系数的最佳操作。马尔可夫决策过程(MDP)模型对DDQL方法的有效性至关重要,因为它训练DQN选择更好的行为。决斗的DDQL收敛到92%的测试用例的目标值。将该方法与基准算法进行了比较,结果表明该方法优于基准算法。
Deep Reinforcement Learning based Resource Allocation in NOMA
NOMA is a novel channel accessing strategy that delivers high throughput and fairness among various users by multiplexing many users across the same frequency resource. In order to guarantee the user's fairness, minimum data rate maximization, also referred to as the max-min approach is adopted. Apparently, transmission power optimization is employed to accomplish the max-min. However, the scalability of the number of users leads the optimization to a non-convex optimization problem. Consequently, the Dueling Double Deep Q Learning(Dueling DDQL) technique, a subclass of Reinforcement Learning is proposed to solve such problem. The Deep Q-Network is used by the DDQL approach in learning the actions that are best to do to maximize user power coefficients. The Markov Decision Process (MDP) model is essential to the DDQL method's effectiveness since it trains the DQN on choosing better actions. The dueling DDQL converges to the target value for 92% of the test cases. The proposed method is compared with the benchmark algorithms and it is illustrated that the proposed algorithm outperforms those comparative algorithms.