A Multi-Agent DRL-Based Power Allocation Mechanism for Multi-Cell NOMA Networks

MohammadAmin Lotfolahi, H. Ferng
{"title":"A Multi-Agent DRL-Based Power Allocation Mechanism for Multi-Cell NOMA Networks","authors":"MohammadAmin Lotfolahi, H. Ferng","doi":"10.1109/APWCS60142.2023.10234069","DOIUrl":null,"url":null,"abstract":"To effectively address the power allocation (PA) problem to maximize the energy efficiency (EE) for a non-orthogonal multiple access (NOMA) system, a novel action mapper alongside a multi-agent deep reinforcement learning (MADRL)-based algorithm is designed in this paper. The action mapper discretizes and merges similar actions into one action so that the action space can be significantly reduced. Then, it is integrated with a multi-agent proximal policy optimization (MAPPO) algorithm to efficiently perform the PA task. Our proposed MADRL-based algorithm with the reduced action mapper is able to find the sub-optimal solution according to the current environmental condition. Supported by our simulation results, our proposed mechanism can significantly improve the EE as compared to the closely related approaches.","PeriodicalId":375211,"journal":{"name":"2023 VTS Asia Pacific Wireless Communications Symposium (APWCS)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 VTS Asia Pacific Wireless Communications Symposium (APWCS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/APWCS60142.2023.10234069","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

To effectively address the power allocation (PA) problem to maximize the energy efficiency (EE) for a non-orthogonal multiple access (NOMA) system, a novel action mapper alongside a multi-agent deep reinforcement learning (MADRL)-based algorithm is designed in this paper. The action mapper discretizes and merges similar actions into one action so that the action space can be significantly reduced. Then, it is integrated with a multi-agent proximal policy optimization (MAPPO) algorithm to efficiently perform the PA task. Our proposed MADRL-based algorithm with the reduced action mapper is able to find the sub-optimal solution according to the current environmental condition. Supported by our simulation results, our proposed mechanism can significantly improve the EE as compared to the closely related approaches.
基于多agent drl的多小区NOMA网络功率分配机制
为了有效地解决非正交多址(NOMA)系统的功率分配(PA)问题,以最大化能源效率(EE),本文设计了一种新的基于多智能体深度强化学习(MADRL)算法的动作映射器。动作映射器将类似的动作离散并合并到一个动作中,这样可以显著减少动作空间。然后,将其与多智能体近端策略优化(MAPPO)算法相结合,有效地执行PA任务。我们提出的基于madrl的简化动作映射算法能够根据当前环境条件找到次优解。仿真结果表明,与密切相关的方法相比,我们提出的机制可以显著提高情感表达。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信