基于强化学习的低延迟NOMA-V2X网络资源分配

Huiyi Ding, Ka-Cheong Leung
{"title":"基于强化学习的低延迟NOMA-V2X网络资源分配","authors":"Huiyi Ding, Ka-Cheong Leung","doi":"10.1109/INFOCOMWKSHPS51825.2021.9484529","DOIUrl":null,"url":null,"abstract":"With the development of the Internet of things (IoT), vehicle-to-everything (V2X) plays an essential role in wireless communication networks. Vehicular communications meet tremendous challenges in guaranteeing low-latency transmission for safety-critical information due to dynamic channels caused by high mobility. To handle the challenges, non-orthogonal multiple access (NOMA) has been considered as a promising candidate for future V2X networks. However, it is still an open issue on how to organize multiple transmission links with suitable resource allocation. In this paper, we investigate the problem of the resource allocation for the low-latency NOMA-integrated V2X (NOMA-V2X) communication networks. First, a cross-layer optimization problem is formulated to consider user scheduling and power allocation jointly while satisfying the quality-of-service (QoS) requirements, including the delay requirements, rate demands, and power constraints. To cope with the limited time-varying channel information, a machine learning based resource allocation algorithm is proposed to find solutions. Specifically, reinforcement learning is applied to learn the dynamic channel information for reducing the transmission delay. The numerical results indicate that our proposed algorithm can significantly reduce the system delay compared with other methods while satisfying the QoS requirements, so as to tackle the congestion issues for V2X communications.","PeriodicalId":109588,"journal":{"name":"IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)","volume":"404 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-05-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"7","resultStr":"{\"title\":\"Resource Allocation for Low-Latency NOMA-V2X Networks Using Reinforcement Learning\",\"authors\":\"Huiyi Ding, Ka-Cheong Leung\",\"doi\":\"10.1109/INFOCOMWKSHPS51825.2021.9484529\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the development of the Internet of things (IoT), vehicle-to-everything (V2X) plays an essential role in wireless communication networks. Vehicular communications meet tremendous challenges in guaranteeing low-latency transmission for safety-critical information due to dynamic channels caused by high mobility. To handle the challenges, non-orthogonal multiple access (NOMA) has been considered as a promising candidate for future V2X networks. However, it is still an open issue on how to organize multiple transmission links with suitable resource allocation. In this paper, we investigate the problem of the resource allocation for the low-latency NOMA-integrated V2X (NOMA-V2X) communication networks. First, a cross-layer optimization problem is formulated to consider user scheduling and power allocation jointly while satisfying the quality-of-service (QoS) requirements, including the delay requirements, rate demands, and power constraints. To cope with the limited time-varying channel information, a machine learning based resource allocation algorithm is proposed to find solutions. Specifically, reinforcement learning is applied to learn the dynamic channel information for reducing the transmission delay. The numerical results indicate that our proposed algorithm can significantly reduce the system delay compared with other methods while satisfying the QoS requirements, so as to tackle the congestion issues for V2X communications.\",\"PeriodicalId\":109588,\"journal\":{\"name\":\"IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)\",\"volume\":\"404 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-05-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"7\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/INFOCOMWKSHPS51825.2021.9484529\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/INFOCOMWKSHPS51825.2021.9484529","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 7

摘要

随着物联网(IoT)的发展,车联网(V2X)在无线通信网络中发挥着至关重要的作用。由于高机动性带来的动态信道,车载通信在保证安全关键信息的低延迟传输方面面临巨大挑战。为了应对这些挑战,非正交多址(NOMA)被认为是未来V2X网络的一个有希望的候选者。然而,如何组织多个传输链路并合理分配资源,仍然是一个有待解决的问题。本文研究了低延迟noma集成V2X (NOMA-V2X)通信网络的资源分配问题。首先,提出了一个跨层优化问题,在满足服务质量(QoS)要求的同时,考虑用户调度和功率分配,包括延迟要求、速率要求和功率约束。针对时变信道信息有限的问题,提出了一种基于机器学习的资源分配算法。具体来说,采用强化学习来学习动态信道信息,以减少传输延迟。数值结果表明,与其他方法相比,该算法在满足QoS要求的同时显著降低了系统延迟,从而解决了V2X通信中的拥塞问题。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Resource Allocation for Low-Latency NOMA-V2X Networks Using Reinforcement Learning
With the development of the Internet of things (IoT), vehicle-to-everything (V2X) plays an essential role in wireless communication networks. Vehicular communications meet tremendous challenges in guaranteeing low-latency transmission for safety-critical information due to dynamic channels caused by high mobility. To handle the challenges, non-orthogonal multiple access (NOMA) has been considered as a promising candidate for future V2X networks. However, it is still an open issue on how to organize multiple transmission links with suitable resource allocation. In this paper, we investigate the problem of the resource allocation for the low-latency NOMA-integrated V2X (NOMA-V2X) communication networks. First, a cross-layer optimization problem is formulated to consider user scheduling and power allocation jointly while satisfying the quality-of-service (QoS) requirements, including the delay requirements, rate demands, and power constraints. To cope with the limited time-varying channel information, a machine learning based resource allocation algorithm is proposed to find solutions. Specifically, reinforcement learning is applied to learn the dynamic channel information for reducing the transmission delay. The numerical results indicate that our proposed algorithm can significantly reduce the system delay compared with other methods while satisfying the QoS requirements, so as to tackle the congestion issues for V2X communications.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信