{"title":"Beyond the Edge: An Advanced Exploration of Reinforcement Learning for Mobile Edge Computing, Its Applications, and Future Research Trajectories","authors":"Ning Yang;Shuo Chen;Haijun Zhang;Randall Berry","doi":"10.1109/COMST.2024.3405075","DOIUrl":"10.1109/COMST.2024.3405075","url":null,"abstract":"Mobile Edge Computing (MEC) broadens the scope of computation and storage beyond the central network, incorporating edge nodes close to end devices. This expansion facilitates the implementation of large-scale “connected things” within edge networks. The advent of applications necessitating real-time, high-quality service presents several challenges, such as low latency, high data rate, reliability, efficiency, and security, all of which demand resolution. The incorporation of reinforcement learning (RL) methodologies within MEC networks promotes a deeper understanding of mobile user behaviors and network dynamics, thereby optimizing resource use in computing and communication processes. This paper offers an exhaustive survey of RL applications in MEC networks, initially presenting an overview of RL from its fundamental principles to the latest advanced frameworks. Furthermore, it outlines various RL strategies employed in offloading, caching, and communication within MEC networks. Finally, it explores open issues linked with software and hardware platforms, representation, RL robustness, safe RL, large-scale scheduling, generalization, security, and privacy. The paper proposes specific RL techniques to mitigate these issues and provides insights into their practical applications.","PeriodicalId":55029,"journal":{"name":"IEEE Communications Surveys and Tutorials","volume":"27 1","pages":"546-594"},"PeriodicalIF":34.4,"publicationDate":"2024-03-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141185273","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Winfried Stock;Robert T. Schwarz;Christian A. Hofmann;Andreas Knopp
{"title":"Survey on Opportunistic PNT With Signals From LEO Communication Satellites","authors":"Winfried Stock;Robert T. Schwarz;Christian A. Hofmann;Andreas Knopp","doi":"10.1109/COMST.2024.3406990","DOIUrl":"10.1109/COMST.2024.3406990","url":null,"abstract":"Positioning, Navigation, and Timing (PNT) is an essential service for modern societies, their industries, and governmental organizations. Mobility, logistics, and agriculture, among others, depend heavily on reliable PNT and will do so even more in the future. However, the predominant Global Navigation Satellite Systems (GNSS) are highly susceptible to jamming and spoofing, a threat that has increased in the recent years. As a result, there is a growing need for a robust, independent PNT backup system. A promising approach to meet this demand is to use the communication signals of satellites in Low Earth Orbit (LEO) as signals of opportunity (opportunistic LEO-PNT). In recent years, opportunistic LEO-PNT has gained relevance in academic research due to the emergence of megaconstellations. This survey provides an holistic overview of opportunistic LEO-PNT and an exhaustive review of the academic work in the field. Error sources and challenges with respect to the development of operational systems are evaluated, and the state of the art performance is analyzed. System-level strategies to mitigate the error sources and challenges are identified, including the combination of opportunistic LEO-PNT with GNSS or other sensors, or the use of base stations. Future research directions, such as the investigation of non-accuracy related KPIs, the required receiver hardware, or the use in low SNR scenarios, are derived.","PeriodicalId":55029,"journal":{"name":"IEEE Communications Surveys and Tutorials","volume":"27 1","pages":"77-107"},"PeriodicalIF":34.4,"publicationDate":"2024-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141182899","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jingru Tan;Tom H. Luan;Wenbo Guan;Yuntao Wang;Haixia Peng;Yao Zhang;Dongmei Zhao;Ning Lu
{"title":"Beam Alignment in mmWave V2X Communications: A Survey","authors":"Jingru Tan;Tom H. Luan;Wenbo Guan;Yuntao Wang;Haixia Peng;Yao Zhang;Dongmei Zhao;Ning Lu","doi":"10.1109/COMST.2024.3383093","DOIUrl":"10.1109/COMST.2024.3383093","url":null,"abstract":"The digital transformation within the automotive industry is accelerating towards an era dominated by autonomous vehicles, with vehicle-to-everything (V2X) communications being a fundamental enabler for this advancement. As vehicular networks evolve to meet the complex demands of autonomous driving, traditional communication systems encounter limitations in bandwidth and data transfer rates. Millimeter-wave (mmWave) communication emerges as a pivotal solution, offering the extensive bandwidth required for the high data throughput and low latency essential in modern vehicular communications. However, challenges loom, with beam alignment in mmWave V2X becoming a time-consuming process and the mmWave’s blockage effect impeding consistent and reliable vehicular communication links. Therefore, the development of efficient, real-time, and robust beam alignment technology is crucial for mmWave V2X communication. In this paper, we present a comprehensive survey of beam alignment techniques in mmWave V2X communication. We explore various approaches including beam sweeping, angle of arrival (AoA)/angle of direction (AoD) estimation, black-box optimization, and side information. Subsequently, we introduce performance metrics for assessing beam alignment performance and compare the performance of four beam alignment methods under different metrics. Finally, we summarize the future research directions and challenges faced by beam alignment techniques in mmWave V2X communication, offering valuable insights for researchers in this field.","PeriodicalId":55029,"journal":{"name":"IEEE Communications Surveys and Tutorials","volume":"26 3","pages":"1676-1709"},"PeriodicalIF":34.4,"publicationDate":"2024-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140329103","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Asif Siddiqui;Bhaskar P. Rimal;Martin Reisslein;Yong Wang
{"title":"Survey on Unified Threat Management (UTM) Systems for Home Networks","authors":"Asif Siddiqui;Bhaskar P. Rimal;Martin Reisslein;Yong Wang","doi":"10.1109/COMST.2024.3382470","DOIUrl":"10.1109/COMST.2024.3382470","url":null,"abstract":"Home networks increasingly support important networked applications with limited professional network administration support, while sophisticated attacks pose enormous security risks for networked applications. A Unified Threat Management (UTM) system strives to comprehensively protect a network by providing firewall, intrusion detection and prevention, as well as antibot protection in an integrated, easy-to-configure manner. Previous surveys have extensively covered the individual components of a UTM system, i.e., there is extensive literature on firewall surveys, intrusion detection and prevention surveys, and antibot protection surveys. Importantly, the previous surveys covered these protection services separately, without considering their integration (however, this integration is critical for comprehensive home network protection). In contrast, the present survey covers for the first time home network UTM systems, i.e., the integrated network security services provided by a UTM system for a home network. This UTM survey is organized according to the UTM components, i.e., we comprehensively survey the firewall methods, the intrusion detection and prevention methods, as well as the antibot protection methods that are suitable for a UTM system for a home network. Throughout, we view these methods from the perspective of integration into a UTM system with limited computational resources and limited network administration support. Our survey includes the protection capabilities, as well as the design and deployment aspects and software/hardware limitations of available off-the-shelf and open-source UTM systems. We find that effective integrated home network protection where the UTM system components synergistically support each other while operating with limited computational resources and network administration support still requires extensive future research and development.","PeriodicalId":55029,"journal":{"name":"IEEE Communications Surveys and Tutorials","volume":"26 4","pages":"2459-2509"},"PeriodicalIF":34.4,"publicationDate":"2024-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140321893","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Klaus I. Pedersen;Roberto Maldonado;Guillermo Pocovi;Enric Juan;Mads Lauridsen;István Z. Kovács;Mads Brix;Jeroen Wigard
{"title":"A Tutorial on Radio System-Level Simulations With Emphasis on 3GPP 5G-Advanced and Beyond","authors":"Klaus I. Pedersen;Roberto Maldonado;Guillermo Pocovi;Enric Juan;Mads Lauridsen;István Z. Kovács;Mads Brix;Jeroen Wigard","doi":"10.1109/COMST.2024.3381669","DOIUrl":"10.1109/COMST.2024.3381669","url":null,"abstract":"In this tutorial we present recipes for dynamic system-level simulations (SLSs) of 5G and beyond cellular radio systems. A key ingredient for such SLSs is selection of proper models to make sure that the performance determining effects are properly reflected to ensure output of realistic radio performance results. We therefore present a significant number of SLS models and related methodologies for a variety of use cases. Our focus is on generally accepted models that are largely supported by academia and industrial players and adopted by 3GPP as being realistic. Among others, we touch on deployment models, traffic models, non-terrestrial cellular networks with satellites, SLS methodologies for Machine Learning (ML) enabled air-interface solutions, and many more. We also present several recommendations for best practices related to preparing and running detailed SLS campaigns, and agile software engineering considerations. Throughout the article we use the 3GPP defined 5G and 5G-Advanced systems to illustrate our points, extending it also into the 6G-era that is predicted to build on alike SLS methodologies and best practices.","PeriodicalId":55029,"journal":{"name":"IEEE Communications Surveys and Tutorials","volume":"26 4","pages":"2290-2325"},"PeriodicalIF":34.4,"publicationDate":"2024-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140310527","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yan F. Coutinho;ândrei Camponogara;Mateus de L. Filomeno;Marcello L. R. de Campos;Andrea M. Tonello;Moisés V. Ribeiro
{"title":"Two Decades of Research Progress in Resource Allocation for PLC Systems: From Core Concepts to Frontiers","authors":"Yan F. Coutinho;ândrei Camponogara;Mateus de L. Filomeno;Marcello L. R. de Campos;Andrea M. Tonello;Moisés V. Ribeiro","doi":"10.1109/COMST.2024.3380901","DOIUrl":"10.1109/COMST.2024.3380901","url":null,"abstract":"In this paper, we review the current state-of-the-art of resource allocation for power line communication systems. The study systematically presents the advancements achieved in this field over the past decades. To achieve this, we adopt two complementary perspectives: a power line communication-centric view and an optimization-centric view. The former highlights resource allocation within the eye of the power line communication community, while the latter emphasizes optimization principles, focusing on the technical aspects of resource allocation. Subsequently, we meticulously present the progress made in both single- and multi-user scenarios, employing a chronological approach to provide readers with a coherent narrative of the evolution and important findings. Furthermore, we accentuate critical insights and valuable lessons gathered from these developments. In conclusion, we explore future trends and prospects within the scope of resource allocation for power line communication systems, intending to inspire research initiatives that push the boundaries beyond the existing state-of-the-art.","PeriodicalId":55029,"journal":{"name":"IEEE Communications Surveys and Tutorials","volume":"26 3","pages":"1710-1747"},"PeriodicalIF":34.4,"publicationDate":"2024-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140291467","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Editorial: Second Quarter 2024 IEEE Communications Surveys and Tutorials","authors":"Dusit Niyato","doi":"10.1109/COMST.2024.3396689","DOIUrl":"https://doi.org/10.1109/COMST.2024.3396689","url":null,"abstract":"I welcome you to the second issue of the IEEE Communications Surveys and Tutorials in 2024. This issue includes 18 articles covering different aspects of communication networks. In particular, these articles survey and tutor various issues in “Wireless Communications”, “Cyber Security”, “IoT and M2M”, “Internet Technologies”, “Network Virtualization” and “Optical Communications”. A brief account for each of these articles is given below.","PeriodicalId":55029,"journal":{"name":"IEEE Communications Surveys and Tutorials","volume":"26 2","pages":"i-vi"},"PeriodicalIF":35.6,"publicationDate":"2024-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10536696","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141084863","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sarah Karmous;Nadia Adem;Mohammed Atiquzzaman;Sumudu Samarakoon
{"title":"How Can Optical Communications Shape the Future of Deep Space Communications? A Survey","authors":"Sarah Karmous;Nadia Adem;Mohammed Atiquzzaman;Sumudu Samarakoon","doi":"10.1109/COMST.2024.3403873","DOIUrl":"10.1109/COMST.2024.3403873","url":null,"abstract":"With a large number of deep space (DS) missions anticipated by the end of this decade, reliable and high-capacity DS communications are needed more than ever. Nevertheless, existing technologies are far from meeting such a goal. Improving current systems does not only require engineering leadership, but also, very crucially, investigating potential technologies that overcome the unique challenges of ultra-long DS links. To the best of our knowledge, there has not been any comprehensive surveys of DS communications technologies over the last decade. Free space optical (FSO) is an emerging DS technology, proven to acquire lower communications systems size weight and power (SWaP) and achieve a very high capacity compared to its counterpart radio frequency (RF), the currently used DS technology. In this survey, we discuss the pros and cons of deep space optical communications (DSOC) and review their physical and networking characteristics. Furthermore, we provide, for the first time, thoughtful discussions about implementing orbital angular momentum (OAM) and quantum communications (QC) for DS. We elaborate on how these technologies among other field advances including interplanetary network (IPN) and RF/FSO systems improve reliability, capacity, and security. This paper provides a holistic survey of DSOC technologies gathering 247 fragmented pieces of literature and including novel perspectives aiming to set the stage for more developments in the field.","PeriodicalId":55029,"journal":{"name":"IEEE Communications Surveys and Tutorials","volume":"27 1","pages":"725-747"},"PeriodicalIF":34.4,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141079062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Gabriel Antonio F. Rebello;Gustavo F. Camilo;Lucas Airam C. de Souza;Maria Potop-Butucaru;Marcelo Dias de Amorim;Miguel Elias M. Campista;Luís Henrique M. K. Costa
{"title":"A Survey on Blockchain Scalability: From Hardware to Layer-Two Protocols","authors":"Gabriel Antonio F. Rebello;Gustavo F. Camilo;Lucas Airam C. de Souza;Maria Potop-Butucaru;Marcelo Dias de Amorim;Miguel Elias M. Campista;Luís Henrique M. K. Costa","doi":"10.1109/COMST.2024.3376252","DOIUrl":"10.1109/COMST.2024.3376252","url":null,"abstract":"Despite the great success of blockchain systems in recent years, blockchains still struggle to provide the same level of latency and throughput as centralized financial systems. The core of this problem lies in the inefficiency of consensus protocols. In this paper, we provide a survey on recent efforts to improve the scalability of blockchains. We focus on layer-two protocols, such as payment channel networks and transaction rollups, which process computations off-chain and only use consensus for dispute resolution. Layer-two protocols are expected to process microtransactions with sub-second latency and reduced fees, allowing blockchains to scale. Much of this work addresses the open challenges of payment channel networks, such as payment routing, channel rebalancing, network design strategies, security and privacy, payment scheduling, congestion control, simulators, and support for light nodes. We also dedicate a section to the existing implementations of smart-contract-based transaction rollups. Our work systematizes the state-of-the-art layer-two protocols, paving the way for future advances.","PeriodicalId":55029,"journal":{"name":"IEEE Communications Surveys and Tutorials","volume":"26 4","pages":"2411-2458"},"PeriodicalIF":34.4,"publicationDate":"2024-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140161573","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Empowering Cloud Computing With Network Acceleration: A Survey","authors":"Lorenzo Rosa;Luca Foschini;Antonio Corradi","doi":"10.1109/COMST.2024.3377531","DOIUrl":"10.1109/COMST.2024.3377531","url":null,"abstract":"Modern interactive and data-intensive applications must operate under demanding time constraints, prompting a shift toward the adoption of specialized software and hardware network acceleration technologies. This specialization, however, poses significant scalability, flexibility, security, and economic sustainability challenges for application developers. Cloud computing holds the potential to overcome these obstacles by offering the cost-effective option to access specialized acceleration technologies through standard cloud interfaces. Nevertheless, that integration is still challenging for cloud providers. In the cloud, physical resources are hidden behind a virtualization layer, whereas acceleration technologies make applications directly interact with the hardware. To bridge this gap, recent literature explores the possibility of empowering cloud platforms with accelerated networking as a commodity, thus offering the innovative option of Network Acceleration as a Service. This survey reviews these recent research efforts by adopting popular technologies like XDP, DPDK, and RDMA as a reference. To organize the surveyed research in a comprehensive framework, we identify four key aspects that pose critical problems to the integration of acceleration options in cloud computing - access interfaces, virtualization techniques, serviceability, and security - and systematically discuss the associated challenges. Then, we present the issues to be further addressed and outline the most promising research directions for the full integration of network acceleration within next-generation cloud computing platforms.","PeriodicalId":55029,"journal":{"name":"IEEE Communications Surveys and Tutorials","volume":"26 4","pages":"2729-2768"},"PeriodicalIF":34.4,"publicationDate":"2024-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10472517","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140135628","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}