Advances in Ubiquitous Networking最新文献

Reinforcement Learning for Protocol Synthesis in Resource-Constrained Wireless Sensor and IoT Networks 资源受限无线传感器和物联网网络协议综合的强化学习

Advances in Ubiquitous Networking Pub Date : 2023-01-14 DOI: 10.48550/arXiv.2302.05300

H. Dutta, Amit Kumar Bhuyan, S. Biswas

{"title":"Reinforcement Learning for Protocol Synthesis in Resource-Constrained Wireless Sensor and IoT Networks","authors":"H. Dutta, Amit Kumar Bhuyan, S. Biswas","doi":"10.48550/arXiv.2302.05300","DOIUrl":"https://doi.org/10.48550/arXiv.2302.05300","url":null,"abstract":"This article explores the concepts of online protocol synthesis using Reinforcement Learning (RL). The study is performed in the context of sensor and IoT networks with ultra low complexity wireless transceivers. The paper introduces the use of RL and Multi Armed Bandit (MAB), a specific type of RL, for Medium Access Control (MAC) under different network and traffic conditions. It then introduces a novel learning based protocol synthesis framework that addresses specific difficulties and limitations in medium access for both random access and time slotted networks. The mechanism does not rely on carrier sensing, network time-synchronization, collision detection, and other low level complex operations, thus making it ideal for ultra simple transceiver hardware used in resource constrained sensor and IoT networks. Additionally, the ability of independent protocol learning by the nodes makes the system robust and adaptive to the changes in network and traffic conditions. It is shown that the nodes can be trained to learn to avoid collisions, and to achieve network throughputs that are comparable to ALOHA based access protocols in sensor and IoT networks with simplest transceiver hardware. It is also shown that using RL, it is feasible to synthesize access protocols that can sustain network throughput at high traffic loads, which is not feasible in the ALOHA-based systems. The ability of the system to provide throughput fairness under network and traffic heterogeneities are also experimentally demonstrated.","PeriodicalId":434010,"journal":{"name":"Advances in Ubiquitous Networking","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123753736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Multi-hop LoRa Network with Pipelined Transmission Capability 具有流水线传输能力的多跳LoRa网络

Advances in Ubiquitous Networking Pub Date : 2019-11-20 DOI: 10.1007/978-3-030-58008-7_10

Dinh Loc Mai, Myung-Kyun Kim

引用次数: 3

Global Modelling of Diffraction Phenomena by Irregular Shapes with Hybrid MOM-GTD Method 不规则形状衍射现象的混合moma - gtd全局建模

Advances in Ubiquitous Networking Pub Date : 2019-11-20 DOI: 10.1007/978-3-030-58008-7_9

Samir Mendil, T. Aguili

引用次数: 0

Dependency Between the Distance and International Voice Traffic 距离和国际话音流量之间的依赖关系

Advances in Ubiquitous Networking Pub Date : 2019-11-20 DOI: 10.1007/978-3-030-58008-7_16

Zagroz Aziz, R. Bestak

引用次数: 0

Optical Wireless Transmission of Electrocardiogram During Effort 用力过程中心电图的光学无线传输

Advances in Ubiquitous Networking Pub Date : 2019-11-20 DOI: 10.1007/978-3-030-58008-7_18

S. Sahuguède, A. Julien-Vergonjanne, O. Bernard, Kostiantyn Vasko, Boris Shtangei

引用次数: 2

IIoT-Based Prognostic Health Management Using a Markov Decision Process Approach 使用马尔可夫决策过程方法的基于工业物联网的预后健康管理

Advances in Ubiquitous Networking Pub Date : 2019-11-20 DOI: 10.1007/978-3-030-58008-7_12

K. Berhili, M. Koulali, Y. Berrehili

引用次数: 0

Extended Low Rank Parity Check Codes and Their Efficient Decoding for Multisource Wireless Sensor Networks 多源无线传感器网络的扩展低秩奇偶校验码及其高效解码

Advances in Ubiquitous Networking Pub Date : 2019-11-20 DOI: 10.1007/978-3-030-58008-7_4

Nicolas Aragon, J. Cances, Imad E. L. Qachchach, P. Gaborit, Oussama Habachi

引用次数: 0

Combined Beam Alignment and Power Allocation for NOMA-Empowered mmWave Communications 基于noma的毫米波通信组合波束对准和功率分配

Advances in Ubiquitous Networking Pub Date : 2019-11-20 DOI: 10.1007/978-3-030-58008-7_7

Wissal Attaoui, Essaid Sabir

引用次数: 3

A Congestion Game Analysis for Route-Parking Selection with Dynamic Pricing Policies 基于动态定价策略的停车路径选择拥堵博弈分析

Advances in Ubiquitous Networking Pub Date : 2019-11-20 DOI: 10.1007/978-3-030-58008-7_14

Bassma Jioudi, Essaid Sabir, F. Moutaouakkil, H. Medromi

引用次数: 1

IoT-Based Vital Sign Monitoring Using UWB Sensor 基于物联网的超宽带传感器生命体征监测

Advances in Ubiquitous Networking Pub Date : 2019-11-20 DOI: 10.1007/978-3-030-58008-7_11

Mohamad Mostafa, Mohammad Saeed Dayari, S. Chamaani, V. Meghdadi, Oussama Habachi, Y. Pousset

引用次数: 1