{"title":"使用深度强化学习的能量感知多访问","authors":"H. Mazandarani, S. Khorsandi","doi":"10.1109/ICEE52715.2021.9544417","DOIUrl":null,"url":null,"abstract":"Deep Reinforcement Learning (DRL), as an emerging trend in the reinforcement learning paradigm, has recently been used for multiple access of wireless nodes to frequency spectrum. Although existing research works are promising in terms of frequency spectrum utilization, the concept of energy-awareness is missing. Nevertheless, the high energy-consumption of DRL algorithms is a serious concern, especially in battery-constrained Internet of Things (IoT) nodes. In this paper, a simple yet effective mechanism is introduced to reduce state size of the DRL algorithm, which results in reduction of energy consumption for IoT nodes. Our simulations indicate that state size can be reduced, without significant change in the system performance.","PeriodicalId":254932,"journal":{"name":"2021 29th Iranian Conference on Electrical Engineering (ICEE)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Energy-aware Multiple Access Using Deep Reinforcement Learning\",\"authors\":\"H. Mazandarani, S. Khorsandi\",\"doi\":\"10.1109/ICEE52715.2021.9544417\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Deep Reinforcement Learning (DRL), as an emerging trend in the reinforcement learning paradigm, has recently been used for multiple access of wireless nodes to frequency spectrum. Although existing research works are promising in terms of frequency spectrum utilization, the concept of energy-awareness is missing. Nevertheless, the high energy-consumption of DRL algorithms is a serious concern, especially in battery-constrained Internet of Things (IoT) nodes. In this paper, a simple yet effective mechanism is introduced to reduce state size of the DRL algorithm, which results in reduction of energy consumption for IoT nodes. Our simulations indicate that state size can be reduced, without significant change in the system performance.\",\"PeriodicalId\":254932,\"journal\":{\"name\":\"2021 29th Iranian Conference on Electrical Engineering (ICEE)\",\"volume\":\"11 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-05-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 29th Iranian Conference on Electrical Engineering (ICEE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICEE52715.2021.9544417\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 29th Iranian Conference on Electrical Engineering (ICEE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICEE52715.2021.9544417","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Energy-aware Multiple Access Using Deep Reinforcement Learning
Deep Reinforcement Learning (DRL), as an emerging trend in the reinforcement learning paradigm, has recently been used for multiple access of wireless nodes to frequency spectrum. Although existing research works are promising in terms of frequency spectrum utilization, the concept of energy-awareness is missing. Nevertheless, the high energy-consumption of DRL algorithms is a serious concern, especially in battery-constrained Internet of Things (IoT) nodes. In this paper, a simple yet effective mechanism is introduced to reduce state size of the DRL algorithm, which results in reduction of energy consumption for IoT nodes. Our simulations indicate that state size can be reduced, without significant change in the system performance.