Yohann Rioual, Y. Moullec, J. Laurent, Muhidul Islam Khan, J. Diguet
{"title":"基于强化学习方法的能量管理奖励函数评价","authors":"Yohann Rioual, Y. Moullec, J. Laurent, Muhidul Islam Khan, J. Diguet","doi":"10.1109/BEC.2018.8600992","DOIUrl":null,"url":null,"abstract":"In the past decade, the energy needs in WBANs have increased due to more information to be processed, more data to be transmitted and longer operational periods. On the other hand, battery technologies have not improved fast enough to cope with these needs. Thus, miniaturized energy harvesting technologies are increasingly used to complement the batteries in WBANs. However, this brings uncertainties in the system since the harvested energy varies a lot during the node operation. It has been shown that reinforcement learning algorithms can be used to manage the energy in the nodes since they are able to make decisions under uncertainty. But the efficiency of these algorithms depends on their reward function. In this paper we explore different reward functions and seek to identify the most suitable variables to use in such functions to obtain the expected behavior. Experimental results with four different reward functions illustrate how the choice thereof impacts the energy consumption of the nodes.","PeriodicalId":140384,"journal":{"name":"2018 16th Biennial Baltic Electronics Conference (BEC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"16","resultStr":"{\"title\":\"Reward Function Evaluation in a Reinforcement Learning Approach for Energy Management\",\"authors\":\"Yohann Rioual, Y. Moullec, J. Laurent, Muhidul Islam Khan, J. Diguet\",\"doi\":\"10.1109/BEC.2018.8600992\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the past decade, the energy needs in WBANs have increased due to more information to be processed, more data to be transmitted and longer operational periods. On the other hand, battery technologies have not improved fast enough to cope with these needs. Thus, miniaturized energy harvesting technologies are increasingly used to complement the batteries in WBANs. However, this brings uncertainties in the system since the harvested energy varies a lot during the node operation. It has been shown that reinforcement learning algorithms can be used to manage the energy in the nodes since they are able to make decisions under uncertainty. But the efficiency of these algorithms depends on their reward function. In this paper we explore different reward functions and seek to identify the most suitable variables to use in such functions to obtain the expected behavior. Experimental results with four different reward functions illustrate how the choice thereof impacts the energy consumption of the nodes.\",\"PeriodicalId\":140384,\"journal\":{\"name\":\"2018 16th Biennial Baltic Electronics Conference (BEC)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"16\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2018 16th Biennial Baltic Electronics Conference (BEC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/BEC.2018.8600992\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 16th Biennial Baltic Electronics Conference (BEC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/BEC.2018.8600992","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Reward Function Evaluation in a Reinforcement Learning Approach for Energy Management
In the past decade, the energy needs in WBANs have increased due to more information to be processed, more data to be transmitted and longer operational periods. On the other hand, battery technologies have not improved fast enough to cope with these needs. Thus, miniaturized energy harvesting technologies are increasingly used to complement the batteries in WBANs. However, this brings uncertainties in the system since the harvested energy varies a lot during the node operation. It has been shown that reinforcement learning algorithms can be used to manage the energy in the nodes since they are able to make decisions under uncertainty. But the efficiency of these algorithms depends on their reward function. In this paper we explore different reward functions and seek to identify the most suitable variables to use in such functions to obtain the expected behavior. Experimental results with four different reward functions illustrate how the choice thereof impacts the energy consumption of the nodes.