{"title":"基于联盟形成贝叶斯强化学习的微电网功率损耗最小化","authors":"M. Sadeghi, M. Erol-Kantarci","doi":"10.1109/PIMRC.2019.8904221","DOIUrl":null,"url":null,"abstract":"Energy trading among microgrids has been emerging as a promising solution to implement community microgrids, also known as energy sharing communities. The key idea behind these communities is to share the surplus energy in one microgrid with another microgrid that has higher demand than its generation. The objective of these transactions can be monetary as well as optimizing a system parameter. In this paper, we focus on energy trading for the purpose of power loss minimization. We assume microgrids form coalitions to avoid exporting energy from the utility grid or a distant microgrid which might cause higher line losses due to increased distance. We propose a novel Bayesian Reinforcement Learning (BRL) based algorithm, which allows the microgrids to reduce the overall power loss. We compare this scheme with a coalitional game theory-based approach, Q-learning based approach, random coalition formation approach, as well as with a case that has no coalitions. Our results show that more than 50% reduction in power loss compared to no coalitions and less power loss than the other approaches is achieved. We also show power loss can be further reduced by proper sizing of the storage unit.","PeriodicalId":412182,"journal":{"name":"2019 IEEE 30th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"Power Loss Minimization in Microgrids Using Bayesian Reinforcement Learning with Coalition Formation\",\"authors\":\"M. Sadeghi, M. Erol-Kantarci\",\"doi\":\"10.1109/PIMRC.2019.8904221\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Energy trading among microgrids has been emerging as a promising solution to implement community microgrids, also known as energy sharing communities. The key idea behind these communities is to share the surplus energy in one microgrid with another microgrid that has higher demand than its generation. The objective of these transactions can be monetary as well as optimizing a system parameter. In this paper, we focus on energy trading for the purpose of power loss minimization. We assume microgrids form coalitions to avoid exporting energy from the utility grid or a distant microgrid which might cause higher line losses due to increased distance. We propose a novel Bayesian Reinforcement Learning (BRL) based algorithm, which allows the microgrids to reduce the overall power loss. We compare this scheme with a coalitional game theory-based approach, Q-learning based approach, random coalition formation approach, as well as with a case that has no coalitions. Our results show that more than 50% reduction in power loss compared to no coalitions and less power loss than the other approaches is achieved. We also show power loss can be further reduced by proper sizing of the storage unit.\",\"PeriodicalId\":412182,\"journal\":{\"name\":\"2019 IEEE 30th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC)\",\"volume\":\"13 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 IEEE 30th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/PIMRC.2019.8904221\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE 30th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/PIMRC.2019.8904221","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Power Loss Minimization in Microgrids Using Bayesian Reinforcement Learning with Coalition Formation
Energy trading among microgrids has been emerging as a promising solution to implement community microgrids, also known as energy sharing communities. The key idea behind these communities is to share the surplus energy in one microgrid with another microgrid that has higher demand than its generation. The objective of these transactions can be monetary as well as optimizing a system parameter. In this paper, we focus on energy trading for the purpose of power loss minimization. We assume microgrids form coalitions to avoid exporting energy from the utility grid or a distant microgrid which might cause higher line losses due to increased distance. We propose a novel Bayesian Reinforcement Learning (BRL) based algorithm, which allows the microgrids to reduce the overall power loss. We compare this scheme with a coalitional game theory-based approach, Q-learning based approach, random coalition formation approach, as well as with a case that has no coalitions. Our results show that more than 50% reduction in power loss compared to no coalitions and less power loss than the other approaches is achieved. We also show power loss can be further reduced by proper sizing of the storage unit.