Hayla Nahom Abishu;Abegaz Mohammed Seid;Aiman Erbad;Sergio Márquez-Sánchez;Javier Hernandez Fernandez;Juan Manuel Corchado
{"title":"基于多智能体drl的物联网智能家居能源管理系统需求响应优化","authors":"Hayla Nahom Abishu;Abegaz Mohammed Seid;Aiman Erbad;Sergio Márquez-Sánchez;Javier Hernandez Fernandez;Juan Manuel Corchado","doi":"10.1109/JIOT.2025.3562137","DOIUrl":null,"url":null,"abstract":"The integration of IoT devices with smart home energy management systems (SHEMS) presents a significant advancement in energy demand response (DR) optimization. However, due to the rapid proliferation of home appliances with varying operating characteristics as well as the variable comfort level demands of users, making effective DR decisions becomes more challenging. In this article, we propose a hierarchical Stackelberg game-based incentive mechanism with multiagent deep reinforcement learning (MADRL) to optimize DR in IoT-based SHEMS. We formulate the hierarchical decision-making problem as a Markov decision process (MDP) and then adopt the multiagent deep deterministic policy gradient (MADDPG) algorithm to solve it by finding an equilibrium solution. Through extensive simulations, we demonstrate that our proposed DR optimization approach can effectively reduce overall energy consumption and peak load by 30.41% and 28.57% from the benchmark approaches, respectively. In addition, the proposed approach maintains user comfort and increases system utility by 13.11% and 15.74% than the benchmark schemes, respectively, resulting in improved energy efficiency.","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":"12 14","pages":"27003-27020"},"PeriodicalIF":8.9000,"publicationDate":"2025-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Multiagent DRL-Based Demand Response Optimization for IoT-Based Smart Home Energy Management Systems\",\"authors\":\"Hayla Nahom Abishu;Abegaz Mohammed Seid;Aiman Erbad;Sergio Márquez-Sánchez;Javier Hernandez Fernandez;Juan Manuel Corchado\",\"doi\":\"10.1109/JIOT.2025.3562137\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The integration of IoT devices with smart home energy management systems (SHEMS) presents a significant advancement in energy demand response (DR) optimization. However, due to the rapid proliferation of home appliances with varying operating characteristics as well as the variable comfort level demands of users, making effective DR decisions becomes more challenging. In this article, we propose a hierarchical Stackelberg game-based incentive mechanism with multiagent deep reinforcement learning (MADRL) to optimize DR in IoT-based SHEMS. We formulate the hierarchical decision-making problem as a Markov decision process (MDP) and then adopt the multiagent deep deterministic policy gradient (MADDPG) algorithm to solve it by finding an equilibrium solution. Through extensive simulations, we demonstrate that our proposed DR optimization approach can effectively reduce overall energy consumption and peak load by 30.41% and 28.57% from the benchmark approaches, respectively. In addition, the proposed approach maintains user comfort and increases system utility by 13.11% and 15.74% than the benchmark schemes, respectively, resulting in improved energy efficiency.\",\"PeriodicalId\":54347,\"journal\":{\"name\":\"IEEE Internet of Things Journal\",\"volume\":\"12 14\",\"pages\":\"27003-27020\"},\"PeriodicalIF\":8.9000,\"publicationDate\":\"2025-04-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Internet of Things Journal\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10967490/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Internet of Things Journal","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10967490/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
Multiagent DRL-Based Demand Response Optimization for IoT-Based Smart Home Energy Management Systems
The integration of IoT devices with smart home energy management systems (SHEMS) presents a significant advancement in energy demand response (DR) optimization. However, due to the rapid proliferation of home appliances with varying operating characteristics as well as the variable comfort level demands of users, making effective DR decisions becomes more challenging. In this article, we propose a hierarchical Stackelberg game-based incentive mechanism with multiagent deep reinforcement learning (MADRL) to optimize DR in IoT-based SHEMS. We formulate the hierarchical decision-making problem as a Markov decision process (MDP) and then adopt the multiagent deep deterministic policy gradient (MADDPG) algorithm to solve it by finding an equilibrium solution. Through extensive simulations, we demonstrate that our proposed DR optimization approach can effectively reduce overall energy consumption and peak load by 30.41% and 28.57% from the benchmark approaches, respectively. In addition, the proposed approach maintains user comfort and increases system utility by 13.11% and 15.74% than the benchmark schemes, respectively, resulting in improved energy efficiency.
期刊介绍:
The EEE Internet of Things (IoT) Journal publishes articles and review articles covering various aspects of IoT, including IoT system architecture, IoT enabling technologies, IoT communication and networking protocols such as network coding, and IoT services and applications. Topics encompass IoT's impacts on sensor technologies, big data management, and future internet design for applications like smart cities and smart homes. Fields of interest include IoT architecture such as things-centric, data-centric, service-oriented IoT architecture; IoT enabling technologies and systematic integration such as sensor technologies, big sensor data management, and future Internet design for IoT; IoT services, applications, and test-beds such as IoT service middleware, IoT application programming interface (API), IoT application design, and IoT trials/experiments; IoT standardization activities and technology development in different standard development organizations (SDO) such as IEEE, IETF, ITU, 3GPP, ETSI, etc.