连续变量量子强化学习在住宅空调控制和电源管理中的应用

IF 9.6 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Sarvar Hussain Nengroo , Dongsoo Har , Hoon Jeong , Taewook Heo , Sangkeum Lee
{"title":"连续变量量子强化学习在住宅空调控制和电源管理中的应用","authors":"Sarvar Hussain Nengroo ,&nbsp;Dongsoo Har ,&nbsp;Hoon Jeong ,&nbsp;Taewook Heo ,&nbsp;Sangkeum Lee","doi":"10.1016/j.egyai.2025.100541","DOIUrl":null,"url":null,"abstract":"<div><div>The use of occupancy information for heating, ventilation, and air conditioning (HVAC) control in smart buildings has become increasingly important for enhancing energy efficiency and occupant comfort. However, residential HVAC control presents significant challenges due to the complex dynamic nature of buildings and the uncertainties associated with heat loads and weather conditions. This study addresses this gap in adaptive and energy efficient HVAC control by introducing a quantum reinforcement learning (QRL) based approach. Unlike conventional reinforcement learning techniques, the QRL leverages quantum computing principles to efficiently handle high dimensional state and action spaces, enabling more precise HVAC control in multi-zone residential buildings. The proposed framework integrates real-time occupancy detection using deep learning with operational data, including power consumption patterns, air conditioner control data, and external temperature variations. To evaluate the effectiveness of the proposed approach, simulations were conducted using real world data from 26 residential households over a three month period. The results demonstrate that the QRL based HVAC control significantly reduces energy consumption and electricity costs while maintaining thermal comfort. Compared to the deep deterministic policy gradient method, the QRL approach achieved a 63% reduction in power consumption and a 64.4% decrease in electricity costs. Similarly, it outperformed the proximal policy optimization algorithm, leading to an average reduction of 62.5% in electricity costs and 62.4% in power consumption.</div></div>","PeriodicalId":34138,"journal":{"name":"Energy and AI","volume":"21 ","pages":"Article 100541"},"PeriodicalIF":9.6000,"publicationDate":"2025-06-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Continuous variable quantum reinforcement learning for HVAC control and power management in residential building\",\"authors\":\"Sarvar Hussain Nengroo ,&nbsp;Dongsoo Har ,&nbsp;Hoon Jeong ,&nbsp;Taewook Heo ,&nbsp;Sangkeum Lee\",\"doi\":\"10.1016/j.egyai.2025.100541\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The use of occupancy information for heating, ventilation, and air conditioning (HVAC) control in smart buildings has become increasingly important for enhancing energy efficiency and occupant comfort. However, residential HVAC control presents significant challenges due to the complex dynamic nature of buildings and the uncertainties associated with heat loads and weather conditions. This study addresses this gap in adaptive and energy efficient HVAC control by introducing a quantum reinforcement learning (QRL) based approach. Unlike conventional reinforcement learning techniques, the QRL leverages quantum computing principles to efficiently handle high dimensional state and action spaces, enabling more precise HVAC control in multi-zone residential buildings. The proposed framework integrates real-time occupancy detection using deep learning with operational data, including power consumption patterns, air conditioner control data, and external temperature variations. To evaluate the effectiveness of the proposed approach, simulations were conducted using real world data from 26 residential households over a three month period. The results demonstrate that the QRL based HVAC control significantly reduces energy consumption and electricity costs while maintaining thermal comfort. Compared to the deep deterministic policy gradient method, the QRL approach achieved a 63% reduction in power consumption and a 64.4% decrease in electricity costs. Similarly, it outperformed the proximal policy optimization algorithm, leading to an average reduction of 62.5% in electricity costs and 62.4% in power consumption.</div></div>\",\"PeriodicalId\":34138,\"journal\":{\"name\":\"Energy and AI\",\"volume\":\"21 \",\"pages\":\"Article 100541\"},\"PeriodicalIF\":9.6000,\"publicationDate\":\"2025-06-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Energy and AI\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2666546825000734\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Energy and AI","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666546825000734","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

在智能建筑中,使用占用信息进行供暖、通风和空调(HVAC)控制对于提高能源效率和居住者舒适度变得越来越重要。然而,由于建筑复杂的动态特性以及与热负荷和天气条件相关的不确定性,住宅HVAC控制提出了重大挑战。本研究通过引入基于量子强化学习(QRL)的方法来解决自适应和节能HVAC控制方面的这一差距。与传统的强化学习技术不同,QRL利用量子计算原理有效地处理高维状态和动作空间,从而在多区域住宅建筑中实现更精确的HVAC控制。该框架将使用深度学习的实时占用检测与运行数据(包括功耗模式、空调控制数据和外部温度变化)集成在一起。为了评估所提出的方法的有效性,我们使用了26个住宅家庭三个月的真实数据进行了模拟。结果表明,基于QRL的暖通空调控制在保持热舒适的同时显著降低了能耗和电力成本。与深度确定性策略梯度方法相比,QRL方法实现了63%的功耗降低和64.4%的电力成本降低。同样,它优于最近邻策略优化算法,导致平均降低62.5%的电力成本和62.4%的电力消耗。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Continuous variable quantum reinforcement learning for HVAC control and power management in residential building

Continuous variable quantum reinforcement learning for HVAC control and power management in residential building
The use of occupancy information for heating, ventilation, and air conditioning (HVAC) control in smart buildings has become increasingly important for enhancing energy efficiency and occupant comfort. However, residential HVAC control presents significant challenges due to the complex dynamic nature of buildings and the uncertainties associated with heat loads and weather conditions. This study addresses this gap in adaptive and energy efficient HVAC control by introducing a quantum reinforcement learning (QRL) based approach. Unlike conventional reinforcement learning techniques, the QRL leverages quantum computing principles to efficiently handle high dimensional state and action spaces, enabling more precise HVAC control in multi-zone residential buildings. The proposed framework integrates real-time occupancy detection using deep learning with operational data, including power consumption patterns, air conditioner control data, and external temperature variations. To evaluate the effectiveness of the proposed approach, simulations were conducted using real world data from 26 residential households over a three month period. The results demonstrate that the QRL based HVAC control significantly reduces energy consumption and electricity costs while maintaining thermal comfort. Compared to the deep deterministic policy gradient method, the QRL approach achieved a 63% reduction in power consumption and a 64.4% decrease in electricity costs. Similarly, it outperformed the proximal policy optimization algorithm, leading to an average reduction of 62.5% in electricity costs and 62.4% in power consumption.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Energy and AI
Energy and AI Engineering-Engineering (miscellaneous)
CiteScore
16.50
自引率
0.00%
发文量
64
审稿时长
56 days
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信