Robust imputation of missing photovoltaic power data using a weather- and context-aware hybrid transformer framework

IF 9.1 1区 工程技术 Q1 ENERGY & FUELS
Chunyu Zhang , Xueqian Fu , Dawei Qiu , Hamed Badihi , Haitong Gu
{"title":"Robust imputation of missing photovoltaic power data using a weather- and context-aware hybrid transformer framework","authors":"Chunyu Zhang ,&nbsp;Xueqian Fu ,&nbsp;Dawei Qiu ,&nbsp;Hamed Badihi ,&nbsp;Haitong Gu","doi":"10.1016/j.renene.2025.124576","DOIUrl":null,"url":null,"abstract":"<div><div>Accurate imputation of missing photovoltaic (PV) power data is critical for ensuring the reliability of downstream energy management systems. This paper proposes a novel imputation framework that leverages both external knowledge and internal data patterns to enhance imputation performance in complex scenarios with high missing data rates. A weather-prompt and context-knowledge fusion mechanism is designed to incorporate meteorological features alongside coarse imputation results. These semantic prompts provide valuable environmental and temporal context, improving the model's ability to better understand missing data regions. The core architecture features a hybrid design that integrates Transformer modules with diagonal masked self-attention (DMSA) to capture different levels of temporal dependencies. These modules work synergistically with coarse-to-fine imputation layers and context-aware refinement blocks, enabling progressive data reconstruction and robust generalization across varying conditions. Comprehensive robustness evaluations demonstrate the model's ability to maintain high imputation accuracy even under extremely high missing rates. Compared with the strongest baseline, our model reduces MAE and RMSE by up to 50.5 % and 55.0 % on the DKASC dataset and 47.4 % and 52.9 % on the Hebei dataset under 90 % missing conditions. Furthermore, the model remains effective in scenarios where meteorological inputs are unavailable, when missing rates differ between the training and testing phases, or when the input PV data is collected at different time resolutions. These findings highlight the strong adaptability and practical applicability of the proposed imputation framework for real-world PV data scenarios.</div></div>","PeriodicalId":419,"journal":{"name":"Renewable Energy","volume":"256 ","pages":"Article 124576"},"PeriodicalIF":9.1000,"publicationDate":"2025-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Renewable Energy","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0960148125022402","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0

Abstract

Accurate imputation of missing photovoltaic (PV) power data is critical for ensuring the reliability of downstream energy management systems. This paper proposes a novel imputation framework that leverages both external knowledge and internal data patterns to enhance imputation performance in complex scenarios with high missing data rates. A weather-prompt and context-knowledge fusion mechanism is designed to incorporate meteorological features alongside coarse imputation results. These semantic prompts provide valuable environmental and temporal context, improving the model's ability to better understand missing data regions. The core architecture features a hybrid design that integrates Transformer modules with diagonal masked self-attention (DMSA) to capture different levels of temporal dependencies. These modules work synergistically with coarse-to-fine imputation layers and context-aware refinement blocks, enabling progressive data reconstruction and robust generalization across varying conditions. Comprehensive robustness evaluations demonstrate the model's ability to maintain high imputation accuracy even under extremely high missing rates. Compared with the strongest baseline, our model reduces MAE and RMSE by up to 50.5 % and 55.0 % on the DKASC dataset and 47.4 % and 52.9 % on the Hebei dataset under 90 % missing conditions. Furthermore, the model remains effective in scenarios where meteorological inputs are unavailable, when missing rates differ between the training and testing phases, or when the input PV data is collected at different time resolutions. These findings highlight the strong adaptability and practical applicability of the proposed imputation framework for real-world PV data scenarios.
使用天气和环境感知混合变压器框架对丢失的光伏电力数据进行鲁棒输入
准确输入缺失的光伏(PV)电力数据对于确保下游能源管理系统的可靠性至关重要。本文提出了一种利用外部知识和内部数据模式来提高数据缺失率高的复杂场景下的插补性能的新型插补框架。设计了一个天气提示和上下文知识融合机制,将气象特征与粗糙的估算结果结合起来。这些语义提示提供了有价值的环境和时间上下文,提高了模型更好地理解缺失数据区域的能力。核心体系结构采用混合设计,将Transformer模块与对角屏蔽自关注(DMSA)集成在一起,以捕获不同级别的时间依赖性。这些模块与从粗到精的输入层和上下文感知的细化块协同工作,实现了在不同条件下的渐进数据重建和鲁棒泛化。综合鲁棒性评估表明,即使在极高的缺失率下,该模型也能保持较高的imputation精度。与最强基线相比,在90%缺失条件下,我们的模型在DKASC数据上的MAE和RMSE分别降低了50.5%和55.0%,在河北数据上的MAE和RMSE分别降低了47.4%和52.9%。此外,该模型在气象输入不可用的情况下仍然有效,当训练和测试阶段的缺失率不同时,或者当输入的PV数据以不同的时间分辨率收集时。这些发现突出了所提出的估算框架对真实PV数据场景的强适应性和实际适用性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Renewable Energy
Renewable Energy 工程技术-能源与燃料
CiteScore
18.40
自引率
9.20%
发文量
1955
审稿时长
6.6 months
期刊介绍: Renewable Energy journal is dedicated to advancing knowledge and disseminating insights on various topics and technologies within renewable energy systems and components. Our mission is to support researchers, engineers, economists, manufacturers, NGOs, associations, and societies in staying updated on new developments in their respective fields and applying alternative energy solutions to current practices. As an international, multidisciplinary journal in renewable energy engineering and research, we strive to be a premier peer-reviewed platform and a trusted source of original research and reviews in the field of renewable energy. Join us in our endeavor to drive innovation and progress in sustainable energy solutions.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信