Yi Ji , Yongyuan Zhu , Siliang Lu , Lixia Yang , Alan Wee-Chung Liew
{"title":"基于多尺度特征提取的短期电力负荷预测深度学习框架","authors":"Yi Ji , Yongyuan Zhu , Siliang Lu , Lixia Yang , Alan Wee-Chung Liew","doi":"10.1016/j.knosys.2025.113907","DOIUrl":null,"url":null,"abstract":"<div><div>Short-term electric load forecasting is essential for efficient power system operation, but existing deep learning models struggle to capture the multi-scale features and cyclical fluctuations inherent in short-term load data. This paper introduces a novel deep learning model, Wavelet Transform Convolution-inverted ProbSparse Transformer (WTC-iPST), specifically designed for short-term load forecasting. Unlike existing deep learning models, WTC-iPST leverages Wavelet Transform Convolution (WTConv) for multi-scale feature extraction and integrates Wavelet Kolmogorov-Arnold Networks (Wav-KAN) to enhance the ProbSparse self-attention mechanism, significantly improving the model's ability to capture multi-scale features and cyclical fluctuations inherent in short-term load data. This design addresses the challenge of extracting multi-scale and cyclical features from short-term load data, which existing models struggle with, and strengthens the model's capacity to handle long series. Additionally, WTC-iPST incorporates quantile regression to quantify uncertainty and provide confidence intervals, further enhancing the prediction's reliability and accuracy. Experimental results on real-world datasets demonstrate that WTC-iPST outperforms state-of-the-art forecasting models, with significant improvements over the baseline iTransformer, achieving reductions of up to 16.84 % in RMSE, 18.09 % in MAPE, and 17.65 % in RRMSE, as well as an increase of up to 2.96 % in R². In terms of probabilistic prediction, WTC-iPST consistently maintains a narrow confidence interval with high interval coverage. Moreover, WTC-iPST shows strong performance across various prediction horizons and different distribution substations, highlighting its robustness and adaptability. These results confirm that WTC-iPST provides more accurate and reliable forecasts, making it a valuable tool for power system dispatch and operational planning.</div></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":"324 ","pages":"Article 113907"},"PeriodicalIF":7.6000,"publicationDate":"2025-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"WTC-iPST: A deep learning framework for short-term electric load forecasting with multi-scale feature extraction\",\"authors\":\"Yi Ji , Yongyuan Zhu , Siliang Lu , Lixia Yang , Alan Wee-Chung Liew\",\"doi\":\"10.1016/j.knosys.2025.113907\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Short-term electric load forecasting is essential for efficient power system operation, but existing deep learning models struggle to capture the multi-scale features and cyclical fluctuations inherent in short-term load data. This paper introduces a novel deep learning model, Wavelet Transform Convolution-inverted ProbSparse Transformer (WTC-iPST), specifically designed for short-term load forecasting. Unlike existing deep learning models, WTC-iPST leverages Wavelet Transform Convolution (WTConv) for multi-scale feature extraction and integrates Wavelet Kolmogorov-Arnold Networks (Wav-KAN) to enhance the ProbSparse self-attention mechanism, significantly improving the model's ability to capture multi-scale features and cyclical fluctuations inherent in short-term load data. This design addresses the challenge of extracting multi-scale and cyclical features from short-term load data, which existing models struggle with, and strengthens the model's capacity to handle long series. Additionally, WTC-iPST incorporates quantile regression to quantify uncertainty and provide confidence intervals, further enhancing the prediction's reliability and accuracy. Experimental results on real-world datasets demonstrate that WTC-iPST outperforms state-of-the-art forecasting models, with significant improvements over the baseline iTransformer, achieving reductions of up to 16.84 % in RMSE, 18.09 % in MAPE, and 17.65 % in RRMSE, as well as an increase of up to 2.96 % in R². In terms of probabilistic prediction, WTC-iPST consistently maintains a narrow confidence interval with high interval coverage. Moreover, WTC-iPST shows strong performance across various prediction horizons and different distribution substations, highlighting its robustness and adaptability. These results confirm that WTC-iPST provides more accurate and reliable forecasts, making it a valuable tool for power system dispatch and operational planning.</div></div>\",\"PeriodicalId\":49939,\"journal\":{\"name\":\"Knowledge-Based Systems\",\"volume\":\"324 \",\"pages\":\"Article 113907\"},\"PeriodicalIF\":7.6000,\"publicationDate\":\"2025-06-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Knowledge-Based Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0950705125009530\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705125009530","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
WTC-iPST: A deep learning framework for short-term electric load forecasting with multi-scale feature extraction
Short-term electric load forecasting is essential for efficient power system operation, but existing deep learning models struggle to capture the multi-scale features and cyclical fluctuations inherent in short-term load data. This paper introduces a novel deep learning model, Wavelet Transform Convolution-inverted ProbSparse Transformer (WTC-iPST), specifically designed for short-term load forecasting. Unlike existing deep learning models, WTC-iPST leverages Wavelet Transform Convolution (WTConv) for multi-scale feature extraction and integrates Wavelet Kolmogorov-Arnold Networks (Wav-KAN) to enhance the ProbSparse self-attention mechanism, significantly improving the model's ability to capture multi-scale features and cyclical fluctuations inherent in short-term load data. This design addresses the challenge of extracting multi-scale and cyclical features from short-term load data, which existing models struggle with, and strengthens the model's capacity to handle long series. Additionally, WTC-iPST incorporates quantile regression to quantify uncertainty and provide confidence intervals, further enhancing the prediction's reliability and accuracy. Experimental results on real-world datasets demonstrate that WTC-iPST outperforms state-of-the-art forecasting models, with significant improvements over the baseline iTransformer, achieving reductions of up to 16.84 % in RMSE, 18.09 % in MAPE, and 17.65 % in RRMSE, as well as an increase of up to 2.96 % in R². In terms of probabilistic prediction, WTC-iPST consistently maintains a narrow confidence interval with high interval coverage. Moreover, WTC-iPST shows strong performance across various prediction horizons and different distribution substations, highlighting its robustness and adaptability. These results confirm that WTC-iPST provides more accurate and reliable forecasts, making it a valuable tool for power system dispatch and operational planning.
期刊介绍:
Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.