Short-term power load forecasting based on Seq2Seq model integrating Bayesian optimization, temporal convolutional network and attention

IF 7.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Yeming Dai, Weijie Yu
{"title":"Short-term power load forecasting based on Seq2Seq model integrating Bayesian optimization, temporal convolutional network and attention","authors":"Yeming Dai,&nbsp;Weijie Yu","doi":"10.1016/j.asoc.2024.112248","DOIUrl":null,"url":null,"abstract":"<div><p>Power load forecasting is of great significance to the electricity management. However, extant research is insufficient in comprehensively combining data processing and further optimization of existing prediction models. Therefore, this paper propose an improved power load prediction methods from two aspects: data processing and optimization of Sequence to Sequence (Seq2Seq) model. Firstly, in the data processing, Extreme Gradient Boosting (XGBoost) is adopted to eliminate the redundant features for feature extraction. Meanwhile, Successive Variational Mode Decomposition (SVMD) is employed to solve the unsteadiness and nonlinearities present in electricity data during the decomposition process. Secondly, the Seq2Seq model is selected and improved with a variety of machine learning methods. Specifically, input data features are extracted using Convolutional Neural Networks (CNN), enhancing the decoder's focus on vital information with the Attention mechanism (AM). Temporal Convolutional Network (TCN) serves as both the encoder and decoder of Seq2Seq, with further optimization of the model parameters through the Bayesian Optimization (BO) algorithm. Finally, the cases of two real power market datasets in Switzerland and Singapore illustrate the efficiency and superiority of proposed hybrid forecasting method. Through a comprehensive comparison and analysis with the other six models and four commonly used evaluation metrics, it is evident that the proposed method excels in performance, attaining the highest level of prediction accuracy, with the highest accuracy rate of 95.83 %. Consequently, it exhibits significant practical utility in the realm of power load forecasting.</p></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":null,"pages":null},"PeriodicalIF":7.2000,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Soft Computing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1568494624010226","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Power load forecasting is of great significance to the electricity management. However, extant research is insufficient in comprehensively combining data processing and further optimization of existing prediction models. Therefore, this paper propose an improved power load prediction methods from two aspects: data processing and optimization of Sequence to Sequence (Seq2Seq) model. Firstly, in the data processing, Extreme Gradient Boosting (XGBoost) is adopted to eliminate the redundant features for feature extraction. Meanwhile, Successive Variational Mode Decomposition (SVMD) is employed to solve the unsteadiness and nonlinearities present in electricity data during the decomposition process. Secondly, the Seq2Seq model is selected and improved with a variety of machine learning methods. Specifically, input data features are extracted using Convolutional Neural Networks (CNN), enhancing the decoder's focus on vital information with the Attention mechanism (AM). Temporal Convolutional Network (TCN) serves as both the encoder and decoder of Seq2Seq, with further optimization of the model parameters through the Bayesian Optimization (BO) algorithm. Finally, the cases of two real power market datasets in Switzerland and Singapore illustrate the efficiency and superiority of proposed hybrid forecasting method. Through a comprehensive comparison and analysis with the other six models and four commonly used evaluation metrics, it is evident that the proposed method excels in performance, attaining the highest level of prediction accuracy, with the highest accuracy rate of 95.83 %. Consequently, it exhibits significant practical utility in the realm of power load forecasting.

基于整合贝叶斯优化、时序卷积网络和注意力的 Seq2Seq 模型的短期电力负荷预测
电力负荷预测对电力管理具有重要意义。然而,现有研究在全面结合数据处理和进一步优化现有预测模型方面存在不足。因此,本文从数据处理和序列到序列(Sequence to Sequence,Seq2Seq)模型优化两个方面提出了一种改进的电力负荷预测方法。首先,在数据处理方面,采用极端梯度提升法(XGBoost)去除冗余特征进行特征提取。同时,在分解过程中,采用连续变异模式分解(SVMD)来解决电力数据中存在的不稳定性和非线性问题。其次,利用多种机器学习方法选择和改进 Seq2Seq 模型。具体来说,使用卷积神经网络(CNN)提取输入数据特征,利用注意力机制(AM)加强解码器对重要信息的关注。时序卷积网络(TCN)同时作为 Seq2Seq 的编码器和解码器,并通过贝叶斯优化(BO)算法进一步优化模型参数。最后,瑞士和新加坡两个真实电力市场数据集的案例说明了所提出的混合预测方法的效率和优越性。通过与其他六种模型和四种常用评价指标的综合比较和分析,可以看出所提出的方法性能卓越,预测准确率达到最高水平,最高准确率为 95.83%。因此,该方法在电力负荷预测领域具有显著的实用性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Applied Soft Computing
Applied Soft Computing 工程技术-计算机:跨学科应用
CiteScore
15.80
自引率
6.90%
发文量
874
审稿时长
10.9 months
期刊介绍: Applied Soft Computing is an international journal promoting an integrated view of soft computing to solve real life problems.The focus is to publish the highest quality research in application and convergence of the areas of Fuzzy Logic, Neural Networks, Evolutionary Computing, Rough Sets and other similar techniques to address real world complexities. Applied Soft Computing is a rolling publication: articles are published as soon as the editor-in-chief has accepted them. Therefore, the web site will continuously be updated with new articles and the publication time will be short.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信