MTTLA‐DLW: Multi‐task TCN‐Bi‐LSTM transfer learning approach with dynamic loss weights based on feature correlations of the training samples for short‐term wind power prediction

IF 5.4 3区 材料科学 Q2 CHEMISTRY, PHYSICAL
Jifeng Song, Xiaosheng Peng, Jiajiong Song, Zimin Yang, Bo Wang, Jianfeng Che
{"title":"MTTLA‐DLW: Multi‐task TCN‐Bi‐LSTM transfer learning approach with dynamic loss weights based on feature correlations of the training samples for short‐term wind power prediction","authors":"Jifeng Song, Xiaosheng Peng, Jiajiong Song, Zimin Yang, Bo Wang, Jianfeng Che","doi":"10.1002/we.2909","DOIUrl":null,"url":null,"abstract":"Wind power prediction for newly built wind farms is usually faced with the problem of no sufficient historical data. To efficiently extract the useful features from related wind farms, a novel transfer learning method based on temporal convolutional network (TCN)‐Bi‐long short‐term memory (LSTM) with dynamic loss weights is proposed. Firstly, a novel multi‐task TCN‐Bi‐LSTM model is designed to extract common features. The separate TCNs, and common Bi‐LSTM layers of the proposed model are designed to extract the temporal features from related wind farms. Secondly, in the pre‐training stage, to optimize the training process of the neural networks, a dynamic loss‐weighting strategy is proposed for multi‐task learning (MTL) to select the most related features, which increase the prediction accuracy by providing a suitable optimization object. Thirdly, the multi‐task TCN‐Bi‐LSTM model is re‐trained based on the samples from the target wind farm. Finally, a dataset of seven wind farms was employed to evaluate the efficiency of the proposed MTL structure and the dynamic loss‐weighting strategy. The result shows that the root mean squared error of the 12‐h short‐term prediction can be decreased by 4.19% compared with the traditional single‐task learning model, which verifies the validity of the proposed multi‐task transfer learning method.","PeriodicalId":4,"journal":{"name":"ACS Applied Energy Materials","volume":null,"pages":null},"PeriodicalIF":5.4000,"publicationDate":"2024-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Energy Materials","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1002/we.2909","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CHEMISTRY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Wind power prediction for newly built wind farms is usually faced with the problem of no sufficient historical data. To efficiently extract the useful features from related wind farms, a novel transfer learning method based on temporal convolutional network (TCN)‐Bi‐long short‐term memory (LSTM) with dynamic loss weights is proposed. Firstly, a novel multi‐task TCN‐Bi‐LSTM model is designed to extract common features. The separate TCNs, and common Bi‐LSTM layers of the proposed model are designed to extract the temporal features from related wind farms. Secondly, in the pre‐training stage, to optimize the training process of the neural networks, a dynamic loss‐weighting strategy is proposed for multi‐task learning (MTL) to select the most related features, which increase the prediction accuracy by providing a suitable optimization object. Thirdly, the multi‐task TCN‐Bi‐LSTM model is re‐trained based on the samples from the target wind farm. Finally, a dataset of seven wind farms was employed to evaluate the efficiency of the proposed MTL structure and the dynamic loss‐weighting strategy. The result shows that the root mean squared error of the 12‐h short‐term prediction can be decreased by 4.19% compared with the traditional single‐task learning model, which verifies the validity of the proposed multi‐task transfer learning method.
MTTLA-DLW:基于训练样本特征相关性的动态损失权重多任务 TCN-Bi-LSTM 转移学习方法,用于短期风力预测
新建风电场的风功率预测通常面临着历史数据不足的问题。为有效提取相关风电场的有用特征,本文提出了一种基于时序卷积网络(TCN)-带动态损失权重的双长短时记忆(LSTM)的新型迁移学习方法。首先,设计了一种新颖的多任务 TCN-Bi-LSTM 模型来提取共性特征。该模型的独立 TCN 层和共同 Bi-LSTM 层旨在提取相关风电场的时间特征。其次,在预训练阶段,为优化神经网络的训练过程,提出了多任务学习(MTL)的动态损失加权策略,以选择最相关的特征,通过提供合适的优化对象来提高预测精度。第三,根据目标风场的样本重新训练多任务 TCN-Bi-LSTM 模型。最后,利用七个风电场的数据集来评估所提出的 MTL 结构和动态损失加权策略的效率。结果表明,与传统的单任务学习模型相比,12 小时短期预测的均方根误差降低了 4.19%,这验证了所提出的多任务迁移学习方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
ACS Applied Energy Materials
ACS Applied Energy Materials Materials Science-Materials Chemistry
CiteScore
10.30
自引率
6.20%
发文量
1368
期刊介绍: ACS Applied Energy Materials is an interdisciplinary journal publishing original research covering all aspects of materials, engineering, chemistry, physics and biology relevant to energy conversion and storage. The journal is devoted to reports of new and original experimental and theoretical research of an applied nature that integrate knowledge in the areas of materials, engineering, physics, bioscience, and chemistry into important energy applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信