{"title":"TFTformer:一种新的基于变压器的短期负荷预测模型","authors":"Ahmad Ahmad , Xun Xiao , Huadong Mo , Daoyi Dong","doi":"10.1016/j.ijepes.2025.110549","DOIUrl":null,"url":null,"abstract":"<div><div>Electrical load forecasting is essential for the efficient operation and planning of power systems. Recent studies have employed Transformer models in forecasting due to their unique attention mechanisms and ability to extract correlations in data. However, these models face challenges in integrating varied data types and capturing long-term dependencies. To address these limitations, this study proposes a TFTformer, a transformer-based neural network designed to enhance the accuracy and generalisability of load forecasting models. The TFTformer incorporates transposed feature-specific embeddings for weather, time, and load data to more accurately capture their unique characteristics. A linear transformation layer post embedding improves feature representation, aligning and standardising features across sequences for improved pattern recognition. Additionally, a Temporal Convolutional Network is integrated within the Transformer’s encoder, employing causal convolutions and dilation to adapt to the sequential nature of data with an expanded receptive field. The effectiveness of the TFTformer is demonstrated through a comparative study against several state-of-the-art methods using load datasets from Belgium, New Zealand, and five Australian states. The results demonstrate that the TFTformer achieves significant MSE improvements across different locations, with over 50% improvement over most models, 42% over CARD, and 16%–17% improvement compared to iFlowformer and iReformer. Furthermore, an Analysis of Variance is conducted to evaluate the impact of each component of the TFTformer. A SHAP-based interpretability analysis, using surrogate models, is conducted to elucidate the decision-making process of TFTformer, highlighting the critical role of time factors and weather features in its predictions.</div></div>","PeriodicalId":50326,"journal":{"name":"International Journal of Electrical Power & Energy Systems","volume":"166 ","pages":"Article 110549"},"PeriodicalIF":5.0000,"publicationDate":"2025-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"TFTformer: A novel transformer based model for short-term load forecasting\",\"authors\":\"Ahmad Ahmad , Xun Xiao , Huadong Mo , Daoyi Dong\",\"doi\":\"10.1016/j.ijepes.2025.110549\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Electrical load forecasting is essential for the efficient operation and planning of power systems. Recent studies have employed Transformer models in forecasting due to their unique attention mechanisms and ability to extract correlations in data. However, these models face challenges in integrating varied data types and capturing long-term dependencies. To address these limitations, this study proposes a TFTformer, a transformer-based neural network designed to enhance the accuracy and generalisability of load forecasting models. The TFTformer incorporates transposed feature-specific embeddings for weather, time, and load data to more accurately capture their unique characteristics. A linear transformation layer post embedding improves feature representation, aligning and standardising features across sequences for improved pattern recognition. Additionally, a Temporal Convolutional Network is integrated within the Transformer’s encoder, employing causal convolutions and dilation to adapt to the sequential nature of data with an expanded receptive field. The effectiveness of the TFTformer is demonstrated through a comparative study against several state-of-the-art methods using load datasets from Belgium, New Zealand, and five Australian states. The results demonstrate that the TFTformer achieves significant MSE improvements across different locations, with over 50% improvement over most models, 42% over CARD, and 16%–17% improvement compared to iFlowformer and iReformer. Furthermore, an Analysis of Variance is conducted to evaluate the impact of each component of the TFTformer. A SHAP-based interpretability analysis, using surrogate models, is conducted to elucidate the decision-making process of TFTformer, highlighting the critical role of time factors and weather features in its predictions.</div></div>\",\"PeriodicalId\":50326,\"journal\":{\"name\":\"International Journal of Electrical Power & Energy Systems\",\"volume\":\"166 \",\"pages\":\"Article 110549\"},\"PeriodicalIF\":5.0000,\"publicationDate\":\"2025-03-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Electrical Power & Energy Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0142061525001000\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Electrical Power & Energy Systems","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0142061525001000","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
TFTformer: A novel transformer based model for short-term load forecasting
Electrical load forecasting is essential for the efficient operation and planning of power systems. Recent studies have employed Transformer models in forecasting due to their unique attention mechanisms and ability to extract correlations in data. However, these models face challenges in integrating varied data types and capturing long-term dependencies. To address these limitations, this study proposes a TFTformer, a transformer-based neural network designed to enhance the accuracy and generalisability of load forecasting models. The TFTformer incorporates transposed feature-specific embeddings for weather, time, and load data to more accurately capture their unique characteristics. A linear transformation layer post embedding improves feature representation, aligning and standardising features across sequences for improved pattern recognition. Additionally, a Temporal Convolutional Network is integrated within the Transformer’s encoder, employing causal convolutions and dilation to adapt to the sequential nature of data with an expanded receptive field. The effectiveness of the TFTformer is demonstrated through a comparative study against several state-of-the-art methods using load datasets from Belgium, New Zealand, and five Australian states. The results demonstrate that the TFTformer achieves significant MSE improvements across different locations, with over 50% improvement over most models, 42% over CARD, and 16%–17% improvement compared to iFlowformer and iReformer. Furthermore, an Analysis of Variance is conducted to evaluate the impact of each component of the TFTformer. A SHAP-based interpretability analysis, using surrogate models, is conducted to elucidate the decision-making process of TFTformer, highlighting the critical role of time factors and weather features in its predictions.
期刊介绍:
The journal covers theoretical developments in electrical power and energy systems and their applications. The coverage embraces: generation and network planning; reliability; long and short term operation; expert systems; neural networks; object oriented systems; system control centres; database and information systems; stock and parameter estimation; system security and adequacy; network theory, modelling and computation; small and large system dynamics; dynamic model identification; on-line control including load and switching control; protection; distribution systems; energy economics; impact of non-conventional systems; and man-machine interfaces.
As well as original research papers, the journal publishes short contributions, book reviews and conference reports. All papers are peer-reviewed by at least two referees.