Senzhen Wu , Zhijin Wang , Xiufeng Liu , Yuan Zhao , Yue Hu , Yaohui Huang
{"title":"Temporal structure-preserving transformer for industrial load forecasting","authors":"Senzhen Wu , Zhijin Wang , Xiufeng Liu , Yuan Zhao , Yue Hu , Yaohui Huang","doi":"10.1016/j.neunet.2025.107887","DOIUrl":null,"url":null,"abstract":"<div><div>Accurate power load forecasting in industrial parks is crucial for optimizing energy management and operational efficiency. Existing models struggle with industrial load series’ complex, multi-target nature and the need to integrate diverse exogenous variables. This paper introduces the Temporal Structure-Preserving Transformer (TSPT), a novel architecture that addresses these challenges by decomposing multi-target series into univariate series, enabling parallel processing and integrating exogenous data. The TSPT model incorporates the Gated Feature Fusion (GFF), which learns to capture multiscale temporal patterns from each target sequence and exogenous factors by preserving the temporal structure of the series. This parallel processing and the structure-preserving transformations allow TSPT to effectively integrate domain-specific knowledge, such as weather, production, and efficiency data, enhancing its forecasting performance. Comprehensive experiments on a real-world industrial park dataset demonstrate TSPT’s superiority over state-of-the-art methods in handling complex, multi-target forecasting tasks with integrated exogenous variables. The proposed approach offers a pathway for scalable and accurate load forecasting in industrial settings, improving energy management and operational decision-making.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"192 ","pages":"Article 107887"},"PeriodicalIF":6.3000,"publicationDate":"2025-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neural Networks","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0893608025007683","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Accurate power load forecasting in industrial parks is crucial for optimizing energy management and operational efficiency. Existing models struggle with industrial load series’ complex, multi-target nature and the need to integrate diverse exogenous variables. This paper introduces the Temporal Structure-Preserving Transformer (TSPT), a novel architecture that addresses these challenges by decomposing multi-target series into univariate series, enabling parallel processing and integrating exogenous data. The TSPT model incorporates the Gated Feature Fusion (GFF), which learns to capture multiscale temporal patterns from each target sequence and exogenous factors by preserving the temporal structure of the series. This parallel processing and the structure-preserving transformations allow TSPT to effectively integrate domain-specific knowledge, such as weather, production, and efficiency data, enhancing its forecasting performance. Comprehensive experiments on a real-world industrial park dataset demonstrate TSPT’s superiority over state-of-the-art methods in handling complex, multi-target forecasting tasks with integrated exogenous variables. The proposed approach offers a pathway for scalable and accurate load forecasting in industrial settings, improving energy management and operational decision-making.
期刊介绍:
Neural Networks is a platform that aims to foster an international community of scholars and practitioners interested in neural networks, deep learning, and other approaches to artificial intelligence and machine learning. Our journal invites submissions covering various aspects of neural networks research, from computational neuroscience and cognitive modeling to mathematical analyses and engineering applications. By providing a forum for interdisciplinary discussions between biology and technology, we aim to encourage the development of biologically-inspired artificial intelligence.