Xiaochen Hao, Yuqiang Qiu, Yonghang Li, Xunian Yang
{"title":"MSTFormer:一种新的水泥煅烧过程电力消耗长期时间序列预测模型","authors":"Xiaochen Hao, Yuqiang Qiu, Yonghang Li, Xunian Yang","doi":"10.1016/j.ces.2025.122696","DOIUrl":null,"url":null,"abstract":"The cement calcination process is a critical and energy-intensive step in the cement production process, with electricity consumption accounting for the majority of overall energy consumption. Due to the combined influence of multiple factors such as process parameters, equipment status, and environmental disturbances, electricity consumption data exhibits complex characteristics. These include high time-delay, pronounced nonlinearity, and multivariate coupling, which pose significant challenges for long-term trend modeling and prediction. This paper addresses the challenge of long sequence time-series forecasting (LSTF) for electricity consumption in the cement calcination process by proposing a predictive model, MSTFormer. It integrates multi-channel time-series inputs with a spatio-temporal self-attention mechanism. The model first preprocesses the raw electricity consumption signals using variational modal decomposition. It then constructs a parallel multi-channel time-series input structure based on a weighted mechanism, effectively enhancing long-term dependency modeling capabilities. Subsequently, a novel spatiotemporal ProbSparse self-attention mechanism is designed, combining spatio-temporal embedding and causal convolution to adaptively extract global trends and local dynamic features, thereby enhancing the model’s ability to capture complex time-series patterns. Experimental results on actual cement production datasets demonstrate that MSTFormer outperforms mainstream long-sequence forecasting models across various prediction lengths. Compared with other decomposition methods, VMD-based decomposition reduces prediction errors by over 30%. For 15-minute prediction length, the model achieves an MAE of 0.063 and R<sup>2</sup> of 0.991. Even at 60-minute length, it improves prediction accuracy by over 24%. This study provides an effective approach for intelligent scheduling and energy optimization, offering theoretical and practical value for enhancing industrial energy efficiency.","PeriodicalId":271,"journal":{"name":"Chemical Engineering Science","volume":"93 1","pages":""},"PeriodicalIF":4.3000,"publicationDate":"2025-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"MSTFormer: A novel long-term time series prediction model for electricity consumption in the cement calcination process\",\"authors\":\"Xiaochen Hao, Yuqiang Qiu, Yonghang Li, Xunian Yang\",\"doi\":\"10.1016/j.ces.2025.122696\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The cement calcination process is a critical and energy-intensive step in the cement production process, with electricity consumption accounting for the majority of overall energy consumption. Due to the combined influence of multiple factors such as process parameters, equipment status, and environmental disturbances, electricity consumption data exhibits complex characteristics. These include high time-delay, pronounced nonlinearity, and multivariate coupling, which pose significant challenges for long-term trend modeling and prediction. This paper addresses the challenge of long sequence time-series forecasting (LSTF) for electricity consumption in the cement calcination process by proposing a predictive model, MSTFormer. It integrates multi-channel time-series inputs with a spatio-temporal self-attention mechanism. The model first preprocesses the raw electricity consumption signals using variational modal decomposition. It then constructs a parallel multi-channel time-series input structure based on a weighted mechanism, effectively enhancing long-term dependency modeling capabilities. Subsequently, a novel spatiotemporal ProbSparse self-attention mechanism is designed, combining spatio-temporal embedding and causal convolution to adaptively extract global trends and local dynamic features, thereby enhancing the model’s ability to capture complex time-series patterns. Experimental results on actual cement production datasets demonstrate that MSTFormer outperforms mainstream long-sequence forecasting models across various prediction lengths. Compared with other decomposition methods, VMD-based decomposition reduces prediction errors by over 30%. For 15-minute prediction length, the model achieves an MAE of 0.063 and R<sup>2</sup> of 0.991. Even at 60-minute length, it improves prediction accuracy by over 24%. This study provides an effective approach for intelligent scheduling and energy optimization, offering theoretical and practical value for enhancing industrial energy efficiency.\",\"PeriodicalId\":271,\"journal\":{\"name\":\"Chemical Engineering Science\",\"volume\":\"93 1\",\"pages\":\"\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2025-09-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Chemical Engineering Science\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1016/j.ces.2025.122696\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, CHEMICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Chemical Engineering Science","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1016/j.ces.2025.122696","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, CHEMICAL","Score":null,"Total":0}
MSTFormer: A novel long-term time series prediction model for electricity consumption in the cement calcination process
The cement calcination process is a critical and energy-intensive step in the cement production process, with electricity consumption accounting for the majority of overall energy consumption. Due to the combined influence of multiple factors such as process parameters, equipment status, and environmental disturbances, electricity consumption data exhibits complex characteristics. These include high time-delay, pronounced nonlinearity, and multivariate coupling, which pose significant challenges for long-term trend modeling and prediction. This paper addresses the challenge of long sequence time-series forecasting (LSTF) for electricity consumption in the cement calcination process by proposing a predictive model, MSTFormer. It integrates multi-channel time-series inputs with a spatio-temporal self-attention mechanism. The model first preprocesses the raw electricity consumption signals using variational modal decomposition. It then constructs a parallel multi-channel time-series input structure based on a weighted mechanism, effectively enhancing long-term dependency modeling capabilities. Subsequently, a novel spatiotemporal ProbSparse self-attention mechanism is designed, combining spatio-temporal embedding and causal convolution to adaptively extract global trends and local dynamic features, thereby enhancing the model’s ability to capture complex time-series patterns. Experimental results on actual cement production datasets demonstrate that MSTFormer outperforms mainstream long-sequence forecasting models across various prediction lengths. Compared with other decomposition methods, VMD-based decomposition reduces prediction errors by over 30%. For 15-minute prediction length, the model achieves an MAE of 0.063 and R2 of 0.991. Even at 60-minute length, it improves prediction accuracy by over 24%. This study provides an effective approach for intelligent scheduling and energy optimization, offering theoretical and practical value for enhancing industrial energy efficiency.
期刊介绍:
Chemical engineering enables the transformation of natural resources and energy into useful products for society. It draws on and applies natural sciences, mathematics and economics, and has developed fundamental engineering science that underpins the discipline.
Chemical Engineering Science (CES) has been publishing papers on the fundamentals of chemical engineering since 1951. CES is the platform where the most significant advances in the discipline have ever since been published. Chemical Engineering Science has accompanied and sustained chemical engineering through its development into the vibrant and broad scientific discipline it is today.