Jinghao Lu , Fan Zhang , Xiaofeng Zhang , Yujuan Sun , Hua Wang
{"title":"MCNR: Multiscale feature-based latent data component extraction linear regression model","authors":"Jinghao Lu , Fan Zhang , Xiaofeng Zhang , Yujuan Sun , Hua Wang","doi":"10.1016/j.eswa.2025.128634","DOIUrl":null,"url":null,"abstract":"<div><div>Time series forecasting is of great significance in various fields and is widely applied in industries such as finance and energy management. However, time series data often contains rich periodic features, and there is a high correlation between these features, with the core trend often being implicit in certain features. Therefore, effectively separating and extracting core information from complex multidimensional data, while avoiding noise interference, has become an urgent problem to be solved. To address this, we propose a multi-scale latent feature extraction model, MCNR, for specific periods. It assigns weighted labels to periodic data points through a backward-weighted periodic module, thereby giving more weight to the periodic points and allowing the model to focus on key periodic features. Another core innovation of the MCNR model is the division of the retrospective window into different scales to capture long-term, mid-term, and short-term time features. For data of different scales, the model uses the Regularized Latent Component Regression (RLC) module for latent component extraction and regularization. By focusing on the correlation between each dimension and the predicted value, it uses principal component analysis to extract linear combinations of multivariate features, thus effectively separating the core regions of the data. This process significantly improves the model’s adaptability to different time series structures. Additionally, MCNR introduces a Multilevel Data Normalization (MDN) module. Through the reversibility of MDN, the model can adapt to the distribution differences of the data, normalizing the features based on the mean and standard deviation of the data, thereby removing the trend and seasonal components from the data and further enhancing the model’s stability, robustness, and generalization ability. Compared to the latest mainstream models, MCNR achieves the same experimental results with only approximately 10k parameters, and in experiments on multiple datasets, the model improved the Mean Squared Error (MSE) by 6.58 %.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"292 ","pages":"Article 128634"},"PeriodicalIF":7.5000,"publicationDate":"2025-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417425022535","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Time series forecasting is of great significance in various fields and is widely applied in industries such as finance and energy management. However, time series data often contains rich periodic features, and there is a high correlation between these features, with the core trend often being implicit in certain features. Therefore, effectively separating and extracting core information from complex multidimensional data, while avoiding noise interference, has become an urgent problem to be solved. To address this, we propose a multi-scale latent feature extraction model, MCNR, for specific periods. It assigns weighted labels to periodic data points through a backward-weighted periodic module, thereby giving more weight to the periodic points and allowing the model to focus on key periodic features. Another core innovation of the MCNR model is the division of the retrospective window into different scales to capture long-term, mid-term, and short-term time features. For data of different scales, the model uses the Regularized Latent Component Regression (RLC) module for latent component extraction and regularization. By focusing on the correlation between each dimension and the predicted value, it uses principal component analysis to extract linear combinations of multivariate features, thus effectively separating the core regions of the data. This process significantly improves the model’s adaptability to different time series structures. Additionally, MCNR introduces a Multilevel Data Normalization (MDN) module. Through the reversibility of MDN, the model can adapt to the distribution differences of the data, normalizing the features based on the mean and standard deviation of the data, thereby removing the trend and seasonal components from the data and further enhancing the model’s stability, robustness, and generalization ability. Compared to the latest mainstream models, MCNR achieves the same experimental results with only approximately 10k parameters, and in experiments on multiple datasets, the model improved the Mean Squared Error (MSE) by 6.58 %.
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.