MCNR: Multiscale feature-based latent data component extraction linear regression model

IF 7.5 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Jinghao Lu , Fan Zhang , Xiaofeng Zhang , Yujuan Sun , Hua Wang
{"title":"MCNR: Multiscale feature-based latent data component extraction linear regression model","authors":"Jinghao Lu ,&nbsp;Fan Zhang ,&nbsp;Xiaofeng Zhang ,&nbsp;Yujuan Sun ,&nbsp;Hua Wang","doi":"10.1016/j.eswa.2025.128634","DOIUrl":null,"url":null,"abstract":"<div><div>Time series forecasting is of great significance in various fields and is widely applied in industries such as finance and energy management. However, time series data often contains rich periodic features, and there is a high correlation between these features, with the core trend often being implicit in certain features. Therefore, effectively separating and extracting core information from complex multidimensional data, while avoiding noise interference, has become an urgent problem to be solved. To address this, we propose a multi-scale latent feature extraction model, MCNR, for specific periods. It assigns weighted labels to periodic data points through a backward-weighted periodic module, thereby giving more weight to the periodic points and allowing the model to focus on key periodic features. Another core innovation of the MCNR model is the division of the retrospective window into different scales to capture long-term, mid-term, and short-term time features. For data of different scales, the model uses the Regularized Latent Component Regression (RLC) module for latent component extraction and regularization. By focusing on the correlation between each dimension and the predicted value, it uses principal component analysis to extract linear combinations of multivariate features, thus effectively separating the core regions of the data. This process significantly improves the model’s adaptability to different time series structures. Additionally, MCNR introduces a Multilevel Data Normalization (MDN) module. Through the reversibility of MDN, the model can adapt to the distribution differences of the data, normalizing the features based on the mean and standard deviation of the data, thereby removing the trend and seasonal components from the data and further enhancing the model’s stability, robustness, and generalization ability. Compared to the latest mainstream models, MCNR achieves the same experimental results with only approximately 10k parameters, and in experiments on multiple datasets, the model improved the Mean Squared Error (MSE) by 6.58 %.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"292 ","pages":"Article 128634"},"PeriodicalIF":7.5000,"publicationDate":"2025-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417425022535","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Time series forecasting is of great significance in various fields and is widely applied in industries such as finance and energy management. However, time series data often contains rich periodic features, and there is a high correlation between these features, with the core trend often being implicit in certain features. Therefore, effectively separating and extracting core information from complex multidimensional data, while avoiding noise interference, has become an urgent problem to be solved. To address this, we propose a multi-scale latent feature extraction model, MCNR, for specific periods. It assigns weighted labels to periodic data points through a backward-weighted periodic module, thereby giving more weight to the periodic points and allowing the model to focus on key periodic features. Another core innovation of the MCNR model is the division of the retrospective window into different scales to capture long-term, mid-term, and short-term time features. For data of different scales, the model uses the Regularized Latent Component Regression (RLC) module for latent component extraction and regularization. By focusing on the correlation between each dimension and the predicted value, it uses principal component analysis to extract linear combinations of multivariate features, thus effectively separating the core regions of the data. This process significantly improves the model’s adaptability to different time series structures. Additionally, MCNR introduces a Multilevel Data Normalization (MDN) module. Through the reversibility of MDN, the model can adapt to the distribution differences of the data, normalizing the features based on the mean and standard deviation of the data, thereby removing the trend and seasonal components from the data and further enhancing the model’s stability, robustness, and generalization ability. Compared to the latest mainstream models, MCNR achieves the same experimental results with only approximately 10k parameters, and in experiments on multiple datasets, the model improved the Mean Squared Error (MSE) by 6.58 %.
MCNR:基于多尺度特征的潜在数据成分提取线性回归模型
时间序列预测在各个领域都具有重要意义,在金融、能源管理等行业得到了广泛的应用。然而,时间序列数据往往包含丰富的周期性特征,这些特征之间存在高度的相关性,核心趋势往往隐含在某些特征中。因此,如何有效地从复杂多维数据中分离和提取核心信息,同时避免噪声干扰,已成为迫切需要解决的问题。为了解决这个问题,我们提出了一种针对特定时期的多尺度潜在特征提取模型,MCNR。它通过反向加权周期模块为周期数据点分配加权标签,从而赋予周期点更多的权重,使模型能够专注于关键的周期特征。MCNR模型的另一个核心创新是将回顾窗口划分为不同的尺度,以捕捉长期、中期和短期时间特征。对于不同尺度的数据,该模型采用正则化潜成分回归(regularization Latent Component Regression, RLC)模块进行潜成分提取和正则化。通过关注各维度与预测值之间的相关性,利用主成分分析提取多元特征的线性组合,从而有效分离数据的核心区域。这一过程显著提高了模型对不同时间序列结构的适应性。此外,MCNR还引入了多级数据规范化(MDN)模块。通过MDN的可逆性,模型可以适应数据的分布差异,根据数据的均值和标准差对特征进行归一化,从而去除数据中的趋势和季节成分,进一步增强模型的稳定性、鲁棒性和泛化能力。与最新的主流模型相比,MCNR只需要大约10k个参数就可以获得相同的实验结果,并且在多数据集上的实验中,该模型的均方误差(MSE)提高了6.58%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Expert Systems with Applications
Expert Systems with Applications 工程技术-工程:电子与电气
CiteScore
13.80
自引率
10.60%
发文量
2045
审稿时长
8.7 months
期刊介绍: Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信