Minglan Zhang , Linfu Sun , Jing Yang , Yisheng Zou
{"title":"用于少镜头多变量时间序列预测的共享多尺度轻量级卷积生成网络","authors":"Minglan Zhang , Linfu Sun , Jing Yang , Yisheng Zou","doi":"10.1016/j.asoc.2024.112420","DOIUrl":null,"url":null,"abstract":"<div><div>Time series forecasting is an important time series data mining technique. Among them, multivariate time series (MTS) forecasting has received extensive attention in many fields. However, many existing MTS forecasting models usually rely on a large amount of labeled data for model training, and data collection and labeling are difficult in real systems. The insufficient amount of data makes it difficult for the model to fully learn the intrinsic patterns and features of the data, which not only increases the prediction error, but also makes it hard to obtain satisfactory prediction results. To address this challenge, we propose a shared multi-scale lightweight convolution generative (SMLCG) network for few-shot multivariate time series forecasting by using samples generation strategy. The overall goal is to design a shared multi-scale feature generation prediction framework that generates data highly similar to the original sample and enriches the training sample to improve prediction accuracy. Specifically, the MTS is divided into different scales, and the multi-scale feature fusion module is utilized to capture and fuse the MTS information in different spatial dimensions to eliminate the heterogeneity among the data. Then, the key information in the multi-scale features is captured by a lightweight convolution generative network, and the feature weights are dynamically assigned to explore the change information. In addition, a spatio-temporal memory module is designed based on the parameter sharing strategy to capture the spatio-temporal dynamic relationship of sequences by learning the common knowledge in multi-scale features, thus improving the robustness and generalization ability. Through comprehensive experiments on four publicly available datasets and comparisons with other reported models, it is demonstrated that the SMLCG model can efficiently generate approximate samples in the few-shot case and provide excellent prediction results. The architecture of SMLCG serves as a valuable reference for practical solutions to address the few-shot problem in multivariate time series.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"167 ","pages":"Article 112420"},"PeriodicalIF":7.2000,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A shared multi-scale lightweight convolution generative network for few-shot multivariate time series forecasting\",\"authors\":\"Minglan Zhang , Linfu Sun , Jing Yang , Yisheng Zou\",\"doi\":\"10.1016/j.asoc.2024.112420\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Time series forecasting is an important time series data mining technique. Among them, multivariate time series (MTS) forecasting has received extensive attention in many fields. However, many existing MTS forecasting models usually rely on a large amount of labeled data for model training, and data collection and labeling are difficult in real systems. The insufficient amount of data makes it difficult for the model to fully learn the intrinsic patterns and features of the data, which not only increases the prediction error, but also makes it hard to obtain satisfactory prediction results. To address this challenge, we propose a shared multi-scale lightweight convolution generative (SMLCG) network for few-shot multivariate time series forecasting by using samples generation strategy. The overall goal is to design a shared multi-scale feature generation prediction framework that generates data highly similar to the original sample and enriches the training sample to improve prediction accuracy. Specifically, the MTS is divided into different scales, and the multi-scale feature fusion module is utilized to capture and fuse the MTS information in different spatial dimensions to eliminate the heterogeneity among the data. Then, the key information in the multi-scale features is captured by a lightweight convolution generative network, and the feature weights are dynamically assigned to explore the change information. In addition, a spatio-temporal memory module is designed based on the parameter sharing strategy to capture the spatio-temporal dynamic relationship of sequences by learning the common knowledge in multi-scale features, thus improving the robustness and generalization ability. Through comprehensive experiments on four publicly available datasets and comparisons with other reported models, it is demonstrated that the SMLCG model can efficiently generate approximate samples in the few-shot case and provide excellent prediction results. The architecture of SMLCG serves as a valuable reference for practical solutions to address the few-shot problem in multivariate time series.</div></div>\",\"PeriodicalId\":50737,\"journal\":{\"name\":\"Applied Soft Computing\",\"volume\":\"167 \",\"pages\":\"Article 112420\"},\"PeriodicalIF\":7.2000,\"publicationDate\":\"2024-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Soft Computing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1568494624011943\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Soft Computing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1568494624011943","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
A shared multi-scale lightweight convolution generative network for few-shot multivariate time series forecasting
Time series forecasting is an important time series data mining technique. Among them, multivariate time series (MTS) forecasting has received extensive attention in many fields. However, many existing MTS forecasting models usually rely on a large amount of labeled data for model training, and data collection and labeling are difficult in real systems. The insufficient amount of data makes it difficult for the model to fully learn the intrinsic patterns and features of the data, which not only increases the prediction error, but also makes it hard to obtain satisfactory prediction results. To address this challenge, we propose a shared multi-scale lightweight convolution generative (SMLCG) network for few-shot multivariate time series forecasting by using samples generation strategy. The overall goal is to design a shared multi-scale feature generation prediction framework that generates data highly similar to the original sample and enriches the training sample to improve prediction accuracy. Specifically, the MTS is divided into different scales, and the multi-scale feature fusion module is utilized to capture and fuse the MTS information in different spatial dimensions to eliminate the heterogeneity among the data. Then, the key information in the multi-scale features is captured by a lightweight convolution generative network, and the feature weights are dynamically assigned to explore the change information. In addition, a spatio-temporal memory module is designed based on the parameter sharing strategy to capture the spatio-temporal dynamic relationship of sequences by learning the common knowledge in multi-scale features, thus improving the robustness and generalization ability. Through comprehensive experiments on four publicly available datasets and comparisons with other reported models, it is demonstrated that the SMLCG model can efficiently generate approximate samples in the few-shot case and provide excellent prediction results. The architecture of SMLCG serves as a valuable reference for practical solutions to address the few-shot problem in multivariate time series.
期刊介绍:
Applied Soft Computing is an international journal promoting an integrated view of soft computing to solve real life problems.The focus is to publish the highest quality research in application and convergence of the areas of Fuzzy Logic, Neural Networks, Evolutionary Computing, Rough Sets and other similar techniques to address real world complexities.
Applied Soft Computing is a rolling publication: articles are published as soon as the editor-in-chief has accepted them. Therefore, the web site will continuously be updated with new articles and the publication time will be short.