Chao Lian , Yafeng Kang , Wenjing Li , Dongyu Zhou , Tianang Sun , Xiaoyong Lyu , Yuliang Zhao
{"title":"MVFusion-TSC: A multi-view fusion image-based network for time series classification","authors":"Chao Lian , Yafeng Kang , Wenjing Li , Dongyu Zhou , Tianang Sun , Xiaoyong Lyu , Yuliang Zhao","doi":"10.1016/j.inffus.2025.103458","DOIUrl":null,"url":null,"abstract":"<div><div>Time series classification (TSC) is a supervised task that aims to categorize time series data into predefined classes by identifying meaningful patterns within their temporal structure. Current methods face numerous challenges in handling time-dependent modeling, capturing long- and short-term relationships, and feature extraction. To address these issues, we propose a time series classification framework, MVFusion-TSC, based on multi-view fusion image representation (MVFI) and a dual-branch feature fusion network (DFFNet). This framework uses the MVFI method to simultaneously encode local texture variations and global structural trends, and uses DFFNet, where one branch focuses on fine-grained local patterns while the other captures holistic temporal structures, effectively revealing and extracting both short- and long-term temporal dependencies. First, MVFI method is employed to convert time series data into multi-view fusion (MVF) images that integrate structural, color, and texture information. This enables the time-varying amplitude features of time-series data to be represented as structural and texture patterns in images, which better capture temporal dependencies and improve the performance of deep learning models. Secondly, DFFNet network is constructed, including a local feature extraction branch, a global feature extraction branch, and a gating fusion module, to achieve the extraction, fusion, and classification of both global and local temporal dependency features. Experiments on 25 benchmark time-series datasets show that the proposed method outperforms the current state-of-the-art methods in key metrics such as accuracy, win rate, and ranking, verifying its effectiveness and advantages in time-series classification tasks. The proposed method can provide a new research perspective for time-series classification, with significant theoretical value and practical application potential.</div></div>","PeriodicalId":50367,"journal":{"name":"Information Fusion","volume":"125 ","pages":"Article 103458"},"PeriodicalIF":15.5000,"publicationDate":"2025-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Fusion","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1566253525005317","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Time series classification (TSC) is a supervised task that aims to categorize time series data into predefined classes by identifying meaningful patterns within their temporal structure. Current methods face numerous challenges in handling time-dependent modeling, capturing long- and short-term relationships, and feature extraction. To address these issues, we propose a time series classification framework, MVFusion-TSC, based on multi-view fusion image representation (MVFI) and a dual-branch feature fusion network (DFFNet). This framework uses the MVFI method to simultaneously encode local texture variations and global structural trends, and uses DFFNet, where one branch focuses on fine-grained local patterns while the other captures holistic temporal structures, effectively revealing and extracting both short- and long-term temporal dependencies. First, MVFI method is employed to convert time series data into multi-view fusion (MVF) images that integrate structural, color, and texture information. This enables the time-varying amplitude features of time-series data to be represented as structural and texture patterns in images, which better capture temporal dependencies and improve the performance of deep learning models. Secondly, DFFNet network is constructed, including a local feature extraction branch, a global feature extraction branch, and a gating fusion module, to achieve the extraction, fusion, and classification of both global and local temporal dependency features. Experiments on 25 benchmark time-series datasets show that the proposed method outperforms the current state-of-the-art methods in key metrics such as accuracy, win rate, and ranking, verifying its effectiveness and advantages in time-series classification tasks. The proposed method can provide a new research perspective for time-series classification, with significant theoretical value and practical application potential.
期刊介绍:
Information Fusion serves as a central platform for showcasing advancements in multi-sensor, multi-source, multi-process information fusion, fostering collaboration among diverse disciplines driving its progress. It is the leading outlet for sharing research and development in this field, focusing on architectures, algorithms, and applications. Papers dealing with fundamental theoretical analyses as well as those demonstrating their application to real-world problems will be welcome.