MVFusion-TSC: A multi-view fusion image-based network for time series classification

IF 15.5 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Chao Lian , Yafeng Kang , Wenjing Li , Dongyu Zhou , Tianang Sun , Xiaoyong Lyu , Yuliang Zhao
{"title":"MVFusion-TSC: A multi-view fusion image-based network for time series classification","authors":"Chao Lian ,&nbsp;Yafeng Kang ,&nbsp;Wenjing Li ,&nbsp;Dongyu Zhou ,&nbsp;Tianang Sun ,&nbsp;Xiaoyong Lyu ,&nbsp;Yuliang Zhao","doi":"10.1016/j.inffus.2025.103458","DOIUrl":null,"url":null,"abstract":"<div><div>Time series classification (TSC) is a supervised task that aims to categorize time series data into predefined classes by identifying meaningful patterns within their temporal structure. Current methods face numerous challenges in handling time-dependent modeling, capturing long- and short-term relationships, and feature extraction. To address these issues, we propose a time series classification framework, MVFusion-TSC, based on multi-view fusion image representation (MVFI) and a dual-branch feature fusion network (DFFNet). This framework uses the MVFI method to simultaneously encode local texture variations and global structural trends, and uses DFFNet, where one branch focuses on fine-grained local patterns while the other captures holistic temporal structures, effectively revealing and extracting both short- and long-term temporal dependencies. First, MVFI method is employed to convert time series data into multi-view fusion (MVF) images that integrate structural, color, and texture information. This enables the time-varying amplitude features of time-series data to be represented as structural and texture patterns in images, which better capture temporal dependencies and improve the performance of deep learning models. Secondly, DFFNet network is constructed, including a local feature extraction branch, a global feature extraction branch, and a gating fusion module, to achieve the extraction, fusion, and classification of both global and local temporal dependency features. Experiments on 25 benchmark time-series datasets show that the proposed method outperforms the current state-of-the-art methods in key metrics such as accuracy, win rate, and ranking, verifying its effectiveness and advantages in time-series classification tasks. The proposed method can provide a new research perspective for time-series classification, with significant theoretical value and practical application potential.</div></div>","PeriodicalId":50367,"journal":{"name":"Information Fusion","volume":"125 ","pages":"Article 103458"},"PeriodicalIF":15.5000,"publicationDate":"2025-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Fusion","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1566253525005317","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Time series classification (TSC) is a supervised task that aims to categorize time series data into predefined classes by identifying meaningful patterns within their temporal structure. Current methods face numerous challenges in handling time-dependent modeling, capturing long- and short-term relationships, and feature extraction. To address these issues, we propose a time series classification framework, MVFusion-TSC, based on multi-view fusion image representation (MVFI) and a dual-branch feature fusion network (DFFNet). This framework uses the MVFI method to simultaneously encode local texture variations and global structural trends, and uses DFFNet, where one branch focuses on fine-grained local patterns while the other captures holistic temporal structures, effectively revealing and extracting both short- and long-term temporal dependencies. First, MVFI method is employed to convert time series data into multi-view fusion (MVF) images that integrate structural, color, and texture information. This enables the time-varying amplitude features of time-series data to be represented as structural and texture patterns in images, which better capture temporal dependencies and improve the performance of deep learning models. Secondly, DFFNet network is constructed, including a local feature extraction branch, a global feature extraction branch, and a gating fusion module, to achieve the extraction, fusion, and classification of both global and local temporal dependency features. Experiments on 25 benchmark time-series datasets show that the proposed method outperforms the current state-of-the-art methods in key metrics such as accuracy, win rate, and ranking, verifying its effectiveness and advantages in time-series classification tasks. The proposed method can provide a new research perspective for time-series classification, with significant theoretical value and practical application potential.
MVFusion-TSC:一种基于多视图融合图像的时间序列分类网络
时间序列分类(TSC)是一种监督任务,旨在通过识别时间序列数据的时间结构中有意义的模式,将时间序列数据分类为预定义的类。当前的方法在处理时间依赖的建模、捕获长期和短期关系以及特征提取方面面临着许多挑战。为了解决这些问题,我们提出了一种基于多视图融合图像表示(MVFI)和双分支特征融合网络(DFFNet)的时间序列分类框架MVFusion-TSC。该框架使用MVFI方法同时编码局部纹理变化和全局结构趋势,并使用DFFNet,其中一个分支专注于细粒度的局部模式,而另一个分支捕获整体时间结构,有效地揭示和提取短期和长期时间依赖性。首先,采用MVFI方法将时间序列数据转换成融合了结构、颜色和纹理信息的多视图融合(MVF)图像;这使得时间序列数据的时变幅度特征可以表示为图像中的结构和纹理模式,从而更好地捕获时间依赖性并提高深度学习模型的性能。其次,构建DFFNet网络,包括局部特征提取分支、全局特征提取分支和门控融合模块,实现全局和局部时间依赖特征的提取、融合和分类;在25个基准时间序列数据集上的实验表明,该方法在准确率、胜率和排名等关键指标上都优于当前最先进的方法,验证了其在时间序列分类任务中的有效性和优势。该方法为时间序列分类提供了一个新的研究视角,具有重要的理论价值和实际应用潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Information Fusion
Information Fusion 工程技术-计算机:理论方法
CiteScore
33.20
自引率
4.30%
发文量
161
审稿时长
7.9 months
期刊介绍: Information Fusion serves as a central platform for showcasing advancements in multi-sensor, multi-source, multi-process information fusion, fostering collaboration among diverse disciplines driving its progress. It is the leading outlet for sharing research and development in this field, focusing on architectures, algorithms, and applications. Papers dealing with fundamental theoretical analyses as well as those demonstrating their application to real-world problems will be welcome.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信