Robust learning with time series noisy labels via self-supervised learning and soft labels refurbishment

IF 6.7 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Neurocomputing Pub Date : 2026-05-01 Epub Date: 2026-02-16 DOI:10.1016/j.neucom.2026.133059
Jiarong Liu , Kaixiang Yang , Jian He , Chengrong Yang , Shuang-hua Yang , Yujue Zhou
{"title":"Robust learning with time series noisy labels via self-supervised learning and soft labels refurbishment","authors":"Jiarong Liu ,&nbsp;Kaixiang Yang ,&nbsp;Jian He ,&nbsp;Chengrong Yang ,&nbsp;Shuang-hua Yang ,&nbsp;Yujue Zhou","doi":"10.1016/j.neucom.2026.133059","DOIUrl":null,"url":null,"abstract":"<div><div>Label noise significantly degrades the generalization performance of Deep Neural Networks (DNNs). While Learning with Noisy Labels (LNL) is well-established in computer vision, its application to time-series data presents unique challenges: (1) Feature extraction in supervised learning is corrupted by noisy labels, as the critical assumption that clean samples yield lower loss than noisy ones is frequently violated. This leads to learned representations with poor class separability and ambiguous boundaries, which degrades downstream task performance. (2) Conventional soft-labeling methods generate soft-labels from a single training epoch, ignoring historical and cross-model information. This often leads to unstable supervision and inconsistent soft-labels. To address these challenges, this paper proposes the Robust Representation Learning Network (RoRLNet) for noisy time-series classification. RoRLNet employs a two-stage robust learning paradigm that decouples feature extraction from classifier training. In the first stage, it learns noise-robust spatio-temporal representations by integrating MixDecomposition, a data augmentation strategy based on trend-seasonality decomposition, with MSSFE, a multi-scale self-supervised feature extractor. In the second stage, it trains the classifier using EnBootstrap, a soft-label correction module that stabilizes supervision by ensembling predictions from multiple models and historical epochs. Extensive experiments on multiple benchmarks under diverse noise conditions demonstrate that RoRLNet consistently outperforms state-of-the-art methods, by 7.76%. The source code is available at: <span><span>https://github.com/JingGu-hub/RoRLNet</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"676 ","pages":"Article 133059"},"PeriodicalIF":6.7000,"publicationDate":"2026-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S092523122600456X","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/2/16 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Label noise significantly degrades the generalization performance of Deep Neural Networks (DNNs). While Learning with Noisy Labels (LNL) is well-established in computer vision, its application to time-series data presents unique challenges: (1) Feature extraction in supervised learning is corrupted by noisy labels, as the critical assumption that clean samples yield lower loss than noisy ones is frequently violated. This leads to learned representations with poor class separability and ambiguous boundaries, which degrades downstream task performance. (2) Conventional soft-labeling methods generate soft-labels from a single training epoch, ignoring historical and cross-model information. This often leads to unstable supervision and inconsistent soft-labels. To address these challenges, this paper proposes the Robust Representation Learning Network (RoRLNet) for noisy time-series classification. RoRLNet employs a two-stage robust learning paradigm that decouples feature extraction from classifier training. In the first stage, it learns noise-robust spatio-temporal representations by integrating MixDecomposition, a data augmentation strategy based on trend-seasonality decomposition, with MSSFE, a multi-scale self-supervised feature extractor. In the second stage, it trains the classifier using EnBootstrap, a soft-label correction module that stabilizes supervision by ensembling predictions from multiple models and historical epochs. Extensive experiments on multiple benchmarks under diverse noise conditions demonstrate that RoRLNet consistently outperforms state-of-the-art methods, by 7.76%. The source code is available at: https://github.com/JingGu-hub/RoRLNet.
基于自监督学习和软标签翻新的时间序列噪声标签鲁棒学习
标签噪声显著降低了深度神经网络(dnn)的泛化性能。虽然带有噪声标签的学习(LNL)在计算机视觉中已经得到了很好的应用,但它在时间序列数据中的应用面临着独特的挑战:(1)监督学习中的特征提取受到噪声标签的破坏,因为干净样本的损失低于噪声样本的关键假设经常被违反。这将导致学习到的表示具有较差的类可分离性和模糊的边界,从而降低下游任务的性能。(2)传统的软标签方法从单个训练历元生成软标签,忽略了历史和跨模型信息。这往往导致不稳定的监督和不一致的软标签。为了解决这些挑战,本文提出了用于噪声时间序列分类的鲁棒表示学习网络(RoRLNet)。RoRLNet采用两阶段鲁棒学习范式,将特征提取与分类器训练分离。在第一阶段,它通过集成MixDecomposition(一种基于趋势季节性分解的数据增强策略)和MSSFE(一种多尺度自监督特征提取器)来学习抗噪声时空表示。在第二阶段,它使用EnBootstrap训练分类器,这是一个软标签校正模块,通过集成来自多个模型和历史时代的预测来稳定监督。在不同噪声条件下的多个基准测试中进行的大量实验表明,RoRLNet的性能始终优于最先进的方法,达到7.76%。源代码可从https://github.com/JingGu-hub/RoRLNet获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Neurocomputing
Neurocomputing 工程技术-计算机:人工智能
CiteScore
13.10
自引率
10.00%
发文量
1382
审稿时长
70 days
期刊介绍: Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书