CTW: Confident Time-Warping for Time-Series Label-Noise Learning

Peitian Ma, Zhen Liu, Junhao Zheng, Linghao Wang, Qianli Ma
{"title":"CTW: Confident Time-Warping for Time-Series Label-Noise Learning","authors":"Peitian Ma, Zhen Liu, Junhao Zheng, Linghao Wang, Qianli Ma","doi":"10.24963/ijcai.2023/450","DOIUrl":null,"url":null,"abstract":"Noisy labels seriously degrade the generalization ability of Deep Neural Networks (DNNs) in various classification tasks. Existing studies on label-noise learning mainly focus on computer vision, while time series also suffer from the same issue. Directly applying the methods from computer vision to time series may reduce the temporal dependency due to different data characteristics. How to make use of the properties of time series to enable DNNs to learn robust representations in the presence of noisy labels has not been fully explored. To this end, this paper proposes a method that expands the distribution of Confident instances by Time-Warping (CTW) to learn robust representations of time series. Specifically, since applying the augmentation method to all data may introduce extra mislabeled data, we select confident instances to implement Time-Warping. In addition, we normalize the distribution of the training loss of each class to eliminate the model's selection preference for instances of different classes, alleviating the class imbalance caused by sample selection. Extensive experimental results show that CTW achieves state-of-the-art performance on the UCR datasets when dealing with different types of noise. Besides, the t-SNE visualization of our method verifies that augmenting confident data improves the generalization ability. Our code is available at https://github.com/qianlima-lab/CTW.","PeriodicalId":394530,"journal":{"name":"International Joint Conference on Artificial Intelligence","volume":"38 2","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Joint Conference on Artificial Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.24963/ijcai.2023/450","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Noisy labels seriously degrade the generalization ability of Deep Neural Networks (DNNs) in various classification tasks. Existing studies on label-noise learning mainly focus on computer vision, while time series also suffer from the same issue. Directly applying the methods from computer vision to time series may reduce the temporal dependency due to different data characteristics. How to make use of the properties of time series to enable DNNs to learn robust representations in the presence of noisy labels has not been fully explored. To this end, this paper proposes a method that expands the distribution of Confident instances by Time-Warping (CTW) to learn robust representations of time series. Specifically, since applying the augmentation method to all data may introduce extra mislabeled data, we select confident instances to implement Time-Warping. In addition, we normalize the distribution of the training loss of each class to eliminate the model's selection preference for instances of different classes, alleviating the class imbalance caused by sample selection. Extensive experimental results show that CTW achieves state-of-the-art performance on the UCR datasets when dealing with different types of noise. Besides, the t-SNE visualization of our method verifies that augmenting confident data improves the generalization ability. Our code is available at https://github.com/qianlima-lab/CTW.
时间序列标签噪声学习的自信时间翘曲
噪声标签严重降低了深度神经网络在各种分类任务中的泛化能力。现有的标签噪声学习研究主要集中在计算机视觉上,时间序列也存在同样的问题。将计算机视觉方法直接应用于时间序列,可以减少由于数据特征不同而产生的时间依赖性。如何利用时间序列的特性使dnn在有噪声标签的情况下学习鲁棒表征还没有得到充分的探讨。为此,本文提出了一种利用时间扭曲(time - warping, CTW)扩展可信实例分布的方法来学习时间序列的鲁棒表示。具体来说,由于对所有数据应用增强方法可能会引入额外的错误标记数据,因此我们选择确信实例来实现时间扭曲。此外,我们对每个类别的训练损失分布进行归一化,消除模型对不同类别实例的选择偏好,缓解样本选择导致的类别失衡。大量的实验结果表明,当处理不同类型的噪声时,CTW在UCR数据集上达到了最先进的性能。此外,我们的方法的t-SNE可视化验证了增加置信数据提高了泛化能力。我们的代码可在https://github.com/qianlima-lab/CTW上获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信