CNLA: Collaborative noisy label adaptive learning for facial expression recognition

IF 6.8 1区 计算机科学 0 COMPUTER SCIENCE, INFORMATION SYSTEMS
Jihua Ye , Dong Liu , Chao Wang , Huiyuan Huang , Liang Ying , Lei Zhang , Aiwen Jiang
{"title":"CNLA: Collaborative noisy label adaptive learning for facial expression recognition","authors":"Jihua Ye ,&nbsp;Dong Liu ,&nbsp;Chao Wang ,&nbsp;Huiyuan Huang ,&nbsp;Liang Ying ,&nbsp;Lei Zhang ,&nbsp;Aiwen Jiang","doi":"10.1016/j.ins.2025.122436","DOIUrl":null,"url":null,"abstract":"<div><div>Existing in-the-wild facial expression recognition (FER) methods rely heavily on predefined labels to achieve high performance. However, in-the-wild FER datasets contain numerous noisy labels, as the uncertainty of facial expressions arises from ambiguous annotations or inter-similarity. Noisy labels provide misleading supervision for learning, leading to decreased generalization. We propose a Collaborative Noisy Label Adaptive Learning (CNLA) method for FER from a new perspective of sample selection to mitigate label inconsistency. CNLA generates perturbed and mixed samples, using Mixed Samples Correction Loss to capture more precise information from various perturbed samples while learning rich representations. Additional information from the perturbed samples is then used for collaborative training, categorizing samples into learnable and relabeled ones. Finally, CNLA constrains the semantic consistency of facial expressions, allowing the model to focus on expression-related regions. Extensive experiments on synthetic noise and original datasets validate the effectiveness of CNLA, demonstrating performance that surpasses state-of-the-art methods.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"719 ","pages":"Article 122436"},"PeriodicalIF":6.8000,"publicationDate":"2025-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Sciences","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0020025525005687","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Existing in-the-wild facial expression recognition (FER) methods rely heavily on predefined labels to achieve high performance. However, in-the-wild FER datasets contain numerous noisy labels, as the uncertainty of facial expressions arises from ambiguous annotations or inter-similarity. Noisy labels provide misleading supervision for learning, leading to decreased generalization. We propose a Collaborative Noisy Label Adaptive Learning (CNLA) method for FER from a new perspective of sample selection to mitigate label inconsistency. CNLA generates perturbed and mixed samples, using Mixed Samples Correction Loss to capture more precise information from various perturbed samples while learning rich representations. Additional information from the perturbed samples is then used for collaborative training, categorizing samples into learnable and relabeled ones. Finally, CNLA constrains the semantic consistency of facial expressions, allowing the model to focus on expression-related regions. Extensive experiments on synthetic noise and original datasets validate the effectiveness of CNLA, demonstrating performance that surpasses state-of-the-art methods.

Abstract Image

CNLA:面部表情识别的协同噪声标签自适应学习
现有的野外面部表情识别方法在很大程度上依赖于预定义的标签来实现高性能。然而,在野外的FER数据集包含大量的噪声标签,因为面部表情的不确定性来自于模糊的注释或内部相似性。噪声标签为学习提供了误导性的监督,导致泛化降低。本文从样本选择的新角度提出了一种基于噪声标签自适应学习(CNLA)的FER算法,以缓解标签不一致性。CNLA生成扰动和混合样本,使用混合样本校正损失从各种扰动样本中捕获更精确的信息,同时学习丰富的表征。然后,来自扰动样本的附加信息用于协作训练,将样本分类为可学习的和重新标记的样本。最后,CNLA约束了面部表情的语义一致性,使模型能够专注于与表情相关的区域。在合成噪声和原始数据集上进行的大量实验验证了CNLA的有效性,证明其性能优于最先进的方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Information Sciences
Information Sciences 工程技术-计算机:信息系统
CiteScore
14.00
自引率
17.30%
发文量
1322
审稿时长
10.4 months
期刊介绍: Informatics and Computer Science Intelligent Systems Applications is an esteemed international journal that focuses on publishing original and creative research findings in the field of information sciences. We also feature a limited number of timely tutorial and surveying contributions. Our journal aims to cater to a diverse audience, including researchers, developers, managers, strategic planners, graduate students, and anyone interested in staying up-to-date with cutting-edge research in information science, knowledge engineering, and intelligent systems. While readers are expected to share a common interest in information science, they come from varying backgrounds such as engineering, mathematics, statistics, physics, computer science, cell biology, molecular biology, management science, cognitive science, neurobiology, behavioral sciences, and biochemistry.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信