Jihua Ye , Dong Liu , Chao Wang , Huiyuan Huang , Liang Ying , Lei Zhang , Aiwen Jiang
{"title":"CNLA: Collaborative noisy label adaptive learning for facial expression recognition","authors":"Jihua Ye , Dong Liu , Chao Wang , Huiyuan Huang , Liang Ying , Lei Zhang , Aiwen Jiang","doi":"10.1016/j.ins.2025.122436","DOIUrl":null,"url":null,"abstract":"<div><div>Existing in-the-wild facial expression recognition (FER) methods rely heavily on predefined labels to achieve high performance. However, in-the-wild FER datasets contain numerous noisy labels, as the uncertainty of facial expressions arises from ambiguous annotations or inter-similarity. Noisy labels provide misleading supervision for learning, leading to decreased generalization. We propose a Collaborative Noisy Label Adaptive Learning (CNLA) method for FER from a new perspective of sample selection to mitigate label inconsistency. CNLA generates perturbed and mixed samples, using Mixed Samples Correction Loss to capture more precise information from various perturbed samples while learning rich representations. Additional information from the perturbed samples is then used for collaborative training, categorizing samples into learnable and relabeled ones. Finally, CNLA constrains the semantic consistency of facial expressions, allowing the model to focus on expression-related regions. Extensive experiments on synthetic noise and original datasets validate the effectiveness of CNLA, demonstrating performance that surpasses state-of-the-art methods.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"719 ","pages":"Article 122436"},"PeriodicalIF":6.8000,"publicationDate":"2025-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Sciences","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0020025525005687","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Existing in-the-wild facial expression recognition (FER) methods rely heavily on predefined labels to achieve high performance. However, in-the-wild FER datasets contain numerous noisy labels, as the uncertainty of facial expressions arises from ambiguous annotations or inter-similarity. Noisy labels provide misleading supervision for learning, leading to decreased generalization. We propose a Collaborative Noisy Label Adaptive Learning (CNLA) method for FER from a new perspective of sample selection to mitigate label inconsistency. CNLA generates perturbed and mixed samples, using Mixed Samples Correction Loss to capture more precise information from various perturbed samples while learning rich representations. Additional information from the perturbed samples is then used for collaborative training, categorizing samples into learnable and relabeled ones. Finally, CNLA constrains the semantic consistency of facial expressions, allowing the model to focus on expression-related regions. Extensive experiments on synthetic noise and original datasets validate the effectiveness of CNLA, demonstrating performance that surpasses state-of-the-art methods.
期刊介绍:
Informatics and Computer Science Intelligent Systems Applications is an esteemed international journal that focuses on publishing original and creative research findings in the field of information sciences. We also feature a limited number of timely tutorial and surveying contributions.
Our journal aims to cater to a diverse audience, including researchers, developers, managers, strategic planners, graduate students, and anyone interested in staying up-to-date with cutting-edge research in information science, knowledge engineering, and intelligent systems. While readers are expected to share a common interest in information science, they come from varying backgrounds such as engineering, mathematics, statistics, physics, computer science, cell biology, molecular biology, management science, cognitive science, neurobiology, behavioral sciences, and biochemistry.