{"title":"Uncertainty-Aware Contrastive Learning for deep clustering","authors":"Luyao Chang, Leiting Chen, Chuan Zhou","doi":"10.1016/j.neucom.2025.130568","DOIUrl":null,"url":null,"abstract":"<div><div>Deep clustering aims to group unlabeled data into meaningful clusters by learning discriminative feature representations. However, ambiguous features often lead to noisy representations and inconsistent semantics, limiting improvements in clustering performance. To address this issue, we propose an Uncertainty-Aware Contrastive Learning (UACL) method for deep clustering, which achieves robustness by adaptively restricting the learning of ambiguous features. Specifically, we model pairwise similarity evidence via subjective logic theory, formulating co-cluster probabilities as a Dirichlet distribution to quantify epistemic uncertainty from feature ambiguity. Guided by this uncertainty, we design a dynamic weight-updating strategy that progressively extracts information from potential positives, enhancing the model’s ability to learn discriminative representations and semantically consistent clusters. Furthermore, to enforce attribute consistency, we develop an Attribute Distribution Alignment module that aligns similarity and uncertainty. Extensive experiments on five benchmark datasets demonstrate UACL outperforms current state-of-the-art methods, with an improved ACC of 3.5% for CIFAR-100 and 7.0% for ImageNet-Dogs. The source code is available at: <span><span>https://github.com/YL616/UACL</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"647 ","pages":"Article 130568"},"PeriodicalIF":5.5000,"publicationDate":"2025-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231225012408","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Deep clustering aims to group unlabeled data into meaningful clusters by learning discriminative feature representations. However, ambiguous features often lead to noisy representations and inconsistent semantics, limiting improvements in clustering performance. To address this issue, we propose an Uncertainty-Aware Contrastive Learning (UACL) method for deep clustering, which achieves robustness by adaptively restricting the learning of ambiguous features. Specifically, we model pairwise similarity evidence via subjective logic theory, formulating co-cluster probabilities as a Dirichlet distribution to quantify epistemic uncertainty from feature ambiguity. Guided by this uncertainty, we design a dynamic weight-updating strategy that progressively extracts information from potential positives, enhancing the model’s ability to learn discriminative representations and semantically consistent clusters. Furthermore, to enforce attribute consistency, we develop an Attribute Distribution Alignment module that aligns similarity and uncertainty. Extensive experiments on five benchmark datasets demonstrate UACL outperforms current state-of-the-art methods, with an improved ACC of 3.5% for CIFAR-100 and 7.0% for ImageNet-Dogs. The source code is available at: https://github.com/YL616/UACL.
期刊介绍:
Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.