机器学习中未标记和不平衡数据挑战:策略和解决方案综述

Neethu M S, Vinod Chandra S S
{"title":"机器学习中未标记和不平衡数据挑战:策略和解决方案综述","authors":"Neethu M S, Vinod Chandra S S","doi":"10.1002/widm.70043","DOIUrl":null,"url":null,"abstract":"Machine learning models often face significant challenges while dealing with imbalanced and unlabeled datasets. Addressing these issues is resource‐intensive, requiring comprehensive strategies to navigate their individual complexities and compounded effects. This article explores the dual challenges imposed by class imbalance and the absence of labeled data, along with their individual complexities and combined effects on the performance of the model. This study addresses approaches for handling the imbalance problem in datasets, such as data‐level, algorithm‐level, and deep learning methods. The survey also examines hybrid methodologies that integrate these strategies to tackle the compounded issues effectively. Emerging techniques like Bayesian graph‐based learning, uncertainty‐guided semi‐supervised learning, and self‐supervised approaches are also considered for their potential to address the scalability, noise filtering, and generalization challenges associated with imbalanced and unlabeled datasets. It identified persistent gaps, such as the lack of robust evaluation metrics and the underutilization of dynamic feature extraction techniques, suggesting solutions with advanced machine learning approaches. Additionally, the need for adaptive techniques, such as dynamic class weighting and data‐driven filtering mechanisms, is highlighted to address limitations and improve the scalability of machine learning models in real‐world applications.This article is categorized under: <jats:list list-type=\"simple\"> <jats:list-item>Technologies &gt; Machine Learning</jats:list-item> <jats:list-item>Technologies &gt; Classification</jats:list-item> <jats:list-item>Technologies &gt; Artificial Intelligence</jats:list-item> </jats:list>","PeriodicalId":501013,"journal":{"name":"WIREs Data Mining and Knowledge Discovery","volume":"53 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2025-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Review of Unlabeled and Imbalanced Data Challenges in Machine Learning: Strategies and Solutions\",\"authors\":\"Neethu M S, Vinod Chandra S S\",\"doi\":\"10.1002/widm.70043\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Machine learning models often face significant challenges while dealing with imbalanced and unlabeled datasets. Addressing these issues is resource‐intensive, requiring comprehensive strategies to navigate their individual complexities and compounded effects. This article explores the dual challenges imposed by class imbalance and the absence of labeled data, along with their individual complexities and combined effects on the performance of the model. This study addresses approaches for handling the imbalance problem in datasets, such as data‐level, algorithm‐level, and deep learning methods. The survey also examines hybrid methodologies that integrate these strategies to tackle the compounded issues effectively. Emerging techniques like Bayesian graph‐based learning, uncertainty‐guided semi‐supervised learning, and self‐supervised approaches are also considered for their potential to address the scalability, noise filtering, and generalization challenges associated with imbalanced and unlabeled datasets. It identified persistent gaps, such as the lack of robust evaluation metrics and the underutilization of dynamic feature extraction techniques, suggesting solutions with advanced machine learning approaches. Additionally, the need for adaptive techniques, such as dynamic class weighting and data‐driven filtering mechanisms, is highlighted to address limitations and improve the scalability of machine learning models in real‐world applications.This article is categorized under: <jats:list list-type=\\\"simple\\\"> <jats:list-item>Technologies &gt; Machine Learning</jats:list-item> <jats:list-item>Technologies &gt; Classification</jats:list-item> <jats:list-item>Technologies &gt; Artificial Intelligence</jats:list-item> </jats:list>\",\"PeriodicalId\":501013,\"journal\":{\"name\":\"WIREs Data Mining and Knowledge Discovery\",\"volume\":\"53 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-08-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"WIREs Data Mining and Knowledge Discovery\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1002/widm.70043\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"WIREs Data Mining and Knowledge Discovery","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1002/widm.70043","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

机器学习模型在处理不平衡和未标记的数据集时经常面临重大挑战。解决这些问题是资源密集型的,需要综合的策略来应对它们的个体复杂性和复合效应。本文探讨了类不平衡和缺乏标记数据所带来的双重挑战,以及它们各自的复杂性和对模型性能的综合影响。本研究解决了处理数据集不平衡问题的方法,如数据级、算法级和深度学习方法。该调查还考察了将这些策略整合起来以有效解决复杂问题的混合方法。新兴技术,如基于贝叶斯图的学习、不确定性引导的半监督学习和自监督方法,也被认为具有解决与不平衡和未标记数据集相关的可扩展性、噪声过滤和泛化挑战的潜力。它确定了持续存在的差距,例如缺乏稳健的评估指标和动态特征提取技术的利用不足,并提出了采用先进机器学习方法的解决方案。此外,还强调了对自适应技术的需求,例如动态类加权和数据驱动的过滤机制,以解决现实世界应用中机器学习模型的局限性并提高其可扩展性。本文分类如下:技术>;机器学习技术>;分类技术>;人工智能
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A Review of Unlabeled and Imbalanced Data Challenges in Machine Learning: Strategies and Solutions
Machine learning models often face significant challenges while dealing with imbalanced and unlabeled datasets. Addressing these issues is resource‐intensive, requiring comprehensive strategies to navigate their individual complexities and compounded effects. This article explores the dual challenges imposed by class imbalance and the absence of labeled data, along with their individual complexities and combined effects on the performance of the model. This study addresses approaches for handling the imbalance problem in datasets, such as data‐level, algorithm‐level, and deep learning methods. The survey also examines hybrid methodologies that integrate these strategies to tackle the compounded issues effectively. Emerging techniques like Bayesian graph‐based learning, uncertainty‐guided semi‐supervised learning, and self‐supervised approaches are also considered for their potential to address the scalability, noise filtering, and generalization challenges associated with imbalanced and unlabeled datasets. It identified persistent gaps, such as the lack of robust evaluation metrics and the underutilization of dynamic feature extraction techniques, suggesting solutions with advanced machine learning approaches. Additionally, the need for adaptive techniques, such as dynamic class weighting and data‐driven filtering mechanisms, is highlighted to address limitations and improve the scalability of machine learning models in real‐world applications.This article is categorized under: Technologies > Machine Learning Technologies > Classification Technologies > Artificial Intelligence
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信