Challenges and recent advances in methods for handling imbalanced multiclass classification problems: a methodological review.

IF 3.7 3区 医学 Q1 HEALTH CARE SCIENCES & SERVICES
Sachin Acharya, Satyanarayana Poojari, Vani Lakshmi R, Asha Kamath
{"title":"Challenges and recent advances in methods for handling imbalanced multiclass classification problems: a methodological review.","authors":"Sachin Acharya, Satyanarayana Poojari, Vani Lakshmi R, Asha Kamath","doi":"10.1186/s12874-026-02899-w","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Class imbalance is a common challenge in real-world health science applications, including medical diagnosis, rare disease detection, and ICU mortality prediction, where one or more classes are underrepresented. Although several methods address imbalance in binary classification, multiclass imbalance remains particularly challenging due to multiple minority classes, often leading to biased performance and reduced predictive accuracy. Despite several advancements, most classification models struggle to identify patterns in imbalanced data, limiting their effectiveness in real-world applications.</p><p><strong>Methods: </strong>A structured literature search was conducted to identify methodological studies on imbalanced multiclass classification, including algorithmic strategies and advances in performance evaluation. Articles published up to 2024 were retrieved from Scopus and Web of Science using predefined keywords. Studies were screened through titles and abstracts based on predefined inclusion and exclusion criteria, with additional backward citation searching for methodologically relevant studies. In total, 75 studies were included in the final methodological review to synthesize key challenges and recent advances.</p><p><strong>Results: </strong>Despite the introduction of several metrics for assessing multiclass imbalance, the Imbalance Ratio (IR) remains the most commonly used measure for quantifying imbalance severity. Existing balancing techniques mainly rely on distance-based, cluster-based, and distribution-based approaches, reflecting methodological diversity. In multiclass settings, various decomposition strategies, classification algorithms, and performance metrics have been proposed to address imbalance; however, repeated use of imbalance-handling mechanisms, such as class weight adjustments across decomposition, training, and evaluation stages, may introduce bias. The effectiveness of these strategies depends on data characteristics including dimensionality, sample size, distribution, number of classes, and imbalance severity. Notably, insufficient reporting of these characteristics in many studies limits the assessment of feasibility and generalizability across diverse data settings.</p><p><strong>Conclusions: </strong>This review synthesizes the strengths and limitations of existing methods for handling imbalanced multiclass classification, offering practical insights for improving model robustness and predictive performance. Effective management of class imbalance supports several Sustainable Development Goals by promoting equitable decision-making and enhancing reliable analysis across diverse health, societal, and environmental challenges, making it essential for developing robust and generalizable models across diverse domains.</p>","PeriodicalId":9114,"journal":{"name":"BMC Medical Research Methodology","volume":" ","pages":""},"PeriodicalIF":3.7000,"publicationDate":"2026-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13536707/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Medical Research Methodology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12874-026-02899-w","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Class imbalance is a common challenge in real-world health science applications, including medical diagnosis, rare disease detection, and ICU mortality prediction, where one or more classes are underrepresented. Although several methods address imbalance in binary classification, multiclass imbalance remains particularly challenging due to multiple minority classes, often leading to biased performance and reduced predictive accuracy. Despite several advancements, most classification models struggle to identify patterns in imbalanced data, limiting their effectiveness in real-world applications.

Methods: A structured literature search was conducted to identify methodological studies on imbalanced multiclass classification, including algorithmic strategies and advances in performance evaluation. Articles published up to 2024 were retrieved from Scopus and Web of Science using predefined keywords. Studies were screened through titles and abstracts based on predefined inclusion and exclusion criteria, with additional backward citation searching for methodologically relevant studies. In total, 75 studies were included in the final methodological review to synthesize key challenges and recent advances.

Results: Despite the introduction of several metrics for assessing multiclass imbalance, the Imbalance Ratio (IR) remains the most commonly used measure for quantifying imbalance severity. Existing balancing techniques mainly rely on distance-based, cluster-based, and distribution-based approaches, reflecting methodological diversity. In multiclass settings, various decomposition strategies, classification algorithms, and performance metrics have been proposed to address imbalance; however, repeated use of imbalance-handling mechanisms, such as class weight adjustments across decomposition, training, and evaluation stages, may introduce bias. The effectiveness of these strategies depends on data characteristics including dimensionality, sample size, distribution, number of classes, and imbalance severity. Notably, insufficient reporting of these characteristics in many studies limits the assessment of feasibility and generalizability across diverse data settings.

Conclusions: This review synthesizes the strengths and limitations of existing methods for handling imbalanced multiclass classification, offering practical insights for improving model robustness and predictive performance. Effective management of class imbalance supports several Sustainable Development Goals by promoting equitable decision-making and enhancing reliable analysis across diverse health, societal, and environmental challenges, making it essential for developing robust and generalizable models across diverse domains.

处理不平衡多类分类问题方法的挑战与最新进展:方法学综述。
背景:类失衡是现实世界健康科学应用中常见的挑战,包括医学诊断、罕见疾病检测和ICU死亡率预测,其中一个或多个类未被充分代表。尽管有几种方法可以解决二元分类中的不平衡问题,但由于存在多个少数类,多类不平衡仍然具有特别的挑战性,这通常会导致性能偏差和预测准确性降低。尽管取得了一些进展,但大多数分类模型难以识别不平衡数据中的模式,这限制了它们在实际应用程序中的有效性。方法:通过结构化的文献检索,找出非平衡多类分类的方法学研究,包括算法策略和绩效评估的进展。使用预定义的关键词从Scopus和Web of Science检索到截至2024年发表的文章。根据预定义的纳入和排除标准,通过标题和摘要筛选研究,并对方法学上相关的研究进行反向引文搜索。总共有75项研究被纳入最后的方法审查,以综合主要挑战和最近的进展。结果:尽管引入了几种评估多类失衡的指标,但失衡比(IR)仍然是量化失衡严重程度的最常用指标。现有的平衡技术主要依赖于基于距离、基于聚类和基于分布的方法,反映了方法的多样性。在多类设置中,提出了各种分解策略、分类算法和性能指标来解决不平衡问题;然而,反复使用不平衡处理机制,例如跨分解、训练和评估阶段的类权重调整,可能会引入偏差。这些策略的有效性取决于数据特征,包括维度、样本量、分布、类别数量和不平衡严重程度。值得注意的是,许多研究中对这些特征的报道不足,限制了对不同数据设置的可行性和概括性的评估。结论:本文综合了现有处理不平衡多类分类方法的优势和局限性,为提高模型稳健性和预测性能提供了实用的见解。阶级失衡的有效管理通过促进公平决策和加强对各种健康、社会和环境挑战的可靠分析来支持若干可持续发展目标,因此对于开发跨不同领域的健壮且可推广的模型至关重要。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
BMC Medical Research Methodology
BMC Medical Research Methodology 医学-卫生保健
CiteScore
6.50
自引率
2.50%
发文量
298
审稿时长
3-8 weeks
期刊介绍: BMC Medical Research Methodology is an open access journal publishing original peer-reviewed research articles in methodological approaches to healthcare research. Articles on the methodology of epidemiological research, clinical trials and meta-analysis/systematic review are particularly encouraged, as are empirical studies of the associations between choice of methodology and study outcomes. BMC Medical Research Methodology does not aim to publish articles describing scientific methods or techniques: these should be directed to the BMC journal covering the relevant biomedical subject area.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书