Application of Explainable Artificial Intelligence (XAI) Techniques in Patients With Intracranial Hemorrhage: A Systematic Review

Intracranial hemorrhage (IH) is a critical condition requiring rapid and accurate diagnosis to ensure effective treatment and reduce mortality rates. Recently, artificial intelligence (AI) models have demonstrated significant potential in automating the detection and analysis of brain injuries in IH patients. However, the “black‐box” nature of many AI systems raises concerns about transparency, reliability, and clinical applicability. Explainable AI (XAI) addresses these challenges by making AI models more interpretable, allowing healthcare professionals to understand and trust the decision‐making processes. This review paper explores various XAI techniques—such as SHapley Additive exPlanations (SHAP), Local Interpretable Model‐Agnostic Explanations (LIME), Randomized Input Sampling for Explanation (RISE), Class Activation Mapping (CAM), and its variants—and their specific applications in IH clinical tasks. We systematically examine studies incorporating XAI for curing IH patients, highlighting how these methods enhance model transparency and support clinical decision‐making. The Preferred Reporting Items for Systematic Reviews and Meta‐Analyses (PRISMA) methodology was employed to select the papers. Studies are categorized into those using tabular data and those using image data. The literature indicates a rapidly growing number of XAI publications in this field. SHAP is the most commonly used XAI method for tabular data, while CAM‐based methods, such as Grad‐CAM, dominate in image‐based applications. Furthermore, we discuss current limitations of XAI methods and future research directions. This review aims to provide researchers and clinicians with valuable insights into the role of XAI in improving the reliability and practical integration of AI‐driven tools for IH patient care.This article is categorized under: Application Areas > Health Care Fundamental Concepts of Data and Knowledge > Explainable AI Technologies > Machine Learning