{"title":"Toward integrated multimodal artificial intelligence in bone marrow examination: current state and open challenges.","authors":"Seung Yeob Lee","doi":"10.1007/s44313-026-00177-8","DOIUrl":null,"url":null,"abstract":"<p><p>Bone marrow (BM) examinations are intrinsically multimodal: hematopathologists integrate peripheral blood, aspirate cytomorphology, trephine histology, flow cytometry, cytogenetics, and molecular genetics data into a single interpretation. Because WHO-HAEM5 and ICC 2022 define entities through integrated morphological, immunophenotypic, cytogenetic, and molecular criteria, multimodal diagnostic reasoning embedded in a procedural workflow, not isolated image classification, represents the appropriate target for the use of artificial intelligence (AI). We review the existing research on integrated multimodal AI systems for BM examination by classifying these systems into three categories: mature single-modality tools; systems that perform cross-modal prediction, in which one modality is estimated from another; and genuine multimodal fusion systems, in which several modalities are jointly ingested by a single model. Evidence is stronger at the single-modality level, where deep learning approaches expert performance in aspirate cytology, trephine histology, and flow cytometry assessments, and the first Food and Drug Administration (FDA) De Novo-authorized all-digital bone marrow aspirate (BMA) application has defined a new device category. On the other hand, while cross-modal prediction is rapidly expanding, genuine multimodal fused systems that jointly ingest matched morphology, flow, molecular, and clinical data to yield unified guideline-aligned recommendations remain unrealized. Direct head-to-head evidence is sparse and endpoint-dependent; nevertheless, the lack of demonstrated superiority over the strongest single-modality comparator does not automatically imply the absence of benefits. The dominant obstacles are fusion of heterogeneous modalities with missing data, absence of large paired multi-institutional datasets and harmonized nomenclature, class imbalances, batch-effect-driven generalization failures, immature explainability, uncertainty quantification, and regulatory pathways. Nevertheless, integrated multimodal AI systems for BM examinations have entered a promising early translational phase, and the field should aim to pursue integration using paired datasets, explicit fusion architectures, calibrated abstention-aware models, and staged prospective validation.</p>","PeriodicalId":46224,"journal":{"name":"Blood Research","volume":"61 1","pages":""},"PeriodicalIF":3.7000,"publicationDate":"2026-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13675459/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Blood Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s44313-026-00177-8","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"HEMATOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Bone marrow (BM) examinations are intrinsically multimodal: hematopathologists integrate peripheral blood, aspirate cytomorphology, trephine histology, flow cytometry, cytogenetics, and molecular genetics data into a single interpretation. Because WHO-HAEM5 and ICC 2022 define entities through integrated morphological, immunophenotypic, cytogenetic, and molecular criteria, multimodal diagnostic reasoning embedded in a procedural workflow, not isolated image classification, represents the appropriate target for the use of artificial intelligence (AI). We review the existing research on integrated multimodal AI systems for BM examination by classifying these systems into three categories: mature single-modality tools; systems that perform cross-modal prediction, in which one modality is estimated from another; and genuine multimodal fusion systems, in which several modalities are jointly ingested by a single model. Evidence is stronger at the single-modality level, where deep learning approaches expert performance in aspirate cytology, trephine histology, and flow cytometry assessments, and the first Food and Drug Administration (FDA) De Novo-authorized all-digital bone marrow aspirate (BMA) application has defined a new device category. On the other hand, while cross-modal prediction is rapidly expanding, genuine multimodal fused systems that jointly ingest matched morphology, flow, molecular, and clinical data to yield unified guideline-aligned recommendations remain unrealized. Direct head-to-head evidence is sparse and endpoint-dependent; nevertheless, the lack of demonstrated superiority over the strongest single-modality comparator does not automatically imply the absence of benefits. The dominant obstacles are fusion of heterogeneous modalities with missing data, absence of large paired multi-institutional datasets and harmonized nomenclature, class imbalances, batch-effect-driven generalization failures, immature explainability, uncertainty quantification, and regulatory pathways. Nevertheless, integrated multimodal AI systems for BM examinations have entered a promising early translational phase, and the field should aim to pursue integration using paired datasets, explicit fusion architectures, calibrated abstention-aware models, and staged prospective validation.
骨髓(BM)检查本质上是多模式的:血液病理学家将外周血、抽吸细胞形态学、环肺组织学、流式细胞术、细胞遗传学和分子遗传学数据整合到一个单一的解释中。由于WHO-HAEM5和ICC 2022通过综合形态学、免疫表型、细胞遗传学和分子标准来定义实体,因此嵌入在程序性工作流程中的多模式诊断推理,而不是孤立的图像分类,是使用人工智能(AI)的适当目标。我们回顾了用于BM检查的集成多模态人工智能系统的现有研究,并将这些系统分为三类:成熟的单模态工具;执行跨模态预测的系统,其中一种模态是从另一种模态估计出来的;以及真正的多模态融合系统,其中多个模态被单个模型共同吸收。单模态水平的证据更强,其中深度学习方法在抽吸细胞学、肾环组织学和流式细胞术评估方面的专家表现,以及美国食品和药物管理局(FDA) De novo授权的第一个全数字骨髓抽吸(BMA)应用程序定义了一个新的设备类别。另一方面,虽然跨模式预测正在迅速扩大,但真正的多模式融合系统仍未实现,该系统可以联合摄取匹配的形态学、血流、分子和临床数据,以产生统一的指南一致的建议。直接的头对头证据是稀疏的和端点依赖的;然而,没有证明比最强的单一模态比较国优越并不自动意味着没有好处。主要障碍是异构模式与缺失数据的融合,缺乏大型配对多机构数据集和统一的命名法,类别不平衡,批量效应驱动的泛化失败,不成熟的可解释性,不确定性量化和监管途径。然而,BM检查的集成多模态人工智能系统已经进入了一个有希望的早期转化阶段,该领域应该致力于使用成对数据集、明确的融合架构、校准的缺席感知模型和分阶段的前瞻性验证来实现集成。