Automatic radiology report generation: a systematic review of emerging AI architectures and multimodal technologies

IF 18.8 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Artificial Intelligence Review Pub Date : 2026-04-27 Epub Date: 2026-06-15 DOI:10.1007/s10462-026-11556-z
Moustapha Boubacar Hamma, Zakariae Alami Merrouni, Bouchra Frikh, Brahim Ouhbi
{"title":"Automatic radiology report generation: a systematic review of emerging AI architectures and multimodal technologies","authors":"Moustapha Boubacar Hamma,&nbsp;Zakariae Alami Merrouni,&nbsp;Bouchra Frikh,&nbsp;Brahim Ouhbi","doi":"10.1007/s10462-026-11556-z","DOIUrl":null,"url":null,"abstract":"<div><p>Generating radiology reports from medical images is a labour-intensive task, exacerbated by the global shortage of radiologists and the complexity of image interpretation. Automatic radiology report generation (ARRG) has emerged to address this challenge, with AI-driven methods showing promise in accelerating diagnosis and improving workflow efficiency. While previous reviews primarily focus on conventional AI and deep learning models and often adopt non-systematic methodologies, this work provides a systematic PRISMA-based review of 51 studies published between 2015 and 2025, offering a rigorous synthesis of model architectures, learning paradigms, data strategies, and evaluation metrics. We categorize approaches from classical CNN-RNN frameworks to emerging paradigms including knowledge graphs, large language models (LLMs), retrieval-augmented generation (RAG), AI agents, and multimodal vision-language models. Our analysis highlights key challenges in clinical translation, including model explainability, factual accuracy, generalization across modalities, and deployment feasibility. We also critically evaluate benchmark datasets and performance metrics, identifying inconsistencies that hinder fair comparison and clinical adoption. Finally, we propose actionable research directions to advance clinically reliable, explainable, and generalizable ARRG systems. By linking technical developments to real-world clinical requirements, this review serves as a forward-looking reference for researchers and practitioners aiming to bridge the gap from AI prototypes to trusted clinical tools.</p></div>","PeriodicalId":8449,"journal":{"name":"Artificial Intelligence Review","volume":"59 8","pages":""},"PeriodicalIF":18.8000,"publicationDate":"2026-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s10462-026-11556-z.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Artificial Intelligence Review","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s10462-026-11556-z","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/6/15 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Generating radiology reports from medical images is a labour-intensive task, exacerbated by the global shortage of radiologists and the complexity of image interpretation. Automatic radiology report generation (ARRG) has emerged to address this challenge, with AI-driven methods showing promise in accelerating diagnosis and improving workflow efficiency. While previous reviews primarily focus on conventional AI and deep learning models and often adopt non-systematic methodologies, this work provides a systematic PRISMA-based review of 51 studies published between 2015 and 2025, offering a rigorous synthesis of model architectures, learning paradigms, data strategies, and evaluation metrics. We categorize approaches from classical CNN-RNN frameworks to emerging paradigms including knowledge graphs, large language models (LLMs), retrieval-augmented generation (RAG), AI agents, and multimodal vision-language models. Our analysis highlights key challenges in clinical translation, including model explainability, factual accuracy, generalization across modalities, and deployment feasibility. We also critically evaluate benchmark datasets and performance metrics, identifying inconsistencies that hinder fair comparison and clinical adoption. Finally, we propose actionable research directions to advance clinically reliable, explainable, and generalizable ARRG systems. By linking technical developments to real-world clinical requirements, this review serves as a forward-looking reference for researchers and practitioners aiming to bridge the gap from AI prototypes to trusted clinical tools.

自动放射报告生成:新兴人工智能架构和多模式技术的系统回顾
从医学图像生成放射学报告是一项劳动密集型任务,全球放射科医生的短缺和图像解释的复杂性加剧了这一任务。为了应对这一挑战,出现了自动放射学报告生成(ARRG),人工智能驱动的方法在加速诊断和提高工作流程效率方面表现出了希望。虽然之前的评论主要关注传统的人工智能和深度学习模型,并且通常采用非系统的方法,但这项工作对2015年至2025年间发表的51项研究进行了系统的基于prisma的评论,提供了模型架构、学习范式、数据策略和评估指标的严格综合。我们对从经典CNN-RNN框架到新兴范式的方法进行了分类,包括知识图、大型语言模型(llm)、检索增强生成(RAG)、人工智能代理和多模态视觉语言模型。我们的分析强调了临床翻译中的关键挑战,包括模型的可解释性、事实准确性、跨模式的泛化和部署可行性。我们还批判性地评估基准数据集和性能指标,找出阻碍公平比较和临床采用的不一致之处。最后,我们提出了可操作的研究方向,以推进临床可靠、可解释和可推广的ARRG系统。通过将技术发展与现实世界的临床需求联系起来,本综述为研究人员和从业人员提供了前瞻性参考,旨在弥合从人工智能原型到可信赖的临床工具的差距。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Artificial Intelligence Review
Artificial Intelligence Review 工程技术-计算机:人工智能
CiteScore
22.00
自引率
3.30%
发文量
194
审稿时长
5.3 months
期刊介绍: Artificial Intelligence Review, a fully open access journal, publishes cutting-edge research in artificial intelligence and cognitive science. It features critical evaluations of applications, techniques, and algorithms, providing a platform for both researchers and application developers. The journal includes refereed survey and tutorial articles, along with reviews and commentary on significant developments in the field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书