Phillip Sloan, Philip Clatworthy, Edwin Simpson, Majid Mirmehdi
{"title":"Automated Radiology Report Generation: A Review of Recent Advances.","authors":"Phillip Sloan, Philip Clatworthy, Edwin Simpson, Majid Mirmehdi","doi":"10.1109/RBME.2024.3408456","DOIUrl":null,"url":null,"abstract":"<p><p>Increasing demands on medical imaging departments are taking a toll on the radiologist's ability to deliver timely and accurate reports. Recent technological advances in artificial intelligence have demonstrated great potential for automatic radiology report generation (ARRG), sparking an explosion of research. This survey paper conducts a methodological review of contemporary ARRG approaches by way of (i) assessing datasets based on characteristics, such as availability, size, and adoption rate, (ii) examining deep learning training methods, such as contrastive learning and reinforcement learning, (iii) exploring state-of-the-art model architectures, including variations of CNN and transformer models, (iv) outlining techniques integrating clinical knowledge through multimodal inputs and knowledge graphs, and (v) scrutinising current model evaluation techniques, including commonly applied NLP metrics and qualitative clinical reviews. Furthermore, the quantitative results of the reviewed models are analysed, where the top performing models are examined to seek further insights. Finally, potential new directions are highlighted, with the adoption of additional datasets from other radiological modalities and improved evaluation methods predicted as important areas of future development.</p>","PeriodicalId":39235,"journal":{"name":"IEEE Reviews in Biomedical Engineering","volume":null,"pages":null},"PeriodicalIF":17.2000,"publicationDate":"2024-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Reviews in Biomedical Engineering","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1109/RBME.2024.3408456","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Increasing demands on medical imaging departments are taking a toll on the radiologist's ability to deliver timely and accurate reports. Recent technological advances in artificial intelligence have demonstrated great potential for automatic radiology report generation (ARRG), sparking an explosion of research. This survey paper conducts a methodological review of contemporary ARRG approaches by way of (i) assessing datasets based on characteristics, such as availability, size, and adoption rate, (ii) examining deep learning training methods, such as contrastive learning and reinforcement learning, (iii) exploring state-of-the-art model architectures, including variations of CNN and transformer models, (iv) outlining techniques integrating clinical knowledge through multimodal inputs and knowledge graphs, and (v) scrutinising current model evaluation techniques, including commonly applied NLP metrics and qualitative clinical reviews. Furthermore, the quantitative results of the reviewed models are analysed, where the top performing models are examined to seek further insights. Finally, potential new directions are highlighted, with the adoption of additional datasets from other radiological modalities and improved evaluation methods predicted as important areas of future development.
期刊介绍:
IEEE Reviews in Biomedical Engineering (RBME) serves as a platform to review the state-of-the-art and trends in the interdisciplinary field of biomedical engineering, which encompasses engineering, life sciences, and medicine. The journal aims to consolidate research and reviews for members of all IEEE societies interested in biomedical engineering. Recognizing the demand for comprehensive reviews among authors of various IEEE journals, RBME addresses this need by receiving, reviewing, and publishing scholarly works under one umbrella. It covers a broad spectrum, from historical to modern developments in biomedical engineering and the integration of technologies from various IEEE societies into the life sciences and medicine.