"Reports in Medical Illustration (REMIL) in Musculoskeletal Radiology: An Evaluation of Evolving AI Models".

Abstract

Objective: Radiology reports remain predominantly text-based, requiring clinicians and patients to mentally reconstruct imaging findings. Reports in Medical Illustration (REMIL) represent an emerging approach in which artificial intelligence (AI) generates simplified visual summaries directly from report text. This study aimed to evaluate the feasibility, anatomical accuracy, and clinical utility of AI-generated REMIL in musculoskeletal (MSK) radiology.

Methods: Twenty-five MSK imaging cases were selected. Identical report text and standardized prompts were provided to three premium multimodal AI systems-ChatGPT (GPT-4 with DALL-E 3), Perplexity AI, and Google Gemini 3.0 Pro. Each model generated a representative illustration based solely on the report description. Two fellowship-trained musculoskeletal radiologists independently assessed each illustration for anatomical accuracy and clinical usefulness. Errors were categorized as minor or major, and image-generation time was recorded.

Results: Google Gemini 3.0 Pro demonstrated the most consistent performance, producing anatomically accurate illustrations in approximately 40-42% of cases and clinically useful images in 60-65% of cases, whereas ChatGPT and Perplexity AI frequently generated visually plausible images with substantial anatomical inaccuracies. Major errors were observed across all models, particularly in complex cases involving multiple anatomical structures or imaging planes. Simpler cases with a single dominant abnormality were illustrated more accurately by all models.

Conclusion: AI-generated REMIL holds promise as an adjunctive tool for enhancing communication in MSK radiology by providing rapid visual summaries of imaging findings. However, current AI models exhibit inconsistent anatomical accuracy and are not yet reliable for unsupervised clinical use. REMIL should therefore be implemented only with radiologist validation.