Agentic Automation of BT-RADS Scoring Using an End-to-End System for Standardized Glioma Follow-up Assessment.

IF 20.1 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Mohamed Sobhi Jabal, Jikai Zhang, Dominic LaBella, Jessica L Houk, Dylan Zhang, Jeffrey D Rudie, Maciej A Mazurowski, Kirti Magudia, Evan Calabrese
{"title":"Agentic Automation of BT-RADS Scoring Using an End-to-End System for Standardized Glioma Follow-up Assessment.","authors":"Mohamed Sobhi Jabal, Jikai Zhang, Dominic LaBella, Jessica L Houk, Dylan Zhang, Jeffrey D Rudie, Maciej A Mazurowski, Kirti Magudia, Evan Calabrese","doi":"10.1148/ryai.260234","DOIUrl":null,"url":null,"abstract":"<p><p>The Brain Tumor Reporting and Data System (BT-RADS) standardizes posttreatment MRI response assessment in patients with diffuse gliomas but requires complex integration of imaging trends, medication effects, and radiation timing. An end-to-end multiagent large language model and convolutional neural network system for automated BTRADS classification was developed and evaluated. Five hundred nine consecutive posttreatment glioma MRI examinations (March 2017-July 2021) from a single center were retrospectively evaluated. An extractor agent identified clinical variables from notes using gpt-oss (OpenAI, 20-billion parameters). A scorer agent applied BTRADS decision logic integrating these with quantitative volumetrics. System accuracy was compared against initial assessments, using expert annotation as the reference standard. Four hundred ninety-two examinations were evaluable. Overall system accuracy was 76.0% (374/492) versus 57.5% (283/492) for initial assessments, an absolute difference of +18.5 percentage points (<i>P</i> < .001). Cohen kappa between the system and the reference standard was 0.71. The system achieved high sensitivity in context-dependent categories (BT-1b; 100%; BT-1a, 92.7%; BT-3a, 87.5%) and moderate sensitivity for threshold-dependent categories (BT-3c, 74.8%; BT-2, 69.2%; BT-4, 69.3%; BT-3b, 57.1%). The BT-4 positive predictive value was 92.9%. These results support further evaluation of this system as a clinical decision-support tool, with local open-weight inference preserving data privacy.</p>","PeriodicalId":29787,"journal":{"name":"Radiology-Artificial Intelligence","volume":" ","pages":"e260234"},"PeriodicalIF":20.1000,"publicationDate":"2026-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Radiology-Artificial Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1148/ryai.260234","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

The Brain Tumor Reporting and Data System (BT-RADS) standardizes posttreatment MRI response assessment in patients with diffuse gliomas but requires complex integration of imaging trends, medication effects, and radiation timing. An end-to-end multiagent large language model and convolutional neural network system for automated BTRADS classification was developed and evaluated. Five hundred nine consecutive posttreatment glioma MRI examinations (March 2017-July 2021) from a single center were retrospectively evaluated. An extractor agent identified clinical variables from notes using gpt-oss (OpenAI, 20-billion parameters). A scorer agent applied BTRADS decision logic integrating these with quantitative volumetrics. System accuracy was compared against initial assessments, using expert annotation as the reference standard. Four hundred ninety-two examinations were evaluable. Overall system accuracy was 76.0% (374/492) versus 57.5% (283/492) for initial assessments, an absolute difference of +18.5 percentage points (P < .001). Cohen kappa between the system and the reference standard was 0.71. The system achieved high sensitivity in context-dependent categories (BT-1b; 100%; BT-1a, 92.7%; BT-3a, 87.5%) and moderate sensitivity for threshold-dependent categories (BT-3c, 74.8%; BT-2, 69.2%; BT-4, 69.3%; BT-3b, 57.1%). The BT-4 positive predictive value was 92.9%. These results support further evaluation of this system as a clinical decision-support tool, with local open-weight inference preserving data privacy.

使用端到端系统标准化胶质瘤随访评估BT-RADS评分的代理自动化。
脑肿瘤报告和数据系统(BT-RADS)标准化了弥漫性胶质瘤患者治疗后MRI反应评估,但需要复杂地整合成像趋势、药物效果和放疗时机。开发了端到端多智能体大语言模型和卷积神经网络系统,并对其进行了评价。回顾性评估来自单个中心的590例治疗后胶质瘤MRI检查(2017年3月- 2021年7月)。提取器代理使用gpt-oss (OpenAI, 200亿个参数)从笔记中识别临床变量。计分代理应用了BTRADS决策逻辑,并将其与定量容积法相结合。以专家注释作为参考标准,将系统的准确性与初始评估进行比较。492项检查是可评估的。总体系统准确率为76.0%(374/492),而初始评估为57.5%(283/492),绝对差异为+18.5个百分点(P < .001)。该体系与标准品的科恩卡帕系数差为0.71。该系统在上下文相关类别中具有高灵敏度(BT-1b, 100%; BT-1a, 92.7%; BT-3a, 87.5%),在阈值相关类别中具有中等灵敏度(BT-3c, 74.8%; BT-2, 69.2%; BT-4, 69.3%; BT-3b, 57.1%)。BT-4阳性预测值为92.9%。这些结果支持进一步评估该系统作为临床决策支持工具,本地开权重推理保护数据隐私。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
16.20
自引率
1.00%
发文量
0
期刊介绍: Radiology: Artificial Intelligence is a bi-monthly publication that focuses on the emerging applications of machine learning and artificial intelligence in the field of imaging across various disciplines. This journal is available online and accepts multiple manuscript types, including Original Research, Technical Developments, Data Resources, Review articles, Editorials, Letters to the Editor and Replies, Special Reports, and AI in Brief.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书