Dyke Ferber, Omar S M El Nahhas, Georg Wölflein, Isabella C Wiest, Jan Clusmann, Marie-Elisabeth Leßmann, Sebastian Foersch, Jacqueline Lammert, Maximilian Tschochohei, Dirk Jäger, Manuel Salto-Tellez, Nikolaus Schultz, Daniel Truhn, Jakob Nikolas Kather
{"title":"Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology.","authors":"Dyke Ferber, Omar S M El Nahhas, Georg Wölflein, Isabella C Wiest, Jan Clusmann, Marie-Elisabeth Leßmann, Sebastian Foersch, Jacqueline Lammert, Maximilian Tschochohei, Dirk Jäger, Manuel Salto-Tellez, Nikolaus Schultz, Daniel Truhn, Jakob Nikolas Kather","doi":"10.1038/s43018-025-00991-6","DOIUrl":null,"url":null,"abstract":"<p><p>Clinical decision-making in oncology is complex, requiring the integration of multimodal data and multidomain expertise. We developed and evaluated an autonomous clinical artificial intelligence (AI) agent leveraging GPT-4 with multimodal precision oncology tools to support personalized clinical decision-making. The system incorporates vision transformers for detecting microsatellite instability and KRAS and BRAF mutations from histopathology slides, MedSAM for radiological image segmentation and web-based search tools such as OncoKB, PubMed and Google. Evaluated on 20 realistic multimodal patient cases, the AI agent autonomously used appropriate tools with 87.5% accuracy, reached correct clinical conclusions in 91.0% of cases and accurately cited relevant oncology guidelines 75.5% of the time. Compared to GPT-4 alone, the integrated AI agent drastically improved decision-making accuracy from 30.3% to 87.2%. These findings demonstrate that integrating language models with precision oncology and search tools substantially enhances clinical accuracy, establishing a robust foundation for deploying AI-driven personalized oncology support systems.</p>","PeriodicalId":18885,"journal":{"name":"Nature cancer","volume":" ","pages":""},"PeriodicalIF":28.5000,"publicationDate":"2025-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nature cancer","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1038/s43018-025-00991-6","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ONCOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Clinical decision-making in oncology is complex, requiring the integration of multimodal data and multidomain expertise. We developed and evaluated an autonomous clinical artificial intelligence (AI) agent leveraging GPT-4 with multimodal precision oncology tools to support personalized clinical decision-making. The system incorporates vision transformers for detecting microsatellite instability and KRAS and BRAF mutations from histopathology slides, MedSAM for radiological image segmentation and web-based search tools such as OncoKB, PubMed and Google. Evaluated on 20 realistic multimodal patient cases, the AI agent autonomously used appropriate tools with 87.5% accuracy, reached correct clinical conclusions in 91.0% of cases and accurately cited relevant oncology guidelines 75.5% of the time. Compared to GPT-4 alone, the integrated AI agent drastically improved decision-making accuracy from 30.3% to 87.2%. These findings demonstrate that integrating language models with precision oncology and search tools substantially enhances clinical accuracy, establishing a robust foundation for deploying AI-driven personalized oncology support systems.
期刊介绍:
Cancer is a devastating disease responsible for millions of deaths worldwide. However, many of these deaths could be prevented with improved prevention and treatment strategies. To achieve this, it is crucial to focus on accurate diagnosis, effective treatment methods, and understanding the socioeconomic factors that influence cancer rates.
Nature Cancer aims to serve as a unique platform for sharing the latest advancements in cancer research across various scientific fields, encompassing life sciences, physical sciences, applied sciences, and social sciences. The journal is particularly interested in fundamental research that enhances our understanding of tumor development and progression, as well as research that translates this knowledge into clinical applications through innovative diagnostic and therapeutic approaches. Additionally, Nature Cancer welcomes clinical studies that inform cancer diagnosis, treatment, and prevention, along with contributions exploring the societal impact of cancer on a global scale.
In addition to publishing original research, Nature Cancer will feature Comments, Reviews, News & Views, Features, and Correspondence that hold significant value for the diverse field of cancer research.