{"title":"Evaluating the Alignment of Artificial Intelligence-Generated Recommendations With Clinical Guidelines Focused on Soft Tissue Tumors.","authors":"Masatake Matsuoka, Tomohiro Onodera, Ryuichi Fukuda, Koji Iwasaki, Masanari Hamasaki, Taku Ebata, Yoshiaki Hosokawa, Eiji Kondo, Norimasa Iwasaki","doi":"10.1002/jso.27874","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The integration of artificial intelligence (AI), particularly, in oncology, has significantly shifted the paradigms of medical diagnostics and treatment planning. However, the utility of AI, specifically OpenAI's ChatGPT, in soft tissue sarcoma treatment, remains unclear.</p><p><strong>Methods: </strong>We evaluated ChatGPT's alignment with the Japanese Orthopaedic Association (JOA) clinical practice guidelines on the management of soft tissue tumors 2020. Twenty-two clinical questions (CQs) were formulated to encompass various aspects of sarcoma diagnosis, treatment, and management. ChatGPT's responses were classified into \"Complete Alignment,\" \"Partial Alignment,\" or \"Nonalignment\" based on the recommendation and strength of evidence.</p><p><strong>Results: </strong>ChatGPT demonstrated an 86% alignment rate with the JOA guidelines. The AI provided two instances of complete alignment and 17 instances of partial alignment, indicating a strong capability to match guideline criteria for most questions. However, three discrepancies were identified in areas concerning the treatment of atypical lipomatous tumors, perioperative chemotherapy for synovial sarcoma, and treatment strategies for elderly patients with malignant soft tissue tumors. Reassessment with guideline input led to some adjustments, revealing both the potential and limitations of AI in complex sarcoma care.</p><p><strong>Conclusion: </strong>Our study demonstrates that AI, specifically ChatGPT, can align with clinical guidelines for soft tissue sarcoma treatment. It also underscores the need for continuous refinement and cautious integration of AI in medical decision-making, particularly in the context of treatment for soft tissue sarcoma.</p>","PeriodicalId":17111,"journal":{"name":"Journal of Surgical Oncology","volume":null,"pages":null},"PeriodicalIF":2.0000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Surgical Oncology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1002/jso.27874","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ONCOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: The integration of artificial intelligence (AI), particularly, in oncology, has significantly shifted the paradigms of medical diagnostics and treatment planning. However, the utility of AI, specifically OpenAI's ChatGPT, in soft tissue sarcoma treatment, remains unclear.
Methods: We evaluated ChatGPT's alignment with the Japanese Orthopaedic Association (JOA) clinical practice guidelines on the management of soft tissue tumors 2020. Twenty-two clinical questions (CQs) were formulated to encompass various aspects of sarcoma diagnosis, treatment, and management. ChatGPT's responses were classified into "Complete Alignment," "Partial Alignment," or "Nonalignment" based on the recommendation and strength of evidence.
Results: ChatGPT demonstrated an 86% alignment rate with the JOA guidelines. The AI provided two instances of complete alignment and 17 instances of partial alignment, indicating a strong capability to match guideline criteria for most questions. However, three discrepancies were identified in areas concerning the treatment of atypical lipomatous tumors, perioperative chemotherapy for synovial sarcoma, and treatment strategies for elderly patients with malignant soft tissue tumors. Reassessment with guideline input led to some adjustments, revealing both the potential and limitations of AI in complex sarcoma care.
Conclusion: Our study demonstrates that AI, specifically ChatGPT, can align with clinical guidelines for soft tissue sarcoma treatment. It also underscores the need for continuous refinement and cautious integration of AI in medical decision-making, particularly in the context of treatment for soft tissue sarcoma.
期刊介绍：
The Journal of Surgical Oncology offers peer-reviewed, original papers in the field of surgical oncology and broadly related surgical sciences, including reports on experimental and laboratory studies. As an international journal, the editors encourage participation from leading surgeons around the world. The JSO is the representative journal for the World Federation of Surgical Oncology Societies. Publishing 16 issues in 2 volumes each year, the journal accepts Research Articles, in-depth Reviews of timely interest, Letters to the Editor, and invited Editorials. Guest Editors from the JSO Editorial Board oversee multiple special Seminars issues each year. These Seminars include multifaceted Reviews on a particular topic or current issue in surgical oncology, which are invited from experts in the field.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
