Assessing ChatGPT's summarization of ⁶⁸Ga PSMA PET/CT reports for patients.

IF 2.3 3区医学 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING

Abdominal Radiology Pub Date : 2024-09-30 DOI:10.1007/s00261-024-04619-8

Ogün Bülbül, Hande Melike Bülbül, Esat Kaba

{"title":"Assessing ChatGPT's summarization of 68Ga PSMA PET/CT reports for patients.","authors":"Ogün Bülbül, Hande Melike Bülbül, Esat Kaba","doi":"10.1007/s00261-024-04619-8","DOIUrl":null,"url":null,"abstract":"Purpose: ChatGPT has recently been the subject of many studies, and its responses to medical questions have been successful. We examined ChatGPT-4's evaluation of structured 68Ga prostate-specific membrane antigen (PSMA) PET/CT reports of newly diagnosed prostate cancer patients.Methods: 68Ga PSMA PET/CT reports of 164 patients were entered to ChatGPT-4. ChatGPT-4 was asked to respond the following questions according to the PET/CT reports: 1-Has the cancer in the prostate extended to organs adjacent to the prostate? 2-Has the cancer in the prostate spread to neighboring lymph nodes? 3-Has the cancer in the prostate spread to lymph nodes in distant areas? 4-Has the cancer in the prostate spread to the bones? 5-Has the cancer in the prostate spread to other organs? ChatGPT-4's responses were scored on a Likert-type scale for clarity and accuracy.Results: The mean scores for clarity were 4.93 ± 0.32, 4.95 ± 0.25, 4.96 ± 0.19, 4.99 ± 0.11, and 4.96 ± 0.30, respectively. The mean scores for accuracy were 4.87 ∓ 0.61, 4.87 ∓ 0.62, 4.79 ± 0.83, 4.96 ± 0.25, and 4.93 ± 0.45, respectively. Patients with distant lymphatic metastases had a lower mean accuracy score than those without (4.28 ± 1.45 vs. 4.94 ± 0.39; p < 0.001). ChatGPT-4's responses in 13 patients (8%) had the potential for harmful information.Conclusion: ChatGPT-4 successfully interprets structured 68Ga PSMA PET/CT reports of reports of newly diagnosed prostate cancer patients. However, it is unlikely that ChatGPT-4 evaluations will replace physicians' evaluations today, especially since it can produce fabricated information.","PeriodicalId":7126,"journal":{"name":"Abdominal Radiology","volume":null,"pages":null},"PeriodicalIF":2.3000,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Abdominal Radiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00261-024-04619-8","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}

引用次数: 0

Abstract

Purpose: ChatGPT has recently been the subject of many studies, and its responses to medical questions have been successful. We examined ChatGPT-4's evaluation of structured ⁶⁸Ga prostate-specific membrane antigen (PSMA) PET/CT reports of newly diagnosed prostate cancer patients.

Methods: ⁶⁸Ga PSMA PET/CT reports of 164 patients were entered to ChatGPT-4. ChatGPT-4 was asked to respond the following questions according to the PET/CT reports: 1-Has the cancer in the prostate extended to organs adjacent to the prostate? 2-Has the cancer in the prostate spread to neighboring lymph nodes? 3-Has the cancer in the prostate spread to lymph nodes in distant areas? 4-Has the cancer in the prostate spread to the bones? 5-Has the cancer in the prostate spread to other organs? ChatGPT-4's responses were scored on a Likert-type scale for clarity and accuracy.

Results: The mean scores for clarity were 4.93 ± 0.32, 4.95 ± 0.25, 4.96 ± 0.19, 4.99 ± 0.11, and 4.96 ± 0.30, respectively. The mean scores for accuracy were 4.87 ∓ 0.61, 4.87 ∓ 0.62, 4.79 ± 0.83, 4.96 ± 0.25, and 4.93 ± 0.45, respectively. Patients with distant lymphatic metastases had a lower mean accuracy score than those without (4.28 ± 1.45 vs. 4.94 ± 0.39; p < 0.001). ChatGPT-4's responses in 13 patients (8%) had the potential for harmful information.

Conclusion: ChatGPT-4 successfully interprets structured ⁶⁸Ga PSMA PET/CT reports of reports of newly diagnosed prostate cancer patients. However, it is unlikely that ChatGPT-4 evaluations will replace physicians' evaluations today, especially since it can produce fabricated information.

查看原文本刊更多论文

评估 ChatGPT 为患者汇总 68Ga PSMA PET/CT 报告的情况。

目的：ChatGPT 最近成为许多研究的主题，它对医学问题的回答也很成功。我们研究了 ChatGPT-4 对新诊断的前列腺癌患者的结构化 68Ga 前列腺特异性膜抗原（PSMA）PET/CT 报告的评估。根据 PET/CT 报告，要求 ChatGPT-4 回答以下问题：1-前列腺癌是否已扩展至前列腺邻近器官？2-前列腺癌是否扩散到邻近淋巴结？3-前列腺癌是否扩散到远处的淋巴结？4-前列腺癌是否已扩散至骨骼？5-前列腺癌是否已扩散到其他器官？对 ChatGPT-4 的回答采用李克特量表对清晰度和准确度进行评分：清晰度的平均得分分别为 4.93 ± 0.32、4.95 ± 0.25、4.96 ± 0.19、4.99 ± 0.11 和 4.96 ± 0.30。准确性的平均得分分别为 4.87 ∓ 0.61、4.87 ∓ 0.62、4.79 ± 0.83、4.96 ± 0.25 和 4.93 ± 0.45。有远处淋巴转移的患者的平均准确度评分低于无远处淋巴转移的患者（4.28 ± 1.45 vs. 4.94 ± 0.39；P 结论：ChatGPT-4 能成功解释癌症：ChatGPT-4 可成功解释新诊断前列腺癌患者的结构化 68Ga PSMA PET/CT 报告。不过，ChatGPT-4 评估不太可能取代现在的医生评估，尤其是因为它可能会产生捏造的信息。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Abdominal Radiology Medicine-Radiology, Nuclear Medicine and Imaging

CiteScore

5.20

自引率

8.30%

发文量

334

期刊介绍： Abdominal Radiology seeks to meet the professional needs of the abdominal radiologist by publishing clinically pertinent original, review and practice related articles on the gastrointestinal and genitourinary tracts and abdominal interventional and radiologic procedures. Case reports are generally not accepted unless they are the first report of a new disease or condition, or part of a special solicited section. Reasons to Publish Your Article in Abdominal Radiology: · Official journal of the Society of Abdominal Radiology (SAR) · Published in Cooperation with: European Society of Gastrointestinal and Abdominal Radiology (ESGAR) European Society of Urogenital Radiology (ESUR) Asian Society of Abdominal Radiology (ASAR) · Efficient handling and Expeditious review · Author feedback is provided in a mentoring style · Global readership · Readers can earn CME credits