Assessing the accuracy, repeatability, and consistency of ChatGPT 4o in treatment planning for tooth-supported fixed prostheses: a comparative analysis of simple and complex clinical cases.

IF 3.1 2区 医学 Q1 DENTISTRY, ORAL SURGERY & MEDICINE
Özer İşisağ, Kevser Karakaya
{"title":"Assessing the accuracy, repeatability, and consistency of ChatGPT 4o in treatment planning for tooth-supported fixed prostheses: a comparative analysis of simple and complex clinical cases.","authors":"Özer İşisağ, Kevser Karakaya","doi":"10.1007/s00784-025-06521-z","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>The aim of this study is to evaluate the effectiveness of ChatGPT 4o in planning tooth-supported fixed prostheses by examining the accuracy, repeatability, and consistency of its responses across various prosthodontic cases.</p><p><strong>Materials and methods: </strong>1,140 responses were generated for 38 questions regarding simple and complex prosthetic cases, using case schemas from Fundamentals of Fixed Prosthodontics. Each question was asked 30 times at different times of day (morning, afternoon, and evening) to assess response consistency.</p><p><strong>Results: </strong>ChatGPT demonstrated high accuracy (97.08%) for simple fixed prostheses but struggled with complex cases, showing a low accuracy rate of 19.69%. Statistically significant differences were observed in the response accuracy between question categories, indicating that ChatGPT performs better with straightforward cases than with complex ones. Repeatability was high across all question types, though accuracy varied, especially in complex scenarios.</p><p><strong>Conclusions: </strong>The findings highlight ChatGPT's potential as an assistive tool in simple prosthodontic cases yet emphasize the need for clinician expertise in more complex treatment planning.</p><p><strong>Clinical relevance: </strong>While ChatGPT shows promise as a supplementary tool for dental education and practice, reliance on AI alone for intricate cases remains premature.</p>","PeriodicalId":10461,"journal":{"name":"Clinical Oral Investigations","volume":"29 9","pages":"433"},"PeriodicalIF":3.1000,"publicationDate":"2025-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Oral Investigations","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00784-025-06521-z","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
引用次数: 0

Abstract

Objectives: The aim of this study is to evaluate the effectiveness of ChatGPT 4o in planning tooth-supported fixed prostheses by examining the accuracy, repeatability, and consistency of its responses across various prosthodontic cases.

Materials and methods: 1,140 responses were generated for 38 questions regarding simple and complex prosthetic cases, using case schemas from Fundamentals of Fixed Prosthodontics. Each question was asked 30 times at different times of day (morning, afternoon, and evening) to assess response consistency.

Results: ChatGPT demonstrated high accuracy (97.08%) for simple fixed prostheses but struggled with complex cases, showing a low accuracy rate of 19.69%. Statistically significant differences were observed in the response accuracy between question categories, indicating that ChatGPT performs better with straightforward cases than with complex ones. Repeatability was high across all question types, though accuracy varied, especially in complex scenarios.

Conclusions: The findings highlight ChatGPT's potential as an assistive tool in simple prosthodontic cases yet emphasize the need for clinician expertise in more complex treatment planning.

Clinical relevance: While ChatGPT shows promise as a supplementary tool for dental education and practice, reliance on AI alone for intricate cases remains premature.

评估ChatGPT 40在牙支撑固定假体治疗计划中的准确性、可重复性和一致性:简单和复杂临床病例的对比分析
目的:本研究的目的是通过检查ChatGPT 40在不同修复病例中反应的准确性、可重复性和一致性,来评估ChatGPT 40在规划牙支撑固定修复中的有效性。材料和方法:使用《固定修复学基础》中的病例图式,对简单和复杂修复病例的38个问题产生了1,140个回答。每个问题在一天的不同时间(上午、下午和晚上)被问了30次,以评估回答的一致性。结果:ChatGPT在简单固定假体中准确率较高(97.08%),但在复杂病例中准确率较低(19.69%)。问题类别之间的回答准确率差异有统计学意义,这表明ChatGPT在简单的情况下比在复杂的情况下表现得更好。所有问题类型的重复性都很高,但准确性各不相同,尤其是在复杂的场景中。结论:研究结果强调了ChatGPT在简单修复病例中作为辅助工具的潜力,但也强调了在更复杂的治疗计划中需要临床医生的专业知识。临床意义:虽然ChatGPT有望成为牙科教育和实践的补充工具,但仅依靠人工智能来处理复杂的病例还为时过早。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Clinical Oral Investigations
Clinical Oral Investigations 医学-牙科与口腔外科
CiteScore
6.30
自引率
5.90%
发文量
484
审稿时长
3 months
期刊介绍: The journal Clinical Oral Investigations is a multidisciplinary, international forum for publication of research from all fields of oral medicine. The journal publishes original scientific articles and invited reviews which provide up-to-date results of basic and clinical studies in oral and maxillofacial science and medicine. The aim is to clarify the relevance of new results to modern practice, for an international readership. Coverage includes maxillofacial and oral surgery, prosthetics and restorative dentistry, operative dentistry, endodontics, periodontology, orthodontics, dental materials science, clinical trials, epidemiology, pedodontics, oral implant, preventive dentistiry, oral pathology, oral basic sciences and more.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信