Assessing the accuracy, repeatability, and consistency of ChatGPT 4o in treatment planning for tooth-supported fixed prostheses: a comparative analysis of simple and complex clinical cases.
{"title":"Assessing the accuracy, repeatability, and consistency of ChatGPT 4o in treatment planning for tooth-supported fixed prostheses: a comparative analysis of simple and complex clinical cases.","authors":"Özer İşisağ, Kevser Karakaya","doi":"10.1007/s00784-025-06521-z","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>The aim of this study is to evaluate the effectiveness of ChatGPT 4o in planning tooth-supported fixed prostheses by examining the accuracy, repeatability, and consistency of its responses across various prosthodontic cases.</p><p><strong>Materials and methods: </strong>1,140 responses were generated for 38 questions regarding simple and complex prosthetic cases, using case schemas from Fundamentals of Fixed Prosthodontics. Each question was asked 30 times at different times of day (morning, afternoon, and evening) to assess response consistency.</p><p><strong>Results: </strong>ChatGPT demonstrated high accuracy (97.08%) for simple fixed prostheses but struggled with complex cases, showing a low accuracy rate of 19.69%. Statistically significant differences were observed in the response accuracy between question categories, indicating that ChatGPT performs better with straightforward cases than with complex ones. Repeatability was high across all question types, though accuracy varied, especially in complex scenarios.</p><p><strong>Conclusions: </strong>The findings highlight ChatGPT's potential as an assistive tool in simple prosthodontic cases yet emphasize the need for clinician expertise in more complex treatment planning.</p><p><strong>Clinical relevance: </strong>While ChatGPT shows promise as a supplementary tool for dental education and practice, reliance on AI alone for intricate cases remains premature.</p>","PeriodicalId":10461,"journal":{"name":"Clinical Oral Investigations","volume":"29 9","pages":"433"},"PeriodicalIF":3.1000,"publicationDate":"2025-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Oral Investigations","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00784-025-06521-z","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
引用次数: 0
Abstract
Objectives: The aim of this study is to evaluate the effectiveness of ChatGPT 4o in planning tooth-supported fixed prostheses by examining the accuracy, repeatability, and consistency of its responses across various prosthodontic cases.
Materials and methods: 1,140 responses were generated for 38 questions regarding simple and complex prosthetic cases, using case schemas from Fundamentals of Fixed Prosthodontics. Each question was asked 30 times at different times of day (morning, afternoon, and evening) to assess response consistency.
Results: ChatGPT demonstrated high accuracy (97.08%) for simple fixed prostheses but struggled with complex cases, showing a low accuracy rate of 19.69%. Statistically significant differences were observed in the response accuracy between question categories, indicating that ChatGPT performs better with straightforward cases than with complex ones. Repeatability was high across all question types, though accuracy varied, especially in complex scenarios.
Conclusions: The findings highlight ChatGPT's potential as an assistive tool in simple prosthodontic cases yet emphasize the need for clinician expertise in more complex treatment planning.
Clinical relevance: While ChatGPT shows promise as a supplementary tool for dental education and practice, reliance on AI alone for intricate cases remains premature.
期刊介绍:
The journal Clinical Oral Investigations is a multidisciplinary, international forum for publication of research from all fields of oral medicine. The journal publishes original scientific articles and invited reviews which provide up-to-date results of basic and clinical studies in oral and maxillofacial science and medicine. The aim is to clarify the relevance of new results to modern practice, for an international readership. Coverage includes maxillofacial and oral surgery, prosthetics and restorative dentistry, operative dentistry, endodontics, periodontology, orthodontics, dental materials science, clinical trials, epidemiology, pedodontics, oral implant, preventive dentistiry, oral pathology, oral basic sciences and more.