Patient trust in artificial intelligence for orthodontic advice: A systematic review.

IF 3.5 2区医学 Q1 DENTISTRY, ORAL SURGERY & MEDICINE

Journal of the American Dental Association Pub Date : 2025-09-26 DOI:10.1016/j.adaj.2025.08.003

Sanjana Santhosh Kumar, Dimitrios Michelogiannakis, Xiuhui Xu, Rachel Chacko, Junad Khan

{"title":"Patient trust in artificial intelligence for orthodontic advice: A systematic review.","authors":"Sanjana Santhosh Kumar, Dimitrios Michelogiannakis, Xiuhui Xu, Rachel Chacko, Junad Khan","doi":"10.1016/j.adaj.2025.08.003","DOIUrl":null,"url":null,"abstract":"Background: Artificial intelligence (AI) large language models are being used increasingly for health care-related queries. This systematic review assessed the reliability of AI chatbot responses to patient questions related to orthodontics.Types of studies reviewed: PubMed, Web of Science, Scopus, Ovid MEDLINE, and Embase were systematically searched for studies published from January 1, 2022, through February 28, 2025. Only cross-sectional studies were included. Data were screened and extracted, and the risk of bias was assessed.Results: Of 105 identified studies, 13 met the inclusion criteria. ChatGPT (OpenAI) showed 68.7% and 92.6% accuracy rates, scoring well on Likert scales and DISCERN evaluations. However, some studies reported lower scores (2.2/4.0, 3.8/10.0) and mixed results for Bard (Google) and Gemini (Google), highlighting inconsistencies in chatbot performance.Practical implications: Whereas large language models, particularly ChatGPT, cannot replace professional consultations, they offer generally reliable orthodontic information and can be valuable tools for addressing routine patient questions. Based on evolving commentary, AI is likely to serve as a frontline support system in the future, helping manage common inquiries, reduce clinician workload, and improve cost-effectiveness while ensuring that final care decisions remain with qualified professionals. This review was registered in Open Science Factory (https://doi.org/10.17605/OSF.IO/X8HJT).","PeriodicalId":17197,"journal":{"name":"Journal of the American Dental Association","volume":" ","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2025-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the American Dental Association","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.adaj.2025.08.003","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}

引用次数: 0

Abstract

Background: Artificial intelligence (AI) large language models are being used increasingly for health care-related queries. This systematic review assessed the reliability of AI chatbot responses to patient questions related to orthodontics.

Types of studies reviewed: PubMed, Web of Science, Scopus, Ovid MEDLINE, and Embase were systematically searched for studies published from January 1, 2022, through February 28, 2025. Only cross-sectional studies were included. Data were screened and extracted, and the risk of bias was assessed.

Results: Of 105 identified studies, 13 met the inclusion criteria. ChatGPT (OpenAI) showed 68.7% and 92.6% accuracy rates, scoring well on Likert scales and DISCERN evaluations. However, some studies reported lower scores (2.2/4.0, 3.8/10.0) and mixed results for Bard (Google) and Gemini (Google), highlighting inconsistencies in chatbot performance.

Practical implications: Whereas large language models, particularly ChatGPT, cannot replace professional consultations, they offer generally reliable orthodontic information and can be valuable tools for addressing routine patient questions. Based on evolving commentary, AI is likely to serve as a frontline support system in the future, helping manage common inquiries, reduce clinician workload, and improve cost-effectiveness while ensuring that final care decisions remain with qualified professionals. This review was registered in Open Science Factory (https://doi.org/10.17605/OSF.IO/X8HJT).

查看原文本刊更多论文

患者对人工智能正畸建议的信任：一项系统综述。

背景：人工智能（AI）大型语言模型越来越多地用于医疗保健相关查询。本系统综述评估了人工智能聊天机器人回答与正畸相关的患者问题的可靠性。综述的研究类型：系统检索了从2022年1月1日至2025年2月28日发表的研究，PubMed, Web of Science, Scopus， Ovid MEDLINE和Embase。仅纳入了横断面研究。对数据进行筛选和提取，并评估偏倚风险。结果：纳入的105项研究中，13项符合纳入标准。ChatGPT （OpenAI）的准确率分别为68.7%和92.6%，在李克特量表和DISCERN评估中得分较高。然而，一些研究报告了较低的分数（2.2/4.0,3.8/10.0），巴德（谷歌）和双子座（谷歌）的结果好坏参半，突出了聊天机器人性能的不一致性。实际意义：尽管大型语言模型，特别是ChatGPT，不能取代专业咨询，但它们提供了通常可靠的正畸信息，并且可以成为解决常规患者问题的有价值的工具。根据不断发展的评论，人工智能未来可能会成为一线支持系统，帮助管理常见查询，减少临床医生的工作量，提高成本效益，同时确保最终的护理决策由合格的专业人员做出。这篇综述已在Open Science Factory （https://doi.org/10.17605/OSF.IO/X8HJT）注册。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Journal of the American Dental Association 医学-牙科与口腔外科

CiteScore

5.30

自引率

10.30%

发文量

221

审稿时长

34 days

期刊介绍： There is not a single source or solution to help dentists in their quest for lifelong learning, improving dental practice, and dental well-being. JADA+, along with The Journal of the American Dental Association, is striving to do just that, bringing together practical content covering dentistry topics and procedures to help dentists—both general dentists and specialists—provide better patient care and improve oral health and well-being. This is a work in progress; as we add more content, covering more topics of interest, it will continue to expand, becoming an ever-more essential source of oral health knowledge.