对人工智能生成的有关正畸透明矫治器的回复(ChatGPT)进行内容分析。

Sarah Abu Arqub, Dalya Al-Moghrabi, Veerasathpurush Allareddy, Madhur Upadhyay, Nikhilesh Vaid, Sumit Yadav
{"title":"对人工智能生成的有关正畸透明矫治器的回复(ChatGPT)进行内容分析。","authors":"Sarah Abu Arqub, Dalya Al-Moghrabi, Veerasathpurush Allareddy, Madhur Upadhyay, Nikhilesh Vaid, Sumit Yadav","doi":"10.2319/071123-484.1","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>To assess the accuracy of ChatGPT answers concerning orthodontic clear aligners.</p><p><strong>Materials and methods: </strong>A cross-sectional content analysis of ChatGPT generated responses to queries related to clear aligner treatment (CAT) was undertaken. A total of 111 questions were generated by three orthodontists based on a set of predefined domains and subdomains. The artificial intelligence (AI)-generated (ChatGPT) answers were extracted and their accuracy was determined independently by five orthodontists. The accuracy of answers was assessed using a prepiloted four-point scale scoring rubric. Descriptive statistics were performed.</p><p><strong>Results: </strong>The total mean accuracy score for the entire set was 2.6 ± 1.1. It was noted that 58% of the AI-generated answers were scored as objectively true, 18% were selected facts, 9% were minimal facts, and 15% were false. False claims included the ability of CAT to reduce the need for orthognathic surgery (4.0 ± 0.0), improve airway function (3.8 ± 0.5), achieve root parallelism (3.6 ± 0.5), alleviate sleep apnea (3.8 ± 0.5), and produce more stable results compared to fixed appliances (3.8 ± 0.5).</p><p><strong>Conclusions: </strong>The overall level of accuracy of ChatGPT responses to questions concerning CAT was suboptimal and lacked citations to relevant literature. Ability of the software to offer current and precise information was limited. Therefore, clinicians and patients must be mindful of false claims and relevant facts omitted in the answers generated by ChatGPT.</p>","PeriodicalId":94224,"journal":{"name":"The Angle orthodontist","volume":" ","pages":"263-272"},"PeriodicalIF":0.0000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11050467/pdf/","citationCount":"0","resultStr":"{\"title\":\"Content analysis of AI-generated (ChatGPT) responses concerning orthodontic clear aligners.\",\"authors\":\"Sarah Abu Arqub, Dalya Al-Moghrabi, Veerasathpurush Allareddy, Madhur Upadhyay, Nikhilesh Vaid, Sumit Yadav\",\"doi\":\"10.2319/071123-484.1\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objectives: </strong>To assess the accuracy of ChatGPT answers concerning orthodontic clear aligners.</p><p><strong>Materials and methods: </strong>A cross-sectional content analysis of ChatGPT generated responses to queries related to clear aligner treatment (CAT) was undertaken. A total of 111 questions were generated by three orthodontists based on a set of predefined domains and subdomains. The artificial intelligence (AI)-generated (ChatGPT) answers were extracted and their accuracy was determined independently by five orthodontists. The accuracy of answers was assessed using a prepiloted four-point scale scoring rubric. Descriptive statistics were performed.</p><p><strong>Results: </strong>The total mean accuracy score for the entire set was 2.6 ± 1.1. It was noted that 58% of the AI-generated answers were scored as objectively true, 18% were selected facts, 9% were minimal facts, and 15% were false. False claims included the ability of CAT to reduce the need for orthognathic surgery (4.0 ± 0.0), improve airway function (3.8 ± 0.5), achieve root parallelism (3.6 ± 0.5), alleviate sleep apnea (3.8 ± 0.5), and produce more stable results compared to fixed appliances (3.8 ± 0.5).</p><p><strong>Conclusions: </strong>The overall level of accuracy of ChatGPT responses to questions concerning CAT was suboptimal and lacked citations to relevant literature. Ability of the software to offer current and precise information was limited. Therefore, clinicians and patients must be mindful of false claims and relevant facts omitted in the answers generated by ChatGPT.</p>\",\"PeriodicalId\":94224,\"journal\":{\"name\":\"The Angle orthodontist\",\"volume\":\" \",\"pages\":\"263-272\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11050467/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"The Angle orthodontist\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.2319/071123-484.1\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Angle orthodontist","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2319/071123-484.1","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

目的: 评估 ChatGPT 有关正畸透明矫治器答案的准确性:评估 ChatGPT 有关透明牙齿矫正器的回答的准确性:对 ChatGPT 生成的有关透明矫治器治疗(CAT)询问的回复进行横向内容分析。三名正畸医生根据一组预定义的领域和子领域共生成了 111 个问题。人工智能(AI)生成的(ChatGPT)答案被提取出来,其准确性由五名正畸学家独立确定。答案的准确性采用预先拟定的四点评分标准进行评估。对结果进行了描述性统计:整组答案的总平均准确率为 2.6 ± 1.1。我们注意到,人工智能生成的答案中有 58% 被评为客观真实,18% 被评为选定事实,9% 被评为最小事实,15% 被评为错误。虚假说法包括 CAT 能够减少正颌外科手术的需要(4.0 ± 0.0)、改善气道功能(3.8 ± 0.5)、实现牙根平行(3.6 ± 0.5)、缓解睡眠呼吸暂停(3.8 ± 0.5)以及与固定矫治器相比产生更稳定的效果(3.8 ± 0.5):ChatGPT 对有关 CAT 问题的回答总体上不够准确,而且缺乏对相关文献的引用。软件提供最新和准确信息的能力有限。因此,临床医生和患者必须注意 ChatGPT 生成的答案中的虚假说法和遗漏的相关事实。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Content analysis of AI-generated (ChatGPT) responses concerning orthodontic clear aligners.

Objectives: To assess the accuracy of ChatGPT answers concerning orthodontic clear aligners.

Materials and methods: A cross-sectional content analysis of ChatGPT generated responses to queries related to clear aligner treatment (CAT) was undertaken. A total of 111 questions were generated by three orthodontists based on a set of predefined domains and subdomains. The artificial intelligence (AI)-generated (ChatGPT) answers were extracted and their accuracy was determined independently by five orthodontists. The accuracy of answers was assessed using a prepiloted four-point scale scoring rubric. Descriptive statistics were performed.

Results: The total mean accuracy score for the entire set was 2.6 ± 1.1. It was noted that 58% of the AI-generated answers were scored as objectively true, 18% were selected facts, 9% were minimal facts, and 15% were false. False claims included the ability of CAT to reduce the need for orthognathic surgery (4.0 ± 0.0), improve airway function (3.8 ± 0.5), achieve root parallelism (3.6 ± 0.5), alleviate sleep apnea (3.8 ± 0.5), and produce more stable results compared to fixed appliances (3.8 ± 0.5).

Conclusions: The overall level of accuracy of ChatGPT responses to questions concerning CAT was suboptimal and lacked citations to relevant literature. Ability of the software to offer current and precise information was limited. Therefore, clinicians and patients must be mindful of false claims and relevant facts omitted in the answers generated by ChatGPT.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信