通过提示工程增强以患者为中心的种植牙科信息:四种大型语言模型的比较。

IF 3 Q1 DENTISTRY, ORAL SURGERY & MEDICINE
Frontiers in oral health Pub Date : 2025-04-07 eCollection Date: 2025-01-01 DOI:10.3389/froh.2025.1566221
John Rong Hao Tay, Dian Yi Chow, Yi Rong Ivan Lim, Ethan Ng
{"title":"通过提示工程增强以患者为中心的种植牙科信息:四种大型语言模型的比较。","authors":"John Rong Hao Tay, Dian Yi Chow, Yi Rong Ivan Lim, Ethan Ng","doi":"10.3389/froh.2025.1566221","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Patients frequently seek dental information online, and generative pre-trained transformers (GPTs) may be a valuable resource. However, the quality of responses based on varying prompt designs has not been evaluated. As dental implant treatment is widely performed, this study aimed to investigate the influence of prompt design on GPT performance in answering commonly asked questions related to dental implants.</p><p><strong>Materials and methods: </strong>Thirty commonly asked questions about implant dentistry - covering patient selection, associated risks, peri-implant disease symptoms, treatment for missing teeth, prevention, and prognosis - were posed to four different GPT models with different prompt designs. Responses were recorded and independently appraised by two periodontists across six quality domains.</p><p><strong>Results: </strong>All models performed well, with responses classified as good quality. The contextualized model performed worse on treatment-related questions (21.5 ± 3.4, <i>p</i> < 0.05), but outperformed the input-output, zero-shot chain of thought, and instruction-tuned models in citing appropriate sources in its responses (4.1 ± 1.0, <i>p</i> < 0.001). However, responses had less clarity and relevance compared to the other models.</p><p><strong>Conclusion: </strong>GPTs can provide accurate, complete, and useful information for questions related to dental implants. While prompt designs can enhance response quality, further refinement is necessary to optimize its performance.</p>","PeriodicalId":94016,"journal":{"name":"Frontiers in oral health","volume":"6 ","pages":"1566221"},"PeriodicalIF":3.0000,"publicationDate":"2025-04-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12009804/pdf/","citationCount":"0","resultStr":"{\"title\":\"Enhancing patient-centered information on implant dentistry through prompt engineering: a comparison of four large language models.\",\"authors\":\"John Rong Hao Tay, Dian Yi Chow, Yi Rong Ivan Lim, Ethan Ng\",\"doi\":\"10.3389/froh.2025.1566221\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Patients frequently seek dental information online, and generative pre-trained transformers (GPTs) may be a valuable resource. However, the quality of responses based on varying prompt designs has not been evaluated. As dental implant treatment is widely performed, this study aimed to investigate the influence of prompt design on GPT performance in answering commonly asked questions related to dental implants.</p><p><strong>Materials and methods: </strong>Thirty commonly asked questions about implant dentistry - covering patient selection, associated risks, peri-implant disease symptoms, treatment for missing teeth, prevention, and prognosis - were posed to four different GPT models with different prompt designs. Responses were recorded and independently appraised by two periodontists across six quality domains.</p><p><strong>Results: </strong>All models performed well, with responses classified as good quality. The contextualized model performed worse on treatment-related questions (21.5 ± 3.4, <i>p</i> < 0.05), but outperformed the input-output, zero-shot chain of thought, and instruction-tuned models in citing appropriate sources in its responses (4.1 ± 1.0, <i>p</i> < 0.001). However, responses had less clarity and relevance compared to the other models.</p><p><strong>Conclusion: </strong>GPTs can provide accurate, complete, and useful information for questions related to dental implants. While prompt designs can enhance response quality, further refinement is necessary to optimize its performance.</p>\",\"PeriodicalId\":94016,\"journal\":{\"name\":\"Frontiers in oral health\",\"volume\":\"6 \",\"pages\":\"1566221\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2025-04-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12009804/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Frontiers in oral health\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3389/froh.2025.1566221\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q1\",\"JCRName\":\"DENTISTRY, ORAL SURGERY & MEDICINE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in oral health","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3389/froh.2025.1566221","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
引用次数: 0

摘要

背景:患者经常在网上寻找牙科信息,生成预训练变压器(GPTs)可能是一个有价值的资源。然而,基于不同提示设计的回答质量尚未得到评估。随着种植牙治疗的广泛开展,本研究旨在探讨提示设计对GPT在回答与种植牙相关的常见问题中的影响。材料和方法:对四种不同提示设计的GPT模型提出了30个关于种植牙科的常见问题,包括患者选择、相关风险、种植体周围疾病症状、缺失牙齿的治疗、预防和预后。反馈被记录下来,并由两名牙周病专家在六个质量领域独立评估。结果:所有模型均表现良好,反应质量为良好。情境化模型在治疗相关问题上的表现较差(21.5±3.4,p)。结论:GPTs可以为种植体相关问题提供准确、完整、有用的信息。虽然快速设计可以提高响应质量,但需要进一步改进以优化其性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Enhancing patient-centered information on implant dentistry through prompt engineering: a comparison of four large language models.

Background: Patients frequently seek dental information online, and generative pre-trained transformers (GPTs) may be a valuable resource. However, the quality of responses based on varying prompt designs has not been evaluated. As dental implant treatment is widely performed, this study aimed to investigate the influence of prompt design on GPT performance in answering commonly asked questions related to dental implants.

Materials and methods: Thirty commonly asked questions about implant dentistry - covering patient selection, associated risks, peri-implant disease symptoms, treatment for missing teeth, prevention, and prognosis - were posed to four different GPT models with different prompt designs. Responses were recorded and independently appraised by two periodontists across six quality domains.

Results: All models performed well, with responses classified as good quality. The contextualized model performed worse on treatment-related questions (21.5 ± 3.4, p < 0.05), but outperformed the input-output, zero-shot chain of thought, and instruction-tuned models in citing appropriate sources in its responses (4.1 ± 1.0, p < 0.001). However, responses had less clarity and relevance compared to the other models.

Conclusion: GPTs can provide accurate, complete, and useful information for questions related to dental implants. While prompt designs can enhance response quality, further refinement is necessary to optimize its performance.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
3.30
自引率
0.00%
发文量
0
审稿时长
13 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信