PAINe: An Artificial Intelligence-based Virtual Assistant to Aid in the Differentiation of Pain of Odontogenic versus Temporomandibular Origin.

IF 3.5 2区 医学 Q1 DENTISTRY, ORAL SURGERY & MEDICINE
Bianca Marques de Mattos de Araujo, Pedro Felipe de Jesus Freitas, Angela Graciela Deliga Schroder, Erika Calvano Küchler, Flares Baratto-Filho, Vania Portela Ditzel Westphalen, Everdan Carneiro, Ulisses Xavier da Silva-Neto, Cristiano Miranda de Araujo
{"title":"PAINe: An Artificial Intelligence-based Virtual Assistant to Aid in the Differentiation of Pain of Odontogenic versus Temporomandibular Origin.","authors":"Bianca Marques de Mattos de Araujo, Pedro Felipe de Jesus Freitas, Angela Graciela Deliga Schroder, Erika Calvano Küchler, Flares Baratto-Filho, Vania Portela Ditzel Westphalen, Everdan Carneiro, Ulisses Xavier da Silva-Neto, Cristiano Miranda de Araujo","doi":"10.1016/j.joen.2024.09.008","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>Pain associated with temporomandibular dysfunction (TMD) is often confused with odontogenic pain, which is a challenge in endodontic diagnosis. Validated screening questionnaires can aid in the identification and differentiation of the source of pain. Therefore, this study aimed to develop a virtual assistant based on artificial intelligence using natural language processing techniques to automate the initial screening of patients with tooth pain.</p><p><strong>Methods: </strong>The PAINe chatbot was developed in Python (Python Software Foundation, Beaverton, OR) language using the PyCharm (JetBrains, Prague, Czech Republic) environment and the openai library to integrate the ChatGPT 4 API (OpenAI, San Francisco, CA) and the Streamlit library (Snowflake Inc, San Francisco, CA) for interface construction. The validated TMD Pain Screener questionnaire and 1 question regarding the current pain intensity were integrated into the chatbot to perform the differential diagnosis of TMD in patients with tooth pain. The accuracy of the responses was evaluated in 50 random scenarios to compare the chatbot with the validated questionnaire. The kappa coefficient was calculated to assess the agreement level between the chatbot responses and the validated questionnaire.</p><p><strong>Results: </strong>The chatbot achieved an accuracy rate of 86% and a substantial level of agreement (κ = 0.70). Most responses were clear and provided adequate information about the diagnosis.</p><p><strong>Conclusions: </strong>The implementation of a virtual assistant using natural language processing based on large language models for initial differential diagnosis screening of patients with tooth pain demonstrated substantial agreement between validated questionnaires and the chatbot. This approach emerges as a practical and efficient option for screening these patients.</p>","PeriodicalId":15703,"journal":{"name":"Journal of endodontics","volume":" ","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of endodontics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.joen.2024.09.008","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
引用次数: 0

Abstract

Introduction: Pain associated with temporomandibular dysfunction (TMD) is often confused with odontogenic pain, which is a challenge in endodontic diagnosis. Validated screening questionnaires can aid in the identification and differentiation of the source of pain. Therefore, this study aimed to develop a virtual assistant based on artificial intelligence using natural language processing techniques to automate the initial screening of patients with tooth pain.

Methods: The PAINe chatbot was developed in Python (Python Software Foundation, Beaverton, OR) language using the PyCharm (JetBrains, Prague, Czech Republic) environment and the openai library to integrate the ChatGPT 4 API (OpenAI, San Francisco, CA) and the Streamlit library (Snowflake Inc, San Francisco, CA) for interface construction. The validated TMD Pain Screener questionnaire and 1 question regarding the current pain intensity were integrated into the chatbot to perform the differential diagnosis of TMD in patients with tooth pain. The accuracy of the responses was evaluated in 50 random scenarios to compare the chatbot with the validated questionnaire. The kappa coefficient was calculated to assess the agreement level between the chatbot responses and the validated questionnaire.

Results: The chatbot achieved an accuracy rate of 86% and a substantial level of agreement (κ = 0.70). Most responses were clear and provided adequate information about the diagnosis.

Conclusions: The implementation of a virtual assistant using natural language processing based on large language models for initial differential diagnosis screening of patients with tooth pain demonstrated substantial agreement between validated questionnaires and the chatbot. This approach emerges as a practical and efficient option for screening these patients.

PAINe - 一种基于人工智能的虚拟助手,用于区分牙源性疼痛和颞下颌源性疼痛。
导言:与颞下颌功能障碍(TMD)相关的疼痛常常与牙源性疼痛相混淆,这是牙髓诊断中的一个难题。经过验证的筛查问卷可以帮助识别和区分疼痛的来源。因此,本研究旨在开发一种基于人工智能的虚拟助手,利用自然语言处理技术自动对牙痛患者进行初步筛查:PAINe 聊天机器人使用 Python 语言开发,使用 PyCharm 环境和 "openai "库集成了 ChatGPT 4 API,并使用 "streamlit "库构建了界面。聊天机器人集成了经过验证的 TMD 疼痛筛查问卷和一个关于当前疼痛强度的问题,用于对牙痛患者进行 TMD 鉴别诊断。在 50 个随机场景中对回答的准确性进行了评估,以比较聊天机器人与有效问卷。计算了卡帕系数,以评估聊天机器人的回答与有效问卷之间的一致程度:结果:聊天机器人的准确率达到了 86%,并且具有相当高的一致性(Kappa = 0.70)。大多数回复都很清晰,并提供了足够的诊断信息:利用基于大型语言模型的自然语言处理技术实施虚拟助手,对牙痛患者进行初步鉴别诊断筛查,结果表明有效问卷与聊天机器人之间存在很大的一致性。这种方法是筛查这些患者的一种实用、高效的选择。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of endodontics
Journal of endodontics 医学-牙科与口腔外科
CiteScore
8.80
自引率
9.50%
发文量
224
审稿时长
42 days
期刊介绍: The Journal of Endodontics, the official journal of the American Association of Endodontists, publishes scientific articles, case reports and comparison studies evaluating materials and methods of pulp conservation and endodontic treatment. Endodontists and general dentists can learn about new concepts in root canal treatment and the latest advances in techniques and instrumentation in the one journal that helps them keep pace with rapid changes in this field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信