Bianca Marques de Mattos de Araujo MDS, PhD , Pedro Felipe de Jesus Freitas DDS , Angela Graciela Deliga Schroder MDS, PhD , Erika Calvano Küchler MDS, PhD , Flares Baratto-Filho MDS, PhD , Vania Portela Ditzel Westphalen MDS, PhD , Everdan Carneiro MDS, PhD , Ulisses Xavier da Silva-Neto MDS, PhD , Cristiano Miranda de Araujo MDS, PhD
{"title":"PAINe - 一种基于人工智能的虚拟助手,用于区分牙源性疼痛和颞下颌源性疼痛。","authors":"Bianca Marques de Mattos de Araujo MDS, PhD , Pedro Felipe de Jesus Freitas DDS , Angela Graciela Deliga Schroder MDS, PhD , Erika Calvano Küchler MDS, PhD , Flares Baratto-Filho MDS, PhD , Vania Portela Ditzel Westphalen MDS, PhD , Everdan Carneiro MDS, PhD , Ulisses Xavier da Silva-Neto MDS, PhD , Cristiano Miranda de Araujo MDS, PhD","doi":"10.1016/j.joen.2024.09.008","DOIUrl":null,"url":null,"abstract":"<div><h3>Introduction</h3><div>Pain associated with temporomandibular dysfunction (TMD) is often confused with odontogenic pain, which is a challenge in endodontic diagnosis. Validated screening questionnaires can aid in the identification and differentiation of the source of pain. Therefore, this study aimed to develop a virtual assistant based on artificial intelligence using natural language processing techniques to automate the initial screening of patients with tooth pain.</div></div><div><h3>Methods</h3><div>The PAINe chatbot was developed in Python (Python Software Foundation, Beaverton, OR) language using the PyCharm (JetBrains, Prague, Czech Republic) environment and the openai library to integrate the ChatGPT 4 API (OpenAI, San Francisco, CA) and the Streamlit library (Snowflake Inc, San Francisco, CA) for interface construction. The validated TMD Pain Screener questionnaire and 1 question regarding the current pain intensity were integrated into the chatbot to perform the differential diagnosis of TMD in patients with tooth pain. The accuracy of the responses was evaluated in 50 random scenarios to compare the chatbot with the validated questionnaire. The kappa coefficient was calculated to assess the agreement level between the chatbot responses and the validated questionnaire.</div></div><div><h3>Results</h3><div>The chatbot achieved an accuracy rate of 86% and a substantial level of agreement (κ = 0.70). Most responses were clear and provided adequate information about the diagnosis.</div></div><div><h3>Conclusions</h3><div>The implementation of a virtual assistant using natural language processing based on large language models for initial differential diagnosis screening of patients with tooth pain demonstrated substantial agreement between validated questionnaires and the chatbot. This approach emerges as a practical and efficient option for screening these patients.</div></div>","PeriodicalId":15703,"journal":{"name":"Journal of endodontics","volume":"50 12","pages":"Pages 1761-1765.e2"},"PeriodicalIF":3.5000,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"PAINe: An Artificial Intelligence–based Virtual Assistant to Aid in the Differentiation of Pain of Odontogenic versus Temporomandibular Origin\",\"authors\":\"Bianca Marques de Mattos de Araujo MDS, PhD , Pedro Felipe de Jesus Freitas DDS , Angela Graciela Deliga Schroder MDS, PhD , Erika Calvano Küchler MDS, PhD , Flares Baratto-Filho MDS, PhD , Vania Portela Ditzel Westphalen MDS, PhD , Everdan Carneiro MDS, PhD , Ulisses Xavier da Silva-Neto MDS, PhD , Cristiano Miranda de Araujo MDS, PhD\",\"doi\":\"10.1016/j.joen.2024.09.008\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Introduction</h3><div>Pain associated with temporomandibular dysfunction (TMD) is often confused with odontogenic pain, which is a challenge in endodontic diagnosis. Validated screening questionnaires can aid in the identification and differentiation of the source of pain. Therefore, this study aimed to develop a virtual assistant based on artificial intelligence using natural language processing techniques to automate the initial screening of patients with tooth pain.</div></div><div><h3>Methods</h3><div>The PAINe chatbot was developed in Python (Python Software Foundation, Beaverton, OR) language using the PyCharm (JetBrains, Prague, Czech Republic) environment and the openai library to integrate the ChatGPT 4 API (OpenAI, San Francisco, CA) and the Streamlit library (Snowflake Inc, San Francisco, CA) for interface construction. The validated TMD Pain Screener questionnaire and 1 question regarding the current pain intensity were integrated into the chatbot to perform the differential diagnosis of TMD in patients with tooth pain. The accuracy of the responses was evaluated in 50 random scenarios to compare the chatbot with the validated questionnaire. The kappa coefficient was calculated to assess the agreement level between the chatbot responses and the validated questionnaire.</div></div><div><h3>Results</h3><div>The chatbot achieved an accuracy rate of 86% and a substantial level of agreement (κ = 0.70). Most responses were clear and provided adequate information about the diagnosis.</div></div><div><h3>Conclusions</h3><div>The implementation of a virtual assistant using natural language processing based on large language models for initial differential diagnosis screening of patients with tooth pain demonstrated substantial agreement between validated questionnaires and the chatbot. This approach emerges as a practical and efficient option for screening these patients.</div></div>\",\"PeriodicalId\":15703,\"journal\":{\"name\":\"Journal of endodontics\",\"volume\":\"50 12\",\"pages\":\"Pages 1761-1765.e2\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2024-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of endodontics\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0099239924005247\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"DENTISTRY, ORAL SURGERY & MEDICINE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of endodontics","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0099239924005247","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
PAINe: An Artificial Intelligence–based Virtual Assistant to Aid in the Differentiation of Pain of Odontogenic versus Temporomandibular Origin
Introduction
Pain associated with temporomandibular dysfunction (TMD) is often confused with odontogenic pain, which is a challenge in endodontic diagnosis. Validated screening questionnaires can aid in the identification and differentiation of the source of pain. Therefore, this study aimed to develop a virtual assistant based on artificial intelligence using natural language processing techniques to automate the initial screening of patients with tooth pain.
Methods
The PAINe chatbot was developed in Python (Python Software Foundation, Beaverton, OR) language using the PyCharm (JetBrains, Prague, Czech Republic) environment and the openai library to integrate the ChatGPT 4 API (OpenAI, San Francisco, CA) and the Streamlit library (Snowflake Inc, San Francisco, CA) for interface construction. The validated TMD Pain Screener questionnaire and 1 question regarding the current pain intensity were integrated into the chatbot to perform the differential diagnosis of TMD in patients with tooth pain. The accuracy of the responses was evaluated in 50 random scenarios to compare the chatbot with the validated questionnaire. The kappa coefficient was calculated to assess the agreement level between the chatbot responses and the validated questionnaire.
Results
The chatbot achieved an accuracy rate of 86% and a substantial level of agreement (κ = 0.70). Most responses were clear and provided adequate information about the diagnosis.
Conclusions
The implementation of a virtual assistant using natural language processing based on large language models for initial differential diagnosis screening of patients with tooth pain demonstrated substantial agreement between validated questionnaires and the chatbot. This approach emerges as a practical and efficient option for screening these patients.
期刊介绍:
The Journal of Endodontics, the official journal of the American Association of Endodontists, publishes scientific articles, case reports and comparison studies evaluating materials and methods of pulp conservation and endodontic treatment. Endodontists and general dentists can learn about new concepts in root canal treatment and the latest advances in techniques and instrumentation in the one journal that helps them keep pace with rapid changes in this field.