Shireen S Gohari, Agata J Baczynska, Valentin Weber, Mohammad S Sarwar, Umar Rehman, Peter A Brennan
{"title":"英国NHS医院提供的颞下颌疾病在线患者信息:使用人工智能聊天机器人评估和改进可读性标准。","authors":"Shireen S Gohari, Agata J Baczynska, Valentin Weber, Mohammad S Sarwar, Umar Rehman, Peter A Brennan","doi":"10.1016/j.bjoms.2025.08.008","DOIUrl":null,"url":null,"abstract":"<p><p>Temporomandibular disorders (TMD) are complex conditions that burden patients and healthcare systems. Disparities in health literacy may hinder patient comprehension of online educational materials, potentially influencing outcomes. Artificial intelligence (AI)-driven chatbots offer a promising solution to improve the readability of patient information materials. We assessed the readability of available online materials on TMD in the United Kingdom (UK) and evaluate the ability of three AI-chatbots to improve readability. A search was done of all UK public hospital websites with Oral and Maxillofacial Surgery (OMFS) or Ear, Nose, and Throat (ENT) units for TMD-related patient information. Readability was assessed using five standard scoring systems. Three AI-chatbots (ChatGPT, Claude, and Google Gemini) were used to revise the content to an 11-year-old (sixth-grade) reading level. A total of 31 out of 122 of UK hospital Trusts provided online TMD materials. Of these, 12/31 and 1/31 met the target readability according to the Flesch-Kincaid Grade Level (FKGL), and the Gunning Fog Index/Coleman-Liau Index (GFI/CLI), respectively, with mean (SD) readability at 64.68 (6.79) for Flesch Reading Ease Score (FRES). After AI modification by Gemini, 96.8% met the target readability per FKGL, 54.8% per GFI, and 29.0% per CLI. Gemini improved the mean (SD) score significantly to 82.59 (5.73) (p < 0.001) for FRES, meeting the target readability level. Online patient information on TMD exceeds the recommended Year Six (sixth grade in the US) reading level. AI chatbots, particularly Gemini, can significantly enhance the readability of these materials, enabling them to meet health literacy standards according to certain readability tools.</p>","PeriodicalId":55318,"journal":{"name":"British Journal of Oral & Maxillofacial Surgery","volume":" ","pages":""},"PeriodicalIF":1.9000,"publicationDate":"2025-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Online patient information on temporomandibular disorders provided by UK NHS hospitals: assessment and improvement of readability standards using AI-chatbots.\",\"authors\":\"Shireen S Gohari, Agata J Baczynska, Valentin Weber, Mohammad S Sarwar, Umar Rehman, Peter A Brennan\",\"doi\":\"10.1016/j.bjoms.2025.08.008\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Temporomandibular disorders (TMD) are complex conditions that burden patients and healthcare systems. Disparities in health literacy may hinder patient comprehension of online educational materials, potentially influencing outcomes. Artificial intelligence (AI)-driven chatbots offer a promising solution to improve the readability of patient information materials. We assessed the readability of available online materials on TMD in the United Kingdom (UK) and evaluate the ability of three AI-chatbots to improve readability. A search was done of all UK public hospital websites with Oral and Maxillofacial Surgery (OMFS) or Ear, Nose, and Throat (ENT) units for TMD-related patient information. Readability was assessed using five standard scoring systems. Three AI-chatbots (ChatGPT, Claude, and Google Gemini) were used to revise the content to an 11-year-old (sixth-grade) reading level. A total of 31 out of 122 of UK hospital Trusts provided online TMD materials. Of these, 12/31 and 1/31 met the target readability according to the Flesch-Kincaid Grade Level (FKGL), and the Gunning Fog Index/Coleman-Liau Index (GFI/CLI), respectively, with mean (SD) readability at 64.68 (6.79) for Flesch Reading Ease Score (FRES). After AI modification by Gemini, 96.8% met the target readability per FKGL, 54.8% per GFI, and 29.0% per CLI. Gemini improved the mean (SD) score significantly to 82.59 (5.73) (p < 0.001) for FRES, meeting the target readability level. Online patient information on TMD exceeds the recommended Year Six (sixth grade in the US) reading level. AI chatbots, particularly Gemini, can significantly enhance the readability of these materials, enabling them to meet health literacy standards according to certain readability tools.</p>\",\"PeriodicalId\":55318,\"journal\":{\"name\":\"British Journal of Oral & Maxillofacial Surgery\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2025-09-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"British Journal of Oral & Maxillofacial Surgery\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1016/j.bjoms.2025.08.008\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"DENTISTRY, ORAL SURGERY & MEDICINE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"British Journal of Oral & Maxillofacial Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.bjoms.2025.08.008","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
引用次数: 0
摘要
颞下颌疾病(TMD)是一种复杂的疾病,给患者和医疗保健系统带来了负担。健康素养的差异可能会阻碍患者对在线教育材料的理解,从而可能影响结果。人工智能(AI)驱动的聊天机器人为提高患者信息材料的可读性提供了一个很有前途的解决方案。我们评估了英国TMD上可用在线材料的可读性,并评估了三种人工智能聊天机器人提高可读性的能力。我们搜索了英国所有有口腔颌面外科(OMFS)或耳鼻喉科(ENT)的公立医院网站,以获取与tmd相关的患者信息。使用五种标准评分系统评估可读性。使用三个人工智能聊天机器人(ChatGPT, Claude和谷歌Gemini)将内容修改为11岁(六年级)的阅读水平。在122家英国医院信托基金中,共有31家提供在线TMD材料。其中12/31和1/31分别达到了Flesch- kincaid Grade Level (FKGL)和Gunning Fog Index/Coleman-Liau Index (GFI/CLI)的目标可读性,Flesch Reading Ease Score (FRES)的平均(SD)可读性为64.68(6.79)。Gemini人工智能修改后,96.8%的FKGL、54.8%的GFI和29.0%的CLI达到了目标可读性。双子组的平均(SD)评分显著提高至82.59分(5.73分)
Online patient information on temporomandibular disorders provided by UK NHS hospitals: assessment and improvement of readability standards using AI-chatbots.
Temporomandibular disorders (TMD) are complex conditions that burden patients and healthcare systems. Disparities in health literacy may hinder patient comprehension of online educational materials, potentially influencing outcomes. Artificial intelligence (AI)-driven chatbots offer a promising solution to improve the readability of patient information materials. We assessed the readability of available online materials on TMD in the United Kingdom (UK) and evaluate the ability of three AI-chatbots to improve readability. A search was done of all UK public hospital websites with Oral and Maxillofacial Surgery (OMFS) or Ear, Nose, and Throat (ENT) units for TMD-related patient information. Readability was assessed using five standard scoring systems. Three AI-chatbots (ChatGPT, Claude, and Google Gemini) were used to revise the content to an 11-year-old (sixth-grade) reading level. A total of 31 out of 122 of UK hospital Trusts provided online TMD materials. Of these, 12/31 and 1/31 met the target readability according to the Flesch-Kincaid Grade Level (FKGL), and the Gunning Fog Index/Coleman-Liau Index (GFI/CLI), respectively, with mean (SD) readability at 64.68 (6.79) for Flesch Reading Ease Score (FRES). After AI modification by Gemini, 96.8% met the target readability per FKGL, 54.8% per GFI, and 29.0% per CLI. Gemini improved the mean (SD) score significantly to 82.59 (5.73) (p < 0.001) for FRES, meeting the target readability level. Online patient information on TMD exceeds the recommended Year Six (sixth grade in the US) reading level. AI chatbots, particularly Gemini, can significantly enhance the readability of these materials, enabling them to meet health literacy standards according to certain readability tools.
期刊介绍:
Journal of the British Association of Oral and Maxillofacial Surgeons:
• Leading articles on all aspects of surgery in the oro-facial and head and neck region
• One of the largest circulations of any international journal in this field
• Dedicated to enhancing surgical expertise.