ChatGPT-4: Alcohol use disorder responses

IF 5.2 1区医学 Q1 PSYCHIATRY

Addiction Pub Date : 2024-08-14 DOI:10.1111/add.16650

Alex M. Russell, Samuel F. Acuff, John F. Kelly, Jon-Patrick Allem, Brandon G. Bergman

{"title":"ChatGPT-4: Alcohol use disorder responses","authors":"Alex M. Russell, Samuel F. Acuff, John F. Kelly, Jon-Patrick Allem, Brandon G. Bergman","doi":"10.1111/add.16650","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background and aims</h3>\n \n <p>Alcohol use disorder (AUD) is characterized by low levels of engagement with effective treatments. Enhancing awareness of AUD treatments and how to navigate the treatment system is crucial. Many individuals use online sources (e.g. search engines) for answers to health-related questions; web-based results include a mix of high- and low-quality information. Artificial intelligence may improve access to quality health information by providing concise, high-quality responses to complex health-related questions. This study evaluated the quality of ChatGPT-4 responses to AUD-related queries.</p>\n </section>\n \n <section>\n \n <h3> Method</h3>\n \n <p>A comprehensive list of 64 AUD-related questions was developed through a combination of Google Trends analysis and expert consultation. ChatGPT-4 was prompted with each question, followed by a request to provide 3–5 peer-reviewed scientific citations supporting each response. Responses were evaluated for whether they were evidence-based, provided a referral and provided supporting documentation.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>ChatGPT-4 responded to all AUD-related queries, with 92.2% (59/64) of responses being fully evidence-based. Although only 12.5% (8/64) of responses included referrals to external resources, all responses (100%; 5/5) to location-specific (‘near me’) queries directed individuals to appropriate resources like the NIAAA Treatment Navigator. Most (85.9%; 55/64) responses to the follow-up question provided supporting documentation.</p>\n </section>\n \n <section>\n \n <h3> Conclusions</h3>\n \n <p>ChatGPT-4 responds to alcohol use disorder-related questions with evidence-based information and supporting documentation. ChatGPT-4 could be promoted as a reasonable resource for those looking online for alcohol use disorder-related information.</p>\n </section>\n </div>","PeriodicalId":109,"journal":{"name":"Addiction","volume":"119 12","pages":"2205-2210"},"PeriodicalIF":5.2000,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Addiction","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/add.16650","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHIATRY","Score":null,"Total":0}

引用次数: 0

Abstract

Background and aims

Alcohol use disorder (AUD) is characterized by low levels of engagement with effective treatments. Enhancing awareness of AUD treatments and how to navigate the treatment system is crucial. Many individuals use online sources (e.g. search engines) for answers to health-related questions; web-based results include a mix of high- and low-quality information. Artificial intelligence may improve access to quality health information by providing concise, high-quality responses to complex health-related questions. This study evaluated the quality of ChatGPT-4 responses to AUD-related queries.

Method

A comprehensive list of 64 AUD-related questions was developed through a combination of Google Trends analysis and expert consultation. ChatGPT-4 was prompted with each question, followed by a request to provide 3–5 peer-reviewed scientific citations supporting each response. Responses were evaluated for whether they were evidence-based, provided a referral and provided supporting documentation.

Results

ChatGPT-4 responded to all AUD-related queries, with 92.2% (59/64) of responses being fully evidence-based. Although only 12.5% (8/64) of responses included referrals to external resources, all responses (100%; 5/5) to location-specific (‘near me’) queries directed individuals to appropriate resources like the NIAAA Treatment Navigator. Most (85.9%; 55/64) responses to the follow-up question provided supporting documentation.

Conclusions

ChatGPT-4 responds to alcohol use disorder-related questions with evidence-based information and supporting documentation. ChatGPT-4 could be promoted as a reasonable resource for those looking online for alcohol use disorder-related information.

查看原文本刊更多论文

ChatGPT-4：酒精使用障碍对策。

背景和目的：酒精使用障碍（AUD）的特点是接受有效治疗的人数较少。提高人们对 AUD 治疗方法以及如何利用治疗系统的认识至关重要。许多人使用在线资源（如搜索引擎）寻找健康相关问题的答案；基于网络的结果包括高质量和低质量的混合信息。人工智能可以为复杂的健康相关问题提供简明、高质量的回答，从而改善高质量健康信息的获取。本研究评估了 ChatGPT-4 对 AUD 相关问题的回答质量：方法：通过谷歌趋势分析和专家咨询，制定了一份包含 64 个 AUD 相关问题的综合列表。每个问题都会提示 ChatGPT-4，然后要求提供 3-5 篇经同行评审的科学引文来支持每个回复。我们对回复进行了评估，看其是否以证据为基础，是否提供了转介，是否提供了证明文件：ChatGPT-4 回答了所有与 AUD 相关的询问，其中 92.2%（59/64）的回答完全以证据为基础。虽然只有 12.5%（8/64）的回复包含外部资源转介，但针对特定地点（"离我很近"）询问的所有回复（100%；5/5）都将个人引向了 NIAAA Treatment Navigator 等适当的资源。大多数（85.9%；55/64）对后续问题的回复都提供了证明文件：结论：ChatGPT-4 通过循证信息和支持文件回答了与酒精使用障碍相关的问题。可以将 ChatGPT-4 作为在线查找酒精使用障碍相关信息的合理资源加以推广。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Addiction 医学-精神病学

CiteScore

10.80

自引率

6.70%

发文量

319

审稿时长

3 months

期刊介绍： Addiction publishes peer-reviewed research reports on pharmacological and behavioural addictions, bringing together research conducted within many different disciplines. Its goal is to serve international and interdisciplinary scientific and clinical communication, to strengthen links between science and policy, and to stimulate and enhance the quality of debate. We seek submissions that are not only technically competent but are also original and contain information or ideas of fresh interest to our international readership. We seek to serve low- and middle-income (LAMI) countries as well as more economically developed countries. Addiction’s scope spans human experimental, epidemiological, social science, historical, clinical and policy research relating to addiction, primarily but not exclusively in the areas of psychoactive substance use and/or gambling. In addition to original research, the journal features editorials, commentaries, reviews, letters, and book reviews.