Oluchi J Abosi, Takaaki Kobayashi, Natalie Ross, Alexandra Trannel, Guillermo Rodriguez Nava, Jorge L Salinas, Karen Brust
{"title":"A head-to-head comparison of the accuracy of commercially available large language models for infection prevention and control inquiries, 2024.","authors":"Oluchi J Abosi, Takaaki Kobayashi, Natalie Ross, Alexandra Trannel, Guillermo Rodriguez Nava, Jorge L Salinas, Karen Brust","doi":"10.1017/ice.2024.205","DOIUrl":null,"url":null,"abstract":"<p><p>We investigated the accuracy and completeness of four large language model (LLM) artificial intelligence tools. Most LLMs provided acceptable answers to commonly asked infection prevention questions (accuracy 98.9%, completeness 94.6%). The use of LLMs to supplement infection prevention consults should be further explored.</p>","PeriodicalId":13663,"journal":{"name":"Infection Control and Hospital Epidemiology","volume":" ","pages":"1-3"},"PeriodicalIF":3.0000,"publicationDate":"2024-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Infection Control and Hospital Epidemiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1017/ice.2024.205","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"INFECTIOUS DISEASES","Score":null,"Total":0}
引用次数: 0
Abstract
We investigated the accuracy and completeness of four large language model (LLM) artificial intelligence tools. Most LLMs provided acceptable answers to commonly asked infection prevention questions (accuracy 98.9%, completeness 94.6%). The use of LLMs to supplement infection prevention consults should be further explored.
期刊介绍:
Infection Control and Hospital Epidemiology provides original, peer-reviewed scientific articles for anyone involved with an infection control or epidemiology program in a hospital or healthcare facility. Written by infection control practitioners and epidemiologists and guided by an editorial board composed of the nation''s leaders in the field, ICHE provides a critical forum for this vital information.