How Chatbots Respond to NCLEX-RN Practice Questions: Assessment of Google Gemini, GPT-3.5, and GPT-4.

IF 0.9 Q3 EDUCATION & EDUCATIONAL RESEARCH

Nursing Education Perspectives Pub Date : 2025-03-01 Epub Date: 2024-12-18 DOI:10.1097/01.NEP.0000000000001364

Alejandro García-Rudolph, David Sanchez-Pinsach, Mira Caridad Fernandez, Sandra Cunyat, Eloy Opisso, Elena Hernandez-Pena

引用次数: 0

Abstract

Abstract: ChatGPT often "hallucinates" or misleads, underscoring the need for formal validation at the professional level for reliable use in nursing education. We evaluated two free chatbots (Google Gemini and GPT-3.5) and a commercial version (GPT-4) on 250 standardized questions from a simulated nursing licensure exam, which closely matches the content and complexity of the actual exam. Gemini achieved 73.2 percent (183/250), GPT-3.5 achieved 72 percent (180/250), and GPT-4 reached a notably higher performance with 92.4 percent (231/250). GPT-4 exhibited its highest error rate (13.3%) in the psychosocial integrity category.

查看原文本刊更多论文

聊天机器人对NCLEX-RN练习题的反应：谷歌Gemini、GPT-3.5和GPT-4的评估

摘要：ChatGPT经常产生“幻觉”或误导，强调需要在专业水平上进行正式验证，以便在护理教育中可靠地使用。我们对两个免费聊天机器人（谷歌Gemini和GPT-3.5）和一个商业版聊天机器人（GPT-4）在模拟护理执照考试的250个标准化问题上进行了评估，这些问题与实际考试的内容和复杂性非常接近。Gemini达到了73.2% (183/250),GPT-3.5达到了72% (180/250)，GPT-4达到了92.4%（231/250）。GPT-4在心理社会完整性方面的错误率最高（13.3%）。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Nursing Education Perspectives EDUCATION & EDUCATIONAL RESEARCH-

CiteScore

1.90

自引率

0.00%

发文量

197

期刊介绍： A publication of the National League for Nursing, Nursing Education Perspectives is a peer-reviewed, bimonthly journal that provides evidence for best practices in nursing education. Through the publication of rigorously designed studies, the journal contributes to the advancement of the science of nursing education. It serves as a forum for research and innovation regarding teaching and learning, curricula, technology, and other issues important to nursing education. Today, as nurse educators strive to advance research in nursing education and break away from established patterns and chart new pathways in nursing education, Nursing Education Perspectives is a vital resource. Nursing Education Perspectives is housed in the NLN Chamberlain College of Nursing for the Advancement of the Science of Nursing Education.