Haelynn Gim, Benjamin Cook, Jasmin Le, Brandon Stretton, Christina Gao, Aashray Gupta, Joshua Kovoor, Christina Guo, Matthew Arnold, Galina Gheihman, Stephen Bacchi
{"title":"Large language model-supported interactive case-based learning: a pilot study.","authors":"Haelynn Gim, Benjamin Cook, Jasmin Le, Brandon Stretton, Christina Gao, Aashray Gupta, Joshua Kovoor, Christina Guo, Matthew Arnold, Galina Gheihman, Stephen Bacchi","doi":"10.1111/imj.70030","DOIUrl":null,"url":null,"abstract":"<p><p>Large language models (LLMs) have been proposed as a means to augment case-based learning but are prone to generating factually incorrect content. In this study, an LLM-based tool was developed, and its performance evaluated. In response to student-generated questions, the LLM adhered to the provided screenplay in 832/857 (97.1%) instances, and in the remaining instances, it was medically appropriate in 24/25 (96.0%) cases. Use of LLM appears to be feasible for this purpose, and further studies are required to examine their educational impact.</p>","PeriodicalId":13625,"journal":{"name":"Internal Medicine Journal","volume":" ","pages":""},"PeriodicalIF":1.8000,"publicationDate":"2025-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Internal Medicine Journal","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/imj.70030","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0
Abstract
Large language models (LLMs) have been proposed as a means to augment case-based learning but are prone to generating factually incorrect content. In this study, an LLM-based tool was developed, and its performance evaluated. In response to student-generated questions, the LLM adhered to the provided screenplay in 832/857 (97.1%) instances, and in the remaining instances, it was medically appropriate in 24/25 (96.0%) cases. Use of LLM appears to be feasible for this purpose, and further studies are required to examine their educational impact.
期刊介绍:
The Internal Medicine Journal is the official journal of the Adult Medicine Division of The Royal Australasian College of Physicians (RACP). Its purpose is to publish high-quality internationally competitive peer-reviewed original medical research, both laboratory and clinical, relating to the study and research of human disease. Papers will be considered from all areas of medical practice and science. The Journal also has a major role in continuing medical education and publishes review articles relevant to physician education.