JMIR Medical Education最新文献

{"title":"Identifying Learning Preferences and Strategies in Health Data Science Courses: Systematic Review.","authors":"Narjes Rohani, Stephen Sowa, Areti Manataki","doi":"10.2196/50667","DOIUrl":"10.2196/50667","url":null,"abstract":"<p><strong>Background: </strong>Learning and teaching interdisciplinary health data science (HDS) is highly challenging, and despite the growing interest in HDS education, little is known about the learning experiences and preferences of HDS students.</p><p><strong>Objective: </strong>We conducted a systematic review to identify learning preferences and strategies in the HDS discipline.</p><p><strong>Methods: </strong>We searched 10 bibliographic databases (PubMed, ACM Digital Library, Web of Science, Cochrane Library, Wiley Online Library, ScienceDirect, SpringerLink, EBSCOhost, ERIC, and IEEE Xplore) from the date of inception until June 2023. We followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines and included primary studies written in English that investigated the learning preferences or strategies of students in HDS-related disciplines, such as bioinformatics, at any academic level. Risk of bias was independently assessed by 2 screeners using the Mixed Methods Appraisal Tool, and we used narrative data synthesis to present the study results.</p><p><strong>Results: </strong>After abstract screening and full-text reviewing of the 849 papers retrieved from the databases, 8 (0.9%) studies, published between 2009 and 2021, were selected for narrative synthesis. The majority of these papers (7/8, 88%) investigated learning preferences, while only 1 (12%) paper studied learning strategies in HDS courses. The systematic review revealed that most HDS learners prefer visual presentations as their primary learning input. In terms of learning process and organization, they mostly tend to follow logical, linear, and sequential steps. Moreover, they focus more on abstract information, rather than detailed and concrete information. Regarding collaboration, HDS students sometimes prefer teamwork, and sometimes they prefer to work alone.</p><p><strong>Conclusions: </strong>The studies' quality, assessed using the Mixed Methods Appraisal Tool, ranged between 73% and 100%, indicating excellent quality overall. However, the number of studies in this area is small, and the results of all studies are based on self-reported data. Therefore, more research needs to be conducted to provide insight into HDS education. We provide some suggestions, such as using learning analytics and educational data mining methods, for conducting future research to address gaps in the literature. We also discuss implications for HDS educators, and we make recommendations for HDS course design; for example, we recommend including visual materials, such as diagrams and videos, and offering step-by-step instructions for students.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11347898/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141971966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"An Approach to the Design and Development of an Accredited Continuing Professional Development e-Learning Module on Virtual Care.","authors":"Vernon Curran, Robert Glynn, Cindy Whitton, Ann Hollett","doi":"10.2196/52906","DOIUrl":"10.2196/52906","url":null,"abstract":"<p><strong>Unlabelled: </strong>Virtual care appointments expanded rapidly during COVID-19 out of necessity and to enable access and continuity of care for many patients. While previous work has explored health care providers' experiences with telehealth usage on small-scale projects, the broad-level adoption of virtual care during the pandemic has expounded opportunities for a better understanding of how to enhance the integration of telehealth as a regular mode of health care services delivery. Training and education for health care providers on the effective use of virtual care technologies are factors that can help facilitate improved adoption and use. We describe our approach to designing and developing an accredited continuing professional development (CPD) program using e-learning technologies to foster better knowledge and comfort among health care providers with the use of virtual care technologies. First, we discuss our approach to undertaking a systematic needs assessment study using a survey questionnaire of providers, key informant interviews, and a patient focus group. Next, we describe our steps in consulting with key stakeholder groups in the health system and arranging committees to inform the design of the program and address accreditation requirements. The instructional design features and aspects of the e-learning module are then described in depth, and our plan for evaluating the program is shared as well. As a CPD modality, e-learning offers the opportunity to enhance access to timely continuing professional education for health care providers who may be geographically dispersed across rural and remote communities.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11327639/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141907878","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Assessing ChatGPT's Competency in Addressing Interdisciplinary Inquiries on Chatbot Uses in Sports Rehabilitation: Simulation Study.","authors":"Joseph C McBee, Daniel Y Han, Li Liu, Leah Ma, Donald A Adjeroh, Dong Xu, Gangqing Hu","doi":"10.2196/51157","DOIUrl":"10.2196/51157","url":null,"abstract":"<p><strong>Background: </strong>ChatGPT showcases exceptional conversational capabilities and extensive cross-disciplinary knowledge. In addition, it can perform multiple roles in a single chat session. This unique multirole-playing feature positions ChatGPT as a promising tool for exploring interdisciplinary subjects.</p><p><strong>Objective: </strong>The aim of this study was to evaluate ChatGPT's competency in addressing interdisciplinary inquiries based on a case study exploring the opportunities and challenges of chatbot uses in sports rehabilitation.</p><p><strong>Methods: </strong>We developed a model termed PanelGPT to assess ChatGPT's competency in addressing interdisciplinary topics through simulated panel discussions. Taking chatbot uses in sports rehabilitation as an example of an interdisciplinary topic, we prompted ChatGPT through PanelGPT to role-play a physiotherapist, psychologist, nutritionist, artificial intelligence expert, and athlete in a simulated panel discussion. During the simulation, we posed questions to the panel while ChatGPT acted as both the panelists for responses and the moderator for steering the discussion. We performed the simulation using ChatGPT-4 and evaluated the responses by referring to the literature and our human expertise.</p><p><strong>Results: </strong>By tackling questions related to chatbot uses in sports rehabilitation with respect to patient education, physiotherapy, physiology, nutrition, and ethical considerations, responses from the ChatGPT-simulated panel discussion reasonably pointed to various benefits such as 24/7 support, personalized advice, automated tracking, and reminders. ChatGPT also correctly emphasized the importance of patient education, and identified challenges such as limited interaction modes, inaccuracies in emotion-related advice, assurance of data privacy and security, transparency in data handling, and fairness in model training. It also stressed that chatbots are to assist as a copilot, not to replace human health care professionals in the rehabilitation process.</p><p><strong>Conclusions: </strong>ChatGPT exhibits strong competency in addressing interdisciplinary inquiry by simulating multiple experts from complementary backgrounds, with significant implications in assisting medical education.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11339563/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141753020","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"How to Develop an Online Video for Teaching Health Procedural Skills: Tutorial for Health Educators New to Video Production.","authors":"Komal Srinivasa, Amanda Charlton, Fiona Moir, Felicity Goodyear-Smith","doi":"10.2196/51740","DOIUrl":"10.2196/51740","url":null,"abstract":"<p><strong>Background: </strong>Clinician educators are experts in procedural skills that students need to learn. Some clinician educators are interested in creating their own procedural videos but are typically not experts in video production, and there is limited information on this topic in the clinical education literature. Therefore, we present a tutorial for clinician educators to develop a procedural video.</p><p><strong>Objective: </strong>We describe the steps needed to develop a medical procedural video from the perspective of a clinician educator new to creating videos, informed by best practices as evidenced by the literature. We also produce a checklist of elements that ensure a quality video. Finally, we identify the barriers and facilitators to making such a video.</p><p><strong>Methods: </strong>We used the example of processing a piece of skeletal muscle in a pathology laboratory to make a video. We developed the video by dividing it into 3 phases: preproduction, production, and postproduction. After writing the learning outcomes, we created a storyboard and script, which were validated by subject matter and audiovisual experts. Photos and videos were captured on a digital camera mounted on a monopod. Video editing software was used to sequence the video clips and photos, insert text and audio narration, and generate closed captions. The finished video was uploaded to YouTube (Google) and then inserted into open-source authoring software to enable an interactive quiz.</p><p><strong>Results: </strong>The final video was 4 minutes and 4 seconds long and took 70 hours to create. The final video included audio narration, closed captioning, bookmarks, and an interactive quiz. We identified that an effective video has six key factors: (1) clear learning outcomes, (2) being engaging, (3) being learner-centric, (4) incorporating principles of multimedia learning, (5) incorporating adult learning theories, and (6) being of high audiovisual quality. To ensure educational quality, we developed a checklist of elements that educators can use to develop a video. One of the barriers to creating procedural videos for a clinician educator who is new to making videos is the significant time commitment to build videography and editing skills. The facilitators for developing an online video include creating a community of practice and repeated skill-building rehearsals using simulations.</p><p><strong>Conclusions: </strong>We outlined the steps in procedural video production and developed a checklist of quality elements. These steps and the checklist can guide a clinician educator in creating a quality video while recognizing the time, technical, and cognitive requirements.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11339575/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141898532","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The Use of a Novel Virtual Reality Training Tool for Peritoneal Dialysis: Qualitative Assessment Among Health Care Professionals.","authors":"Caterina Lonati, Marie Wellhausen, Stefan Pennig, Thomas Röhrßen, Fatih Kircelli, Svenja Arendt, Ulrich Tschulena","doi":"10.2196/46220","DOIUrl":"10.2196/46220","url":null,"abstract":"<p><strong>Background: </strong>Effective peritoneal dialysis (PD) training is essential for performing dialysis at home and reducing the risk of peritonitis and other PD-related infections. Virtual reality (VR) is an innovative learning tool that is able to combine theoretical information, interactivity, and behavioral instructions while offering a playful learning environment. To improve patient training for PD, Fresenius Medical Care launched the stay•safe MyTraining VR, a novel educational program based on the use of a VR headset and a handheld controller.</p><p><strong>Objective: </strong>This qualitative assessment aims to investigate opinions toward the new tool among the health care professionals (HCPs) who were responsible for implementing the VR application.</p><p><strong>Methods: </strong>We recruited nursing staff and nephrologists who have gained practical experience with the stay•safe MyTraining VR within pilot dialysis centers. Predetermined open-ended questions were administered during individual and group video interviews.</p><p><strong>Results: </strong>We interviewed 7 HCPs who have 2 to 20 years of experience in PD training. The number of patients trained with the stay•safe MyTraining VR ranged from 2 to 5 for each professional. The stay•safe MyTraining VR was well accepted and perceived as a valuable supplementary tool for PD training. From the respondents' perspective, the technology improved patients' learning experience by facilitating the internalization of both medical information and procedural skills. HCPs highlighted that the opportunity offered by VR to reiterate training activities in a positive and safe learning environment, according to each patient's needs, can facilitate error correction and implement a standardized training curriculum. However, VR had limited use in the final phase of the patient PD training program, where learners need to get familiar with the handling of the materials. Moreover, the traditional PD training was still considered essential to manage the emotional and motivational aspects and address any patient-specific application-oriented questions. In addition to its use within PD training, VR was perceived as a useful tool to support the decision-making process of patients and train other HCPs. Moreover, VR introduction was associated with increased efficiency and productivity of HCPs because it enabled them to perform other activities while the patient was practicing with the device. As for patients' acceptance of the new tool, interviewees reported positive feedback, including that of older adults. Limited use with patients experiencing dementia or severe visual impairment or lacking sensomotoric competence was mentioned.</p><p><strong>Conclusions: </strong>The stay•safe MyTraining VR is suggested to improve training efficiency and efficacy and thus could have a positive impact in the PD training scenario. Our study offers a process proposal that can serve as a guide to the implementation ","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11336508/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141894516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Multidisciplinary Design-Based Multimodal Virtual Reality Simulation in Nursing Education: Mixed Methods Study.","authors":"Ji-Young Yeo, Hyeongil Nam, Jong-Il Park, Soo-Yeon Han","doi":"10.2196/53106","DOIUrl":"10.2196/53106","url":null,"abstract":"<p><strong>Background: </strong>The COVID-19 pandemic underscored the necessity for innovative educational methods in nursing. Our study takes a unique approach using a multidisciplinary simulation design, which offers a systematic and comprehensive strategy for developing virtual reality (VR) simulations in nursing education.</p><p><strong>Objective: </strong>The aim of this study is to develop VR simulation content for a pediatric nursing module based on a multidisciplinary simulation design and to evaluate its feasibility for nursing education.</p><p><strong>Methods: </strong>This study used a 1-group, posttest-only design. VR content for pediatric nursing practice was developed by integrating the technological characteristics of a multimodal VR system with the learning elements of traditional nursing simulation, combining various disciplines, including education, engineering, and nursing. A user test was conducted with 12 nursing graduates (preservice nurses) followed by post hoc surveys (assessing presence, VR systems, VR sickness, and simulation satisfaction) and in-depth, one-on-one interviews.</p><p><strong>Results: </strong>User tests showed mean scores of 4.01 (SD 1.43) for presence, 4.91 (SD 0.81) for the VR system, 0.64 (SD 0.35) for VR sickness, and 5.00 (SD 1.00) for simulation satisfaction. In-depth interviews revealed that the main strengths of the immersive VR simulation for pediatric pneumonia nursing were effective visualization and direct experience through hands-on manipulation; the drawback was keyword-based voice interaction. To improve VR simulation quality, participants suggested increasing the number of nursing techniques and refining them in more detail.</p><p><strong>Conclusions: </strong>This VR simulation content for a pediatric nursing practice using a multidisciplinary educational design model was confirmed to have positive educational potential. Further research is needed to confirm the specific learning effects of immersive nursing content based on multidisciplinary design models.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11316146/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141761456","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Assessing the Ability of a Large Language Model to Score Free-Text Medical Student Clinical Notes: Quantitative Study.","authors":"Harry B Burke, Albert Hoang, Joseph O Lopreiato, Heidi King, Paul Hemmer, Michael Montgomery, Viktoria Gagarin","doi":"10.2196/56342","DOIUrl":"10.2196/56342","url":null,"abstract":"<p><strong>Background: </strong>Teaching medical students the skills required to acquire, interpret, apply, and communicate clinical information is an integral part of medical education. A crucial aspect of this process involves providing students with feedback regarding the quality of their free-text clinical notes.</p><p><strong>Objective: </strong>The goal of this study was to assess the ability of ChatGPT 3.5, a large language model, to score medical students' free-text history and physical notes.</p><p><strong>Methods: </strong>This is a single-institution, retrospective study. Standardized patients learned a prespecified clinical case and, acting as the patient, interacted with medical students. Each student wrote a free-text history and physical note of their interaction. The students' notes were scored independently by the standardized patients and ChatGPT using a prespecified scoring rubric that consisted of 85 case elements. The measure of accuracy was percent correct.</p><p><strong>Results: </strong>The study population consisted of 168 first-year medical students. There was a total of 14,280 scores. The ChatGPT incorrect scoring rate was 1.0%, and the standardized patient incorrect scoring rate was 7.2%. The ChatGPT error rate was 86%, lower than the standardized patient error rate. The ChatGPT mean incorrect scoring rate of 12 (SD 11) was significantly lower than the standardized patient mean incorrect scoring rate of 85 (SD 74; P=.002).</p><p><strong>Conclusions: </strong>ChatGPT demonstrated a significantly lower error rate compared to standardized patients. This is the first study to assess the ability of a generative pretrained transformer (GPT) program to score medical students' standardized patient-based free-text clinical notes. It is expected that, in the near future, large language models will provide real-time feedback to practicing physicians regarding their free-text notes. GPT artificial intelligence programs represent an important advance in medical education and medical practice.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11327632/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141907879","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Roles and Responsibilities of the Global Specialist Digital Health Workforce: Analysis of Global Census Data.","authors":"Kerryn Butler-Henderson, Kathleen Gray, Salma Arabi","doi":"10.2196/54137","DOIUrl":"10.2196/54137","url":null,"abstract":"<p><strong>Background: </strong>The Global Specialist Digital Health Workforce Census is the largest workforce survey of the specialist roles that support the development, use, management, and governance of health data, health information, health knowledge, and health technology.</p><p><strong>Objective: </strong>This paper aims to present an analysis of the roles and functions reported by respondents in the 2023 census.</p><p><strong>Methods: </strong>The 2023 census was deployed using Qualtrics and was open from July 1 to August 13, 2023. A broad definition was provided to guide respondents about who is in the specialist digital health workforce. Anyone who self-identifies as being part of this workforce could undertake the survey. The data was analyzed using descriptive statistical analysis and thematic analysis of the functions respondents reported in their roles.</p><p><strong>Results: </strong>A total of 1103 respondents completed the census, with data reported about their demographic information and their roles. The majority of respondents lived in Australia (n=870, 78.9%) or New Zealand (n=130, 11.8%), with most (n=620, 56.3%) aged 35-54 years and identifying as female (n=720, 65.3%). The top four occupational specialties were health informatics (n=179, 20.2%), health information management (n=175, 19.8%), health information technology (n=128, 14.4%), and health librarianship (n=104, 11.7%). Nearly all (n=797, 90%) participants identified as a manager or professional. Less than half (430/1019, 42.2%) had a formal qualification in a specialist digital health area, and only one-quarter (244/938, 26%) held a credential in a digital health area. While two-thirds (502/763, 65.7%) reported undertaking professional development in the last year, most were self-directed activities, such as seeking information or consuming online content. Work undertaken by specialist digital health workers could be classified as either leadership, functional, occupational, or technological.</p><p><strong>Conclusions: </strong>Future specialist digital health workforce capability frameworks should include the aspects of leadership, function, occupation, and technology. This largely unqualified workforce is undertaking little formal professional development to upskill them to continue to support the safe delivery and management of health and care through the use of digital data and technology.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11327619/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141907880","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Using the Kirkpatrick Model to Evaluate the Effect of a Primary Trauma Care Course on Health Care Workers' Knowledge, Attitude, and Practice in Two Vietnamese Local Hospitals: Prospective Intervention Study.","authors":"Ba Tuan Nguyen, Van Anh Nguyen, Christopher Leigh Blizzard, Andrew Palmer, Huu Tu Nguyen, Thang Cong Quyet, Viet Tran, Marcus Skinner, Haydn Perndt, Mark R Nelson","doi":"10.2196/47127","DOIUrl":"10.2196/47127","url":null,"abstract":"<p><strong>Background: </strong>The Primary Trauma Care (PTC) course was originally developed to instruct health care workers in the management of patients with severe injuries in low- and middle-income countries (LMICs) with limited medical resources. PTC has now been taught for more than 25 years. Many studies have demonstrated that the 2-day PTC workshop is useful and informative to frontline health staff and has helped improve knowledge and confidence in trauma management; however, there is little evidence of the effect of the course on changes in clinical practice. The Kirkpatrick model (KM) and the knowledge, attitude, and practice (KAP) model are effective methods to evaluate this question.</p><p><strong>Objective: </strong>The aim of this study was to investigate how the 2-day PTC course impacts the satisfaction, knowledge, and skills of health care workers in 2 Vietnamese hospitals using a conceptual framework incorporating the KAP model and the 4-level KM as evaluation tools.</p><p><strong>Methods: </strong>The PTC course was delivered over 2 days in the emergency departments (EDs) of Thanh Hoa and Ninh Binh hospitals in February and March 2022, respectively. This study followed a prospective pre- and postintervention design. We used validated instruments to assess the participants' satisfaction, knowledge, and skills before, immediately after, and 6 months after course delivery. The Fisher exact test and the Wilcoxon matched-pairs signed rank test were used to compare the percentages and mean scores at the pretest, posttest, and 6-month postcourse follow-up time points among course participants.</p><p><strong>Results: </strong>A total of 80 health care staff members attended the 2-day PTC course and nearly 100% of the participants were satisfied with the course. At level 2 of the KM (knowledge), the scores on multiple-choice questions and the confidence matrix improved significantly from 60% to 77% and from 59% to 71%, respectively (P<.001), and these improvements were seen in both subgroups (nurses and doctors). The focus of level 3 was on practice, demonstrating a significant incremental change, with scenarios checklist points increasing from a mean of 5.9 (SD 1.9) to 9.0 (SD 0.9) and bedside clinical checklist points increasing from a mean of 5 (SD 1.5) to 8.3 (SD 0.8) (both P<.001). At the 6-month follow-up, the scores for multiple-choice questions, the confidence matrix, and scenarios checklist all remained unchanged, except for the multiple-choice question score in the nurse subgroup (P=.005).</p><p><strong>Conclusions: </strong>The PTC course undertaken in 2 local hospitals in Vietnam was successful in demonstrating improvements at 3 levels of the KM for ED health care staff. The improvements in the confidence matrix and scenarios checklist were maintained for at least 6 months after the course. PTC courses should be effective in providing and sustaining improvement in knowledge and trauma care practice in other LMICs such as Vi","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11284612/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141749212","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Appraisal of ChatGPT's Aptitude for Medical Education: Comparative Analysis With Third-Year Medical Students in a Pulmonology Examination.","authors":"Hela Cherif, Chirine Moussa, Abdel Mouhaymen Missaoui, Issam Salouage, Salma Mokaddem, Besma Dhahri","doi":"10.2196/52818","DOIUrl":"10.2196/52818","url":null,"abstract":"<p><strong>Background: </strong>The rapid evolution of ChatGPT has generated substantial interest and led to extensive discussions in both public and academic domains, particularly in the context of medical education.</p><p><strong>Objective: </strong>This study aimed to evaluate ChatGPT's performance in a pulmonology examination through a comparative analysis with that of third-year medical students.</p><p><strong>Methods: </strong>In this cross-sectional study, we conducted a comparative analysis with 2 distinct groups. The first group comprised 244 third-year medical students who had previously taken our institution's 2020 pulmonology examination, which was conducted in French. The second group involved ChatGPT-3.5 in 2 separate sets of conversations: without contextualization (V1) and with contextualization (V2). In both V1 and V2, ChatGPT received the same set of questions administered to the students.</p><p><strong>Results: </strong>V1 demonstrated exceptional proficiency in radiology, microbiology, and thoracic surgery, surpassing the majority of medical students in these domains. However, it faced challenges in pathology, pharmacology, and clinical pneumology. In contrast, V2 consistently delivered more accurate responses across various question categories, regardless of the specialization. ChatGPT exhibited suboptimal performance in multiple choice questions compared to medical students. V2 excelled in responding to structured open-ended questions. Both ChatGPT conversations, particularly V2, outperformed students in addressing questions of low and intermediate difficulty. Interestingly, students showcased enhanced proficiency when confronted with highly challenging questions. V1 fell short of passing the examination. Conversely, V2 successfully achieved examination success, outperforming 139 (62.1%) medical students.</p><p><strong>Conclusions: </strong>While ChatGPT has access to a comprehensive web-based data set, its performance closely mirrors that of an average medical student. Outcomes are influenced by question format, item complexity, and contextual nuances. The model faces challenges in medical contexts requiring information synthesis, advanced analytical aptitude, and clinical judgment, as well as in non-English language assessments and when confronted with data outside mainstream internet sources.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11303904/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141753019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}