Lena Rössler, Manfred Herrmann, Annette Wiegand, Philipp Kanzow
{"title":"Use of Multiple-Choice Items in Summative Examinations: Questionnaire Survey Among German Undergraduate Dental Training Programs.","authors":"Lena Rössler, Manfred Herrmann, Annette Wiegand, Philipp Kanzow","doi":"10.2196/58126","DOIUrl":"10.2196/58126","url":null,"abstract":"<p><strong>Background: </strong>Multiple-choice examinations are frequently used in German dental schools. However, details regarding the used item types and applied scoring methods are lacking.</p><p><strong>Objective: </strong>This study aims to gain insight into the current use of multiple-choice items (ie, questions) in summative examinations in German undergraduate dental training programs.</p><p><strong>Methods: </strong>A paper-based 10-item questionnaire regarding the used assessment methods, multiple-choice item types, and applied scoring methods was designed. The pilot-tested questionnaire was mailed to the deans of studies and to the heads of the Department of Operative/Restorative Dentistry at all 30 dental schools in Germany in February 2023. Statistical analysis was performed using the Fisher exact test (P<.05).</p><p><strong>Results: </strong>The response rate amounted to 90% (27/30 dental schools). All respondent dental schools used multiple-choice examinations for summative assessments. Examinations were delivered electronically by 70% (19/27) of the dental schools. Almost all dental schools used single-choice Type A items (24/27, 89%), which accounted for the largest number of items in approximately half of the dental schools (13/27, 48%). Further item types (eg, conventional multiple-select items, Multiple-True-False, and Pick-N) were only used by fewer dental schools (≤67%, up to 18 out of 27 dental schools). For the multiple-select item types, the applied scoring methods varied considerably (ie, awarding [intermediate] partial credit and requirements for partial credit). Dental schools with the possibility of electronic examinations used multiple-select items slightly more often (14/19, 74% vs 4/8, 50%). However, this difference was statistically not significant (P=.38). Dental schools used items either individually or as key feature problems consisting of a clinical case scenario followed by a number of items focusing on critical treatment steps (15/27, 56%). Not a single school used alternative testing methods (eg, answer-until-correct). A formal item review process was established at about half of the dental schools (15/27, 56%).</p><p><strong>Conclusions: </strong>Summative assessment methods among German dental schools vary widely. Especially, a large variability regarding the use and scoring of multiple-select multiple-choice items was found.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"10 ","pages":"e58126"},"PeriodicalIF":3.2,"publicationDate":"2024-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11220727/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141477566","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Proposed Decision-Making Framework for the Translation of In-Person Clinical Care to Digital Care: Tutorial.","authors":"Anna DeLaRosby, Julie Mulcahy, Todd Norwood","doi":"10.2196/52993","DOIUrl":"10.2196/52993","url":null,"abstract":"<p><strong>Unlabelled: </strong>The continued demand for digital health requires that providers adapt thought processes to enable sound clinical decision-making in digital settings. Providers report that lack of training is a barrier to providing digital health care. Physical examination techniques and hands-on interventions must be adjusted in safe, reliable, and feasible ways to provide digital care, and decision-making may be impacted by modifications made to these techniques. We have proposed a framework to determine whether a procedure can be modified to obtain a comparable result in a digital environment or whether a referral to in-person care is required. The decision-making framework was developed using program outcomes of a digital physical therapy platform and aims to alleviate barriers to delivering digital care that providers may experience. This paper describes the unique considerations a provider must make when collecting background information, selecting and executing procedures, assessing results, and determining whether they can proceed with clinical care in digital settings.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"10 ","pages":"e52993"},"PeriodicalIF":3.2,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11256212/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141634818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zonglin He, Botao Zhou, Haixiao Feng, Jian Bai, Yuechun Wang
{"title":"Inverted Classroom Teaching of Physiology in Basic Medical Education: Bibliometric Visual Analysis.","authors":"Zonglin He, Botao Zhou, Haixiao Feng, Jian Bai, Yuechun Wang","doi":"10.2196/52224","DOIUrl":"10.2196/52224","url":null,"abstract":"<p><strong>Background: </strong>Over the last decade, there has been growing interest in inverted classroom teaching (ICT) and its various forms within the education sector. Physiology is a core course that bridges basic and clinical medicine, and ICT in physiology has been sporadically practiced to different extents globally. However, students' and teachers' responses and feedback to ICT in physiology are diverse, and the effectiveness of a modified ICT model integrated into regular teaching practice in physiology courses is difficult to assess objectively and quantitatively.</p><p><strong>Objective: </strong>This study aimed to explore the current status and development direction of ICT in physiology in basic medical education using bibliometric visual analysis of the related literature.</p><p><strong>Methods: </strong>A bibliometric analysis of the ICT-related literature in physiology published between 2000 and 2023 was performed using CiteSpace, a bibliometric visualization tool, based on the Web of Science database. Moreover, an in-depth review was performed to summarize the application of ICT in physiology courses worldwide, along with identification of research hot spots and development trends.</p><p><strong>Results: </strong>A total of 42 studies were included for this bibliometric analysis, with the year 2013 marking the commencement of the field. University staff and doctors working at affiliated hospitals represent the core authors of this field, with several research teams forming cooperative relationships and developing research networks. The development of ICT in physiology could be divided into several stages: the introduction stage (2013-2014), extensive practice stage (2015-2019), and modification and growth stage (2020-2023). Gopalan C is the author with the highest citation count of 5 cited publications and has published 14 relevant papers since 2016, with a significant surge from 2019 to 2022. Author collaboration is generally limited in this field, and most academic work has been conducted in independent teams, with minimal cross-team communication. Authors from the United States published the highest number of papers related to ICT in physiology (18 in total, accounting for over 43% of the total papers), and their intermediary centrality was 0.24, indicating strong connections both within the country and internationally. Chinese authors ranked second, publishing 8 papers in the field, although their intermediary centrality was only 0.02, suggesting limited international influence and lower overall research quality. The topics of ICT in physiology research have been multifaceted, covering active learning, autonomous learning, student performance, teaching effect, blended teaching, and others.</p><p><strong>Conclusions: </strong>This bibliometric analysis and literature review provides a comprehensive overview of the history, development process, and future direction of the field of ICT in physiology. These findings can help t","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"10 ","pages":"e52224"},"PeriodicalIF":3.2,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11217164/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141471235","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evaluation of ChatGPT-Generated Differential Diagnosis for Common Diseases With Atypical Presentation: Descriptive Research.","authors":"Kiyoshi Shikino, Taro Shimizu, Yuki Otsuka, Masaki Tago, Hiromizu Takahashi, Takashi Watari, Yosuke Sasaki, Gemmei Iizuka, Hiroki Tamura, Koichi Nakashima, Kotaro Kunitomo, Morika Suzuki, Sayaka Aoyama, Shintaro Kosaka, Teiko Kawahigashi, Tomohiro Matsumoto, Fumina Orihara, Toru Morikawa, Toshinori Nishizawa, Yoji Hoshina, Yu Yamamoto, Yuichiro Matsuo, Yuto Unoki, Hirofumi Kimura, Midori Tokushima, Satoshi Watanuki, Takuma Saito, Fumio Otsuka, Yasuharu Tokuda","doi":"10.2196/58758","DOIUrl":"10.2196/58758","url":null,"abstract":"<p><strong>Background: </strong>The persistence of diagnostic errors, despite advances in medical knowledge and diagnostics, highlights the importance of understanding atypical disease presentations and their contribution to mortality and morbidity. Artificial intelligence (AI), particularly generative pre-trained transformers like GPT-4, holds promise for improving diagnostic accuracy, but requires further exploration in handling atypical presentations.</p><p><strong>Objective: </strong>This study aimed to assess the diagnostic accuracy of ChatGPT in generating differential diagnoses for atypical presentations of common diseases, with a focus on the model's reliance on patient history during the diagnostic process.</p><p><strong>Methods: </strong>We used 25 clinical vignettes from the Journal of Generalist Medicine characterizing atypical manifestations of common diseases. Two general medicine physicians categorized the cases based on atypicality. ChatGPT was then used to generate differential diagnoses based on the clinical information provided. The concordance between AI-generated and final diagnoses was measured, with a focus on the top-ranked disease (top 1) and the top 5 differential diagnoses (top 5).</p><p><strong>Results: </strong>ChatGPT's diagnostic accuracy decreased with an increase in atypical presentation. For category 1 (C1) cases, the concordance rates were 17% (n=1) for the top 1 and 67% (n=4) for the top 5. Categories 3 (C3) and 4 (C4) showed a 0% concordance for top 1 and markedly lower rates for the top 5, indicating difficulties in handling highly atypical cases. The χ2 test revealed no significant difference in the top 1 differential diagnosis accuracy between less atypical (C1+C2) and more atypical (C3+C4) groups (χ²1=2.07; n=25; P=.13). However, a significant difference was found in the top 5 analyses, with less atypical cases showing higher accuracy (χ²1=4.01; n=25; P=.048).</p><p><strong>Conclusions: </strong>ChatGPT-4 demonstrates potential as an auxiliary tool for diagnosing typical and mildly atypical presentations of common diseases. However, its performance declines with greater atypicality. The study findings underscore the need for AI systems to encompass a broader range of linguistic capabilities, cultural understanding, and diverse clinical scenarios to improve diagnostic utility in real-world settings.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"10 ","pages":"e58758"},"PeriodicalIF":3.2,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11199925/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141447236","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ayma Aqib, Faiha Fareez, Elnaz Assadpour, Tubba Babar, Andrew Kokavec, Edward Wang, Thomas Lo, Jean-Paul Lam, Christopher Smith
{"title":"Development of a Novel Web-Based Tool to Enhance Clinical Skills in Medical Education.","authors":"Ayma Aqib, Faiha Fareez, Elnaz Assadpour, Tubba Babar, Andrew Kokavec, Edward Wang, Thomas Lo, Jean-Paul Lam, Christopher Smith","doi":"10.2196/47438","DOIUrl":"10.2196/47438","url":null,"abstract":"<p><strong>Unlabelled: </strong>A significant component of Canadian medical education is the development of clinical skills. The medical educational curriculum assesses these skills through an objective structured clinical examination (OSCE). This OSCE assesses skills imperative to good clinical practice, such as patient communication, clinical decision-making, and medical knowledge. Despite the widespread implementation of this examination across all academic settings, few preparatory resources exist that cater specifically to Canadian medical students. MonkeyJacket is a novel, open-access, web-based application, built with the goal of providing medical students with an accessible and representative tool for clinical skill development for the OSCE and clinical settings. This viewpoint paper presents the development of the MonkeyJacket application and its potential to assist medical students in preparation for clinical examinations and practical settings. Limited resources exist that are web-based; accessible in terms of cost; specific to the Medical Council of Canada (MCC); and, most importantly, scalable in nature. The goal of this research study was to thoroughly describe the potential utility of the application, particularly its capacity to provide practice and scalable formative feedback to medical students. MonkeyJacket was developed to provide Canadian medical students with the opportunity to practice their clinical examination skills and receive peer feedback by using a centralized platform. The OSCE cases included in the application were developed by using the MCC guidelines to ensure their applicability to a Canadian setting. There are currently 75 cases covering 5 specialties, including cardiology, respirology, gastroenterology, neurology, and psychiatry. The MonkeyJacket application is a web-based platform that allows medical students to practice clinical decision-making skills in real time with their peers through a synchronous platform. Through this application, students can practice patient interviewing, clinical reasoning, developing differential diagnoses, and formulating a management plan, and they can receive both qualitative feedback and quantitative feedback. Each clinical case is associated with an assessment checklist that is accessible to students after practice sessions are complete; the checklist promotes personal improvement through peer feedback. This tool provides students with relevant case stems, follow-up questions that probe for differential diagnoses and management plans, assessment checklists, and the ability to review the trend in their performance. The MonkeyJacket application provides medical students with a valuable tool that promotes clinical skill development for OSCEs and clinical settings. MonkeyJacket introduces a way for medical learners to receive feedback regarding patient interviewing and clinical reasoning skills that is both formative and scalable in nature, in addition to promoting interinstituti","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"10 ","pages":"e47438"},"PeriodicalIF":3.2,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11217162/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141433025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jennifer Jones, Jamie Sewan Johnston, Ngouille Yabsa Ndiaye, Anna Tokar, Saumya Singla, Nadine Ann Skinner, Matthew Strehlow, Heini Utunen
{"title":"Health Care Workers' Motivations for Enrolling in Massive Open Online Courses During a Public Health Emergency: Descriptive Analysis.","authors":"Jennifer Jones, Jamie Sewan Johnston, Ngouille Yabsa Ndiaye, Anna Tokar, Saumya Singla, Nadine Ann Skinner, Matthew Strehlow, Heini Utunen","doi":"10.2196/51915","DOIUrl":"10.2196/51915","url":null,"abstract":"<p><strong>Background: </strong>Massive open online courses (MOOCs) are increasingly used to educate health care workers during public health emergencies. In early 2020, the World Health Organization (WHO) developed a series of MOOCs for COVID-19, introducing the disease and strategies to control its outbreak, with 6 courses specifically targeting health care workers as learners. In 2020, Stanford University also launched a MOOC designed to deliver accurate and timely education on COVID-19, equipping health care workers across the globe to provide health care safely and effectively to patients with the novel infectious disease. Although the use of MOOCs for just-in-time training has expanded during the pandemic, evidence is limited regarding the factors motivating health care workers to enroll in and complete courses, particularly in low-income countries (LICs) and lower-middle-income countries (LMICs).</p><p><strong>Objective: </strong>This study seeks to gain insights on the characteristics and motivations of learners turning to MOOCs for just-in-time training, to provide evidence that can better inform MOOC design to meet the needs of health care workers. We examine data from learners in 1 Stanford University and 6 WHO COVID-19 courses to identify (1) the characteristics of health care workers completing the courses and (2) the factors motivating them to enroll.</p><p><strong>Methods: </strong>We analyze (1) course registration data of the 49,098 health care workers who completed the 7 focal courses and (2) survey responses from 6272 course completers. The survey asked respondents to rank their motivations for enrollment and share feedback about their learning experience. We use descriptive statistics to compare responses by health care profession and by World Bank country income classification.</p><p><strong>Results: </strong>Health care workers completed the focal courses from all regions of the world, with nearly one-third (14,159/49,098, 28.84%) practicing in LICs and LMICs. Survey data revealed a diverse range of professional roles among the learners, including physicians (2171/6272, 34.61%); nurses (1599/6272, 25.49%); and other health care professionals such as allied health professionals, community health workers, paramedics, and pharmacists (2502/6272, 39.89%). Across all health care professions, the primary motivation to enroll was for personal learning to improve clinical practice. Continuing education credit was also an important motivator, particularly for nonphysicians and learners in LICs and LMICs. Course cost (3423/6272, 54.58%) and certification (4238/6272, 67.57%) were also important to a majority of learners.</p><p><strong>Conclusions: </strong>Our results demonstrate that a diverse range of health care professionals accessed MOOCs for just-in-time training during a public health emergency. Although all health care workers were motivated to improve their clinical practice, different factors were influential across professio","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"10 ","pages":"e51915"},"PeriodicalIF":3.2,"publicationDate":"2024-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11199926/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141433026","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Joy Doll, A Jerrod Anzalone, Martina Clarke, Kathryn Cooper, Ann Polich, Jacob Siedlik
{"title":"A Call for a Health Data-Informed Workforce Among Clinicians.","authors":"Joy Doll, A Jerrod Anzalone, Martina Clarke, Kathryn Cooper, Ann Polich, Jacob Siedlik","doi":"10.2196/52290","DOIUrl":"10.2196/52290","url":null,"abstract":"<p><strong>Unlabelled: </strong>A momentous amount of health data has been and is being collected. Across all levels of health care, data are driving decision-making and impacting patient care. A new field of knowledge and role for those in health care is emerging-the need for a health data-informed workforce. In this viewpoint, we describe the approaches needed to build a health data-informed workforce, a new and critical skill for the health care ecosystem.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"10 ","pages":"e52290"},"PeriodicalIF":3.2,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11194696/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141421267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evolution of Chatbots in Nursing Education: Narrative Review.","authors":"Fang Zhang, Xiaoliu Liu, Wenyan Wu, Shiben Zhu","doi":"10.2196/54987","DOIUrl":"10.2196/54987","url":null,"abstract":"<p><strong>Background: </strong>The integration of chatbots in nursing education is a rapidly evolving area with potential transformative impacts. This narrative review aims to synthesize and analyze the existing literature on chatbots in nursing education.</p><p><strong>Objective: </strong>This study aims to comprehensively examine the temporal trends, international distribution, study designs, and implications of chatbots in nursing education.</p><p><strong>Methods: </strong>A comprehensive search was conducted across 3 databases (PubMed, Web of Science, and Embase) following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram.</p><p><strong>Results: </strong>A total of 40 articles met the eligibility criteria, with a notable increase of publications in 2023 (n=28, 70%). Temporal analysis revealed a notable surge in publications from 2021 to 2023, emphasizing the growing scholarly interest. Geographically, Taiwan province made substantial contributions (n=8, 20%), followed by the United States (n=6, 15%) and South Korea (n=4, 10%). Study designs varied, with reviews (n=8, 20%) and editorials (n=7, 18%) being predominant, showcasing the richness of research in this domain.</p><p><strong>Conclusions: </strong>Integrating chatbots into nursing education presents a promising yet relatively unexplored avenue. This review highlights the urgent need for original research, emphasizing the importance of ethical considerations.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"10 ","pages":"e54987"},"PeriodicalIF":3.2,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11186796/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141421268","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Julia-Astrid Moldt, Teresa Festl-Wietek, Wolfgang Fuhl, Susanne Zabel, Manfred Claassen, Samuel Wagner, Kay Nieselt, Anne Herrmann-Werner
{"title":"Assessing AI Awareness and Identifying Essential Competencies: Insights From Key Stakeholders in Integrating AI Into Medical Education.","authors":"Julia-Astrid Moldt, Teresa Festl-Wietek, Wolfgang Fuhl, Susanne Zabel, Manfred Claassen, Samuel Wagner, Kay Nieselt, Anne Herrmann-Werner","doi":"10.2196/58355","DOIUrl":"10.2196/58355","url":null,"abstract":"<p><strong>Background: </strong>The increasing importance of artificial intelligence (AI) in health care has generated a growing need for health care professionals to possess a comprehensive understanding of AI technologies, requiring an adaptation in medical education.</p><p><strong>Objective: </strong>This paper explores stakeholder perceptions and expectations regarding AI in medicine and examines their potential impact on the medical curriculum. This study project aims to assess the AI experiences and awareness of different stakeholders and identify essential AI-related topics in medical education to define necessary competencies for students.</p><p><strong>Methods: </strong>The empirical data were collected as part of the TüKITZMed project between August 2022 and March 2023, using a semistructured qualitative interview. These interviews were administered to a diverse group of stakeholders to explore their experiences and perspectives of AI in medicine. A qualitative content analysis of the collected data was conducted using MAXQDA software.</p><p><strong>Results: </strong>Semistructured interviews were conducted with 38 participants (6 lecturers, 9 clinicians, 10 students, 6 AI experts, and 7 institutional stakeholders). The qualitative content analysis revealed 6 primary categories with a total of 24 subcategories to answer the research questions. The evaluation of the stakeholders' statements revealed several commonalities and differences regarding their understanding of AI. Crucial identified AI themes based on the main categories were as follows: possible curriculum contents, skills, and competencies; programming skills; curriculum scope; and curriculum structure.</p><p><strong>Conclusions: </strong>The analysis emphasizes integrating AI into medical curricula to ensure students' proficiency in clinical applications. Standardized AI comprehension is crucial for defining and teaching relevant content. Considering diverse perspectives in implementation is essential to comprehensively define AI in the medical context, addressing gaps and facilitating effective solutions for future AI use in medical studies. The results provide insights into potential curriculum content and structure, including aspects of AI in medicine.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"10 ","pages":"e58355"},"PeriodicalIF":3.2,"publicationDate":"2024-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11238140/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141581002","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zach Landis-Lewis, Chris A Andrews, Colin A Gross, Charles P Friedman, Nirav J Shah
{"title":"Exploring Anesthesia Provider Preferences for Precision Feedback: Preference Elicitation Study.","authors":"Zach Landis-Lewis, Chris A Andrews, Colin A Gross, Charles P Friedman, Nirav J Shah","doi":"10.2196/54071","DOIUrl":"10.2196/54071","url":null,"abstract":"<p><strong>Background: </strong>Health care professionals must learn continuously as a core part of their work. As the rate of knowledge production in biomedicine increases, better support for health care professionals' continuous learning is needed. In health systems, feedback is pervasive and is widely considered to be essential for learning that drives improvement. Clinical quality dashboards are one widely deployed approach to delivering feedback, but engagement with these systems is commonly low, reflecting a limited understanding of how to improve the effectiveness of feedback about health care. When coaches and facilitators deliver feedback for improving performance, they aim to be responsive to the recipient's motivations, information needs, and preferences. However, such functionality is largely missing from dashboards and feedback reports. Precision feedback is the delivery of high-value, motivating performance information that is prioritized based on its motivational potential for a specific recipient, including their needs and preferences. Anesthesia care offers a clinical domain with high-quality performance data and an abundance of evidence-based quality metrics.</p><p><strong>Objective: </strong>The objective of this study is to explore anesthesia provider preferences for precision feedback.</p><p><strong>Methods: </strong>We developed a test set of precision feedback messages with balanced characteristics across 4 performance scenarios. We created an experimental design to expose participants to contrasting message versions. We recruited anesthesia providers and elicited their preferences through analysis of the content of preferred messages. Participants additionally rated their perceived benefit of preferred messages to clinical practice on a 5-point Likert scale.</p><p><strong>Results: </strong>We elicited preferences and feedback message benefit ratings from 35 participants. Preferences were diverse across participants but largely consistent within participants. Participants' preferences were consistent for message temporality (α=.85) and display format (α=.80). Ratings of participants' perceived benefit to clinical practice of preferred messages were high (mean rating 4.27, SD 0.77).</p><p><strong>Conclusions: </strong>Health care professionals exhibited diverse yet internally consistent preferences for precision feedback across a set of performance scenarios, while also giving messages high ratings of perceived benefit. A \"one-size-fits-most approach\" to performance feedback delivery would not appear to satisfy these preferences. Precision feedback systems may hold potential to improve support for health care professionals' continuous learning by accommodating feedback preferences.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"10 ","pages":"e54071"},"PeriodicalIF":3.2,"publicationDate":"2024-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11185285/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141421269","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}