Andrew E Krumm, Hollis Lai, Kayla Marcotte, Tavinder K Ark, Victoria Yaneva, Saad Chahine
{"title":"Proximity to Practice: The Role of Technology in the Next Era of Assessment.","authors":"Andrew E Krumm, Hollis Lai, Kayla Marcotte, Tavinder K Ark, Victoria Yaneva, Saad Chahine","doi":"10.5334/pme.1272","DOIUrl":"10.5334/pme.1272","url":null,"abstract":"<p><p>The integration of technology into health professions assessment has created multiple possibilities. In this paper, we focus on the challenges and opportunities of integrating technologies that are used during clinical activities or that are completed by raters after a clinical encounter. In focusing on technologies that are more proximal to practice, we identify tradeoffs with different data collection approaches. To maximize the benefits of integrating technology in workplace-based assessment, we describe the importance of using preexisting frameworks from the fields of assessment design, implementation research, and clinical artificial intelligence governance.</p>","PeriodicalId":48532,"journal":{"name":"Perspectives on Medical Education","volume":"13 1","pages":"646-653"},"PeriodicalIF":4.8,"publicationDate":"2024-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11673589/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142903997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jeffrey Siegelman, Lisa Bernstein, Jennifer Goedken, Linda Lewin, Jason Schneider, Martha Ward, Hugh Stoddard
{"title":"Assessment of Clinical Reasoning During a High Stakes Medical Student OSCE.","authors":"Jeffrey Siegelman, Lisa Bernstein, Jennifer Goedken, Linda Lewin, Jason Schneider, Martha Ward, Hugh Stoddard","doi":"10.5334/pme.1513","DOIUrl":"10.5334/pme.1513","url":null,"abstract":"<p><strong>Background & need for innovation: </strong>Objective Structured Clinical Examinations (OSCEs) are commonly employed to assess clinical skills. While several existing tools address components of clinical reasoning, including the Assessment of Reasoning Tool, none are calibrated for competency-based assessment of medical students (UME) in an OSCE setting.</p><p><strong>Goal of innovation: </strong>We sought to create a clinical reasoning assessment for use in a high-stakes, summative medical student OSCE.</p><p><strong>Steps taken for development and implementation of innovation: </strong>A minimum-competency OSCE was administered to medical students following their required clinical clerkships. We developed a tool to assess clinical reasoning of medical students at the conclusion of their required clinical clerkships and deployed it during a minimum-competency OSCE exam given at that time. The highest level of the modified tool represented minimum acceptable performance for examinees.</p><p><strong>Evaluation of innovation: </strong>The scores and analyses provided evidence to support the use of this tool. Examinees' performance on clinical reasoning tasks was comparable with their overall performance on the OSCE. The sub-scores for clinical reasoning accurately distinguished successful examinees from those who did not meet the minimum performance level, providing support for the use of the tool in this high stakes setting.</p><p><strong>Critical reflection: </strong>This tool was found to be useful and defensible to assess medical students' clinical reasoning. Expanded evidence for generalizability of the tool and its utility in other settings will need to be garnered through multi-center implementation and study.</p>","PeriodicalId":48532,"journal":{"name":"Perspectives on Medical Education","volume":"13 1","pages":"629-634"},"PeriodicalIF":4.8,"publicationDate":"2024-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11639687/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142830428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Development and Evaluation of a Virtual Reality Program for Immediate Newborn Care Training in Nursing Education: A Feasibility Study.","authors":"Hsiao-Ying Hung, Yu-Wen Wang, Min-Chai Hsieh, Po-Yu Chen, Ying-Ju Chang","doi":"10.5334/pme.1538","DOIUrl":"10.5334/pme.1538","url":null,"abstract":"<p><strong>Introduction: </strong>Nursing education equips students with the skills necessary to navigate the clinical environment. Repetitive training in complex skills ensures patient and student safety. Immersive virtual reality (VR) offers a realistic and safe environment for such repetitive learning processes. However, the feasibility of integrating such technology into the training of immediate newborn care skills remains unexplored.</p><p><strong>Methods: </strong>In this feasibility study, the care procedure for immediate newborn care (INC) was standardized and converted into a VR teaching model. Experts and students were then recruited to assess and evaluate the suitability, usefulness and user-friendliness of the INC-VR model. A total of 35 students were recruited and allocated to a VR learning group and a traditional learning group to evaluate the INC-VR model in terms of knowledge acquisition, skill confidence, performance accuracy, and the time required to complete the INC tasks.</p><p><strong>Results: </strong>Thirteen INC care tasks were transformed into a 15-minute INC-VR model, and the suitability, usefulness, and user-friendliness of the model were validated by both students and experts. Furthermore, students in the VR group demonstrated comparable INC knowledge, confidence, and performance accuracy to those in the traditional group, with a more time-efficient learning framework (10.3 minutes vs. 35 minutes).</p><p><strong>Discussion: </strong>The INC-VR model developed herein can supplement traditional teaching to enhance students' learning. This model could provide an accessible platform for additional practice and remediation, addressing the limitations of real-time skill practice opportunities. Therefore, it may also serve as a valuable reference for other institutions developing similar VR educational tools.</p>","PeriodicalId":48532,"journal":{"name":"Perspectives on Medical Education","volume":"13 1","pages":"620-628"},"PeriodicalIF":4.8,"publicationDate":"2024-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11639688/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142830438","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Alexandra Androni, Joke Fleer, Laura R Smids, Joke M van der Wouden, A Debbie C Jaarsma, Johanna Schönrock-Adema
{"title":"Identifying Behaviours Representative of Agentic Engagement in Pre-clinical Medical Education PBL Groups Based on Literature and Observations.","authors":"Alexandra Androni, Joke Fleer, Laura R Smids, Joke M van der Wouden, A Debbie C Jaarsma, Johanna Schönrock-Adema","doi":"10.5334/pme.1414","DOIUrl":"10.5334/pme.1414","url":null,"abstract":"<p><strong>Introduction: </strong>In this study we aimed to identify behaviours representative of agentic engagement in pre-clinical medical education problem-based learning (PBL) groups. Agentic engagement is defined as the proactive, intentional contributions students make to their flow of instruction. This concept, developed in secondary education, appears relevant for benefitting optimally from PBL in higher medical education.</p><p><strong>Methods: </strong>We followed a four-step process to identify any behaviours representative of agentic engagement in our PBL setting. Following a literature search on agentic engagement scales, proactive behaviour, PBL practices and adult learning, we listed behaviours that could denote agentic engagement in our context. We fine-tuned this list through exploratory observations and tailored it to our specific context of second-year PBL groups.</p><p><strong>Results: </strong>We identified ten observable student behaviours representative of agentic engagement within medical PBL groups. Some aligned with previous literature (asking questions, telling the teacher what they (dis)like, telling the teacher what they are interested in, defending opinions, expressing expectations, suggesting co-operation), and others had not been identified before as representative of agentic engagement (making learning as interactive as possible, creating alternative ways of covering the material, correcting content and enriching others' insights); thereby introducing novel behaviours unique to our setting.</p><p><strong>Discussion: </strong>In medical PBL groups, we identified both known agentic engagement behaviours and distinctive behaviours specific to our context, thereby highlighting that the expression of agentic engagement is context-bound.</p>","PeriodicalId":48532,"journal":{"name":"Perspectives on Medical Education","volume":"13 1","pages":"608-619"},"PeriodicalIF":4.8,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11623076/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142796425","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Anna de Beer, Adelina S Werner, Seunggeun Kim, Frederike A Jenne
{"title":"Professional Resistance: Why Korean Medical Students are Boycotting Over Increasing Medical School Places.","authors":"Anna de Beer, Adelina S Werner, Seunggeun Kim, Frederike A Jenne","doi":"10.5334/pme.1426","DOIUrl":"https://doi.org/10.5334/pme.1426","url":null,"abstract":"<p><p>In February 2024, medical students in South Korea began submitting leave-of-absence requests in protest of a 65% increase in the number of medical school places in 2025. 14,000 medical students have boycotted classes and 12,000 doctors have resigned en masse. The 2024 Korean medical student collective action highlights the 'power' of medical students, the need for independent medical licensing bodies and the risks to the quality of medical education when places in medical schools are rapidly increased. The South Korean healthcare system is consistently ranked as one of the best in the world but there is now a significant risk that few new doctors will graduate and enter the workforce in March 2025.</p>","PeriodicalId":48532,"journal":{"name":"Perspectives on Medical Education","volume":"13 1","pages":"602-607"},"PeriodicalIF":4.8,"publicationDate":"2024-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11606388/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142773884","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kain Kim, Sujal Manohar, Meher Kalkat, Kayla Iuliano, Margaret S Chisolm
{"title":"Museum-Based Education in Health Professions Learning: A 5-Year Retrospective.","authors":"Kain Kim, Sujal Manohar, Meher Kalkat, Kayla Iuliano, Margaret S Chisolm","doi":"10.5334/pme.1448","DOIUrl":"https://doi.org/10.5334/pme.1448","url":null,"abstract":"<p><p>A growing evidence base suggests that the integration of museum-based activities into health professions education can contribute to learner resilience and wellbeing, promote capacity for patient-centered care, and encourage equity in learning environments. However, the styles and methods for implementing museum-based programs vary widely across different institutions. This retrospective leverages the lessons learned from 5 years of experience implementing museum-based programs at one large academic institution to examine the various operational and logistical considerations in implementing a museum-based program for health professions learners. These efforts are intended to support the Association of American Medical Colleges and National Academies of Sciences, Engineering, and Medicine's aims to formally integrate the arts and humanities into health professions education. We structure our recommendations under the subheadings of program form, audience, function, and evaluation, with hopes of providing medical educators with starting guidelines that are broadly adoptable across different institutions.</p>","PeriodicalId":48532,"journal":{"name":"Perspectives on Medical Education","volume":"13 1","pages":"585-591"},"PeriodicalIF":4.8,"publicationDate":"2024-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11606393/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142773879","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Matthew Kelleher, Benjamin Kinnear, Danielle Weber, Abigail Martini, Sally A Santen, Pamela Baker, Laurah Turner, Eric Warm, Melissa Klein, Daniel Schumacher
{"title":"A Rollercoaster of Grades Versus Growth in the Clerkship Year: A Phenomenological Study of Medical Student Experience with Competency Development.","authors":"Matthew Kelleher, Benjamin Kinnear, Danielle Weber, Abigail Martini, Sally A Santen, Pamela Baker, Laurah Turner, Eric Warm, Melissa Klein, Daniel Schumacher","doi":"10.5334/pme.1564","DOIUrl":"https://doi.org/10.5334/pme.1564","url":null,"abstract":"<p><strong>Purpose: </strong>As competency-based medical education (CBME) continues to advance in undergraduate medical education, students are expected to simultaneously pursue their competency development while also discriminating themselves for residency selection. During the foundational clerkship year, it is important to understand how these seemingly competing goals are navigated.</p><p><strong>Methods: </strong>In this phenomenological qualitative study, the authors describe the experience of 15 clerkship students taking part in a pilot pathway seeking to implement CBME principles. These students experienced the same clerkship curriculum and requirements with additional CBME components such as coaching, an entrustment committee to review their data, a dashboard to visualize their assessment data in real-time, and meeting as a community of practice.</p><p><strong>Results: </strong>Students shared their experiences with growth during the clerkship year. They conveyed the importance of learning from mistakes, but pushing past their discomfort with imperfect performance was a challenge when they feel pressure to perform well for grades. This tension led to significant effort spent on impression management while also trying to identify their role, clarify expectations, and learn to navigate feedback.</p><p><strong>Conclusions: </strong>Tension exists in the clinical environment for clerkship students between an orientation that focuses on maximizing grades versus maximizing growth. The former defined an era of medical education that is fading, while the latter offers a new vision for the future. The threats posed by continuing to grade and rank students seems incompatible with goals of implementing CBME.</p>","PeriodicalId":48532,"journal":{"name":"Perspectives on Medical Education","volume":"13 1","pages":"592-601"},"PeriodicalIF":4.8,"publicationDate":"2024-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11606390/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142773875","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Development and Validation of an Instrument to Measure Career Decision-Making Challenges of International Medical Students in China.","authors":"Wen Li, Asaduzzaman Khan, Robyn Gillies, Hong Sun","doi":"10.5334/pme.1384","DOIUrl":"10.5334/pme.1384","url":null,"abstract":"<p><strong>Introduction: </strong>International medical students (IMSs) experience various problems preventing them from making career decisions. Assessing the difficulties involved in the career decision-making process is instrumental for identifying the sources of their career indecision, which may assist them in making more informed career decisions. This study aims to develop and validate an instrument to measure career decision-making challenges of IMSs in China, who are mainly from low- and middle-income countries.</p><p><strong>Methods: </strong>A new scale, INternational meDical studEnt Carrer decISION-making Scale (INDECISION Scale) was developed utilising data from IMSs in China. Initial item generation stemmed from a literature review and qualitative interviews (n = 20), with items adapted or formulated referencing phrasing used in prior instruments. Subsequent expert validation and cognitive interviews (n = 6) informed adjustments, followed by a pilot study (n = 52) and focus group discussions (n = 6). Exploratory factor analysis (EFA) was performed on data from four Chinese universities (n = 334), followed by confirmatory factor analysis (CFA) on data from eight other Chinese universities (n = 514). Convergent validity (n = 102) and test-retest reliability (n = 86) were evaluated using subsets of respondents.</p><p><strong>Results: </strong>The EFA retained 21 items, identifying six factors: unreadiness; lack of self-knowledge; lack of options knowledge; external complexity; lack of decision-making competence; and negative mentality. The CFA confirmed the six-factor model, demonstrating satisfactory model fit indices. Convergent validity and test-retest reliability were supported.</p><p><strong>Conclusions: </strong>The INDECISION Scale exhibits adequate psychometric properties, helping IMSs systematically navigate their decision-making process, allowing for individual challenges to be effectively identified for discussion in counselling. This study serves as a starting point for further research on career indecision and career guidance for IMSs.</p>","PeriodicalId":48532,"journal":{"name":"Perspectives on Medical Education","volume":"13 1","pages":"572-584"},"PeriodicalIF":4.8,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11583610/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142711417","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Shut up, or Set Free: Poetic Inquiry into Disabled Students' Experiences of Differential Attainment.","authors":"Megan E L Brown, Gabrielle Finn","doi":"10.5334/pme.1392","DOIUrl":"10.5334/pme.1392","url":null,"abstract":"<p><strong>Introduction: </strong>Differential attainment (DA) - systematic differences in training and assessment outcomes when grouping individuals by demographic characteristics - is a pervasive problem in health professions education. Despite evidence of its prevalence, there have been few qualitative studies relating to disabled learners' experiences of differential attainment. This represents a significant gap, as understanding disabled learners' experiences is key to developing effective interventions that mitigate the impact of differential attainment.</p><p><strong>Methods: </strong>We used critical poetic inquiry to explore the lived experiences - including emotional, cultural, and contextual dimensions - of differential attainment for disabled health professions students. We constructed poems following a secondary analysis of a large interview dataset (n = 123 participants) from one institution. We focused on students who disclosed disability (n = 18), narrowing to health professions education (n = 10).</p><p><strong>Results: </strong>Poems reflect individuals' experiences of DA. Four themes were constructed, within which we use poems to illustrate key connections: The perseverance stereotype, Managing the hidden curriculum, Privilege and access, and Surviving, not thriving. These themes illustrate the complex interplay of systemic barriers, ableist stereotypes, and privilege in the educational journey of disabled students.</p><p><strong>Discussion: </strong>The poems reveal the often-unseen struggles of disabled learners, challenging ableist perceptions and highlighting the necessity of inclusive practices. Our findings underscore the need for a shift in educational approaches, advocating for universal design and comprehensive support systems that consider the unique experiences of disabled learners. This study lays the groundwork for future research to develop interventions that address DA in a more inclusive and equitable manner, ensuring educational environments support all learners effectively.</p>","PeriodicalId":48532,"journal":{"name":"Perspectives on Medical Education","volume":"13 1","pages":"561-571"},"PeriodicalIF":4.8,"publicationDate":"2024-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11590743/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142733530","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Andrew E Krumm, Saad Chahine, Abigail M Schuh, Daniel J Schumacher, Sondra Zabar, Brian C George, Kayla Marcotte, Stefanie S Sebok-Syer, Michael A Barone, Alina Smirnova
{"title":"Digital Evidence: Revisiting Assumptions at the Intersection of Technology and Assessment.","authors":"Andrew E Krumm, Saad Chahine, Abigail M Schuh, Daniel J Schumacher, Sondra Zabar, Brian C George, Kayla Marcotte, Stefanie S Sebok-Syer, Michael A Barone, Alina Smirnova","doi":"10.5334/pme.1270","DOIUrl":"10.5334/pme.1270","url":null,"abstract":"<p><p>The increasing use of technology in health care and health professions education is an invitation to examine how digital sources of evidence are used in making assessment claims. In this paper, we describe how four sets of terms-primary and secondary data; structured and unstructured data; development and use; and deterministic and generative-can aid in examining how data from digital sources are used in evaluating what learners know and can do. Drawing on multiple examples, this paper shows how the four sets of terms can help both developers and users of technology-based assessment systems.</p>","PeriodicalId":48532,"journal":{"name":"Perspectives on Medical Education","volume":"13 1","pages":"553-560"},"PeriodicalIF":4.8,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11583624/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142711418","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}