Advances in Health Sciences Education最新文献

{"title":"Assessing supervisor versus trainee viewpoints of entrustment through cognitive and affective lenses: an artificial intelligence investigation of bias in feedback","authors":"Brian C. Gin,&nbsp;Olle ten Cate,&nbsp;Patricia S. O’Sullivan,&nbsp;Christy Boscardin","doi":"10.1007/s10459-024-10311-9","DOIUrl":"10.1007/s10459-024-10311-9","url":null,"abstract":"<div><p>The entrustment framework redirects assessment from considering only trainees’ competence to decision-making about their readiness to perform clinical tasks independently. Since trainees and supervisors both contribute to entrustment decisions, we examined the cognitive and affective factors that underly their negotiation of trust, and whether trainee demographic characteristics may bias them. Using a document analysis approach, we adapted large language models (LLMs) to examine feedback dialogs (N = 24,187, each with an associated entrustment rating) between medical student trainees and their clinical supervisors. We compared how trainees and supervisors differentially documented feedback dialogs about similar tasks by identifying qualitative themes and quantitatively assessing their correlation with entrustment ratings. Supervisors’ themes predominantly reflected skills related to patient presentations, while trainees’ themes were broader—including clinical performance and personal qualities. To examine affect, we trained an LLM to measure feedback sentiment. On average, trainees used more negative language (5.3% lower probability of positive sentiment, <i>p</i> &lt; 0.05) compared to supervisors, while documenting higher entrustment ratings (+ 0.08 on a 1–4 scale, <i>p</i> &lt; 0.05). We also found biases tied to demographic characteristics: trainees’ documentation reflected more positive sentiment in the case of male trainees (+ 1.3%, <i>p</i> &lt; 0.05) and of trainees underrepresented in medicine (UIM) (+ 1.3%, <i>p</i> &lt; 0.05). Entrustment ratings did not appear to reflect these biases, neither when documented by trainee nor supervisor. As such, bias appeared to influence the emotive language trainees used to document entrustment more than the degree of entrustment they experienced. Mitigating these biases is nonetheless important because they may affect trainees’ assimilation into their roles and formation of trusting relationships.</p></div>","PeriodicalId":50959,"journal":{"name":"Advances in Health Sciences Education","volume":"29 5","pages":"1571 - 1592"},"PeriodicalIF":3.0,"publicationDate":"2024-02-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s10459-024-10311-9.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139934044","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"“I never wanted to burn any bridges”: discerning between pushing too hard and not enough in trainees’ acts of professional resistance","authors":"Tasha R. Wyatt,&nbsp;Vinayak Jain,&nbsp;TingLan Ma","doi":"10.1007/s10459-024-10312-8","DOIUrl":"10.1007/s10459-024-10312-8","url":null,"abstract":"<div><p>As trainees resist social harm and injustice in medicine, they must navigate the tension between pushing too hard and risking their reputation, or not enough and risking no change at all. We explore the discernment process by examining what trainees attend to moments before and while they are resisting to understand how they manage this tension. We interviewed 18 medical trainees who shared stories of resisting social harm and injustice in their training environments. Interviews were analyzed using open and focused coding using Vinthagen and Johansson’s work, which conceptualizes resistance as a dynamic process that includes an individual’s <i>subjectivity</i> within a larger system, the <i>context</i> in which they find themselves, and the <i>interactions</i> they have with others. We framed these acts as an individuals’ attempt to undermine power, while also being entangled with that power and needing it for their efforts. When deciding on how and whether to resist, trainees underwent a cost-benefit analysis weighing the potential risk against their chances at change. They considered how their acts may influence their relationship with others, whether resisting would damage personal and programmatic reputations, and the embodied and social cues of other stakeholders involved. Trainees undergo a dynamic assessment process in which they analyze large amounts of information to keep themselves safe from potential retaliation. It is by attending to these various factors in their environment that trainees are able to keep their acts <i>professional</i>, and continue to do this challenging work in medical education. </p></div>","PeriodicalId":50959,"journal":{"name":"Advances in Health Sciences Education","volume":"29 4","pages":"1379 - 1392"},"PeriodicalIF":3.0,"publicationDate":"2024-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11369053/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139724815","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The case for metacognitive reflection: a theory integrative review with implications for medical education","authors":"Jerusalem Merkebu,&nbsp;Mario Veen,&nbsp;Shera Hosseini,&nbsp;Lara Varpio","doi":"10.1007/s10459-023-10310-2","DOIUrl":"10.1007/s10459-023-10310-2","url":null,"abstract":"<div><p>The concepts of metacognitive reflection, reflection, and metacognition are distinct but have undergone shifts in meaning as they migrated into medical education. Conceptual clarity is essential to the construction of the knowledge base of medical education and its educational interventions. We conducted a theoretical integrative review across diverse bodies of literature with the goal of understanding what metacognitive reflection is. We searched PubMed, Embase, CINAHL, PsychInfo, and Web of Science databases, including all peer-reviewed research articles and theoretical papers as well as book chapters that addressed the topic, with no limitations for date, language, or location. A total of 733 articles were identified and 87 were chosen after careful review and application of exclusion criteria. The work of conceptually and empirically delineating metacognitive reflection has begun. Contributions have been made to root metacognitive reflection in the concept of metacognition and moving beyond it to engage in cycles of reflection. Other work has underscored its affective component, transformational nature, and contextual factors. Despite this merging of threads to develop a richer conceptualization, a theory of how metacognitive reflection works is elusive. Debates address whether metacognition drives reflection or vice versa. It has also been suggested that learners evolve along on a continuum from thinking, to task-related reflection, to self-reflection, and finally to metacognitive reflection. Based on prior theory and research, as well as the findings of this review, we propose the following conceptualization: Metacognitive reflection involves heightened internal observation, awareness, monitoring, and regulation of our own knowledge, experiences, and emotions by questioning and examining cognition and emotional processes to continually refine and enhance our perspectives and decisions while thoughtfully accounting for context. We argue that metacognitive reflection brings a shift in perspective and can support valuable reconceptualization for lifelong learning.</p></div>","PeriodicalId":50959,"journal":{"name":"Advances in Health Sciences Education","volume":"29 4","pages":"1481 - 1500"},"PeriodicalIF":3.0,"publicationDate":"2024-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11368986/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139724816","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Medical students’ motivations for participating in an elective focused on social inequalities and health disparities","authors":"Shahna Arps,&nbsp;Krista McCarthy Noviski,&nbsp;Lauren Tucker,&nbsp;Ameisha Tutwiler","doi":"10.1007/s10459-024-10313-7","DOIUrl":"10.1007/s10459-024-10313-7","url":null,"abstract":"<div><p>In this study, we examine students’ reasons for pursuing elective training focused on medical racism and systemic health inequities at a midwestern medical school. Data collection included semi-structured interviews with students who participated in an optional course focused on these topics. We analyzed their motivations, goals, and interests using reflexive thematic analysis and created three themes based on students’ responses. Theme (1) “pre-existing conditions” focuses on students’ knowledge, beliefs, worldviews and experience prior to the class. Theme (2) “enacting change” examines their desires to become effective physicians and improve medicine overall. Theme (3) “creating community” considers their preferences for a supportive and connected learning and social environment. We discuss the findings within the context of adult learning theory and Self-Determination Theory. The research provides insight about the overt and underlying factors that drive medical students’ participation in training focused on social inequality. We also share recommendations for curriculum development and future research based on the patterns we found in students’ discussions of their needs and expectations.</p></div>","PeriodicalId":50959,"journal":{"name":"Advances in Health Sciences Education","volume":"29 4","pages":"1353 - 1378"},"PeriodicalIF":3.0,"publicationDate":"2024-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11369016/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139693517","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Exploring the use of metacognitive monitoring cues following a diagram completion intervention","authors":"Babu Noushad,&nbsp;Pascal W. M. Van Gerven,&nbsp;Anique B. H. de Bruin","doi":"10.1007/s10459-023-10309-9","DOIUrl":"10.1007/s10459-023-10309-9","url":null,"abstract":"<div><p>Studying texts constitutes a significant part of student learning in health professions education. Key to learning from text is the ability to effectively monitor one’s own cognitive performance and take appropriate regulatory steps for improvement. Inferential cues generated during a learning experience typically guide this monitoring process. It has been shown that interventions to assist learners in using comprehension cues improve their monitoring accuracy. One such intervention is having learners to complete a diagram. Little is known, however, about how learners use cues to shape their monitoring judgments. In addition, previous research has not examined the difference in cue use between categories of learners, such as good and poor monitors. This study explored the types and patterns of cues used by participants after being subjected to a diagram completion task prior to their prediction of performance (PoP). Participants’ thought processes were studied by means of a think-aloud method during diagram completion and the subsequent PoP. Results suggest that relying on comprehension-specific cues may lead to a better PoP. Poor monitors relied on multiple cue types and failed to use available cues appropriately. They gave more incorrect responses and made commission errors in the diagram, which likely led to their overconfidence. Good monitors, on the other hand, utilized cues that are predictive of learning from the diagram completion task and seemed to have relied on comprehension cues for their PoP. However, they tended to be cautious in their judgement, which probably made them underestimate themselves. These observations contribute to the current understanding of the use and effectiveness of diagram completion as a cue-prompt intervention and provide direction for future research in enhancing monitoring accuracy.</p></div>","PeriodicalId":50959,"journal":{"name":"Advances in Health Sciences Education","volume":"29 4","pages":"1323 - 1351"},"PeriodicalIF":3.0,"publicationDate":"2024-01-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11368990/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139572111","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The effect of the attitude towards risk/ambiguity on examination grades: cross-sectional study in a Portuguese medical school","authors":"Filipe Leite-Mendes,&nbsp;Luis Delgado,&nbsp;Amelia Ferreira,&nbsp;Milton Severo","doi":"10.1007/s10459-023-10305-z","DOIUrl":"10.1007/s10459-023-10305-z","url":null,"abstract":"<div><p>Given the high prevalence of multiple-choice examinations with formula scoring in medical training, several studies have tried to identify other factors in addition to the degree of knowledge of students which influence their response patterns. This study aims to measure the effect of students’ attitude towards risk and ambiguity on their number of correct, wrong, and blank answers. In October 2018, 233 3rd year medical students from the Faculty of Medicine of the University of Porto, in Porto, Portugal, completed a questionnaire which assessed the student’s attitudes towards risk and ambiguity, and aversion to ambiguity in medicine. Simple and multiple regression models and the respective regression coefficients were used to measure the association between the students’ attitudes, and their answers in two examinations that they had taken in June 2018. Having an intermediate level of ambiguity aversion in medicine (as opposed to a very high or low level) was associated with a significant increase in the number of correct answers and decrease in the number of blank answers in the first examination. In the second examination, high levels of ambiguity aversion in medicine were associated with a decrease in the number of wrong answers. Attitude towards risk, tolerance for ambiguity, and gender did not show significant association with the number of correct, wrong, and blank answers for either examination. Students’ ambiguity aversion in medicine is correlated with their performance in multiple-choice examinations with negative marking. Therefore, it is suggested the planning and implementation of counselling sessions with medical students regarding the possible impact of ambiguity aversion on their performance in multiple-choice questions with negative marking.</p></div>","PeriodicalId":50959,"journal":{"name":"Advances in Health Sciences Education","volume":"29 4","pages":"1309 - 1321"},"PeriodicalIF":3.0,"publicationDate":"2024-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11368994/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139467211","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"An exploration of values in medical school admissions processes: the interplay between contextual factors, admissions practices, and validity","authors":"Meredith E. Young,&nbsp;Sneha Shankar,&nbsp;Christina St-Onge","doi":"10.1007/s10459-023-10307-x","DOIUrl":"10.1007/s10459-023-10307-x","url":null,"abstract":"<div><p>Medical school admissions is a contentious and high stakes selection activity. Many assessment approaches are available to support selection; but how are decisions about building, monitoring, and adapting admissions systems made? What shapes the processes and practices that underpin selection decisions? We explore how these decisions are made across several Canadian medical schools, and how values shape the creation, monitoring, and adaptation of admissions systems. Using phenomenography (a qualitative method suited to examining variability), the authors analyzed interviews with 10 current or previous heads of admissions from 10 different undergraduate medical education programs in Canada. Interviews were conducted in English and French, and data was collected between 2016 and 2017 (therefore participants no longer hold these roles). Data was coded and analyzed iteratively, focusing on identifying underlying values, and exploring how these values shape admissions practices and considerations for validity. Eight different intersecting values were identified. Of these, four were shared across all participants: critically questioning the process and tools, aiming for equity, striving for better, and embracing the challenges of change. The expression of these values depended on different contextual variables (e.g., geographic location, access to expertise, resource availability), and values shaped how admissions systems were built, enacted, and monitored for quality. Ultimately, values shaped: (1) admissions practices resulting in different candidates being offered admission, and (2) how arguments supporting score interpretation are built (i.e., validity). This study documents various values that influence admissions processes, practices, and quality monitoring. The values that shape what is assessed, how it is assessed, and how fair and defensible practices are conceptualized have significant impact, ultimately determining who is selected. These values—whether implicit or explicit—result in intended and unintended consequences in selection processes. However, these values are rarely explicitly examined and questioned, leaving it uncertain as to which consequences are the intended outcomes of deliberately chosen values, and which are unintended consequences of implicitly held values of admissions systems and their actors.</p></div>","PeriodicalId":50959,"journal":{"name":"Advances in Health Sciences Education","volume":"29 4","pages":"1285 - 1308"},"PeriodicalIF":3.0,"publicationDate":"2023-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138587274","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Training healthcare professionals to be ready for practice in an era of social distancing: a realist evaluation","authors":"Janet Lefroy,&nbsp;Jessica Bialan,&nbsp;Alice Moult,&nbsp;Fiona Hay,&nbsp;Claire Stapleton,&nbsp;Jessica Thompson,&nbsp;Kate Diggory,&nbsp;Nageen Mustafa,&nbsp;Julia Farrington,&nbsp;Sarah A. Aynsley,&nbsp;Simon Jacklin,&nbsp;Adam Winterton,&nbsp;Natalie Cope","doi":"10.1007/s10459-023-10297-w","DOIUrl":"10.1007/s10459-023-10297-w","url":null,"abstract":"<div><h3>Background</h3><p>Programme changes due to the COVID-19 pandemic have impacted variably on preparation for practice of healthcare professional students. Explanations for such variability need exploration. The aim of our study was to understand what clinical learning, whilst under socially distanced restrictions, worked and why (or why not).</p><h3>Methods</h3><p>We conducted a realist evaluation of the undergraduate healthcare programmes at one UK university in 2020–21. Initial programme theories to be tested in this study were derived from discussions with programme leads about the changes they implemented due to the pandemic. Study participants were students and teaching faculty. Online interview transcripts were coded, identifying why interventions had worked or not. This resulted in a set of ‘context-mechanism-outcome’ (CMO) statements about each intervention. The initial programme theories were refined as a result.</p><h3>Results and discussion</h3><p>29 students and 22 faculty members participated. 18 CMO configurations were identified relating to clinical skills learning and 25 relating to clinical placements. Clinical skills learning was successful whether in person, remote or hybrid if it followed the steps of: demonstration—explanation—mental rehearsal—attempt with feedback. Where it didn’t work there was usually a lack of observation and corrective feedback. Placements were generally highly valued despite some deficiencies in student experience. Being useful on placements was felt to be good preparation for practice. If student numbers are to expand, findings about what works in distance learning of clinical skills and the value of various modes of induction to clinical workplace activity may also be relevant post-pandemic.</p></div>","PeriodicalId":50959,"journal":{"name":"Advances in Health Sciences Education","volume":"29 4","pages":"1265 - 1284"},"PeriodicalIF":3.0,"publicationDate":"2023-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s10459-023-10297-w.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138587385","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The effects of procedural and conceptual knowledge on visual learning","authors":"Nadja Beeler,&nbsp;Esther Ziegler,&nbsp;Andreas Volz,&nbsp;Alexander A. Navarini,&nbsp;Manu Kapur","doi":"10.1007/s10459-023-10304-0","DOIUrl":"10.1007/s10459-023-10304-0","url":null,"abstract":"<div><p>Even though past research suggests that visual learning may benefit from conceptual knowledge, current interventions for medical image evaluation often focus on procedural knowledge, mainly by teaching classification algorithms. We compared the efficacy of pure procedural knowledge (three-point checklist for evaluating skin lesions) versus combined procedural plus conceptual knowledge (histological explanations for each of the three points). All students then trained their classification skills with a visual learning resource that included images of two types of pigmented skin lesions: benign nevi and malignant melanomas. Both treatments produced significant and long-lasting effects on diagnostic accuracy in transfer tasks. However, only students in the combined procedural plus conceptual knowledge condition significantly improved their diagnostic performance in classifying lesions they had seen before in the pre- and post-tests. Findings suggest that the provision of additional conceptual knowledge supported error correction mechanisms.</p></div>","PeriodicalId":50959,"journal":{"name":"Advances in Health Sciences Education","volume":"29 4","pages":"1243 - 1263"},"PeriodicalIF":3.0,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11368992/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138500085","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"How should I determine author order for this paper?","authors":"Ayelet Kuper,&nbsp;Patricia O’Sullivan,&nbsp;Jennifer Cleland","doi":"10.1007/s10459-023-10308-w","DOIUrl":"10.1007/s10459-023-10308-w","url":null,"abstract":"<div><p>This column is intended to address the kinds of knotty problems and dilemmas with which many scholars grapple in studying health professions education. In this article, the authors conclude their short series of articles on academic authorship by addressing the question of how to determine author order, including taking into account power dynamics that may be at play.</p></div>","PeriodicalId":50959,"journal":{"name":"Advances in Health Sciences Education","volume":"28 5","pages":"1367 - 1369"},"PeriodicalIF":4.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138464119","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}