Asil El Galad, Stefanie S Sebok-Syer, Michael Panza, Kristen Ng, Lorelei Lingard
{"title":"Beyond the Scores: Gendered Interpretations of Emergency Medicine Resident Assessments of Interdependent Performances.","authors":"Asil El Galad, Stefanie S Sebok-Syer, Michael Panza, Kristen Ng, Lorelei Lingard","doi":"10.5334/pme.1937","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>In medicine, gender bias and gendered language within assessments of individual performance are well established. Recent shifts toward assessing interdependence (the ability to work supportively and collaboratively within teams) demand we understand how gender bias and gendered language influence assessments. In exploring how faculty assess residents' interdependent performances, this study evaluated how gender-presentation influences faculty raters' assessments of residents' interdependence in Emergency Medicine (EM).</p><p><strong>Methods: </strong>Using a multiple-methods (an experimental within-subjects study with follow-up interviews), 18 EM faculty from Canada and the United States assessed scripted videos of identical clinical encounters acted by male- and female-presenting residents. Faculty assessed female residents via anonymous online surveys and, six months later, assessed male residents via follow-up interviews using the same clinical scenarios. After every clip, faculty completed entrustable professional activity (EPA) and Milestone ratings and provided narrative justifications. Statistical analyses were conducted using Wilcoxon signed-rank tests to assess gender differences in EPA and Milestone scores. Qualitative data were analyzed using thematic analysis to identify recurring, gendered patterns in narrative justifications.</p><p><strong>Results: </strong>Quantitative results revealed no gender differences in Milestone and EPA scores, except for the resuscitation entrustment rating, where male residents were rated less favorably (z = -3.09, p = 0.002). Qualitative findings uncovered subtle gender differences. For the same clinical performances, male residents were frequently described as leaders, while female residents as collaborative. Furthermore, male residents' help-seeking was framed as proactive, whereas female residents' help-seeking was indicative of lacking knowledge. Finally, bias was not consistent across genders: male leadership expectations could negatively flavor assessments of male collaborative performances.</p><p><strong>Conclusion: </strong>EPA and Milestone scores showed marginal gender-based differences, while narrative justifications reflected clear gendered expectations about residents' interdependence. These findings highlight the need for equity-oriented assessment practices that interrogate both the numbers and the narratives. As team-based competencies like interdependence become central to clinical training, ensuring that assessments reflect fair, unbiased interpretations are essential to supporting all learners equitably.</p>","PeriodicalId":48532,"journal":{"name":"Perspectives on Medical Education","volume":"14 1","pages":"504-518"},"PeriodicalIF":3.9000,"publicationDate":"2025-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12372684/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Perspectives on Medical Education","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.5334/pme.1937","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: In medicine, gender bias and gendered language within assessments of individual performance are well established. Recent shifts toward assessing interdependence (the ability to work supportively and collaboratively within teams) demand we understand how gender bias and gendered language influence assessments. In exploring how faculty assess residents' interdependent performances, this study evaluated how gender-presentation influences faculty raters' assessments of residents' interdependence in Emergency Medicine (EM).
Methods: Using a multiple-methods (an experimental within-subjects study with follow-up interviews), 18 EM faculty from Canada and the United States assessed scripted videos of identical clinical encounters acted by male- and female-presenting residents. Faculty assessed female residents via anonymous online surveys and, six months later, assessed male residents via follow-up interviews using the same clinical scenarios. After every clip, faculty completed entrustable professional activity (EPA) and Milestone ratings and provided narrative justifications. Statistical analyses were conducted using Wilcoxon signed-rank tests to assess gender differences in EPA and Milestone scores. Qualitative data were analyzed using thematic analysis to identify recurring, gendered patterns in narrative justifications.
Results: Quantitative results revealed no gender differences in Milestone and EPA scores, except for the resuscitation entrustment rating, where male residents were rated less favorably (z = -3.09, p = 0.002). Qualitative findings uncovered subtle gender differences. For the same clinical performances, male residents were frequently described as leaders, while female residents as collaborative. Furthermore, male residents' help-seeking was framed as proactive, whereas female residents' help-seeking was indicative of lacking knowledge. Finally, bias was not consistent across genders: male leadership expectations could negatively flavor assessments of male collaborative performances.
Conclusion: EPA and Milestone scores showed marginal gender-based differences, while narrative justifications reflected clear gendered expectations about residents' interdependence. These findings highlight the need for equity-oriented assessment practices that interrogate both the numbers and the narratives. As team-based competencies like interdependence become central to clinical training, ensuring that assessments reflect fair, unbiased interpretations are essential to supporting all learners equitably.
期刊介绍:
Perspectives on Medical Education mission is support and enrich collaborative scholarship between education researchers and clinical educators, and to advance new knowledge regarding clinical education practices.
Official journal of the The Netherlands Association of Medical Education (NVMO).
Perspectives on Medical Education is a non-profit Open Access journal with no charges for authors to submit or publish an article, and the full text of all articles is freely available immediately upon publication, thanks to the sponsorship of The Netherlands Association for Medical Education.
Perspectives on Medical Education is highly visible thanks to its unrestricted online access policy.
Perspectives on Medical Education positions itself at the dynamic intersection of educational research and clinical education. While other journals in the health professional education domain orient predominantly to education researchers or to clinical educators, Perspectives positions itself at the collaborative interface between these perspectives. This unique positioning reflects the journal’s mission to support and enrich collaborative scholarship between education researchers and clinical educators, and to advance new knowledge regarding clinical education practices. Reflecting this mission, the journal both welcomes original research papers arising from scholarly collaborations among clinicians, teachers and researchers and papers providing resources to develop the community’s ability to conduct such collaborative research. The journal’s audience includes researchers and practitioners: researchers who wish to explore challenging questions of health professions education and clinical teachers who wish to both advance their practice and envision for themselves a collaborative role in scholarly educational innovation. This audience of researchers, clinicians and educators is both international and interdisciplinary.
The journal has a long history. In 1982, the journal was founded by the Dutch Association for Medical Education, as a Dutch language journal (Netherlands Journal of Medical Education). As a Dutch journal it fuelled educational research and innovation in the Netherlands. It is one of the factors for the Dutch success in medical education. In 2012, it widened its scope, transforming into an international English language journal. The journal swiftly became international in all aspects: the readers, authors, reviewers and editorial board members.
The editorial board members represent the different parental disciplines in the field of medical education, e.g. clinicians, social scientists, biomedical scientists, statisticians and linguists. Several of them are leading scholars. Three of the editors are in the top ten of most cited authors in the medical education field. Two editors were awarded the Karolinska Institute Prize for Research. Presently, Erik Driessen leads the journal as Editor in Chief.
Perspectives on Medical Education is highly visible thanks to its unrestricted online access policy. It is sponsored by theThe Netherlands Association of Medical Education and offers free manuscript submission.
Perspectives on Medical Education positions itself at the dynamic intersection of educational research and clinical education. While other journals in the health professional education domain orient predominantly to education researchers or to clinical educators, Perspectives positions itself at the collaborative interface between these perspectives. This unique positioning reflects the journal’s mission to support and enrich collaborative scholarship between education researchers and clinical educators, and to advance new knowledge regarding clinical education practices. Reflecting this mission, the journal both welcomes original research papers arising from scholarly collaborations among clinicians, teachers and researchers and papers providing resources to develop the community’s ability to conduct such collaborative research. The journal’s audience includes researchers and practitioners: researchers who wish to explore challenging questions of health professions education and clinical teachers who wish to both advance their practice and envision for themselves a collaborative role in scholarly educational innovation. This audience of researchers, clinicians and educators is both international and interdisciplinary.
The journal has a long history. In 1982, the journal was founded by the Dutch Association for Medical Education, as a Dutch language journal (Netherlands Journal of Medical Education). As a Dutch journal it fuelled educational research and innovation in the Netherlands. It is one of the factors for the Dutch success in medical education. In 2012, it widened its scope, transforming into an international English language journal. The journal swiftly became international in all aspects: the readers, authors, reviewers and editorial board members.
The editorial board members represent the different parental disciplines in the field of medical education, e.g. clinicians, social scientists, biomedical scientists, statisticians and linguists. Several of them are leading scholars. Three of the editors are in the top ten of most cited authors in the medical education field. Two editors were awarded the Karolinska Institute Prize for Research. Presently, Erik Driessen leads the journal as Editor in Chief.
Perspectives on Medical Education is highly visible thanks to its unrestricted online access policy. It is sponsored by theThe Netherlands Association of Medical Education and offers free manuscript submission.