Assessing situational judgement tests for team leadership in medical residents.

IF 3.3 2区教育学 Q1 EDUCATION, SCIENTIFIC DISCIPLINES

Medical Teacher Pub Date : 2025-05-10 DOI:10.1080/0142159X.2025.2500577

Nazanin Shamaeian Razavi, Mohammad Jalili, Homa Kashani, Ali Jafarian, Roghayeh Gandomkar

{"title":"Assessing situational judgement tests for team leadership in medical residents.","authors":"Nazanin Shamaeian Razavi, Mohammad Jalili, Homa Kashani, Ali Jafarian, Roghayeh Gandomkar","doi":"10.1080/0142159X.2025.2500577","DOIUrl":null,"url":null,"abstract":"Introduction: Team leadership is a core competency of medical graduates. The purpose of this study was to develop and evaluate the validity and acceptability of a situational judgment test (SJT) to assess team leadership in residents.Methods: We followed protocols for the development of construct-driven SJTs. A 27-question SJT was developed using a multistage process: construct definition, test construction, and test evaluation. The final SJT was administered to 133 years 2 to 4 residents and was evaluated using item-level analyses, internal consistency, confirmatory factor analysis and residents' reactions.Results: The item difficulty indices ranged from 0.79 to 0.90 and partial correlations were between 0.11 and 0.41. The level of internal consistency of SJT was 0.76. Confirmatory factor analysis confirmed an acceptable model fit. Over 96% of participants rated the SJT as appropriate for assessing different aspects of team leadership and increasing team leadership awareness.Conclusion: This study reports the initial efforts toward the development of an SJT for team leadership in residents. The findings indicate that the SJT can assess all dimensions of the construct of team leadership in residency training which can be used for offering focused feedback and coaching to residents on team leadership behaviors.","PeriodicalId":18643,"journal":{"name":"Medical Teacher","volume":" ","pages":"1-9"},"PeriodicalIF":3.3000,"publicationDate":"2025-05-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical Teacher","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1080/0142159X.2025.2500577","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}

引用次数: 0

Abstract

Introduction: Team leadership is a core competency of medical graduates. The purpose of this study was to develop and evaluate the validity and acceptability of a situational judgment test (SJT) to assess team leadership in residents.

Methods: We followed protocols for the development of construct-driven SJTs. A 27-question SJT was developed using a multistage process: construct definition, test construction, and test evaluation. The final SJT was administered to 133 years 2 to 4 residents and was evaluated using item-level analyses, internal consistency, confirmatory factor analysis and residents' reactions.

Results: The item difficulty indices ranged from 0.79 to 0.90 and partial correlations were between 0.11 and 0.41. The level of internal consistency of SJT was 0.76. Confirmatory factor analysis confirmed an acceptable model fit. Over 96% of participants rated the SJT as appropriate for assessing different aspects of team leadership and increasing team leadership awareness.

Conclusion: This study reports the initial efforts toward the development of an SJT for team leadership in residents. The findings indicate that the SJT can assess all dimensions of the construct of team leadership in residency training which can be used for offering focused feedback and coaching to residents on team leadership behaviors.

查看原文本刊更多论文

评估住院医师团队领导能力的情境判断测试。

团队领导能力是医学毕业生的核心能力。摘要本研究旨在发展情境判断测验，以评估住院医师团队领导能力的效度与可接受性。方法：我们遵循构建驱动型sjt的开发方案。一个有27个问题的SJT是通过一个多阶段的过程开发出来的：结构定义、测试构建和测试评估。对133名2至4岁的居民实施最终的SJT，并使用项目水平分析、内部一致性、验证性因子分析和居民反应进行评估。结果：题目难度指数在0.79 ~ 0.90之间，偏相关系数在0.11 ~ 0.41之间。SJT的内部一致性水平为0.76。验证性因子分析证实了一个可接受的模型拟合。超过96%的参与者认为SJT适合于评估团队领导的不同方面和提高团队领导意识。结论：本研究报告了住院医师团队领导的SJT发展的初步努力。研究结果表明，SJT可以评估住院医师培训团队领导力建构的各个维度，可用于对住院医师团队领导行为提供有针对性的反馈和指导。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Medical Teacher 医学-卫生保健

CiteScore

7.80

自引率

8.50%

发文量

396

审稿时长

3-6 weeks

期刊介绍： Medical Teacher provides accounts of new teaching methods, guidance on structuring courses and assessing achievement, and serves as a forum for communication between medical teachers and those involved in general education. In particular, the journal recognizes the problems teachers have in keeping up-to-date with the developments in educational methods that lead to more effective teaching and learning at a time when the content of the curriculum—from medical procedures to policy changes in health care provision—is also changing. The journal features reports of innovation and research in medical education, case studies, survey articles, practical guidelines, reviews of current literature and book reviews. All articles are peer reviewed.