Development of a Brief, Positively Framed Care Team Experience Measure.

IF 4.2 2区 医学 Q1 ORTHOPEDICS
Niels Brinkman, Sina Ramtin, Amir Fatehi, Tom J Crijns, David Ring, Prakash Jayakumar, Karl Koenig
{"title":"Development of a Brief, Positively Framed Care Team Experience Measure.","authors":"Niels Brinkman, Sina Ramtin, Amir Fatehi, Tom J Crijns, David Ring, Prakash Jayakumar, Karl Koenig","doi":"10.1097/CORR.0000000000003336","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Measures that quantify clinician fulfillment and engagement with work (clinician experience measures) have the potential to improve the quality, effectiveness, and enjoyment of patient care. Many existing measures of clinician fulfillment and engagement with work are relatively long and potentially burdensome, negatively framed, or address personal well-being. A measure with a small number of items that address positive attributes to which a team aspires may be a more useful measure to guide organizational improvement efforts.</p><p><strong>Questions/purposes: </strong>In a series of cross-sectional studies we asked: (1) Can we develop a brief, positively framed, and team-oriented care team experience measure (CTEM)? (2) How does the CTEM perform relative to the Team Climate Inventory (TCI)?</p><p><strong>Methods: </strong>In a first step, the clinical leadership group of a nascent multispecialty group practice curated 21 items, some from existing engagement and burnout measures and others based on suggestions from clinical leaders. After pilot testing and interviews with specific clinicians, these items were then administered to all clinicians in the practice, and 44% (120 of 274) participated. Factor analysis identified three groups of items (factors). In a second step, 43% (493 of 1135) of patient-facing employees (75% [368] of whom were women and 45% [222] of whom were ages 42 to 61 years) of a statewide musculoskeletal specialty practice rated 12 items (two from each of the factors identified in the first stage and six new items recommended by administrative leaders) and completed the TCI. Participants were then randomly allocated to a learning cohort (70% [343 participants]), in which we performed factor analysis and item response theory to develop a new CTEM and validation cohort (30% [150 participants]) to test the consistency of the findings. The best-performing items in terms of factor loadings (the degree to which an individual item represents an identified factor or \"theme\"; we chose a minimum of 0.4 as items above this threshold are generally regarded as stable), item discrimination (ability to measure different experiences among participants), item difficulty (the ability of an item to contribute to variation in scores), and model fit (the degree to which the estimates of the statistical model align with the observed data) were selected to form a new three-item CTEM. The CTEM was subsequently evaluated for internal consistency (Cronbach alpha, which measures the extent to which different subsets of the included items would provide the same measurement), floor and ceiling effects (the percentage of the lowest and highest possible scores, with high percentages indicating that information is lost because of the inability of a tool to measure the extremes of variation), and correlation with the TCI.</p><p><strong>Results: </strong>Factor analysis identified two groups of items representing \"effectiveness\" (nine items, including \"I am proud of the work we do\") and \"collaboration\" (three items, including \"Our team encourages everyone's input before making changes\"). The best-performing items of \"effectiveness\" (two items) and \"collaboration\" (one item) were selected to form the three-item CTEM, which had good internal consistency (Cronbach α = 0.77; > 0.7 generally considered acceptable); a notable ceiling (37%; higher than desired, common with experience measures, and-in our opinion-acceptable for routine use given the trade-off of limited participant burden) and limited floor effect (1.3%); strong correlation with the TCI (Spearman ρ 0.77 [95% confidence interval 0.70 to 0.85]), which supports convergent validity (part of construct validity, meaning correlation with measures of related concepts); and similar correlations with participant characteristics compared with the TCI, supporting construct and criterion validity (association with real-world outcomes).</p><p><strong>Conclusion: </strong>A small number of positively framed, team-oriented questions (the CTEM) can quantify clinician and care team experience and provide a practical and feasible method for health organizations to monitor and improve the experience of their clinicians.</p><p><strong>Clinical relevance: </strong>Routine measurement of organizational climate at regular intervals using a brief, user-friendly, team-oriented measure might help organizations improve their culture and help their clinicians feel appreciated and engaged.</p>","PeriodicalId":10404,"journal":{"name":"Clinical Orthopaedics and Related Research®","volume":" ","pages":""},"PeriodicalIF":4.2000,"publicationDate":"2024-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Orthopaedics and Related Research®","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/CORR.0000000000003336","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Measures that quantify clinician fulfillment and engagement with work (clinician experience measures) have the potential to improve the quality, effectiveness, and enjoyment of patient care. Many existing measures of clinician fulfillment and engagement with work are relatively long and potentially burdensome, negatively framed, or address personal well-being. A measure with a small number of items that address positive attributes to which a team aspires may be a more useful measure to guide organizational improvement efforts.

Questions/purposes: In a series of cross-sectional studies we asked: (1) Can we develop a brief, positively framed, and team-oriented care team experience measure (CTEM)? (2) How does the CTEM perform relative to the Team Climate Inventory (TCI)?

Methods: In a first step, the clinical leadership group of a nascent multispecialty group practice curated 21 items, some from existing engagement and burnout measures and others based on suggestions from clinical leaders. After pilot testing and interviews with specific clinicians, these items were then administered to all clinicians in the practice, and 44% (120 of 274) participated. Factor analysis identified three groups of items (factors). In a second step, 43% (493 of 1135) of patient-facing employees (75% [368] of whom were women and 45% [222] of whom were ages 42 to 61 years) of a statewide musculoskeletal specialty practice rated 12 items (two from each of the factors identified in the first stage and six new items recommended by administrative leaders) and completed the TCI. Participants were then randomly allocated to a learning cohort (70% [343 participants]), in which we performed factor analysis and item response theory to develop a new CTEM and validation cohort (30% [150 participants]) to test the consistency of the findings. The best-performing items in terms of factor loadings (the degree to which an individual item represents an identified factor or "theme"; we chose a minimum of 0.4 as items above this threshold are generally regarded as stable), item discrimination (ability to measure different experiences among participants), item difficulty (the ability of an item to contribute to variation in scores), and model fit (the degree to which the estimates of the statistical model align with the observed data) were selected to form a new three-item CTEM. The CTEM was subsequently evaluated for internal consistency (Cronbach alpha, which measures the extent to which different subsets of the included items would provide the same measurement), floor and ceiling effects (the percentage of the lowest and highest possible scores, with high percentages indicating that information is lost because of the inability of a tool to measure the extremes of variation), and correlation with the TCI.

Results: Factor analysis identified two groups of items representing "effectiveness" (nine items, including "I am proud of the work we do") and "collaboration" (three items, including "Our team encourages everyone's input before making changes"). The best-performing items of "effectiveness" (two items) and "collaboration" (one item) were selected to form the three-item CTEM, which had good internal consistency (Cronbach α = 0.77; > 0.7 generally considered acceptable); a notable ceiling (37%; higher than desired, common with experience measures, and-in our opinion-acceptable for routine use given the trade-off of limited participant burden) and limited floor effect (1.3%); strong correlation with the TCI (Spearman ρ 0.77 [95% confidence interval 0.70 to 0.85]), which supports convergent validity (part of construct validity, meaning correlation with measures of related concepts); and similar correlations with participant characteristics compared with the TCI, supporting construct and criterion validity (association with real-world outcomes).

Conclusion: A small number of positively framed, team-oriented questions (the CTEM) can quantify clinician and care team experience and provide a practical and feasible method for health organizations to monitor and improve the experience of their clinicians.

Clinical relevance: Routine measurement of organizational climate at regular intervals using a brief, user-friendly, team-oriented measure might help organizations improve their culture and help their clinicians feel appreciated and engaged.

求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
7.00
自引率
11.90%
发文量
722
审稿时长
2.5 months
期刊介绍: Clinical Orthopaedics and Related Research® is a leading peer-reviewed journal devoted to the dissemination of new and important orthopaedic knowledge. CORR® brings readers the latest clinical and basic research, along with columns, commentaries, and interviews with authors.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信