Assessment of service provider competency for child and adolescent psychological treatments and psychosocial services in global mental health: evaluation of feasibility and reliability of the WeACT tool in Gaza, Palestine.

Global mental health (Cambridge, England) Pub Date : 2021-02-22 eCollection Date: 2021-01-01 DOI:10.1017/gmh.2021.6
M J D Jordans, A Coetzee, H F Steen, G V Koppenol-Gonzalez, H Galayini, S Y Diab, S A Aisha, B A Kohrt
{"title":"Assessment of service provider competency for child and adolescent psychological treatments and psychosocial services in global mental health: evaluation of feasibility and reliability of the WeACT tool in Gaza, Palestine.","authors":"M J D Jordans,&nbsp;A Coetzee,&nbsp;H F Steen,&nbsp;G V Koppenol-Gonzalez,&nbsp;H Galayini,&nbsp;S Y Diab,&nbsp;S A Aisha,&nbsp;B A Kohrt","doi":"10.1017/gmh.2021.6","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>There is a scarcity of evaluated tools to assess whether non-specialist providers achieve minimum levels of competency to effectively and safely deliver psychological interventions in low- and middle-income countries. The objective of this study was to evaluate the reliability and utility of the newly developed Working with children - Assessment of Competencies Tool (WeACT) to assess service providers' competencies in Gaza, Palestine.</p><p><strong>Methods: </strong>The study evaluated; (1) psychometric properties of the WeACT based on observed role-plays by trainers/supervisors (<i>N</i> = 8); (2) sensitivity to change among service provider competencies (<i>N</i> = 25) using pre-and-post training WeACT scores on standardized role-plays; (3) in-service competencies among experienced service providers (<i>N</i> = 64) using standardized role-plays.</p><p><strong>Results: </strong>We demonstrated moderate interrater reliability [intraclass correlation coefficient, single measures, ICC = 0.68 (95% CI 0.48-0.86)] after practice, with high internal consistency (<i>α</i> = 0.94). WeACT assessments provided clinically relevant information on achieved levels of competencies (55% of the competencies were scored as adequate pre-training; 71% post-training; 62% in-service). Pre-post training assessment saw significant improvement in competencies (<i>W</i> = -3.64; <i>p</i> < 0.001).</p><p><strong>Conclusion: </strong>This study demonstrated positive results on the reliability and utility of the WeACT, with sufficient inter-rater agreement, excellent internal consistency, sensitivity to assess change, and providing insight needs for remedial training. The WeACT holds promise as a tool for monitoring quality of care when implementing evidence-based care at scale.</p>","PeriodicalId":520633,"journal":{"name":"Global mental health (Cambridge, England)","volume":" ","pages":"e7"},"PeriodicalIF":0.0000,"publicationDate":"2021-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1017/gmh.2021.6","citationCount":"10","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Global mental health (Cambridge, England)","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1017/gmh.2021.6","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2021/1/1 0:00:00","PubModel":"eCollection","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 10

Abstract

Background: There is a scarcity of evaluated tools to assess whether non-specialist providers achieve minimum levels of competency to effectively and safely deliver psychological interventions in low- and middle-income countries. The objective of this study was to evaluate the reliability and utility of the newly developed Working with children - Assessment of Competencies Tool (WeACT) to assess service providers' competencies in Gaza, Palestine.

Methods: The study evaluated; (1) psychometric properties of the WeACT based on observed role-plays by trainers/supervisors (N = 8); (2) sensitivity to change among service provider competencies (N = 25) using pre-and-post training WeACT scores on standardized role-plays; (3) in-service competencies among experienced service providers (N = 64) using standardized role-plays.

Results: We demonstrated moderate interrater reliability [intraclass correlation coefficient, single measures, ICC = 0.68 (95% CI 0.48-0.86)] after practice, with high internal consistency (α = 0.94). WeACT assessments provided clinically relevant information on achieved levels of competencies (55% of the competencies were scored as adequate pre-training; 71% post-training; 62% in-service). Pre-post training assessment saw significant improvement in competencies (W = -3.64; p < 0.001).

Conclusion: This study demonstrated positive results on the reliability and utility of the WeACT, with sufficient inter-rater agreement, excellent internal consistency, sensitivity to assess change, and providing insight needs for remedial training. The WeACT holds promise as a tool for monitoring quality of care when implementing evidence-based care at scale.

Abstract Image

Abstract Image

Abstract Image

评估服务提供者在全球精神卫生方面的儿童和青少年心理治疗和社会心理服务能力:评估巴勒斯坦加沙地区WeACT工具的可行性和可靠性。
背景:在低收入和中等收入国家,缺乏评估工具来评估非专业提供者是否达到有效和安全提供心理干预的最低能力水平。本研究的目的是评估新开发的儿童工作能力评估工具(WeACT)的可靠性和实用性,以评估巴勒斯坦加沙地区服务提供者的能力。方法:对研究进行评价;(1)基于培训师/主管角色扮演观察的WeACT心理测量特征(N = 8);(2)利用培训前后WeACT标准化角色扮演分数分析服务提供者胜任力变化的敏感性(N = 25);(3)采用标准化角色扮演法对经验丰富的服务提供者(N = 64)的在职胜任力进行研究。结果:在实践后,我们表现出中等的组间信度[组内相关系数,单测量,ICC = 0.68 (95% CI 0.48-0.86)],具有较高的内部一致性(α = 0.94)。WeACT评估提供了关于已达到的能力水平的临床相关信息(55%的能力被评为充分的预训练;71%的岗位培训;62%的在职)。岗前培训评估显示胜任力显著提高(W = -3.64;P < 0.001)。结论:本研究显示了WeACT的可靠性和实用性的积极结果,具有足够的评分者之间的一致性,良好的内部一致性,评估变化的敏感性,并为补救培训提供了洞察力需求。在大规模实施循证护理时,WeACT有望成为监测护理质量的工具。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信