Shannon Wiltsey Stirman, Nicole B. Gumport, Amber Calloway, Cassidy Gunter, Luana Marques, Samantha Hernandez, Jiyoung Song, Clara Johnson, Soo Jeong Youn, Sohayla Elhusseini, Regine M. Deguzman-Lucero, Taylor Loskot, Heidi La Bash, Yesenia Aguilar Silvan, Caroline Canale, Alayna L. Park, Jansey Lagdamen, Anna D. Bartuska, Booil Jo, Paul Barnett, Torrey A. Creed
{"title":"在常规护理环境中评估认知加工治疗忠实度的实用和可扩展策略的比较","authors":"Shannon Wiltsey Stirman, Nicole B. Gumport, Amber Calloway, Cassidy Gunter, Luana Marques, Samantha Hernandez, Jiyoung Song, Clara Johnson, Soo Jeong Youn, Sohayla Elhusseini, Regine M. Deguzman-Lucero, Taylor Loskot, Heidi La Bash, Yesenia Aguilar Silvan, Caroline Canale, Alayna L. Park, Jansey Lagdamen, Anna D. Bartuska, Booil Jo, Paul Barnett, Torrey A. Creed","doi":"10.1016/j.beth.2024.12.003","DOIUrl":null,"url":null,"abstract":"<div><div>Fidelity monitoring is crucial for successful implementation of evidence-based practices, but traditional methods such as observation and video recording are impractical for routine mental health care due to their high resource demands. A reliable, low-burden fidelity (adherence and competence) assessment can support the implementation of cognitive behavioral therapies (CBTs). This study evaluated two pragmatic alternatives to the time and cost-intensive “gold standard” observer ratings based on session recordings to assess fidelity in Cognitive Processing Therapy (CPT). We assessed the feasibility of clinician-completed adherence checklists and ratings of worksheets that were completed during sessions in public and private mental healthcare settings by a diverse sample of patients with significant trauma histories and their therapists. We also examined whether fidelity ratings using these approaches were associated with observer ratings of fidelity and with subsequent PTSD symptom change. Results indicated high overall rater agreement for adherence and competence on CPT worksheets and session recordings. We found significant associations among traditional observer ratings of adherence and our two low-burden alternatives for assessing adherence. Clinician-completed adherence checklists were also associated with subsequent symptom change. Checklists and worksheets required substantially less time to rate than session recordings. Overall, checklists and worksheets emerged as reliable and feasible methods for fidelity assessment, potentially diminishing the necessity for time- and labor-intensive fidelity ratings based on session recordings. Our findings suggest a scalable approach for integrating fidelity monitoring and support into policies aimed at enhancing the accessibility and effectiveness of evidence-based care.</div></div>","PeriodicalId":48359,"journal":{"name":"Behavior Therapy","volume":"56 3","pages":"Pages 453-469"},"PeriodicalIF":3.4000,"publicationDate":"2024-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Comparison of Pragmatic and Scalable Strategies to Assess Fidelity to Cognitive Processing Therapy in Routine Care Settings\",\"authors\":\"Shannon Wiltsey Stirman, Nicole B. Gumport, Amber Calloway, Cassidy Gunter, Luana Marques, Samantha Hernandez, Jiyoung Song, Clara Johnson, Soo Jeong Youn, Sohayla Elhusseini, Regine M. Deguzman-Lucero, Taylor Loskot, Heidi La Bash, Yesenia Aguilar Silvan, Caroline Canale, Alayna L. Park, Jansey Lagdamen, Anna D. Bartuska, Booil Jo, Paul Barnett, Torrey A. Creed\",\"doi\":\"10.1016/j.beth.2024.12.003\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Fidelity monitoring is crucial for successful implementation of evidence-based practices, but traditional methods such as observation and video recording are impractical for routine mental health care due to their high resource demands. A reliable, low-burden fidelity (adherence and competence) assessment can support the implementation of cognitive behavioral therapies (CBTs). This study evaluated two pragmatic alternatives to the time and cost-intensive “gold standard” observer ratings based on session recordings to assess fidelity in Cognitive Processing Therapy (CPT). We assessed the feasibility of clinician-completed adherence checklists and ratings of worksheets that were completed during sessions in public and private mental healthcare settings by a diverse sample of patients with significant trauma histories and their therapists. We also examined whether fidelity ratings using these approaches were associated with observer ratings of fidelity and with subsequent PTSD symptom change. Results indicated high overall rater agreement for adherence and competence on CPT worksheets and session recordings. We found significant associations among traditional observer ratings of adherence and our two low-burden alternatives for assessing adherence. Clinician-completed adherence checklists were also associated with subsequent symptom change. Checklists and worksheets required substantially less time to rate than session recordings. Overall, checklists and worksheets emerged as reliable and feasible methods for fidelity assessment, potentially diminishing the necessity for time- and labor-intensive fidelity ratings based on session recordings. Our findings suggest a scalable approach for integrating fidelity monitoring and support into policies aimed at enhancing the accessibility and effectiveness of evidence-based care.</div></div>\",\"PeriodicalId\":48359,\"journal\":{\"name\":\"Behavior Therapy\",\"volume\":\"56 3\",\"pages\":\"Pages 453-469\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2024-12-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Behavior Therapy\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0005789424001655\",\"RegionNum\":2,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"PSYCHIATRY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Behavior Therapy","FirstCategoryId":"102","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0005789424001655","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PSYCHIATRY","Score":null,"Total":0}
A Comparison of Pragmatic and Scalable Strategies to Assess Fidelity to Cognitive Processing Therapy in Routine Care Settings
Fidelity monitoring is crucial for successful implementation of evidence-based practices, but traditional methods such as observation and video recording are impractical for routine mental health care due to their high resource demands. A reliable, low-burden fidelity (adherence and competence) assessment can support the implementation of cognitive behavioral therapies (CBTs). This study evaluated two pragmatic alternatives to the time and cost-intensive “gold standard” observer ratings based on session recordings to assess fidelity in Cognitive Processing Therapy (CPT). We assessed the feasibility of clinician-completed adherence checklists and ratings of worksheets that were completed during sessions in public and private mental healthcare settings by a diverse sample of patients with significant trauma histories and their therapists. We also examined whether fidelity ratings using these approaches were associated with observer ratings of fidelity and with subsequent PTSD symptom change. Results indicated high overall rater agreement for adherence and competence on CPT worksheets and session recordings. We found significant associations among traditional observer ratings of adherence and our two low-burden alternatives for assessing adherence. Clinician-completed adherence checklists were also associated with subsequent symptom change. Checklists and worksheets required substantially less time to rate than session recordings. Overall, checklists and worksheets emerged as reliable and feasible methods for fidelity assessment, potentially diminishing the necessity for time- and labor-intensive fidelity ratings based on session recordings. Our findings suggest a scalable approach for integrating fidelity monitoring and support into policies aimed at enhancing the accessibility and effectiveness of evidence-based care.
期刊介绍:
Behavior Therapy is a quarterly international journal devoted to the application of the behavioral and cognitive sciences to the conceptualization, assessment, and treatment of psychopathology and related clinical problems. It is intended for mental health professionals and students from all related disciplines who wish to remain current in these areas and provides a vehicle for scientist-practitioners and clinical scientists to report the results of their original empirical research. Although the major emphasis is placed upon empirical research, methodological and theoretical papers as well as evaluative reviews of the literature will also be published. Controlled single-case designs and clinical replication series are welcome.