Jonas Petter, Lea Schumacher, Jette Echterhoff, Jan Philipp Klein, Elisabeth Schramm, Martin Härter, Martin Hautzinger, Levente Kriston
{"title":"Heterogeneity of Treatment Outcomes Across Therapists and Sites in a Randomized Multicentre Psychotherapy Trial","authors":"Jonas Petter, Lea Schumacher, Jette Echterhoff, Jan Philipp Klein, Elisabeth Schramm, Martin Härter, Martin Hautzinger, Levente Kriston","doi":"10.1002/cpp.70087","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Objective</h3>\n \n <p>Establishing robust evidence for psychotherapeutic treatment efficacy is crucial in evidence-based medicine for mental disorders. Randomized controlled trials (RCTs) are key to minimizing biases such as selection effects and baseline imbalances between study groups. However, another challenge to robust evidence in psychotherapy research is heterogeneity in treatment outcomes due to therapists and clinical sites. While this has been frequently observed in naturalistic settings, therapist- and site-related heterogeneity in treatment outcomes has been understudied in RCTs.</p>\n </section>\n \n <section>\n \n <h3> Method</h3>\n \n <p>The present study addresses this gap in a secondary data analysis, examining how therapists and clinical sites differ in treatment outcomes and differential/average treatment effect (i.e., outcome differences between treatment groups) within a large, multicentre RCT. We analysed data from 255 patients with chronic depression treated by 79 therapists in nine study sites, that received two different active psychotherapeutic interventions.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>Therapist- and site-related variances in treatment outcomes appeared relatively small, accounting for 1.1% [0.0%, 8.1%] and 1.7% [0.0%, 9.9%] of the total variance, respectively. Notably, site-related variance in differential treatment effects appeared relatively larger at 12.5% [0.1%, 44.4%]. These variances were only partially explained by patient or therapist characteristics.</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>While the sample size only allowed to estimate the variance contributions of therapists and sites with high uncertainty, the relative size comparison points to the importance of considering site heterogeneity in evaluating RCTs' differential treatment effects. Further research on site characteristics' impact could enhance understanding of psychotherapeutic treatment efficacy across diverse contexts.</p>\n </section>\n </div>","PeriodicalId":10460,"journal":{"name":"Clinical psychology & psychotherapy","volume":"32 3","pages":""},"PeriodicalIF":3.2000,"publicationDate":"2025-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cpp.70087","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical psychology & psychotherapy","FirstCategoryId":"102","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/cpp.70087","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, CLINICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Objective
Establishing robust evidence for psychotherapeutic treatment efficacy is crucial in evidence-based medicine for mental disorders. Randomized controlled trials (RCTs) are key to minimizing biases such as selection effects and baseline imbalances between study groups. However, another challenge to robust evidence in psychotherapy research is heterogeneity in treatment outcomes due to therapists and clinical sites. While this has been frequently observed in naturalistic settings, therapist- and site-related heterogeneity in treatment outcomes has been understudied in RCTs.
Method
The present study addresses this gap in a secondary data analysis, examining how therapists and clinical sites differ in treatment outcomes and differential/average treatment effect (i.e., outcome differences between treatment groups) within a large, multicentre RCT. We analysed data from 255 patients with chronic depression treated by 79 therapists in nine study sites, that received two different active psychotherapeutic interventions.
Results
Therapist- and site-related variances in treatment outcomes appeared relatively small, accounting for 1.1% [0.0%, 8.1%] and 1.7% [0.0%, 9.9%] of the total variance, respectively. Notably, site-related variance in differential treatment effects appeared relatively larger at 12.5% [0.1%, 44.4%]. These variances were only partially explained by patient or therapist characteristics.
Conclusion
While the sample size only allowed to estimate the variance contributions of therapists and sites with high uncertainty, the relative size comparison points to the importance of considering site heterogeneity in evaluating RCTs' differential treatment effects. Further research on site characteristics' impact could enhance understanding of psychotherapeutic treatment efficacy across diverse contexts.
期刊介绍:
Clinical Psychology & Psychotherapy aims to keep clinical psychologists and psychotherapists up to date with new developments in their fields. The Journal will provide an integrative impetus both between theory and practice and between different orientations within clinical psychology and psychotherapy. Clinical Psychology & Psychotherapy will be a forum in which practitioners can present their wealth of expertise and innovations in order to make these available to a wider audience. Equally, the Journal will contain reports from researchers who want to address a larger clinical audience with clinically relevant issues and clinically valid research.