Establishing empirically derived non-inferiority margins for large-scale trials: An umbrella review of meta-analytic comparisons of bona fide psychological therapies.
Christoph Flückiger, Michael Barkham, Juan Martín Goméz Penedo
{"title":"Establishing empirically derived non-inferiority margins for large-scale trials: An umbrella review of meta-analytic comparisons of <i>bona fide</i> psychological therapies.","authors":"Christoph Flückiger, Michael Barkham, Juan Martín Goméz Penedo","doi":"10.1080/10503307.2026.2653992","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Setting non-inferiority margins has been problematic with decision making often appearing to be arbitrary. A pragmatic approach is to use the existing literature to provide empirical reference values for these margins. The current meta-analytic umbrella review estimates empirically derived non-inferiority margins for direct psychological therapy comparisons meeting <i>bona fide</i> conditions.</p><p><strong>Methods: </strong>A systematic search identified meta-analytic estimates of <i>bona fide</i> comparisons for primary and secondary outcomes. We conducted multilevel meta-analyses of these estimates to obtain generalizable empirically derived point-estimate non-inferiority margins.</p><p><strong>Results: </strong>Most patients included in the analyses represented populations commonly expected in outpatient psychological therapy settings. Overall, 46 meta-analytic standardized mean differences (<i>SMD</i>) nested in 19 meta-analyses (mean of 15.6 primary studies and 1302 participants in each meta-analysis) were identified to estimate generalizable non-inferiority margins. The estimated homogeneously distributed margins for the primary outcomes were <i>SMD</i> = -.17 (95% CI = -.21, -.13) and for secondary outcomes <i>SMD</i> = -.16 (95% CI = -.20, -.11), respectively.</p><p><strong>Discussion: </strong>This study provides empirically derived estimates for non-inferiority margins that are generalizable to large-scale trials to differentiate between small but nuanced effects and negligible non-inferior effects. Research on <i>bona fide</i> psychological therapy that accepts working on small effects needs careful consideration of confounding effects.</p>","PeriodicalId":48159,"journal":{"name":"Psychotherapy Research","volume":" ","pages":"1-12"},"PeriodicalIF":3.0000,"publicationDate":"2026-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychotherapy Research","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/10503307.2026.2653992","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PSYCHOLOGY, CLINICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: Setting non-inferiority margins has been problematic with decision making often appearing to be arbitrary. A pragmatic approach is to use the existing literature to provide empirical reference values for these margins. The current meta-analytic umbrella review estimates empirically derived non-inferiority margins for direct psychological therapy comparisons meeting bona fide conditions.
Methods: A systematic search identified meta-analytic estimates of bona fide comparisons for primary and secondary outcomes. We conducted multilevel meta-analyses of these estimates to obtain generalizable empirically derived point-estimate non-inferiority margins.
Results: Most patients included in the analyses represented populations commonly expected in outpatient psychological therapy settings. Overall, 46 meta-analytic standardized mean differences (SMD) nested in 19 meta-analyses (mean of 15.6 primary studies and 1302 participants in each meta-analysis) were identified to estimate generalizable non-inferiority margins. The estimated homogeneously distributed margins for the primary outcomes were SMD = -.17 (95% CI = -.21, -.13) and for secondary outcomes SMD = -.16 (95% CI = -.20, -.11), respectively.
Discussion: This study provides empirically derived estimates for non-inferiority margins that are generalizable to large-scale trials to differentiate between small but nuanced effects and negligible non-inferior effects. Research on bona fide psychological therapy that accepts working on small effects needs careful consideration of confounding effects.
期刊介绍:
Psychotherapy Research seeks to enhance the development, scientific quality, and social relevance of psychotherapy research and to foster the use of research findings in practice, education, and policy formulation. The Journal publishes reports of original research on all aspects of psychotherapy, including its outcomes, its processes, education of practitioners, and delivery of services. It also publishes methodological, theoretical, and review articles of direct relevance to psychotherapy research. The Journal is addressed to an international, interdisciplinary audience and welcomes submissions dealing with diverse theoretical orientations, treatment modalities.