Juan Martín Gómez Penedo, Julian Rubel, Manuel Meglio, Leo Bornhauser, Tobias Krieger, Anna Babl, Roberto Muiños, Andrés Roussos, Jaime Delgadillo, Christoph Flückiger, Thomas Berger, Wolfgang Lutz, Martin Grosse Holtforth
{"title":"Using machine learning algorithms to predict the effects of change processes in psychotherapy: Toward process-level treatment personalization.","authors":"Juan Martín Gómez Penedo, Julian Rubel, Manuel Meglio, Leo Bornhauser, Tobias Krieger, Anna Babl, Roberto Muiños, Andrés Roussos, Jaime Delgadillo, Christoph Flückiger, Thomas Berger, Wolfgang Lutz, Martin Grosse Holtforth","doi":"10.1037/pst0000507","DOIUrl":null,"url":null,"abstract":"<p><p>This study aimed to develop and test algorithms to determine the individual relevance of two psychotherapeutic change processes (i.e., mastery and clarification) for outcome prediction. We measured process and outcome variables in a naturalistic outpatient sample treated with an integrative treatment for a variety of diagnoses (<i>n</i> = 608) during the first 10 sessions. We estimated individual within-patient effects of each therapist-evaluated process of change on patient-evaluated subsequent outcomes on a session-by-session basis. Using patients' baseline characteristics, we trained machine learning algorithms on a randomly selected subsample (<i>n</i> = 407) to predict the effects of patients' process variables on outcome. We subsequently tested the predictive capacity of the best algorithm for each process on a holdout subsample (<i>n</i> = 201). We found significant within-patient effects of therapist perceived mastery and clarification on subsequent outcome. In the holdout subsample, the best-performing algorithms resulted in significant but small-to-medium correlations between the predicted and observed relevance of therapist perceived mastery (<i>r</i> = .18) and clarification (<i>r</i> = .16). Using the algorithms to create criteria for individual recommendations, in the holdout sample, we identified patients for whom mastery (14%) or clarification (18%) were indicated. In the mastery-indicated group, a greater focus on mastery was moderately associated with better outcome (<i>r</i> = .33, <i>d</i> = .70), while in the clarification-indicated group, the focus was not related to outcome (<i>r</i> = -.05, <i>d</i> = .10). Results support the feasibility of performing individual predictions regarding mastery process relevance that can be useful for therapist feedback and treatment recommendations. However, results will need to be replicated with prospective experimental designs. (PsycInfo Database Record (c) 2023 APA, all rights reserved).</p>","PeriodicalId":20910,"journal":{"name":"Psychotherapy","volume":" ","pages":"536-547"},"PeriodicalIF":2.6000,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychotherapy","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/pst0000507","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/10/5 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"PSYCHOLOGY, CLINICAL","Score":null,"Total":0}
引用次数: 0
Abstract
This study aimed to develop and test algorithms to determine the individual relevance of two psychotherapeutic change processes (i.e., mastery and clarification) for outcome prediction. We measured process and outcome variables in a naturalistic outpatient sample treated with an integrative treatment for a variety of diagnoses (n = 608) during the first 10 sessions. We estimated individual within-patient effects of each therapist-evaluated process of change on patient-evaluated subsequent outcomes on a session-by-session basis. Using patients' baseline characteristics, we trained machine learning algorithms on a randomly selected subsample (n = 407) to predict the effects of patients' process variables on outcome. We subsequently tested the predictive capacity of the best algorithm for each process on a holdout subsample (n = 201). We found significant within-patient effects of therapist perceived mastery and clarification on subsequent outcome. In the holdout subsample, the best-performing algorithms resulted in significant but small-to-medium correlations between the predicted and observed relevance of therapist perceived mastery (r = .18) and clarification (r = .16). Using the algorithms to create criteria for individual recommendations, in the holdout sample, we identified patients for whom mastery (14%) or clarification (18%) were indicated. In the mastery-indicated group, a greater focus on mastery was moderately associated with better outcome (r = .33, d = .70), while in the clarification-indicated group, the focus was not related to outcome (r = -.05, d = .10). Results support the feasibility of performing individual predictions regarding mastery process relevance that can be useful for therapist feedback and treatment recommendations. However, results will need to be replicated with prospective experimental designs. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
期刊介绍:
Psychotherapy Theory, Research, Practice, Training publishes a wide variety of articles relevant to the field of psychotherapy. The journal strives to foster interactions among individuals involved with training, practice theory, and research since all areas are essential to psychotherapy. This journal is an invaluable resource for practicing clinical and counseling psychologists, social workers, and mental health professionals.