Joint models inform the longitudinal assessment of patient-reported outcomes in clinical trials: a simulation study and secondary analysis of the restrictive Vs. liberal fluid therapy for major abdominal surgery (RELIEF) randomized controlled trial
Julian F. Daza , Aya A. Mitani , Shabbir M.H. Alibhai , Peter M. Smith , Erin D. Kennedy , Mark A. Shulman , Paul S. Myles , Duminda N. Wijeysundera
{"title":"Joint models inform the longitudinal assessment of patient-reported outcomes in clinical trials: a simulation study and secondary analysis of the restrictive Vs. liberal fluid therapy for major abdominal surgery (RELIEF) randomized controlled trial","authors":"Julian F. Daza , Aya A. Mitani , Shabbir M.H. Alibhai , Peter M. Smith , Erin D. Kennedy , Mark A. Shulman , Paul S. Myles , Duminda N. Wijeysundera","doi":"10.1016/j.jclinepi.2024.111553","DOIUrl":null,"url":null,"abstract":"<div><h3>Objectives</h3><div>Evaluate the utility of a joint model when analysing a patient-reported endpoint as part of a randomized controlled trial (RCT) in which censoring occurs when patients die during follow-up.</div></div><div><h3>Study Design and Setting</h3><div>The present study comprises two parts as follows: first we reanalyzed data from a previously published RCT comparing two fluid regimens in the first 24 hours of major abdomino-pelvic surgery ('Restrictive versus Liberal Fluid Therapy for Major Abdominal Surgery [RELIEF]' trial). In this trial, patient-reported disability was measured at multiple timepoints before and after surgery. Next, we conducted a simulation study to jointly emulate patient-reported disability and survival, similar to the RELIEF trial, under nine treatment-outcome scenarios. In both parts, we compared a joint model analysis to a linear mixed-effect model combined with one of the several traditional methods of handling longitudinal missingness as follows: available data analysis, complete case analysis, last observation carried forward, and worst-case assumption.</div></div><div><h3>Results</h3><div>In part one, the joint model revealed no between-group differences in patient-reported disability at 1, 3, 6, and 12 months after surgery. The worst-case approach consistently resulted in the largest deviation from the joint model estimates, although in this particular setting none of the approaches materially changed the study's conclusions. In part two, the simulations revealed that across all treatment-outcome scenarios, the joint model expectedly produced unbiased estimates of patient-reported disability. Similarly, employing an approach based on all available data (ie, relying on the maximum likelihood estimator for handling missingness) yielded disability estimates close to the simulated values, albeit with slight bias across some scenarios. The last observation carried forward approach that mirrored the joint model's estimates except when the treatment had a nonnull effect on patient-reported disability. The worst-case analysis resulted in high bias, which was particularly evident when the treatment had a large effect on survival. The complete case analysis resulted in high bias across all scenarios.</div></div><div><h3>Conclusion</h3><div>In randomized trials that employ a patient-reported outcome as one of their endpoints, a joint model can address bias arising from informative missingness related to death. Methods for handling missingness based on all available data appear to be a reasonable alternative to joint models, with only slight bias across some simulated scenarios.</div></div><div><h3>Plain Language Summary</h3><div>‘Patient-centered research’ focuses on outcomes that are prioritized by patients. This approach often involves asking patients to complete questionnaires about their health experiences. However, if a patient does not finish a study, dealing with their missing answers can pose significant challenges. Joint models are a recent statistical method that may help address this issue. In this study, we used joint models in a real-world clinical trial, and in a series of simulated trials, to determine how well they handle missing questionnaire data from patients. We found that joint models offer significant benefits over most traditional methods used to analyze clinical trials.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"176 ","pages":"Article 111553"},"PeriodicalIF":7.3000,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Clinical Epidemiology","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0895435624003093","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Objectives
Evaluate the utility of a joint model when analysing a patient-reported endpoint as part of a randomized controlled trial (RCT) in which censoring occurs when patients die during follow-up.
Study Design and Setting
The present study comprises two parts as follows: first we reanalyzed data from a previously published RCT comparing two fluid regimens in the first 24 hours of major abdomino-pelvic surgery ('Restrictive versus Liberal Fluid Therapy for Major Abdominal Surgery [RELIEF]' trial). In this trial, patient-reported disability was measured at multiple timepoints before and after surgery. Next, we conducted a simulation study to jointly emulate patient-reported disability and survival, similar to the RELIEF trial, under nine treatment-outcome scenarios. In both parts, we compared a joint model analysis to a linear mixed-effect model combined with one of the several traditional methods of handling longitudinal missingness as follows: available data analysis, complete case analysis, last observation carried forward, and worst-case assumption.
Results
In part one, the joint model revealed no between-group differences in patient-reported disability at 1, 3, 6, and 12 months after surgery. The worst-case approach consistently resulted in the largest deviation from the joint model estimates, although in this particular setting none of the approaches materially changed the study's conclusions. In part two, the simulations revealed that across all treatment-outcome scenarios, the joint model expectedly produced unbiased estimates of patient-reported disability. Similarly, employing an approach based on all available data (ie, relying on the maximum likelihood estimator for handling missingness) yielded disability estimates close to the simulated values, albeit with slight bias across some scenarios. The last observation carried forward approach that mirrored the joint model's estimates except when the treatment had a nonnull effect on patient-reported disability. The worst-case analysis resulted in high bias, which was particularly evident when the treatment had a large effect on survival. The complete case analysis resulted in high bias across all scenarios.
Conclusion
In randomized trials that employ a patient-reported outcome as one of their endpoints, a joint model can address bias arising from informative missingness related to death. Methods for handling missingness based on all available data appear to be a reasonable alternative to joint models, with only slight bias across some simulated scenarios.
Plain Language Summary
‘Patient-centered research’ focuses on outcomes that are prioritized by patients. This approach often involves asking patients to complete questionnaires about their health experiences. However, if a patient does not finish a study, dealing with their missing answers can pose significant challenges. Joint models are a recent statistical method that may help address this issue. In this study, we used joint models in a real-world clinical trial, and in a series of simulated trials, to determine how well they handle missing questionnaire data from patients. We found that joint models offer significant benefits over most traditional methods used to analyze clinical trials.
联合模型为临床试验中患者报告结果的纵向评估提供依据:大腹部手术限制性输液疗法与自由输液疗法(RELIEF)随机对照试验的模拟研究与二次分析》(A Simulation Study and Secondary Analysis of the Restrictive versus Liberal Fluid Therapy for Major Abdominal Surgery (RELIEF) Randomized Controlled Trial)。
期刊介绍:
The Journal of Clinical Epidemiology strives to enhance the quality of clinical and patient-oriented healthcare research by advancing and applying innovative methods in conducting, presenting, synthesizing, disseminating, and translating research results into optimal clinical practice. Special emphasis is placed on training new generations of scientists and clinical practice leaders.