Stuart R Wallace, Sachinkumar B Singh, Rebekah Blakney, Lexi Rene, Stephen S Johnston
{"title":"Optimization-Based Stable Balancing Weights Versus Propensity Score Weighting for Samples With High Covariate Imbalance.","authors":"Stuart R Wallace, Sachinkumar B Singh, Rebekah Blakney, Lexi Rene, Stephen S Johnston","doi":"10.1002/pds.5864","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>To compare the performance (covariate balance, effective sample size [ESS]) of stable balancing weights (SBW) versus propensity score weighting (PSW). Two applied cases were used to compare performance: (Case 1) extreme imbalance in baseline covariates between groups and (Case 2) substantial discrepancy in sample size between groups.</p><p><strong>Methods: </strong>Using the Premier Healthcare Database, we selected patients who (Case 1) underwent a surgical procedure with one of two different bipolar forceps between January 2000 and June 2020, or (Case 2) a neurological procedure using one of two different nonabsorbable surgical sutures between January 2000 and March 2020. Average treatment effects on the treated (ATT) weights were generated based on selected covariates. SBW was implemented using two techniques: (1) \"grid search\" to find weights of minimum variance at the lowest target absolute standardized mean difference (SMD); (2) finding weights of minimum variance at prespecified SMD tolerance. PSW and SBW methods were compared on postweighting SMDs, the number of imbalanced covariates, and ESS of the ATT-weighted control group.</p><p><strong>Results: </strong>In both studies, improved covariate balance was achieved with both SBW techniques. All methods suffered from postweighting ESS that was lower than the unweighted control group's original sample size; however, SBW methods achieved higher ESS for the control groups. Sensitivity analyses using SBW to apply variable-specific SMD thresholds increased ESS, outperforming PSW.</p><p><strong>Conclusions: </strong>In this applied example, the optimization-based SBW method provided ample flexibility with respect to prespecification of covariate balance goals and resulted in better postweighting covariate balance and larger ESS as compared with PSW.</p>","PeriodicalId":19782,"journal":{"name":"Pharmacoepidemiology and Drug Safety","volume":"33 7","pages":"e5864"},"PeriodicalIF":2.4000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pharmacoepidemiology and Drug Safety","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1002/pds.5864","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PHARMACOLOGY & PHARMACY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: To compare the performance (covariate balance, effective sample size [ESS]) of stable balancing weights (SBW) versus propensity score weighting (PSW). Two applied cases were used to compare performance: (Case 1) extreme imbalance in baseline covariates between groups and (Case 2) substantial discrepancy in sample size between groups.
Methods: Using the Premier Healthcare Database, we selected patients who (Case 1) underwent a surgical procedure with one of two different bipolar forceps between January 2000 and June 2020, or (Case 2) a neurological procedure using one of two different nonabsorbable surgical sutures between January 2000 and March 2020. Average treatment effects on the treated (ATT) weights were generated based on selected covariates. SBW was implemented using two techniques: (1) "grid search" to find weights of minimum variance at the lowest target absolute standardized mean difference (SMD); (2) finding weights of minimum variance at prespecified SMD tolerance. PSW and SBW methods were compared on postweighting SMDs, the number of imbalanced covariates, and ESS of the ATT-weighted control group.
Results: In both studies, improved covariate balance was achieved with both SBW techniques. All methods suffered from postweighting ESS that was lower than the unweighted control group's original sample size; however, SBW methods achieved higher ESS for the control groups. Sensitivity analyses using SBW to apply variable-specific SMD thresholds increased ESS, outperforming PSW.
Conclusions: In this applied example, the optimization-based SBW method provided ample flexibility with respect to prespecification of covariate balance goals and resulted in better postweighting covariate balance and larger ESS as compared with PSW.
期刊介绍:
The aim of Pharmacoepidemiology and Drug Safety is to provide an international forum for the communication and evaluation of data, methods and opinion in the discipline of pharmacoepidemiology. The Journal publishes peer-reviewed reports of original research, invited reviews and a variety of guest editorials and commentaries embracing scientific, medical, statistical, legal and economic aspects of pharmacoepidemiology and post-marketing surveillance of drug safety. Appropriate material in these categories may also be considered for publication as a Brief Report.
Particular areas of interest include:
design, analysis, results, and interpretation of studies looking at the benefit or safety of specific pharmaceuticals, biologics, or medical devices, including studies in pharmacovigilance, postmarketing surveillance, pharmacoeconomics, patient safety, molecular pharmacoepidemiology, or any other study within the broad field of pharmacoepidemiology;
comparative effectiveness research relating to pharmaceuticals, biologics, and medical devices. Comparative effectiveness research is the generation and synthesis of evidence that compares the benefits and harms of alternative methods to prevent, diagnose, treat, and monitor a clinical condition, as these methods are truly used in the real world;
methodologic contributions of relevance to pharmacoepidemiology, whether original contributions, reviews of existing methods, or tutorials for how to apply the methods of pharmacoepidemiology;
assessments of harm versus benefit in drug therapy;
patterns of drug utilization;
relationships between pharmacoepidemiology and the formulation and interpretation of regulatory guidelines;
evaluations of risk management plans and programmes relating to pharmaceuticals, biologics and medical devices.