Research Synthesis Methods最新文献_第9页

Generalizing some key results from “alternative weighting schemes when performing matching-adjusted indirect comparisons” 归纳 "进行匹配调整间接比较时的替代加权方案 "的一些关键结果

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-11-13 DOI: 10.1002/jrsm.1682

Landan Zhang, Dan Jackson

引用次数: 0

The impact of correction methods on rare-event meta-analysis 校正方法对罕见事件荟萃分析的影响。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-11-09 DOI: 10.1002/jrsm.1677

Brinley N. Zabriskie, Nolan Cole, Jacob Baldauf, Craig Decker

{"title":"The impact of correction methods on rare-event meta-analysis","authors":"Brinley N. Zabriskie, Nolan Cole, Jacob Baldauf, Craig Decker","doi":"10.1002/jrsm.1677","DOIUrl":"10.1002/jrsm.1677","url":null,"abstract":"Meta-analyses have become the gold standard for synthesizing evidence from multiple clinical trials, and they are especially useful when outcomes are rare or adverse since individual trials often lack sufficient power to detect a treatment effect. However, when zero events are observed in one or both treatment arms in a trial, commonly used meta-analysis methods can perform poorly. Continuity corrections (CCs), and numerical adjustments to the data to make computations feasible, have been proposed to ameliorate this issue. While the impact of various CCs on meta-analyses with rare events has been explored, how this impact varies based on the choice of pooling method and heterogeneity variance estimator is not widely understood. We compare several correction methods via a simulation study with a variety of commonly used meta-analysis methods. We consider how these method combinations impact important meta-analysis results, such as the estimated overall treatment effect, 95% confidence interval coverage, and Type I error rate. We also provide a website application of these results to aid researchers in selecting meta-analysis methods for rare-event data sets. Overall, no one-method combination can be consistently recommended, but some general trends are evident. For example, when there is no heterogeneity variance, we find that all pooling methods can perform well when paired with a specific correction method. Additionally, removing studies with zero events can work very well when there is no heterogeneity variance, while excluding single-zero studies results in poorer method performance when there is non-negligible heterogeneity variance and is not recommended.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"15 1","pages":"130-151"},"PeriodicalIF":9.8,"publicationDate":"2023-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72012794","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Avoiding common mistakes in meta-analysis: Understanding the distinct roles of Q, I-squared, tau-squared, and the prediction interval in reporting heterogeneity 避免荟萃分析中的常见错误：了解Q、I平方、τ平方和预测区间在报告异质性中的不同作用。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-11-08 DOI: 10.1002/jrsm.1678

Michael Borenstein

{"title":"Avoiding common mistakes in meta-analysis: Understanding the distinct roles of Q, I-squared, tau-squared, and the prediction interval in reporting heterogeneity","authors":"Michael Borenstein","doi":"10.1002/jrsm.1678","DOIUrl":"10.1002/jrsm.1678","url":null,"abstract":"In any meta-analysis, it is critically important to report the dispersion in effects as well as the mean effect. If an intervention has a moderate clinical impact on average we also need to know if the impact is moderate for all relevant populations, or if it varies from trivial in some to major in others. Or indeed, if the intervention is beneficial in some cases but harmful in others. Researchers typically report a series of statistics such as the Q-value, the p-value, and I2, which are intended to address this issue. Often, they use these statistics to classify the heterogeneity as being low, moderate, or high and then use these classifications when considering the potential utility of the intervention. While this practice is ubiquitous, it is nevertheless incorrect. The statistics mentioned above do not actually tell us how much the effect size varies. Classifications of heterogeneity based on these statistics are uninformative at best, and often misleading. My goal in this paper is to explain what these statistics do tell us, and that none of them tells us how much the effect size varies. Then I will introduce the prediction interval, the statistic that does tell us how much the effect size varies, and that addresses the question we have in mind when we ask about heterogeneity. This paper is adapted from a chapter in “Common Mistakes in Meta-Analysis and How to Avoid Them.” A free PDF of the book is available at https://www.Meta-Analysis.com/rsm.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"15 2","pages":"354-368"},"PeriodicalIF":9.8,"publicationDate":"2023-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71519800","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A framework to characterise the reproducibility of meta-analysis results with its application to direct oral anticoagulants in the acute treatment of venous thromboembolism 荟萃分析结果再现性的表征框架及其在静脉血栓栓塞症急性治疗中直接口服抗凝剂的应用。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-10-17 DOI: 10.1002/jrsm.1676

Céline Chapelle, Gwénaël Le Teuff, Paul Jacques Zufferey, Silvy Laporte, Edouard Ollier

{"title":"A framework to characterise the reproducibility of meta-analysis results with its application to direct oral anticoagulants in the acute treatment of venous thromboembolism","authors":"Céline Chapelle, Gwénaël Le Teuff, Paul Jacques Zufferey, Silvy Laporte, Edouard Ollier","doi":"10.1002/jrsm.1676","DOIUrl":"10.1002/jrsm.1676","url":null,"abstract":"The number of meta-analyses of aggregate data has dramatically increased due to the facility of obtaining data from publications and the development of free, easy-to-use, and specialised statistical software. Even when meta-analyses include the same studies, their results may vary owing to different methodological choices. Assessment of the replication of meta-analysis provides an example of the variation of effect ‘naturally’ observed between multiple research projects. Reproducibility of results has mostly been reported using graphical descriptive representations. A quantitative analysis of such results would enable (i) breakdown of the total observed variability with quantification of the variability generated by the replication process and (ii) identification of which variables account for this variability, such as methodological quality or the statistical analysis procedures used. These variables might explain systematic mean differences between results and dispersion of the results. To quantitatively characterise the reproducibility of meta-analysis results, a bivariate linear mixed-effects model was developed to simulate both mean results and their corresponding uncertainty. Results were assigned to several replication groups, those assessing the same studies, outcomes, treatment indication and comparisons classified in the same replication group. A nested random effect structure was used to break down the total variability within each replication group and between these groups to enable calculation of an intragroup correlation coefficient and quantification of reproducibility. Determinants of variability were investigated by modelling both mean and variance parameters using covariates. The proposed model was applied to the example of meta-analyses evaluating direct oral anticoagulants in the acute treatment of venous thromboembolism.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"15 1","pages":"117-129"},"PeriodicalIF":9.8,"publicationDate":"2023-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41230945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Use of multiple covariates in assessing treatment-effect modifiers: A methodological review of individual participant data meta-analyses 多协变量在评估治疗效果调节剂中的应用：个体参与者数据荟萃分析的方法综述。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-09-28 DOI: 10.1002/jrsm.1674

Peter J. Godolphin, Nadine Marlin, Chantelle Cornett, David J. Fisher, Jayne F. Tierney, Ian R. White, Ewelina Rogozińska

{"title":"Use of multiple covariates in assessing treatment-effect modifiers: A methodological review of individual participant data meta-analyses","authors":"Peter J. Godolphin, Nadine Marlin, Chantelle Cornett, David J. Fisher, Jayne F. Tierney, Ian R. White, Ewelina Rogozińska","doi":"10.1002/jrsm.1674","DOIUrl":"10.1002/jrsm.1674","url":null,"abstract":"Individual participant data (IPD) meta-analyses of randomised trials are considered a reliable way to assess participant-level treatment effect modifiers but may not make the best use of the available data. Traditionally, effect modifiers are explored one covariate at a time, which gives rise to the possibility that evidence of treatment-covariate interaction may be due to confounding from a different, related covariate. We aimed to evaluate current practice when estimating treatment-covariate interactions in IPD meta-analysis, specifically focusing on involvement of additional covariates in the models. We reviewed 100 IPD meta-analyses of randomised trials, published between 2015 and 2020, that assessed at least one treatment-covariate interaction. We identified four approaches to handling additional covariates: (1) Single interaction model (unadjusted): No additional covariates included (57/100 IPD meta-analyses); (2) Single interaction model (adjusted): Adjustment for the main effect of at least one additional covariate (35/100); (3) Multiple interactions model: Adjustment for at least one two-way interaction between treatment and an additional covariate (3/100); and (4) Three-way interaction model: Three-way interaction formed between treatment, the additional covariate and the potential effect modifier (5/100). IPD is not being utilised to its fullest extent. In an exemplar dataset, we demonstrate how these approaches lead to different conclusions. Researchers should adjust for additional covariates when estimating interactions in IPD meta-analysis providing they adjust their main effects, which is already widely recommended. Further, they should consider whether more complex approaches could provide better information on who might benefit most from treatments, improving patient choice and treatment policy and practice.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"15 1","pages":"107-116"},"PeriodicalIF":9.8,"publicationDate":"2023-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jrsm.1674","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41093916","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Catchii: Empowering literature review screening in healthcare Catchii：在医疗保健中进行文献综述筛查。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-09-28 DOI: 10.1002/jrsm.1675

Andreas Halman, Alicia Oshlack

{"title":"Catchii: Empowering literature review screening in healthcare","authors":"Andreas Halman, Alicia Oshlack","doi":"10.1002/jrsm.1675","DOIUrl":"10.1002/jrsm.1675","url":null,"abstract":"A systematic review is a type of literature review that aims to collect and analyse all available evidence from the literature on a particular topic. The process of screening and identifying eligible articles from the vast amounts of literature is a time-consuming task. Specialised software has been developed to aid in the screening process and save significant time and labour. However, the most suitable software tools that are available often come with a cost or only offer either a limited or a trial version for free. In this paper, we report the release of a new software application, Catchii, which contains all the important features of a systematic review screening application while being completely free. It supports a user at different stages of screening, from detecting duplicates to creating the final flowchart for a publication. Catchii is designed to provide a good user experience and streamline the screening process through its clean and user-friendly interface on both computers and mobile devices. All in all, Catchii is a valuable addition to the current selection of systematic review screening applications. It enables researchers without financial resources to access features found in the best paid tools, while also diminishing costs for those who have previously relied on paid applications. Catchii is available at https://catchii.org.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"15 1","pages":"157-165"},"PeriodicalIF":9.8,"publicationDate":"2023-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jrsm.1675","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41094045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Accuracy and precision of fixed and random effects in meta-analyses of randomized control trials for continuous outcomes 随机对照试验连续结果荟萃分析中固定和随机效应的准确性和准确性。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-09-26 DOI: 10.1002/jrsm.1673

Timo Gnambs, Ulrich Schroeders

{"title":"Accuracy and precision of fixed and random effects in meta-analyses of randomized control trials for continuous outcomes","authors":"Timo Gnambs, Ulrich Schroeders","doi":"10.1002/jrsm.1673","DOIUrl":"10.1002/jrsm.1673","url":null,"abstract":"Meta-analyses of treatment effects in randomized control trials are often faced with the problem of missing information required to calculate effect sizes and their sampling variances. Particularly, correlations between pre- and posttest scores are frequently not available. As an ad-hoc solution, researchers impute a constant value for the missing correlation. As an alternative, we propose adopting a multivariate meta-regression approach that models independent group effect sizes and accounts for the dependency structure using robust variance estimation or three-level modeling. A comprehensive simulation study mimicking realistic conditions of meta-analyses in clinical and educational psychology suggested that imputing a fixed correlation 0.8 or adopting a multivariate meta-regression with robust variance estimation work well for estimating the pooled effect but lead to slightly distorted between-study heterogeneity estimates. In contrast, three-level meta-regressions resulted in largely unbiased fixed effects but more inconsistent prediction intervals. Based on these results recommendations for meta-analytic practice and future meta-analytic developments are provided.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"15 1","pages":"86-106"},"PeriodicalIF":9.8,"publicationDate":"2023-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jrsm.1673","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41099377","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A comparison of machine learning methods to find clinical trials for inclusion in new systematic reviews from their PROSPERO registrations prior to searching and screening 机器学习方法的比较，以在搜索和筛选之前，从其PROSPERO注册中找到可纳入新系统综述的临床试验。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-09-25 DOI: 10.1002/jrsm.1672

Shifeng Liu, Florence T. Bourgeois, Claire Narang, Adam G. Dunn

{"title":"A comparison of machine learning methods to find clinical trials for inclusion in new systematic reviews from their PROSPERO registrations prior to searching and screening","authors":"Shifeng Liu, Florence T. Bourgeois, Claire Narang, Adam G. Dunn","doi":"10.1002/jrsm.1672","DOIUrl":"10.1002/jrsm.1672","url":null,"abstract":"Searching for trials is a key task in systematic reviews and a focus of automation. Previous approaches required knowing examples of relevant trials in advance, and most methods are focused on published trial articles. To complement existing tools, we compared methods for finding relevant trial registrations given a International Prospective Register of Systematic Reviews (PROSPERO) entry and where no relevant trials have been screened for inclusion in advance. We compared SciBERT-based (extension of Bidirectional Encoder Representations from Transformers) PICO extraction, MetaMap, and term-based representations using an imperfect dataset mined from 3632 PROSPERO entries connected to a subset of 65,662 trial registrations and 65,834 trial articles known to be included in systematic reviews. Performance was measured by the median rank and recall by rank of trials that were eventually included in the published systematic reviews. When ranking trial registrations relative to PROSPERO entries, 296 trial registrations needed to be screened to identify half of the relevant trials, and the best performing approach used a basic term-based representation. When ranking trial articles relative to PROSPERO entries, 162 trial articles needed to be screened to identify half of the relevant trials, and the best-performing approach used a term-based representation. The results show that MetaMap and term-based representations outperformed approaches that included PICO extraction for this use case. The results suggest that when starting with a PROSPERO entry and where no trials have been screened for inclusion, automated methods can reduce workload, but additional processes are still needed to efficiently identify trial registrations or trial articles that meet the inclusion criteria of a systematic review.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"15 1","pages":"73-85"},"PeriodicalIF":9.8,"publicationDate":"2023-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jrsm.1672","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41101717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Sensitivity analysis for the interactive effects of internal bias and publication bias in meta-analyses 荟萃分析中内部偏倚和发表偏倚交互影响的敏感性分析。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-09-24 DOI: 10.1002/jrsm.1667

Maya B. Mathur

{"title":"Sensitivity analysis for the interactive effects of internal bias and publication bias in meta-analyses","authors":"Maya B. Mathur","doi":"10.1002/jrsm.1667","DOIUrl":"10.1002/jrsm.1667","url":null,"abstract":"Meta-analyses can be compromised by studies' internal biases (e.g., confounding in nonrandomized studies) as well as publication bias. These biases often operate nonadditively: publication bias that favors significant, positive results selects indirectly for studies with more internal bias. We propose sensitivity analyses that address two questions: (1) “For a given severity of internal bias across studies and of publication bias, how much could the results change?”; and (2) “For a given severity of publication bias, how severe would internal bias have to be, hypothetically, to attenuate the results to the null or by a given amount?” These methods consider the average internal bias across studies, obviating specifying the bias in each study individually. The analyst can assume that internal bias affects all studies, or alternatively that it only affects a known subset (e.g., nonrandomized studies). The internal bias can be of unknown origin or, for certain types of bias in causal estimates, can be bounded analytically. The analyst can specify the severity of publication bias or, alternatively, consider a “worst-case” form of publication bias. Robust estimation methods accommodate non-normal effects, small meta-analyses, and clustered estimates. As we illustrate by re-analyzing published meta-analyses, the methods can provide insights that are not captured by simply considering each bias in turn. An R package implementing the methods is available (multibiasmeta).","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"15 1","pages":"21-43"},"PeriodicalIF":9.8,"publicationDate":"2023-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jrsm.1667","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41091622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Evaluation of statistical methods used to meta-analyse results from interrupted time series studies: A simulation study 用于对中断时间序列研究的结果进行荟萃分析的统计方法的评估：一项模拟研究。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-09-20 DOI: 10.1002/jrsm.1669

Elizabeth Korevaar, Simon L. Turner, Andrew B. Forbes, Amalia Karahalios, Monica Taljaard, Joanne E. McKenzie

{"title":"Evaluation of statistical methods used to meta-analyse results from interrupted time series studies: A simulation study","authors":"Elizabeth Korevaar, Simon L. Turner, Andrew B. Forbes, Amalia Karahalios, Monica Taljaard, Joanne E. McKenzie","doi":"10.1002/jrsm.1669","DOIUrl":"10.1002/jrsm.1669","url":null,"abstract":"Interrupted time series (ITS) are often meta-analysed to inform public health and policy decisions but examination of the statistical methods for ITS analysis and meta-analysis in this context is limited. We simulated meta-analyses of ITS studies with continuous outcome data, analysed the studies using segmented linear regression with two estimation methods [ordinary least squares (OLS) and restricted maximum likelihood (REML)], and meta-analysed the immediate level- and slope-change effect estimates using fixed-effect and (multiple) random-effects meta-analysis methods. Simulation design parameters included varying series length; magnitude of lag-1 autocorrelation; magnitude of level- and slope-changes; number of included studies; and, effect size heterogeneity. All meta-analysis methods yielded unbiased estimates of the interruption effects. All random effects meta-analysis methods yielded coverage close to the nominal level, irrespective of the ITS analysis method used and other design parameters. However, heterogeneity was frequently overestimated in scenarios where the ITS study standard errors were underestimated, which occurred for short series or when the ITS analysis method did not appropriately account for autocorrelation. The performance of meta-analysis methods depends on the design and analysis of the included ITS studies. Although all random effects methods performed well in terms of coverage, irrespective of the ITS analysis method, we recommend the use of effect estimates calculated from ITS methods that adjust for autocorrelation when possible. Doing so will likely to lead to more accurate estimates of the heterogeneity variance.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"14 6","pages":"882-902"},"PeriodicalIF":9.8,"publicationDate":"2023-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41101718","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0