Research Synthesis Methods最新文献_第10页

Robust variance estimation in small meta-analysis with the standardized mean difference 标准化平均差的小型荟萃分析的稳健方差估计。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-09-17 DOI: 10.1002/jrsm.1668

Rrita Zejnullahi, Larry V. Hedges

引用次数: 0

How to plan and manage an individual participant data meta-analysis. An illustrative toolkit 如何规划和管理个体参与者数据荟萃分析。一个说明性的工具包。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-09-12 DOI: 10.1002/jrsm.1670

Lauren Maxwell, Priya Shreedhar, Mabel Carabali, Brooke Levis

{"title":"How to plan and manage an individual participant data meta-analysis. An illustrative toolkit","authors":"Lauren Maxwell, Priya Shreedhar, Mabel Carabali, Brooke Levis","doi":"10.1002/jrsm.1670","DOIUrl":"10.1002/jrsm.1670","url":null,"abstract":"Individual participant data meta-analyses (IPD-MAs) have several benefits over standard aggregate data meta-analyses, including the consideration of additional participants, follow-up time, and the joint consideration of study- and participant-level heterogeneity for improved diagnostic and prognostic model development and evaluation. However, IPD-MAs are resource-intensive and require careful budgeting of time from data contributing groups, a dedicated management team, diversity of expertise, clearly documented data sharing and authorship agreements, and consistent and clear communication. We present a toolkit to facilitate the implementation and management of IPD-MAs, from study recruitment to retrospective harmonization. The toolkit was developed and refined over our work on multiple multinational IPD-MA projects over the last 13 years. The toolkit's budget and email templates, agreements, project management spreadsheets, and standard operating procedures are meant to facilitate routine IPD-MA tasks to expedite implementing and managing future IPD-MA projects.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"15 1","pages":"166-174"},"PeriodicalIF":9.8,"publicationDate":"2023-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jrsm.1670","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10224705","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

What are the best methods for rapid reviews of the research evidence? A systematic review of reviews and primary studies 快速审查研究证据的最佳方法是什么？对审查和初步研究进行系统审查。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-09-11 DOI: 10.1002/jrsm.1664

Michelle M. Haby, Jorge Otávio Maia Barreto, Jenny Yeon Hee Kim, Sasha Peiris, Cristián Mansilla, Marcela Torres, Diego Emmanuel Guerrero-Magaña, Ludovic Reveiz

{"title":"What are the best methods for rapid reviews of the research evidence? A systematic review of reviews and primary studies","authors":"Michelle M. Haby, Jorge Otávio Maia Barreto, Jenny Yeon Hee Kim, Sasha Peiris, Cristián Mansilla, Marcela Torres, Diego Emmanuel Guerrero-Magaña, Ludovic Reveiz","doi":"10.1002/jrsm.1664","DOIUrl":"10.1002/jrsm.1664","url":null,"abstract":"Rapid review methodology aims to facilitate faster conduct of systematic reviews to meet the needs of the decision-maker, while also maintaining quality and credibility. This systematic review aimed to determine the impact of different methodological shortcuts for undertaking rapid reviews on the risk of bias (RoB) of the results of the review. Review stages for which reviews and primary studies were sought included the preparation of a protocol, question formulation, inclusion criteria, searching, selection, data extraction, RoB assessment, synthesis, and reporting. We searched 11 electronic databases in April 2022, and conducted some supplementary searching. Reviewers worked in pairs to screen, select, extract data, and assess the RoB of included reviews and studies. We included 15 systematic reviews, 7 scoping reviews, and 65 primary studies. We found that several commonly used shortcuts in rapid reviews are likely to increase the RoB in the results. These include restrictions based on publication date, use of a single electronic database as a source of studies, and use of a single reviewer for screening titles and abstracts, selecting studies based on the full-text, and for extracting data. Authors of rapid reviews should be transparent in reporting their use of these shortcuts and acknowledge the possibility of them causing bias in the results. This review also highlights shortcuts that can save time without increasing the risk of bias. Further research is needed for both systematic and rapid reviews on faster methods for accurate data extraction and RoB assessment, and on development of more precise search strategies.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"15 1","pages":"2-20"},"PeriodicalIF":9.8,"publicationDate":"2023-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jrsm.1664","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10215523","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Causally interpretable meta-analysis: Clearly defined causal effects and two case studies 可解释因果关系的荟萃分析：明确界定的因果效应和两个案例研究。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-09-11 DOI: 10.1002/jrsm.1671

Kollin W. Rott, Gert Bronfort, Haitao Chu, Jared D. Huling, Brent Leininger, Mohammad Hassan Murad, Zhen Wang, James S. Hodges

{"title":"Causally interpretable meta-analysis: Clearly defined causal effects and two case studies","authors":"Kollin W. Rott, Gert Bronfort, Haitao Chu, Jared D. Huling, Brent Leininger, Mohammad Hassan Murad, Zhen Wang, James S. Hodges","doi":"10.1002/jrsm.1671","DOIUrl":"10.1002/jrsm.1671","url":null,"abstract":"Meta-analysis is commonly used to combine results from multiple clinical trials, but traditional meta-analysis methods do not refer explicitly to a population of individuals to whom the results apply and it is not clear how to use their results to assess a treatment's effect for a population of interest. We describe recently-introduced causally interpretable meta-analysis methods and apply their treatment effect estimators to two individual-participant data sets. These estimators transport estimated treatment effects from studies in the meta-analysis to a specified target population using the individuals' potentially effect-modifying covariates. We consider different regression and weighting methods within this approach and compare the results to traditional aggregated-data meta-analysis methods. In our applications, certain versions of the causally interpretable methods performed somewhat better than the traditional methods, but the latter generally did well. The causally interpretable methods offer the most promise when covariates modify treatment effects and our results suggest that traditional methods work well when there is little effect heterogeneity. The causally interpretable approach gives meta-analysis an appealing theoretical framework by relating an estimator directly to a specific population and lays a solid foundation for future developments.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"15 1","pages":"61-72"},"PeriodicalIF":9.8,"publicationDate":"2023-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10579866","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A mapping exercise using automated techniques to develop a search strategy to identify systematic review tools 使用自动化技术开发搜索策略以识别系统审查工具的映射练习。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-09-05 DOI: 10.1002/jrsm.1665

Anthea Sutton, Hannah O'Keefe, Eugenie Evelynne Johnson, Christopher Marshall

{"title":"A mapping exercise using automated techniques to develop a search strategy to identify systematic review tools","authors":"Anthea Sutton, Hannah O'Keefe, Eugenie Evelynne Johnson, Christopher Marshall","doi":"10.1002/jrsm.1665","DOIUrl":"10.1002/jrsm.1665","url":null,"abstract":"The Systematic Review Toolbox aims provide a web-based catalogue of tools that support various tasks within the systematic review and wider evidence synthesis process. Identifying publications surrounding specific systematic review tools is currently challenging, leading to a high screening burden for few eligible records. We aimed to develop a search strategy that could be regularly and automatically run to identify eligible records for the SR Toolbox, thus reducing time on task and burden for those involved. We undertook a mapping exercise to identify the PubMed IDs of papers indexed within the SR Toolbox. We then used the Yale MeSH Analyser and Visualisation of Similarities (VOS) Viewer text-mining software to identify the most commonly used MeSH terms and text words within the eligible records. These MeSH terms and text words were combined using Boolean Operators into a search strategy for Ovid MEDLINE. Prior to the mapping exercise and search strategy development, 81 software tools and 55 ‘Other’ tools were included within the SR Toolbox. Since implementation of the search strategy, 146 tools have been added. There has been an increase in tools added to the toolbox since the search was developed and its corresponding auto-alert in MEDLINE was originally set up. Developing a search strategy based on a mapping exercise is an effective way of identifying new tools to support the systematic review process. Further research could be conducted to help prioritise records for screening to reduce reviewer burden further and to adapt the strategy for disciplines beyond healthcare.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"14 6","pages":"874-881"},"PeriodicalIF":9.8,"publicationDate":"2023-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10533852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

DTAmetasa: An R shiny application for meta-analysis of diagnostic test accuracy and sensitivity analysis of publication bias DTAmetasa:用于诊断测试准确性和发表偏倚敏感性分析的meta分析。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-08-28 DOI: 10.1002/jrsm.1666

Shosuke Mizutani, Yi Zhou, Yu-Shi Tian, Tatsuya Takagi, Tadayasu Ohkubo, Satoshi Hattori

{"title":"DTAmetasa: An R shiny application for meta-analysis of diagnostic test accuracy and sensitivity analysis of publication bias","authors":"Shosuke Mizutani, Yi Zhou, Yu-Shi Tian, Tatsuya Takagi, Tadayasu Ohkubo, Satoshi Hattori","doi":"10.1002/jrsm.1666","DOIUrl":"10.1002/jrsm.1666","url":null,"abstract":"Meta-analysis of diagnostic test accuracy (DTA) is a powerful statistical method for synthesizing and evaluating the diagnostic capacity of medical tests and has been extensively used by clinical physicians and healthcare decision-makers. However, publication bias (PB) threatens the validity of meta-analysis of DTA. Some statistical methods have been developed to deal with PB in meta-analysis of DTA, but implementing these methods requires high-level statistical knowledge and programming skill. To assist non-technical users in running most routines in meta-analysis of DTA and handling with PB, we developed an interactive application, DTAmetasa. DTAmetasa is developed as a web-based graphical user interface based on the R shiny framework. It allows users to upload data and conduct meta-analysis of DTA by “point and click” operations. Moreover, DTAmetasa provides the sensitivity analysis of PB and presents the graphical results to evaluate the magnitude of the PB under various publication mechanisms. In this study, we introduce the functionalities of DTAmetasa and use the real-world meta-analysis to show its capacity for dealing with PB.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"14 6","pages":"916-925"},"PeriodicalIF":9.8,"publicationDate":"2023-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10484382","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Two-stage or not two-stage? That is the question for IPD meta-analysis projects 两阶段还是不两阶段?这是IPD元分析项目的问题。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-08-22 DOI: 10.1002/jrsm.1661

Richard D. Riley, Joie Ensor, Miriam Hattle, Katerina Papadimitropoulou, Tim P. Morris

{"title":"Two-stage or not two-stage? That is the question for IPD meta-analysis projects","authors":"Richard D. Riley, Joie Ensor, Miriam Hattle, Katerina Papadimitropoulou, Tim P. Morris","doi":"10.1002/jrsm.1661","DOIUrl":"10.1002/jrsm.1661","url":null,"abstract":"Individual participant data meta-analysis (IPDMA) projects obtain, check, harmonise and synthesise raw data from multiple studies. When undertaking the meta-analysis, researchers must decide between a two-stage or a one-stage approach. In a two-stage approach, the IPD are first analysed separately within each study to obtain aggregate data (e.g., treatment effect estimates and standard errors); then, in the second stage, these aggregate data are combined in a standard meta-analysis model (e.g., common-effect or random-effects). In a one-stage approach, the IPD from all studies are analysed in a single step using an appropriate model that accounts for clustering of participants within studies and, potentially, between-study heterogeneity (e.g., a general or generalised linear mixed model). The best approach to take is debated in the literature, and so here we provide clearer guidance for a broad audience. Both approaches are important tools for IPDMA researchers and neither are a panacea. If most studies in the IPDMA are small (few participants or events), a one-stage approach is recommended due to using a more exact likelihood. However, in other situations, researchers can choose either approach, carefully following best practice. Some previous claims recommending to always use a one-stage approach are misleading, and the two-stage approach will often suffice for most researchers. When differences do arise between the two approaches, often it is caused by researchers using different modelling assumptions or estimation methods, rather than using one or two stages per se.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"14 6","pages":"903-910"},"PeriodicalIF":9.8,"publicationDate":"2023-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10030540","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Rare events meta-analysis using the Bayesian beta-binomial model 使用贝叶斯-二项模型的罕见事件元分析。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-08-22 DOI: 10.1002/jrsm.1662

Katrin Jansen, Heinz Holling

{"title":"Rare events meta-analysis using the Bayesian beta-binomial model","authors":"Katrin Jansen, Heinz Holling","doi":"10.1002/jrsm.1662","DOIUrl":"10.1002/jrsm.1662","url":null,"abstract":"In meta-analyses of rare events, it can be challenging to obtain a reliable estimate of the pooled effect, in particular when the meta-analysis is based on a small number of studies. Recent simulation studies have shown that the beta-binomial model is a promising candidate in this situation, but have thus far only investigated its performance in a frequentist framework. In this study, we aim to make the beta-binomial model for meta-analysis of rare events amenable to Bayesian inference by proposing prior distributions for the effect parameter and investigating the models' robustness to different specifications of priors for the scale parameter. To evaluate the performance of Bayesian beta-binomial models with different priors, we conducted a simulation study with two different data generating models in which we varied the size of the pooled effect, the degree of heterogeneity, the baseline probability, and the sample size. Our results show that while some caution must be exercised when using the Bayesian beta-binomial in meta-analyses with extremely sparse data, the use of a weakly informative prior for the effect parameter is beneficial in terms of mean bias, mean squared error, and coverage. For the scale parameter, half-normal and exponential distributions are identified as candidate priors in meta-analysis of rare events using the Bayesian beta-binomial model.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"14 6","pages":"853-873"},"PeriodicalIF":9.8,"publicationDate":"2023-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10050893","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Advice for improving the reproducibility of data extraction in meta-analysis 对提高荟萃分析数据提取可重复性的建议。

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-08-11 DOI: 10.1002/jrsm.1663

Edward R. Ivimey-Cook, Daniel W. A. Noble, Shinichi Nakagawa, Marc J. Lajeunesse, Joel L. Pick

引用次数: 1

Combining meta-analysis with multiple imputation for one-step, privacy-protecting estimation of causal treatment effects in multi-site studies 结合荟萃分析与多重归算的一步，在多地点研究中保护隐私的因果治疗效果估计

IF 9.8 2区生物学

Research Synthesis Methods Pub Date : 2023-08-01 DOI: 10.1002/jrsm.1660

Di Shu, Xiaojuan Li, Qoua Her, Jenna Wong, Dongdong Li, Rui Wang, Sengwee Toh

{"title":"Combining meta-analysis with multiple imputation for one-step, privacy-protecting estimation of causal treatment effects in multi-site studies","authors":"Di Shu, Xiaojuan Li, Qoua Her, Jenna Wong, Dongdong Li, Rui Wang, Sengwee Toh","doi":"10.1002/jrsm.1660","DOIUrl":"https://doi.org/10.1002/jrsm.1660","url":null,"abstract":"Missing data complicates statistical analyses in multi-site studies, especially when it is not feasible to centrally pool individual-level data across sites. We combined meta-analysis with within-site multiple imputation for one-step estimation of the average causal effect (ACE) of a target population comprised of all individuals from all data-contributing sites within a multi-site distributed data network, without the need for sharing individual-level data to handle missing data. We considered two orders of combination and three choices of weights for meta-analysis, resulting in six approaches. The first three approaches, denoted as RR + metaF, RR + metaR and RR + std, first combined results from imputed data sets within each site using Rubin's rules and then meta-analyzed the combined results across sites using fixed-effect, random-effects and sample-standardization weights, respectively. The last three approaches, denoted as metaF + RR, metaR + RR and std + RR, first meta-analyzed results across sites separately for each imputation and then combined the meta-analysis results using Rubin's rules. Simulation results confirmed very good performance of RR + std and std + RR under various missing completely at random and missing at random settings. A direct application of the inverse-variance weighted meta-analysis based on site-specific ACEs can lead to biased results for the targeted network-wide ACE in the presence of treatment effect heterogeneity by site, demonstrating the need to clearly specify the target population and estimand and properly account for potential site heterogeneity in meta-analyses seeking to draw causal interpretations. An illustration using a large administrative claims database is presented.","PeriodicalId":226,"journal":{"name":"Research Synthesis Methods","volume":"14 5","pages":"742-763"},"PeriodicalIF":9.8,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"6754045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0