Tamara Lotfi, Vivian Welch, Jordi P. Pardo, Jennifer Petkovic, Shaun Treweek, Andrea J. Darzi, Rebecca Glover, Declan Devane, Meera Viswanathan, Lawrence Mbuagbaw, Kevin Pottie, Elizabeth Kristjansson, Shahab Sayfi, Lara Maxwell, Olivia Magwood, Damian Francis, Dru Riddle, Beverly Shea, Peter Tugwell
{"title":"Equity in evidence synthesis: You can't play on broken strings","authors":"Tamara Lotfi, Vivian Welch, Jordi P. Pardo, Jennifer Petkovic, Shaun Treweek, Andrea J. Darzi, Rebecca Glover, Declan Devane, Meera Viswanathan, Lawrence Mbuagbaw, Kevin Pottie, Elizabeth Kristjansson, Shahab Sayfi, Lara Maxwell, Olivia Magwood, Damian Francis, Dru Riddle, Beverly Shea, Peter Tugwell","doi":"10.1002/cesm.12091","DOIUrl":"https://doi.org/10.1002/cesm.12091","url":null,"abstract":"<p>In the 2022 Cochrane Lecture [<span>1</span>], Jimmy Volmink, recognized as a pioneer of evidence-based medicine in Africa, challenged Cochrane to enhance its equity efforts and suggested five ways to do so. We, as members of the Campbell and Cochrane Health Equity Thematic group*, fully agree with his suggestions and have developed an actionable plan, described below. We invite the global community to join us in our efforts to meet the equity gaps in research and practice.</p><p>Population health and healthcare delivery should be equitable and the research that guides it equity sensitive. By this, we mean that we need to focus on the distribution of health outcomes in the population not just overall health. That is, people should have equal opportunities for health and are not subjected to systemic discrimination or structural barriers to health. It is an ambitious goal and one that many of us who work in healthcare delivery and health research are striving for.</p><p>This includes those of us who work in evidence synthesis. Synthesizers of other researchers' evidence may think that our handling of equity cannot be better than the handling of equity in the research we synthesize. We, as members of the Campbell and Cochrane Health Equity Thematic Group, disagree. To truly address inequity, evidence synthesis must take into account equity considerations in a systematic and explicit manner, regardless of how equity was addressed in the original research. We believe that evidence synthesis should lead the way in promoting equity, rather than simply reflecting the approaches taken in the primary research that is included in our reviews (Box 1).</p><p>We fully agree that Cochrane cannot succeed in better addressing health equity in systematic reviews without also addressing inequities in its own organization and governance. As members of the Campbell and Cochrane Health Equity Thematic group, we commit to the following actions.</p><p><b>Tamara Lotfi</b>: Conceptualization, writing—original draft, reviewing and editing. <b>Vivian Welch</b>: Conceptualization, writing—original draft, review & editing. <b>Jordi P. Pardo</b>: Conceptualization, writing—original draft, review & editing. <b>Jennifer Petkovic</b>: Conceptualization, writing—original draft, review & editing. <b>Shaun Treweek</b>: Writing—review & editing. <b>Andrea Darzi</b>: Writing—review & editing. <b>Rebecca Glover</b>: Writing—review & editing. <b>Declan Devane</b>: Writing—review & editing. <b>Meera Viswanathan</b>: Writing—review & editing. <b>Lawrence Mbuagbaw</b>: Writing—review & editing. <b>Kevin Pottie</b>: Writing—review & editing. <b>Elizabeth Kristjansson</b>: Writing—review & editing. <b>Shahab Sayfi</b>: Writing—review & editing. <b>Lara Maxwell</b>: Writing—review & editing. <b>Olivia Magwood</b>: Writing—review & editing. <b>Damian Francis</b>: Writing—review & editing. <b>Dru Riddle</b>: Writing—review & ed","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12091","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141425124","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jessica Power, Sara Dada, Andrew Booth, Aoife De Brún, Brynne Gilmore
{"title":"Advisory groups in realist reviews: Systematically mapping current research and recommendations for practice","authors":"Jessica Power, Sara Dada, Andrew Booth, Aoife De Brún, Brynne Gilmore","doi":"10.1002/cesm.12073","DOIUrl":"https://doi.org/10.1002/cesm.12073","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Realist reviews may involve groups or panels external to the research team who provide external and independent perspectives informing the review based on their experience of the topic area. These panels or groups are termed in this study as an “advisory group.” This study aims to map current practice of advisory groups in realist reviews and provide guidance for planning and reporting.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>A “best-fit” framework synthesis methodology was used by first searching for a best-fit framework and then conducting a systematic search to identify a sample of realist reviews and rapid realist reviews (RRRs) from the most recent year, 2021. Nine databases were searched: CINAHL Complete, Cochrane, Embase, ERIC, MEDLINE, PsycInfo, Social Services Abstracts, Sociological Abstracts, and Web of Science Core Collection. Screening and data extraction was conducted by two researchers. The chosen best-fit framework (ACTIVE framework) informed the data extraction tool.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>One hundred and seven reviews (93 realist reviews, 14 RRRs) were identified for inclusion. Of these, 40% (<i>n</i> = 37) of realist reviews and 71.5% (<i>n</i> = 10) of RRRs mentioned use of an advisory group, though there was considerable variation in terminology used. Individuals in advisory groups were involved at varying stages of the review and tended to bring experience in the topic area from the perspective of (i) a lived experience, that is, patients, carers, family members (<i>n</i> = 15 realist reviews; <i>n</i> = 4 RRRs); (ii) professional experience, such as healthcare professionals (<i>n</i> = 20 realist reviews; <i>n</i> = 6 RRRs); or (iii) policy or research experience in the topic area (<i>n</i> = 19 realist reviews; <i>n</i> = 7 RRRs).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>This study proposes a definition of advisory groups, considerations for advisory group use, and suggested items for reporting. The purpose of the advisory group should be carefully considered when deciding on their use in a realist review.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12073","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141304224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Claudia Kapp, Naomi Fujita-Rohwerder, Jona Lilienthal, Wiebke Sieben, Siw Waffenschmidt, Elke Hausner
{"title":"The searchbuildR shiny app: A new implementation of the objective approach for search strategy development in systematic reviews","authors":"Claudia Kapp, Naomi Fujita-Rohwerder, Jona Lilienthal, Wiebke Sieben, Siw Waffenschmidt, Elke Hausner","doi":"10.1002/cesm.12078","DOIUrl":"https://doi.org/10.1002/cesm.12078","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>One of the main tasks in information retrieval is the development of Boolean search strategies for systematic searches in bibliographic databases. This includes the identification of free-text terms and controlled vocabulary. IQWiG has previously implemented its objective approach for search strategy development using a fee-based text analysis software. However, this implementation is not fully automated, due to a lack of technical options. The aim of our project was to develop a text analysis tool for the development of Boolean search strategies using R.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We adopt an incremental approach to software development, with the first goal being to develop a minimum viable product for the previously defined use cases. To create an interactive user interface, we use the shiny framework.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Our newly developed shiny app searchbuildR is a text analysis tool with a point-and-click user interface, that automatically extracts and ranks terms from titles, abstracts, and MeSH terms of a given test set of PubMed records. It returns searchable, interactive tables of free-text and MeSH terms. Each free-text term can also be viewed within its original context in the full titles and abstracts or in a user-defined word window. In addition, 2-word combinations are extracted and also provided as an interactive table to help the user identify free-text term combinations, that can be searched with proximity operators in Boolean searches. The results can be exported to a CSV file. The new implementation with searchbuildR was evaluated by validating the text analysis results against the results of the previously used fee-based software.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>QWiG has developed the shiny app searchbuildR to support the development of search strategies in systematic reviews. It is open source and can be used by researchers and other information specialists without extensive R or programming skills. The package code is openly available on GitHub at www.github.com/IQWiG/searchbuildR.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12078","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141304225","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Heather M. Munthe-Kaas, Andrew Booth, Isolde Sommer, Sara Cooper, Ruth Garside, Karin Hannes, Jane Noyes, The CAMELOT Development Group
{"title":"Developing CAMELOT for assessing methodological limitations of qualitative research for inclusion in qualitative evidence syntheses","authors":"Heather M. Munthe-Kaas, Andrew Booth, Isolde Sommer, Sara Cooper, Ruth Garside, Karin Hannes, Jane Noyes, The CAMELOT Development Group","doi":"10.1002/cesm.12058","DOIUrl":"https://doi.org/10.1002/cesm.12058","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Qualitative evidence is increasingly incorporated into decision-making processes. Assessing the methodological limitations of primary studies is critical to making an overall assessment of confidence in findings from qualitative evidence syntheses (QES) using GRADE-CERQual. Current critical appraisal tools were not developed specifically for use in Cochrane reviews or GRADE-CERQual, and few are evidence-based. The aim of CochrAne qualitative Methodological LimitatiOns Tool (CAMELOT) was to address this gap.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We undertook this project in four stages: (1) systematic literature search to identify existing tools, (2) identification of evidence to support inclusion of potential CAMELOT domains (3) consensus survey to agree on the inclusion and definition of CAMELOT domains, and (4) human-centered design approach to develop and refine CAMELOT by exploring user experience.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>CAMELOT is a new evidence-based tool for assessing the methodological strengths and limitations of primary qualitative research studies in a QES. CAMELOT is comprised of 12 domains: four <i>Meta domains</i> that encourage review authors to consider those characteristics of the primary study that are beyond how the study was carried out, but which inform the conduct and design of the study, and eight <i>Method domains</i> which encourage review authors to consider how the study was designed, planned and/or conducted, and how study conduct and design fits with the information provided in the four meta domains. Review authors make an assessment by identifying any concerns regarding the methods used in the study and considering the appropriateness of fit between the <i>Meta</i> and <i>Method domains</i>.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>CAMELOT provides review authors with a transparent and systematic method to assess methodological limitations of primary qualitative studies. CAMELOT incorporates qualitative principles and focuses on appropriateness of fit between <i>Meta</i> and <i>Method domains</i>. In line with iterative tool development approach, CAMELOT will continue to be revised over time following extensive user testing and piloting.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12058","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141294962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Correction to “Standardized mean differences in meta-analysis: A tutorial”","authors":"","doi":"10.1002/cesm.12076","DOIUrl":"https://doi.org/10.1002/cesm.12076","url":null,"abstract":"<p>In Equation 4 (computation of the standard error [SE] of the mean difference [MD] at posttreatment time point), we wrote SD instead of SE, which is the correct one (see attached figure below).</p><p></p><p>We apologize for this error.</p>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12076","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141245517","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Diego Ivaldi, Mariana Burgos, Gisela Oltra, Camila E. Liquitay, Luis Garegnani
{"title":"Adherence to PRISMA 2020 statement assessed through the expanded checklist in systematic reviews of interventions: A meta-epidemiological study","authors":"Diego Ivaldi, Mariana Burgos, Gisela Oltra, Camila E. Liquitay, Luis Garegnani","doi":"10.1002/cesm.12074","DOIUrl":"https://doi.org/10.1002/cesm.12074","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>The preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement was developed to improve the reporting of systematic reviews (SRs) and meta-analyses. Due to the suboptimal reporting of the 2009 version, an update was performed and published in 2021. Despite having been evaluated in studies published before its publication, its adherence in SRs of interventions published after 2021 remains unclear.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objective</h3>\u0000 \u0000 <p>To assess PRISMA 2020 statement adherence and its uptake in SRs of interventions.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We conducted a prospective cross-sectional study searching MEDLINE (PubMed), including a 10% random sample of all SRs involving human interventions published since January 2022 retrieved by our search process. We did not apply any restrictions. We assessed PRISMA 2020 statement uptake and its adherence using its expanded checklist.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>We included 222 out of 945 studies. 67 (30.18%) used PRISMA 2020 statement. None adhered completely, with an average adherence of 42.64% (Min–Max: 14.29%–76.19%). Results and Methods sections had low adherence, with 40.57% (Min–Max: 10.45%–98.51%) and 25.55% (Min–Max: 7.46%–55.22%) respectively. The items with the least adherence were: certainty and reporting bias assessment, excluded studies characteristics and search strategy with 7.46% (5/67), 8.96% (6/67), 10.45% (7/67), and 11.94% (8/67) respectively.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Discussion</h3>\u0000 \u0000 <p>As in previous studies, our study showed low adherence, mainly to the methods and results sections. However, our study showed a lower adherence, probably due to the use of the expanded checklist to assessed the tools adherence.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>We found a low adherence rate to the PRISMA 2020 expanded checklist. Further PRISMA dissemination and targeted audience training are needed to improve SR reporting and quality.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12074","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141085071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Intention-to-treat analyses and missing outcome data: A tutorial","authors":"Marty Chaplin, Kerry Dwan","doi":"10.1002/cesm.12075","DOIUrl":"https://doi.org/10.1002/cesm.12075","url":null,"abstract":"<p>This tutorial focuses on “intention-to-treat” analyses and missing outcome data in systematic reviews. There is a lack of consensus on the definition of the ITT approach. We will explain the principles of an intention-to-treat analysis, and outline the key issues you need to consider when planning, conducting and writing up your systematic review.</p><p>The authors of studies included in systematic reviews may use the term “intention-to-treat” or “intent-to-treat” (ITT) to describe the approach taken when reporting and analyzing outcome data. The ITT approach has two principles.</p><p><i>Principle A: Outcome data are reported and/or analysed according to the participant's assigned intervention, regardless of the intervention they actually received or their adherence to their assigned intervention. For randomised controlled trials, this approach is sometimes referred to as an “as-randomised” analysis</i>.</p><p>Study authors make decisions about which approach to take based on whether they are interested in determining the effect of allocation to an intervention (regardless of whether the intervention was received as intended), the effect of receiving an intervention, or the effect of adhering to an intervention (as specified in the trial protocol).</p><p><i>Principle B: Outcome data are measured for all randomised participants</i>.</p><p>If some participants do not contribute data for the outcome of interest at the required follow-up time (i.e., there are missing outcome data), data may be imputed. Various imputation methods are available, from simply assuming that all participants with missing data had a particular outcome (e.g., study authors may assume that all participants with missing data experienced a poor outcome, such as treatment failure), to more complex methods such as multiple imputation.</p><p>This principle is not met if study authors report and/or analyze outcome data only for participants with nonmissing outcome data (this approach is sometimes referred to as a “complete-case analysis”).</p><p>When choosing whether to ignore or impute missing data, and when selecting an imputation method, study authors should consider whether missing data are likely to be “missing at random” or not. Data are “missing at random” if the fact that the data are missing is unrelated to the true data values. Complete-case analyses, and some imputation methods, may lead to biased results if the missing data is “missing not at random.” Table 1 provides examples of data that are “missing at random” and data that are “missing not at random.”</p><p>There is no consensus on the definition of the ITT approach [<span>1, 2</span>]. Some study authors use the term ITT when applying both principles; others use the term when applying just one principle. Study authors may use the term “modified ITT” approach, which also has no consistent definition. The estimated intervention effect in a study may be impacted by the study author's choice of ITT approach. If this","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12075","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141078933","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lasse Østengaard, Ariel Barrientos, Isabelle Boutron, An-Wen Chan, Gary Collins, Sally Hopewell, David Moher, Camilla Hansen Nejstgaard, Kenneth F. Schulz, Benjamin Speich, Evan Tang, Ruth Tunn, Nozomi Watanabe, Chenchen Xu, Asbjørn Hróbjartsson
{"title":"Development of a topic-specific bibliographic database supporting the updates of SPIRIT 2013 and CONSORT 2010","authors":"Lasse Østengaard, Ariel Barrientos, Isabelle Boutron, An-Wen Chan, Gary Collins, Sally Hopewell, David Moher, Camilla Hansen Nejstgaard, Kenneth F. Schulz, Benjamin Speich, Evan Tang, Ruth Tunn, Nozomi Watanabe, Chenchen Xu, Asbjørn Hróbjartsson","doi":"10.1002/cesm.12057","DOIUrl":"https://doi.org/10.1002/cesm.12057","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>An important mechanism of research waste is inadequate incorporation of, and references to, previous relevant research. Identifying references for a research manuscript can be challenging, in part due to the exponential rise in potentially relevant literature to consider. For large research projects, such as developing or updating reporting guidelines, it may be helpful to construct a supportive topic-specific bibliographic database.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>In support of updating the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 and the CONsolidated Standards Of Reporting Trials (CONSORT) 2010, we developed the SPIRIT-CONSORT Evidence Bibliographic database (SCEBdb): a freely available topic-specific bibliographic database of publications providing an evidence foundation for the updates. We searched multiple sources of potential publications and tagged included ones with database-specific keywords. For context, we also formulated 10 core considerations for constructing topic-specific bibliographic databases and identified and described 5 illustrative other databases.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>As of April 2024, the SCEBdb included 846 publications. The database proved useful as a supplementary information source for our scoping review of published comments on SPIRIT 2013 and CONSORT 2010, for a supplementary Delphi process, and in the writing phase of the guidance documents. We expect that the database will be useful for future projects within the fields of clinical research methodology, bias, evidence synthesis, and randomized trials.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>The methods involved in constructing the SCEBdb, and our suggested core considerations for topic-specific bibliographic databases, could be helpful for researchers reflecting on whether, and how, to develop a topic-specific bibliographic database.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12057","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140924824","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Annapoorani Muthiah, Loch Kith Lee, John Koh, Ashly Liu, Aidan Tan
{"title":"Quality of systematic reviews and meta-analyses in dermatology","authors":"Annapoorani Muthiah, Loch Kith Lee, John Koh, Ashly Liu, Aidan Tan","doi":"10.1002/cesm.12056","DOIUrl":"https://doi.org/10.1002/cesm.12056","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Although the number of published systematic reviews and meta-analyses in dermatology has increased over the past decade, their quality is unknown.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objective</h3>\u0000 \u0000 <p>The objective of this study was to determine the change in risk of bias, methodological quality and reporting quality of systematic reviews and meta-analyses in dermatology between 2010 and 2019.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We conducted a comparative study of systematic reviews and meta-analyses published in the 10 highest-ranked dermatology journals in 2010 and 2019. Studies were identified through electronic searches of MEDLINE, Embase, and eight other bibliographic databases. Risk of bias and methodological quality were assessed in duplicate with the risk of bias in systematic reviews (ROBIS) and A MeaSurement Tool to Assess systematic Reviews-2 (AMSTAR-2) tools, respectively, with the latter only applied to studies of interventions. Reporting quality was assessed with the Preferred Reporting Items of systematic reviews and Meta-Analyses (PRISMA) 2009 and PRISMA for abstracts (PRISMA-A) 2013 statements.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>We included 27 systematic reviews and meta-analyses published in 2010 and 127 published in 2019. There was no evidence of a difference in the proportion of systematic reviews and meta-analyses at high/unclear risk of bias with ROBIS (Fisher's exact test = 1.00) or critically low methodological quality using AMSTAR-2 (Fisher's exact test = 0.456), between 2010 and 2019. There was evidence of a difference in proportion of PRISMA (<i>t</i>(26) = 2.7, <i>p</i> = 0.01), and very strong evidence of a difference in proportion of PRISMA-A (<i>t</i>(26) = 4.2, <i>p</i> < 0.001) checklist items adequately reported between 2010 and 2019. The difference in mean proportion of PRISMA checklist items adequately reported was 3.6 items more (95% confidence interval [CI]: 1.8–5.4 items more) in 2019 (mean = 10.7 items, SD = 2.4 items) than in 2010 (mean = 7.1 items, SD = 2.9 items), and of PRISMA-A checklist items adequately reported was 1.1 items more (95% CI: 0.2–2.0 items more) in 2019 (mean = 5.6 items, SD = 1.5 items) than in 2010 (mean = 4.4 items, SD = 1.7 items)</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>No improvement was observed in the overall methodological quality of included systematic reviews and meta-analyses; however, there was strong evidenc","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12056","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140819017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Racha Fadlallah, Fadi El-Jardali, Lama Bou Karroum, Nour Kalach, Reem Hoteit, Andrew Aoun, Lara Al-Hakim, Francisca Verdugo-Paiva, Gabriel Rada, Atle Fretheim, Simon Lewin, Ramona Ludolph, Elie A. Akl
{"title":"The effects of public health and social measures (PHSM) implemented during the COVID-19 pandemic: An overview of systematic reviews","authors":"Racha Fadlallah, Fadi El-Jardali, Lama Bou Karroum, Nour Kalach, Reem Hoteit, Andrew Aoun, Lara Al-Hakim, Francisca Verdugo-Paiva, Gabriel Rada, Atle Fretheim, Simon Lewin, Ramona Ludolph, Elie A. Akl","doi":"10.1002/cesm.12055","DOIUrl":"https://doi.org/10.1002/cesm.12055","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>To systematically review the effectiveness and unintended health and socioeconomic consequences of public health and social measures (PHSM) aimed at reducing the scale and risk of transmission of coronavirus disease 2019 (COVID-19).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>This review followed guidance about overviews of reviews in the <i>Cochrane handbook for systematic reviews of interventions</i> and used the Epistemonikos database's COVID-19 Living Overview of Evidence repository as a primary search source. Methodological quality was evaluated using the Measurement Tool to Assess Systematic Reviews (AMSTAR 2) checklist.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>A total of 94 reviews were included, of which eight (9%) had “moderate” to “high” confidence ratings on the AMSTAR 2. Of 16 reviews (17%) reporting applying the GRADE framework, none found high certainty evidence for any of our outcomes of interest. Across the 94 reviews, the most frequently examined PHSM were personal protection (<i>n</i> = 18, 19%). Within multicomponent interventions, so-called “lockdown” was the most frequently examined component (<i>n</i> = 39, 41%). The most frequently reported outcome category was non-COVID-19-related health outcomes (<i>n</i> = 58, 62%). Only five (5%) reviews reported on socioeconomic outcomes. Findings from the eight reviews with moderate or high confidence ratings on AMSTAR 2 are narratively summarized. There is low-certainty evidence that multicomponent interventions may reduce the transmission of COVID-19 in different settings. For active surveillance and response measures, low-certainty evidence suggests that routine testing of residents and staff in long-term care facilities may reduce the number of infections, hospitalizations, and deaths among residents. We found very low-certainty evidence about the effectiveness of personal protection measures, travel-related control measures, and environmental measures. Unintended consequences were rarely examined by those eight reviews.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>We found predominantly low- to very low-certainty evidence regarding the effectiveness and unintended consequences of PHSM in controlling the risk and scale of COVID-19 transmission. There is a need to improve the conduct and reporting of systematic reviews.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12055","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140814153","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}