{"title":"The international HTA database returned incomplete search results for NICE technology appraisals: An exploratory study and discussion of the implications","authors":"Christopher Cooper, Sabrina Smith","doi":"10.1002/cesm.12034","DOIUrl":"https://doi.org/10.1002/cesm.12034","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>The International Network of Agencies for Health Technology Assessment (INAHTA) database offers a single point of access for identifying technology appraisals, in contrast to searching multiple websites directly. The aim of this research is to compare the coverage of the INAHTA and Centre for Reviews and Dissemination (CRD) Health Technology Assessment (HTA) databases with direct searching on the National Institute for Health and Care Excellence (NICE) website to identify Technology Appraisals published by NICE.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>NICE Technology Appraisals were downloaded from the NICE website (April 2022). Technology Appraisals were randomized and the first 20 Technology Appraisals constituted data for analysis. The INAHTA and CRD HTA databases were searched to determine if the 20 Technology Appraisals available on the NICE website were also available for retrieval.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Coverage was incomplete. INAHTA: 15 of 20 Technology Appraisals (75%) were not identified via full title or intervention-specific searches. CRD HTA: 7 of 12 Technology Appraisals (58%) that were published before the last update of the database were not identified.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>Findings indicate that researchers seeking to identify NICE Technology Appraisals should search the NICE website directly. How this finding impacts identification of guidance from other agencies should be evaluated.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"1 10","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12034","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138468522","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Julie Brown, Gill Baer, Sheila Cameron, Karl Jackson, Carrol Lamouline, Richard Morley, Diane Ormsby, Anneliese Synnot, Alex Todhunter-Brown
{"title":"Stakeholder involvement in a Cochrane review of physical rehabilitation after stroke: Description and reflections","authors":"Julie Brown, Gill Baer, Sheila Cameron, Karl Jackson, Carrol Lamouline, Richard Morley, Diane Ormsby, Anneliese Synnot, Alex Todhunter-Brown","doi":"10.1002/cesm.12032","DOIUrl":"https://doi.org/10.1002/cesm.12032","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>It is good practice to involve stakeholders in systematic reviews, but it is not clear how best to involve them.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Aim</h3>\u0000 \u0000 <p>To describe and reflect on the stakeholder involvement within an update of a Cochrane review of physical rehabilitation after stroke.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>A stakeholder group, comprising 15 stroke survivors, carers, and physiotherapists from across the United Kingdom, were recruited and contributed throughout the process of the review. A framework was used to describe when and how stakeholders were involved. Stakeholders provided feedback on their involvement after meetings. An amended version of a validated patient engagement tool was used to collect reflections on the stakeholder involvement process.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Five stakeholder meetings were held throughout the review process, supplemented by additional communication. Several changes were made to the review structure, analyses, and wording as a direct result of the stakeholder involvement. Stakeholders and researchers agreed that stakeholders' contributions were taken seriously and influenced the review. Stakeholders felt that they were given the chance to share their views and that information was shared well before, during, and after each meeting to help them to contribute knowledgeably in the process. Stakeholder reflections highlighted a number of key lessons relating to stakeholder involvement, including process of reflection and feedback, use of remote/virtual meetings, need for adequate time and funding, tensions experienced by clinicians, and recruitment considerations.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>We describe and reflect on stakeholder involvement in a systematic review and explores practical ways to support meaningful engagement during systematic review production. Our experience supports the view that coproducing reviews with stakeholders can make systematic reviews more relevant and meaningful. Our approach and experiences can be used to inform future review coproduction, supporting development of useful reviews that will improve clinical practice.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"1 10","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12032","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138468526","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
KM Saif-Ur-Rahman, Ani Movsisyan, Kavita Kothari, Thomas Conway, Marie Tierney, Caoimhe Madden, Petek Eylul Taneri, Jane A. O'Halloran, Nadra Nurdin, Lena Murphy, Deirdre Mulholland, Andrea C. Tricco, Declan Devane
{"title":"Effectiveness of SARS-CoV-2 testing strategies: A scoping review","authors":"KM Saif-Ur-Rahman, Ani Movsisyan, Kavita Kothari, Thomas Conway, Marie Tierney, Caoimhe Madden, Petek Eylul Taneri, Jane A. O'Halloran, Nadra Nurdin, Lena Murphy, Deirdre Mulholland, Andrea C. Tricco, Declan Devane","doi":"10.1002/cesm.12030","DOIUrl":"https://doi.org/10.1002/cesm.12030","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Rapid identification of severe acute respiratory syndrome-coronavirus 2 (SARS-CoV-2) infections by testing potentially reduced coronavirus disease-19 (COVID-19) cases. Testing strategies varied across countries and during different stages of the pandemic. This scoping review aims to map the available evidence on the effectiveness of SARS-CoV-2 testing strategies for suspected cases and asymptomatic populations to inform the development of World Health Organization recommendations for SARS-CoV-2 testing strategies.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We followed the standard methods for scoping reviews. We searched Medline (OVID), EMBASE (Elsevier), and Europe PMC using a comprehensive search strategy. The search was conducted in January 2023 and covered the period from January 2020 to January 2023. Two review authors independently screened the titles and abstracts, and full texts. Data were extracted onto a pilot-tested form by a review author and cross-checked by another review author. We provided a descriptive report summarizing the extracted data around the outcomes and created an interactive map of the available evidence using the evidence for policy and practice mapper.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>We identified 34,550 citations from the databases. After the screening, we included 17 studies from 11 countries for data extraction. The study designs were randomized controlled trials (<i>n</i> = 3), nonrandomized experimental studies (<i>n</i> = 3), cohort studies (<i>n</i> = 3), cross-sectional studies (<i>n</i> = 4), self-controlled case series (<i>n</i> = 1), and economic evaluations (<i>n</i> = 3). Among the included studies, 14 used reverse transcription-polymerase chain reaction and 10 studies used antigen-detecting rapid diagnostic test. The settings of the studies were healthcare facilities (<i>n</i> = 8), communities (<i>n</i> = 4), schools, and workplaces (<i>n</i> = 3). Included studies considered symptomatic and asymptomatic individuals, or both, or asymptomatic contacts. Most of the studies (<i>n</i> = 14) reported the COVID-19 positivity rate as the primary outcome. Other reported outcomes are the number of COVID-19 cases (<i>n</i> = 11), number of hospitalizations and deaths (<i>n</i> = 3), and cost (<i>n</i> = 3).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>We identified evidence gaps in the effectiveness of SARS-CoV-2 testing strategies, particularly in specific settings such as schools and long-term care facilities. This scoping review provides a foundati","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"1 9","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12030","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138432116","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kylie E. Hunter, Aidan C. Tan, Angela C. Webster, Daniel G. Hamilton, Adrian Barnett, Lee Jones, Myra Cheng, Salma Fahridin, Antonio Laguna-Camacho, Sol Libesman, Mark Hoffmann, Rui Wang, Anna Lene Seidler
{"title":"Responsibilities for receiving and using individual participant data","authors":"Kylie E. Hunter, Aidan C. Tan, Angela C. Webster, Daniel G. Hamilton, Adrian Barnett, Lee Jones, Myra Cheng, Salma Fahridin, Antonio Laguna-Camacho, Sol Libesman, Mark Hoffmann, Rui Wang, Anna Lene Seidler","doi":"10.1002/cesm.12028","DOIUrl":"10.1002/cesm.12028","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Sharing of individual participant data enhances the value of existing data to generate new evidence and inform decision-making. While there is strong in-principle support for data sharing, in practice study data are often difficult to find, access, and re-use. Currently, there is no consensus statement to guide the data-sharing process. In particular, more guidance is needed on the responsibilities of data recipients for re-using individual participant data.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Purpose</h3>\u0000 \u0000 <p>To determine views on the responsibilities of recipients of study data, and to propose how these responsibilities could be met.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>A 2-h online focus group was conducted at the 2021 Association for Interdisciplinary Meta-research and Open Science conference. Three example data-sharing scenarios were discussed (evidence synthesis, study reproducibility, and secondary analyses). Notes and audio transcripts were collated using thematic analysis and shared with attendees for further iterative input.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>A purposive sample of 16 conference delegates attended the focus group. Analyses revealed four recurring themes that were synthesized into recommendations. The “privacy and ethics” theme described the need for data recipients to prioritize the protection of participant privacy, and the recommendation to proactively share a secure data management plan and evidence of ethical oversight with the data provider. The “capability and resourcing” theme required recipients to demonstrate sufficient capacity to process and analyze study data. The “recognition and collaboration” theme asserted the responsibility to acknowledge the contributions of data providers and invite them to contribute to the secondary project. Last, the “compliance” theme focused on the responsibility to adhere to local data sharing regulations.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>Successful data sharing and re-use requires cooperation from multiple stakeholders. We identified the responsibilities of recipients of study data to the individual from whom data arose and the research team who collected the data. Implementation of these in practice could facilitate increased data sharing.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"1 9","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12028","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135411363","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Claire M. Hardie, Ryckie G. Wade, Justin C. R. Wormald, Brian Stafford, Faye Elliott, Julia Newton-Bishop, Donald Dewar
{"title":"Surgical excision methods for skin cancer involving the nail unit: A systematic review","authors":"Claire M. Hardie, Ryckie G. Wade, Justin C. R. Wormald, Brian Stafford, Faye Elliott, Julia Newton-Bishop, Donald Dewar","doi":"10.1002/cesm.12026","DOIUrl":"https://doi.org/10.1002/cesm.12026","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Skin cancer affecting the nail unit is rare but is associated with morbidity, and melanoma has a high mortality rate. The principal treatment is surgical excision and methods can be classified into digit-sparing surgery or amputation. Digit-sparing surgery (wide excision or Mohs surgery) may be safe and effective for malignancies involving the nail unit in comparison to amputation if there is not bony invasion. The objective was to assess the efficacy and safety of different methods of surgical excision for skin cancer involving the nail unit.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>Prospective comparative studies (randomized controlled studies, non-randomized controlled studies and prospective observational studies) of surgical excision for skin cancer of the nail unit in all participants were eligible for inclusion. We searched electronic databases, trials registers and conference abstracts. We checked the reference lists of included studies and related systematic reviews for further references to relevant studies, and we contacted experts to enquire if they were aware of any additional relevant trials. We used standard methodological procedures expected by Cochrane. The primary outcomes were overall survival, disease free survival and adverse events/outcomes at 30 days. The secondary outcomes were quality of life outcomes. We planned to use GRADE to assess the quality of the evidence for each outcome.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>We did not identify any studies that met the inclusion criteria for this review. We have been unable to assess our outcomes of overall survival, disease free survival, adverse events/effects and quality of life.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>As we have not identified any studies for inclusion, we are unable to assess the efficacy and safety of different methods of surgical excision for skin cancer involving the nail unit. We suggest that comprehensive cancer registry analysis is required in this field to obtain meaningful data.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"1 8","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12026","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50135556","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Cluster-randomized controlled trials: A tutorial","authors":"Marty Chaplin, Kerry Dwan","doi":"10.1002/cesm.12024","DOIUrl":"https://doi.org/10.1002/cesm.12024","url":null,"abstract":"<p>This tutorial focuses on cluster-randomized controlled trials (cluster-RCTs). We will explain what cluster-RCTs are, why they might be used, and how to include data from cluster-RCTs in systematic reviews.</p><p><b>What is a cluster-randomized controlled trial?</b></p><p>In most RCTs, individuals are randomly assigned to intervention groups. In a cluster-RCT, groups of individuals (e.g., schools, communities, or clinics) are randomized to intervention groups.</p><p><b>Why use a cluster-randomized controlled trial design?</b></p><p>Table 1 outlines reasons that a cluster-RCT design might be used by researchers, and provides an example for each of these reasons.</p><p><b>How do I perform risk of bias assessments for cluster-randomized controlled trials?</b></p><p>An adaptation of the Risk of Bias 2 tool [<span>1</span>] outlines issues that should be considered when assessing the risk of bias of cluster-RCTs. Detailed guidance on the use of the adapted tool is also available [<span>2</span>].</p><p><b>What is a “unit-of analysis” error?</b></p><p>Individuals from the same cluster are likely to respond in a similar way to each other, and therefore observations made for these individuals cannot be assumed to be independent. It is important that this dependency is accounted for when analyzing data from a cluster-RCT.</p><p>If the effects of clustering are ignored, and the analysis is conducted as if individuals were randomized, a “unit-of-analysis error” occurs [<span>3</span>], as the unit of analysis (the individual) is different to the unit of randomization (the cluster). When a “unit-of-analysis error” occurs, confidence intervals for the effect estimate will be artificially narrow and associated <i>p</i>-values will be artificially small. The trial will also have too much weight in any meta-analysis. Incorrect conclusions may therefore be drawn from the results of the cluster-RCT itself, and any meta-analyses that include the cluster-RCT.</p><p><b>How do I include data from a cluster-randomized controlled trial in a systematic review?</b></p><p>When a cluster-RCT is included in a systematic review (with or without a meta-analysis), it is important that the effect estimate and its corresponding confidence interval are adjusted for the clustered nature of the data.</p><p>The ideal approach is to extract cluster-adjusted effect estimates and a measure of uncertainty (i.e., confidence interval or standard error) that have been calculated by the trial authors using statistical methods such as multilevel models or generalized estimating equations. These effect estimates and the measure of uncertainty may be included in meta-analyses that use the generic inverse variance method.</p><p>Another acceptable approach is to conduct the analysis at the cluster level. The data set for analysis would include a summary measurement for each cluster, and the sample size is the number of clusters. These data can then be treated as if they were from an RCT that ra","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"1 7","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12024","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50121946","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"What tool do undergraduate pharmacy students prefer when grading systematic review evidence: AMSTAR-2 or ROBIS?","authors":"Shaun W. H. Lee","doi":"10.1002/cesm.12023","DOIUrl":"https://doi.org/10.1002/cesm.12023","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>While systematic reviews (SRs) are considered the highest form of evidence in the hierarchy, the quality and standard of reviews varies. Two quality assessment tools have been developed to assess the variation in such standards. This study compared the preference, validity, reliability, and applicability of using A Measurement Tool to Assess Systematic Reviews (AMSTAR-2) and the Risk of Bias in Systematic Reviews (ROBIS) for critically appraising evidence by pharmacy students.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Materials and Methods</h3>\u0000 \u0000 <p>Students attended eight lectures on evidence-based medicine. Students independently assessed two SRs using AMSTAR-2 and ROBIS. The agreement between both tools were calculated using Spearman's test while interrater reliability was calculated using Fleiss' <i>κ</i> statistics.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Students reported a preference for the AMSTAR-2 tool due to its clear and distinct rating criteria as well as guidance provided by the tool's developer. In comparison, students found the items on the ROBIS tool difficult to judge as it was subjective. A moderate agreement between both tools on the overall domain ratings was noted (Spearman <i>r</i><sub>s</sub> = 0.60). There was slight agreement in the overall confidence using AMSTAR-2 (<i>κ</i> = 0.05; 95% confidence interval [CI]: 0.01–0.12) and the overall domain in ROBIS (<i>κ</i> = 0.09; 95% CI: 0.01–0.16).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>The AMSTAR-2 tool had a low level of concordance in ratings of review among students. However, the AMSTAR-2 tool was preferred by students due to the clear guidance and ease of use.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"1 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12023","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50125499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Measuring dichotomous outcomes using risk ratios, odds ratios, and the risk difference: A tutorial","authors":"Rachel Richardson, Kerry Dwan, Afroditi Kanellopoulou","doi":"10.1002/cesm.12022","DOIUrl":"https://doi.org/10.1002/cesm.12022","url":null,"abstract":"<p>In this article, we look at risk ratios (RR), odds ratios (OR), and the risk difference (RD); what they are, how to interpret them, and when they should be used.</p><p>The RR, the OR, and the RD are used to compare the occurrence of an event in two groups for dichotomous outcomes. For example, a recent Cochrane review compared oral misoprostol to placebo for induction of labour and reported whether the women in each group went on to have a caesarian section, or not [<span>1</span>].</p><p>The RR provides a measure of how much higher or lower the risk of the event happening in the intervention group is, compared to the risk of the same event happening in the control group. Risk might sound like a complicated term but it is actually just the probability of an event happening.</p><p>Example: Trial A is interested in whether patients were readmitted to hospital within 30 days of an operation (procedure X) and compared this with patients who had a different operation (procedure Y). One hundred out of 200 patients who had procedure X were readmitted within 30 days. The risk (or probability) of this event occurring is 100 divided by 200, or 0.5. One hundred and fifty patients out of 200 patients who had procedure Y were readmitted within 30 days. The risk (or probability) of this event occurring is 150 divided by 200 or 0.75.</p><p>This means that if patients have procedure X, their risk of being readmitted is <b>reduced</b> by 33% compared to their risk if they had procedure Y. We can also express this as a probability—the probability of them being readmitted is reduced by 33%.</p><p>On the other hand, if 140 out of 200 patients who had procedure X (risk: 140/200 = 0.7) and 120 of 200 patients who had procedure Y (risk: 120/200 = 0.6) were readmitted within 30 days, then the RR equals 0.7/0.6 = 1.17. This means that if patients have procedure X, their risk of being readmitted is <b>increased</b> by 17% compared to their risk if they have procedure Y. When the risk in the intervention group is the same as the risk in the control group, the RR will be 1, and we can say that the risks are the same for both groups.</p><p>The OR provides a measure of how much higher or lower the odds of the event happening in the intervention group are compared to the odds of the same event happening in the control group. Odds may also sound like a complicated term, but it merely refers to the probability of something happening compared to the probability of it not happening. If the odds of a horse winning the Kentucky Derby are 7 to 2 against, this means that over nine races it would be predicted to win twice and lose seven times.</p><p><i>Example</i>: Let's go back to our hypothetical example of procedure X versus procedure Y. If 100 out of 200 patients who had procedure X were readmitted within 30 days, the odds of readmission would be 100/100 or 1. In betting terminology, this would be “evens”: the chances of being readmitted and not being readmitted are the same. If","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"1 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12022","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50143136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mary Chappell, Mary Edwards, Deborah Watkins, Christopher Marshall, Sara Graziadio
{"title":"Machine learning for accelerating screening in evidence reviews","authors":"Mary Chappell, Mary Edwards, Deborah Watkins, Christopher Marshall, Sara Graziadio","doi":"10.1002/cesm.12021","DOIUrl":"https://doi.org/10.1002/cesm.12021","url":null,"abstract":"<p>Evidence reviews are important for informing decision-making and primary research, but they can be time-consuming and costly. With the advent of artificial intelligence, including machine learning, there is an opportunity to accelerate the review process at many stages, with study screening identified as a prime candidate for assistance. Despite the availability of a large number of tools promising to assist with study screening, these are not consistently used in practice and there is skepticism about their application. Single-arm evaluations suggest the potential for tools to reduce screening burden. However, their integration into practice may need further investigation through evaluations of outcomes such as overall resource use and impact on review findings and recommendations. Because the literature lacks comparative studies, it is not currently possible to determine their relative accuracy. In this commentary, we outline the published research and discuss options for incorporating tools into the review workflow, considering the needs and requirements of different types of review.</p>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"1 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12021","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50152689","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Should CINAHL be used as one of the main databases for evidence synthesis of health services intervention?","authors":"Teerapon Dhippayom, Natnicha Rattanachaisit, Apinya Wateemongkollert, Rawiwan Napim, Nathorn Chaiyakunapruk","doi":"10.1002/cesm.12019","DOIUrl":"https://doi.org/10.1002/cesm.12019","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>CINAHL is not listed as one of the minimum databases for systematic review (SR) of interventions in the Methodological Expectations of the Cochrane Intervention Review.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objective</h3>\u0000 \u0000 <p>To determine additional studies uniquely identified from the CINAHL search in SR of health services interventions (HSI).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We searched PubMed from inception to October 1, 2022 to identify SRs of HSI that determined clinical or humanistic outcomes of HSI and used CINAHL. Out of 5655 Systematic reviews identified, we randomly selected 374 SRs and extracted all primary studies included. We then explored the bibliographic databases in which the journals of those studies were indexed. The outcome of interest was the number of studies uniquely available in CINHAL. We also performed a subgroup analysis based on the type of HSI. We performed descriptive statistics to report the study outcomes using Excel (Microsoft 365).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>A total of 7550 primary studies were identified from the 374 Systematic reviews that met the inclusion criteria. Of these studies, 7380 were journal publications that have been indexed in MEDLINE/PubMed (75.1%), Scopus (74.5%), Sciences Citation Index, SCI (54.7%), Embase (48.1%), and CINAHL (34.9%). Only 83 out of 7380 (1.1%) studies were published in journals that were uniquely indexed in CINAHL. The percentage of studies that were only available in other databases was 9.7% (Scopus), 4.3% (MEDLINE/PubMed), 1.6% (SCI), and 0.3% (Embase). The number of studies that were unique to CINAHL in specific types of HSI were: 24/1570 (1.5%) for community health services, 20/1520 (1.3%) for preventive health services, 45/3624 (1.2%) for patient care, 8/1173 (0.7%) for mental health services, and 18/2804 (0.6%) for rehabilitation.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>The gain of CINAHL to identify unique primary studies for SR of HSI appears minimal. The impact of missing studies uniquely available in CINAHL on SR summary or magnitude of effect estimates from meta-analysis requires further investigation.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"1 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12019","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50130211","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}