V Prakash, Kirti Gore, Gunjan Shukla, Priyanshi Tapiawala, Smit Thakkar
{"title":"Does the format of result presentation and type of conclusion in Cochrane plain language summaries matter? A randomised controlled trial.","authors":"V Prakash, Kirti Gore, Gunjan Shukla, Priyanshi Tapiawala, Smit Thakkar","doi":"10.1136/bmjebm-2023-112433","DOIUrl":"10.1136/bmjebm-2023-112433","url":null,"abstract":"<p><strong>Objectives: </strong>This study aimed to investigate whether the format and type of conclusion in Cochrane plain language summaries (PLSs) influence readers' perception of treatment benefit and decision-making.</p><p><strong>Design: </strong>An online parallel group, three-arm randomised controlled trial was conducted.</p><p><strong>Setting: </strong>The study was conducted online.</p><p><strong>Participants: </strong>The participants were physiotherapy students.</p><p><strong>Interventions: </strong>The participants read two Cochrane PLSs, one with a positive conclusion (strong evidence of benefit) and another with a negative conclusion (strong evidence of non-benefit). Each participant read the results of both reviews presented in one of three formats: (1) numerical, (2) textual or (3) numerical and textual.</p><p><strong>Main outcome measures: </strong>The primary outcome measure was the participants' perception of treatment benefit.</p><p><strong>Results: </strong>All three groups of participants perceived the treatment to have positive effects when the Cochrane PLS had a positive conclusion, regardless of the format of presentation (mean perception of treatment benefit score: textual 7.7 (SD 2.3), numerical 7.9 (SD 1.8), numerical and textual 7.7 (SD 1.7), p=0.362). However, when the Cochrane PLS had a negative conclusion, all three groups of participants failed to perceive a negative effect (mean perception of treatment benefit score: textual 5.5 (SD 3.3), numerical 5.6 (SD 2.7), numerical and textual 5.9 (SD 2.8), p=0.019).</p><p><strong>Conclusions: </strong>The format of Cochrane PLSs does not appear to significantly impact physiotherapy students' perception of treatment benefit, understanding of evidence, persuasiveness or confidence in their decision. However, participants' perception of treatment benefit does not align with the conclusion when the Cochrane PLS indicates strong evidence of non-benefit from the intervention.</p><p><strong>Trial registration number: </strong>CTRI/2022/10/046476.</p>","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"96-103"},"PeriodicalIF":5.8,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50160610","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Adriani Nikolakopoulou, Anna Chaimani, Toshi A Furukawa, Theodoros Papakonstantinou, Gerta Rücker, Guido Schwarzer
{"title":"When does the placebo effect have an impact on network meta-analysis results?","authors":"Adriani Nikolakopoulou, Anna Chaimani, Toshi A Furukawa, Theodoros Papakonstantinou, Gerta Rücker, Guido Schwarzer","doi":"10.1136/bmjebm-2022-112197","DOIUrl":"10.1136/bmjebm-2022-112197","url":null,"abstract":"<p><p>The placebo effect is the 'effect of the simulation of treatment that occurs due to a participant's belief or expectation that a treatment is effective'. Although the effect might be of little importance for some conditions, it can have a great role in others, mostly when the evaluated symptoms are subjective. Several characteristics that include informed consent, number of arms in a study, the occurrence of adverse events and quality of blinding may influence response to placebo and possibly bias the results of randomised controlled trials. Such a bias is inherited in systematic reviews of evidence and their quantitative components, pairwise meta-analysis (when two treatments are compared) and network meta-analysis (when more than two treatments are compared). In this paper, we aim to provide red flags as to when a placebo effect is likely to bias pairwise and network meta-analysis treatment effects. The classic paradigm has been that placebo-controlled randomised trials are focused on estimating the treatment effect. However, the magnitude of placebo effect itself may also in some instances be of interest and has also lately received attention. We use component network meta-analysis to estimate placebo effects. We apply these methods to a published network meta-analysis, examining the relative effectiveness of four psychotherapies and four control treatments for depression in 123 studies.</p>","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"127-134"},"PeriodicalIF":5.8,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10982636/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9698305","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Elise Gamertsfelder, Netzahualpilli Delgado Figueroa, Sarai Keestra, Alan Rossi Silva, Ronak Borana, Maximilian Siebert, Till Bruckner
{"title":"Towards transparency: adoption of WHO best practices in clinical trial registration and reporting among top medical research funders in the USA.","authors":"Elise Gamertsfelder, Netzahualpilli Delgado Figueroa, Sarai Keestra, Alan Rossi Silva, Ronak Borana, Maximilian Siebert, Till Bruckner","doi":"10.1136/bmjebm-2023-112395","DOIUrl":"10.1136/bmjebm-2023-112395","url":null,"abstract":"<p><strong>Objective: </strong>To assess to what extent the clinical trial policies of the largest public and philanthropic funders of clinical research in the United States meet WHO best practices in trial registration and reporting.</p><p><strong>Methods: </strong>Public and philanthropic funders of clinical trials in the USA with >US$50 million annual spend were selected. The funders were assessed using an 11-item scoring tool based on WHO Joint Statement benchmarks. These 11 items fell into 4 categories, namely: trial registration, academic publication, monitoring and sanctions. An additional item captured whether and how funders referred to Consolidated Standards of Reporting Trials (CONSORT) within their trial policies. Each funder was independently assessed by two or three researchers. Funders were contacted to flag possible errors and omissions. Ambiguous or difficult-to-score items were settled by an independent adjudicator.</p><p><strong>Results: </strong>Fourteen funders were assessed. Our cross-sectional study found that, on average, funders have only implemented 4.1/11 (37%) of WHO best practices in clinical trial transparency. The most frequently adopted requirement was open access publishing (14/14 funders). The least frequently adopted were (1) requiring trial ID to appear in all publications (2/14 funders, 14%) and (2) making compliance reports public (2/14 funders, 14%). Public funders, on average, adopted more policy elements (5.2/11 items, 47%) than philanthropic funders (2.8/11 items, 25%). Only one funder's policy documents mentioned the CONSORT statement.</p><p><strong>Conclusions: </strong>There is a significant variation between the number of best practice policy items adopted by medical research funders in the USA. Many funders fell significantly short of WHO Joint Statement benchmarks. Each funder could benefit from policy revision and strengthening.</p>","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"79-86"},"PeriodicalIF":5.8,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71477843","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Marla L Clayman, Fülöp Scheibler, Jens Ulrich Rüffer, Kai Wehkamp, Friedemann Geiger
{"title":"The Six Steps of SDM: linking theory to practice, measurement and implementation.","authors":"Marla L Clayman, Fülöp Scheibler, Jens Ulrich Rüffer, Kai Wehkamp, Friedemann Geiger","doi":"10.1136/bmjebm-2023-112289","DOIUrl":"10.1136/bmjebm-2023-112289","url":null,"abstract":"","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"75-78"},"PeriodicalIF":5.8,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10982624/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10226367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
James Flory, Jessica S Ancker, Scott Yung Ho Kim, Gilad Kuperman, Andrew Vickers
{"title":"Decision architecture randomisation: extremely efficient clinical trials that preserve clinician and patient choice?","authors":"James Flory, Jessica S Ancker, Scott Yung Ho Kim, Gilad Kuperman, Andrew Vickers","doi":"10.1136/bmjebm-2023-112386","DOIUrl":"10.1136/bmjebm-2023-112386","url":null,"abstract":"","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"71-74"},"PeriodicalIF":5.8,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9841305","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reducing the residue of retractions in evidence synthesis: ways to minimise inappropriate citation and use of retracted data.","authors":"Caitlin Bakker, Stephanie Boughton, Clovis Mariano Faggion, Daniele Fanelli, Kathryn Kaiser, Jodi Schneider","doi":"10.1136/bmjebm-2022-111921","DOIUrl":"10.1136/bmjebm-2022-111921","url":null,"abstract":"<p><p>The incorporation of publications that have been retracted is a risk in reliable evidence synthesis. Retraction is an important mechanism for correcting the literature and protecting its integrity. Within the medical literature, the continued citation of retracted publications occurs for a variety of reasons. Recent evidence suggests that systematic reviews and meta-analyses often unwittingly cite retracted publications which, at least in some cases, may significantly impact quantitative effect estimates in meta-analyses. There is strong evidence that authors of systematic reviews and meta-analyses may be unaware of the retracted status of publications and treat them as if they are not retracted. These problems are difficult to address for several reasons: identifying retracted publications is important but logistically challenging; publications may be retracted while a review is in preparation or in press and problems with a publication may also be discovered after the evidence synthesis is published. We propose a set of concrete actions that stakeholders (eg, scientists, peer-reviewers, journal editors) might take in the near-term, and that research funders, citation management systems, and databases and search engines might take in the longer term to limit the impact of retracted primary studies on evidence syntheses.</p>","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"121-126"},"PeriodicalIF":5.8,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10982619/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9860804","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fülöp Scheibler, Friedemann Geiger, Kai Wehkamp, Marion Danner, Marie Debrouwere, Constanze Stolz-Klingenberg, Anja Schuldt-Joswig, Christina Gesine Sommer, Olga Kopeleva, Claudia Bünzen, Christine Wagner-Ullrich, Gerhard Koch, Marie Coors, Felix Wehking, Marla Clayman, Christian Weymayr, Leonie Sundmacher, Jens Ulrich Rüffer
{"title":"Patient-reported effects of hospital-wide implementation of shared decision-making at a university medical centre in Germany: a pre-post trial.","authors":"Fülöp Scheibler, Friedemann Geiger, Kai Wehkamp, Marion Danner, Marie Debrouwere, Constanze Stolz-Klingenberg, Anja Schuldt-Joswig, Christina Gesine Sommer, Olga Kopeleva, Claudia Bünzen, Christine Wagner-Ullrich, Gerhard Koch, Marie Coors, Felix Wehking, Marla Clayman, Christian Weymayr, Leonie Sundmacher, Jens Ulrich Rüffer","doi":"10.1136/bmjebm-2023-112462","DOIUrl":"10.1136/bmjebm-2023-112462","url":null,"abstract":"<p><strong>Objectives: </strong>To evaluate the feasibility and effectiveness of the SHARE TO CARE (S2C) programme, a complex intervention designed for hospital-wide implementation of shared decision-making (SDM).</p><p><strong>Design: </strong>Pre-post study.</p><p><strong>Setting: </strong>University Hospital Schleswig-Holstein (UKSH), Kiel Campus.</p><p><strong>Participants: </strong>Healthcare professionals as well as inpatients and outpatients from 22 departments of the Kiel Campus of UKSH.</p><p><strong>Interventions: </strong>The S2C programme is a comprehensive implementation strategy including four core modules: (1) physician training, (2) SDM support training for and support by nurses as decision coaches, (3) patient activation and (4) evidence-based patient decision aid development and integration into patient pathways. After full implementation, departments received the S2C certificate.</p><p><strong>Main outcome measures: </strong>In this paper, we report on the feasibility and effectiveness outcomes of the implementation. Feasibility was judged by the degree of implementation of the four modules of the programme. Outcome measures for effectiveness are patient-reported experience measures (PREMs). The primary outcome measure for effectiveness is the Patient Decision Making subscale of the Perceived Involvement in Care Scale (PICS<sub>PDM</sub>). Pre-post comparisons were done using t-tests.</p><p><strong>Results: </strong>The implementation of the four components of the S2C programme was able to be completed in 18 of the 22 included departments within the time frame of the study. After completion of implementation, PICS<sub>PDM</sub> showed a statistically significant difference (p<0.01) between the means compared with baseline. This difference corresponds to a small to medium yet clinically meaningful positive effect (Hedges' g=0.2). Consistent with this, the secondary PREMs (Preparation for Decision Making and collaboRATE) also showed statistically significant, clinically meaningful positive effects.</p><p><strong>Conclusions: </strong>The hospital-wide implementation of SDM with the S2C-programme proved to be feasible and effective within the time frame of the project. The German Federal Joint Committee has recommended to make the Kiel model of SDM a national standard of care.</p>","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"87-95"},"PeriodicalIF":5.8,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10982630/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"61560716","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Chantelle Garritty, Barbara Nussbaumer-Streit, Candyce Hamel, Declan Devane
{"title":"Rapid reviews methods series: assessing the appropriateness of conducting a rapid review.","authors":"Chantelle Garritty, Barbara Nussbaumer-Streit, Candyce Hamel, Declan Devane","doi":"10.1136/bmjebm-2023-112722","DOIUrl":"https://doi.org/10.1136/bmjebm-2023-112722","url":null,"abstract":"<p><p>This paper, part of the Cochrane Rapid Review Methods Group series, offers guidance on determining when to conduct a rapid review (RR) instead of a full systematic review (SR). While both review types aim to comprehensively synthesise evidence, RRs, conducted within a shorter time frame of typically 6 months or less, involve streamlined methods to expedite the process. The decision to opt for an RR depends on the urgency of the research question, resource availability and the impact on decision outcomes. The paper categorises scenarios where RRs are appropriate, including urgent decision-making, informing guidelines, assessing new technologies and identifying evidence gaps. It also outlines instances when RRs may be inappropriate, cautioning against conducting them solely for ease, quick publication or only cost-saving motives.When deciding on an RR, it is crucial to consider both conceptual and practical factors. These factors encompass the urgency of needing timely evidence, the consequences of waiting for a full SR, the potential risks associated with incomplete evidence, and the risk of not using synthesised evidence in decision-making, among other considerations. Key factors to weigh also include having a clearly defined need, a manageable scope and access to the necessary expertise. Overall, this paper aims to guide informed judgements about whether to choose an RR over an SR based on the specific research question and context. Researchers and decision-makers are encouraged to carefully weigh potential trade-offs when opting for RRs.</p>","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":""},"PeriodicalIF":5.8,"publicationDate":"2024-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140130641","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}