Xiuxia Li, Tao Nian, Wendi Liu, Xue Shang, Xinxin Deng, Kangle Guo, Nan Chen, Yan Wang, Yaolong Chen, Kehu Yang
{"title":"Exploring the application of GRADE in formulating WHO public health guidelines: a scoping evidence review.","authors":"Xiuxia Li, Tao Nian, Wendi Liu, Xue Shang, Xinxin Deng, Kangle Guo, Nan Chen, Yan Wang, Yaolong Chen, Kehu Yang","doi":"10.1136/bmjebm-2024-113487","DOIUrl":"10.1136/bmjebm-2024-113487","url":null,"abstract":"<p><strong>Objectives: </strong>To systematically review the utilisation of the Grading of Recommendations Assessment, Development and Evaluations (GRADE) framework within the context of WHO public health guidelines (PHGs), identifying key features, areas of concentration and potential deficiencies.</p><p><strong>Design and setting: </strong>From 2007 to February 2024, a comprehensive search of the WHO website was conducted to identify PHGs that have incorporated the GRADE methodology.</p><p><strong>Participants: </strong>The study focused on the PHGs identified through the above search.</p><p><strong>Interventions: </strong>Data extraction and analysis were independently conducted by researchers using Microsoft Excel 2019.</p><p><strong>Main outcome measures: </strong>For each PHG, key recorded characteristics included publication details, thematic areas, the strength of recommendations, the certainty of evidence, and characteristics of the GRADE downgrading/upgrading domains.</p><p><strong>Results: </strong>Out of 228 PHGs examined, 9234 (90.55%) outcome indicators used the GRADE rating system, predominantly in the area of sexual and reproductive health (50%). Only 31.62% of the outcomes reported moderate and high certainty in evidence. The main clustering results were dominated by adverse events. Among the 4013 recommendations, 2067 (51.51%) were strong, while 1477 (36.81%) were weak/conditional. It is noteworthy that 46.83% of the strong recommendations were based on low or very low confidence in evidence. Among these strong recommendations, 119 met the criteria of five paradigmatic situations where it was necessary to issue a strong recommendation despite low or very low confidence in the effect estimates. Among the 13 230 instances of downgrading, 41.09% were due to the risk of bias and 35.90% were due to imprecision. Only 0.25% outcomes were upgraded by the magnitude of effect size and 0.03% by dose-response gradient.</p><p><strong>Conclusion: </strong>The GRADE approach is widely used in the development of PHGs. More than half of the recommendations in PHGs are based on low or very low-quality evidence, primarily due to risks of bias and imprecision. Additionally, strong recommendations based on low-confidence or very low-confidence estimates are frequently made. Therefore, it is necessary to enhance guideline developers' understanding of the GRADE methodology and to further investigate and clarify discordant recommendations in PHGs.</p>","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"290-299"},"PeriodicalIF":10.8,"publicationDate":"2026-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146008851","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Naveen Kumar Reddy, Michael A Steinman, Joseph S Ross, Eric Widera, Nina Zeldes, Robert Steinbrook, Reshma Ramachandran
{"title":"FDA approval of benzgalantamine exposes flaws in the 505(b)(2) pathway for innovations on existing drugs.","authors":"Naveen Kumar Reddy, Michael A Steinman, Joseph S Ross, Eric Widera, Nina Zeldes, Robert Steinbrook, Reshma Ramachandran","doi":"10.1136/bmjebm-2025-114142","DOIUrl":"10.1136/bmjebm-2025-114142","url":null,"abstract":"","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"350-352"},"PeriodicalIF":10.8,"publicationDate":"2026-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147343707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Ginger for the treatment and prevention of migraine headaches: a systematic review and meta-analysis of randomised controlled trials.","authors":"Tiffany Atkins, Sam Manger, Loai Albarqouni","doi":"10.1136/bmjebm-2025-114382","DOIUrl":"https://doi.org/10.1136/bmjebm-2025-114382","url":null,"abstract":"<p><strong>Objective: </strong>To determine the efficacy of ginger (either stand-alone or as an adjunct treatment) for the treatment and management of migraine headaches.</p><p><strong>Methods: </strong>We searched PubMed, Embase, CINAHL, PsycINFO, Epistemonikos and Cochrane CENTRAL from inception to 26 March 2025 which was updated on 16 April 2026 and conducted a backwards and forwards citation search of included studies. We included randomised controlled trials (RCTs) that compared the effect of ginger (either stand-alone or as an adjunct) to placebo or usual active control (such as Depakine (valproic acid), amitriptyline or sumatriptan). Two authors independently screened articles, extracted data, assessed risk of bias using the Cochrane Risk of Bias 2 Tool (ROB-2) tool. Primary outcomes included headache severity or pain scores post-treatment, proportion of patients pain free or with pain relief post-treatment, frequency and duration of migraine attacks and migraine-associated symptoms. Random-effects meta-analyses were done and the certainty of evidence was assessed using Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology.</p><p><strong>Results: </strong>Eight RCTs involving 594 patients were included. For acute treatments, ginger with ketoprofen compared with placebo with ketoprofen may have little to no difference on headache severity at 2 hours post (mean difference (MD) 1.27 lower, 95% CI 1.46 lower to 1.08 lower; 1 study, 60 participants; low certainty evidence). It was very uncertain if ginger combined with feverfew versus placebo or ginger alone compared with sumatriptan improved proportions of those with pain relief, pain free or the mean headache severity at 2 hours post. For preventative treatment, ginger in addition to an active drug compared with the same active drug with or without placebo, may result in an important reduction in headache pain severity at 3 months (pooled MD -3.18, 95% CI -3.94 to -2.42; 2 studies, 183 participants; low certainty evidence). However, it was very uncertain if ginger combined with herbs compared with active drugs of both Depakine and amitriptyline lowered headache frequency, duration or headache severity at 3 months. The overall certainty of evidence for all outcome measures ranged from low to very low.</p><p><strong>Conclusions: </strong>The volume of the existing evidence is limited and combined with either a low or very low certainty of evidence, it is currently too uncertain if ginger is effective either as an acute or preventative treatment. Therefore, additional acute and preventative trials are required to help raise the certainty of evidence.</p><p><strong>Trial registration number: </strong>https://www.crd.york.ac.uk/PROSPERO/view/CRD420251025768.</p>","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":""},"PeriodicalIF":10.8,"publicationDate":"2026-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148757280","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pedro Lopez-Romero, Brenda Jean Crowe, Philip He, Natalia Kan-Dobrosky, Andreas Sashegyi, Jonathan Siegel
{"title":"Applying the estimand framework to safety: aligning estimators with treatment effects in the presence of intercurrent events.","authors":"Pedro Lopez-Romero, Brenda Jean Crowe, Philip He, Natalia Kan-Dobrosky, Andreas Sashegyi, Jonathan Siegel","doi":"10.1136/bmjebm-2026-114587","DOIUrl":"https://doi.org/10.1136/bmjebm-2026-114587","url":null,"abstract":"<p><p>Understanding the risks associated with healthcare interventions is essential for clinical decision-making and for the regulatory evaluation of new drugs. Yet, safety analyses in randomised controlled trials are often conducted without clearly specifying (a) the estimand of interest in the presence of intercurrent events (IEs) (ie, events such as treatment discontinuation or use of rescue medication that occur after randomisation and complicate outcome interpretation) or (b) the estimand implicitly targeted by the statistical estimator used in the analysis. This lack of clarity produces ambiguous results and complicates their interpretation.This paper provides practical guidance on applying the estimand framework from the ICH E9(R1) addendum to safety outcomes in phase III randomised trials conducted for regulatory submissions. We describe how IEs influence the interpretation of treatment effects in safety assessment and how commonly used safety estimators align with different estimands, making explicit both the clinical question and the assumptions required to estimate it.Although the primary emphasis is on regulatory trials, where these decisions are especially consequential, the principles outlined are equally applicable to other randomised interventions and non-interventional studies. As safety results from pivotal regulatory trials are increasingly published using estimand terminology, these concepts are essential not only for researchers such as statisticians, clinicians and regulators involved in clinical development but also for clinicians who prescribe newly approved drugs and need to interpret safety results communicated using estimand terminology to inform their clinical decision-making. This paper aims to make these concepts accessible to a broader medical audience.</p>","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":""},"PeriodicalIF":10.8,"publicationDate":"2026-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148683523","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Target trial emulation lacks the Magic of Randomization: HARKing and terminology can mislead.","authors":"Lum Kastrati, John P A Ioannidis, Lars G Hemkens","doi":"10.1136/bmjebm-2026-114575","DOIUrl":"https://doi.org/10.1136/bmjebm-2026-114575","url":null,"abstract":"","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":""},"PeriodicalIF":10.8,"publicationDate":"2026-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148677074","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Target trial emulation: from observational data to causal inference.","authors":"Venexia M Walker, Jonathan A C Sterne","doi":"10.1136/bmjebm-2025-114080","DOIUrl":"https://doi.org/10.1136/bmjebm-2025-114080","url":null,"abstract":"","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":""},"PeriodicalIF":10.8,"publicationDate":"2026-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148583498","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tiziano Innocenti, Tim Schleimer, Maarten de Wit, Manuela Ferreira, Toshi A Furukawa, Harrison J Hansford, James H McAuley, Georgia Salanti, Stefano Salvioli, Raymond Ostelo, Alessandro Chiarotto
{"title":"Defining and interpreting the clinical relevance of intervention effects for patient-reported outcomes: the smallest worthwhile effect construct.","authors":"Tiziano Innocenti, Tim Schleimer, Maarten de Wit, Manuela Ferreira, Toshi A Furukawa, Harrison J Hansford, James H McAuley, Georgia Salanti, Stefano Salvioli, Raymond Ostelo, Alessandro Chiarotto","doi":"10.1136/bmjebm-2026-114620","DOIUrl":"https://doi.org/10.1136/bmjebm-2026-114620","url":null,"abstract":"<p><p>In clinical research, statistically significant effects do not necessarily indicate that an intervention provides benefits that are meaningful to patients. This is particularly important for patient-reported outcomes, where thresholds used to interpret clinical relevance are often derived from within-person changes, such as the minimal clinically important difference, and then inappropriately applied to between-group effects in randomised trials and meta-analyses. This article clarifies the conceptual distinction between within-group change and between-group effects, and argues that the latter should be the focus when judging the comparative value of healthcare interventions. We introduce the smallest worthwhile effect (SWE) as a patient-centred, intervention-specific construct representing the smallest between-group effect of an intervention over a comparator that patients consider worthwhile when weighed against harms, costs and other inconveniences. We describe the main methods used to estimate the SWE, including benefit-harm trade-off studies and discrete choice experiments, and illustrate its application by reinterpreting a randomised trial of physiotherapy for low back pain and a meta-analysis of discectomy versus non-surgical care for sciatica. We also show how the SWE can inform judgements of imprecision within the Grading of Recommendations Assessment, Development and Evaluation (GRADE) framework, offering a patient-derived threshold for distinguishing trivial from worthwhile effects. By focusing on patient-derived thresholds rather than arbitrary statistical or within-group approaches, the SWE construct can help researchers, clinicians and other stakeholders make more transparent and meaningful judgements about the worthwhileness of compared healthcare interventions from a patient perspective.</p>","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":""},"PeriodicalIF":10.8,"publicationDate":"2026-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148577137","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Correspondence on 'Less is more for patients, practitioners, public and planet: a taxonomy for the harms of too much medicine'.","authors":"Hana Abbasian","doi":"10.1136/bmjebm-2025-114275","DOIUrl":"10.1136/bmjebm-2025-114275","url":null,"abstract":"","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"286"},"PeriodicalIF":10.8,"publicationDate":"2026-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145367661","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Joseph B John, William K Gray, Chantelle Rizan, Kristin J Konnyu, Forbes McGain, Manraj Phull, John Ford, Paula R Williamson, Edward Nickell, Kieran O'Flynn, Tim Briggs, John S McGrath
{"title":"Environmental Lessons Learned and Applied (ELLA): a new framework for identifying, prioritising and implementing decarbonisation interventions in clinical care pathways.","authors":"Joseph B John, William K Gray, Chantelle Rizan, Kristin J Konnyu, Forbes McGain, Manraj Phull, John Ford, Paula R Williamson, Edward Nickell, Kieran O'Flynn, Tim Briggs, John S McGrath","doi":"10.1136/bmjebm-2025-113911","DOIUrl":"10.1136/bmjebm-2025-113911","url":null,"abstract":"<p><p>A multidisciplinary framework for designing rapidly deployable, scalable and context-specific decarbonisation interventions for clinical care has been developed within the National Health Service, devised at a care pathway level to identify modifiable emissions hotspots while addressing wider priority outcomes and implementation.</p>","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"269-278"},"PeriodicalIF":10.8,"publicationDate":"2026-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145793243","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}