Karl T Chamberlin, Christopher DiTullio, Jennifer Rossman, Bruce A Barton, Martin Reznek, Kevin Kotkowski
{"title":"Randomised controlled trial of audit-and-feedback strategies to reduce imaging overutilisation in the emergency department.","authors":"Karl T Chamberlin, Christopher DiTullio, Jennifer Rossman, Bruce A Barton, Martin Reznek, Kevin Kotkowski","doi":"10.1136/bmjqs-2024-018374","DOIUrl":"https://doi.org/10.1136/bmjqs-2024-018374","url":null,"abstract":"<p><strong>Background: </strong>Evaluation of neck trauma is a common reason for emergency department (ED) visits. There are several validated clinical decision rules, such as the National Emergency X-Radiography Utilization Study (NEXUS) Cervical Spine (C-spine) Rule, that can be used to risk stratify these patients and identify low-risk patients who do not require CT imaging. Overutilisation of CT imaging exposes patients to unnecessary radiation, impairs hospital throughput and increases healthcare costs. Various audit-and-feedback strategies have been described in other settings, but it is not known whether these strategies are effective for reducing imaging overutilisation in the ED. Additionally, the effectiveness of face-to-face feedback strategies as compared with digital feedback strategies for addressing this problem has not been previously evaluated. The aim of this study was to compare audit-and-feedback strategies to reduce CT overutilisation in the ED.</p><p><strong>Methods: </strong>This was a prospective randomised controlled trial, in which emergency medicine clinicians were randomised into three arms to receive digital feedback, hybrid face-to-face/digital feedback or no feedback. Each clinician received three rounds of feedback on patient encounters in which they ordered a CT of the C-spine. Patient encounters were retrospectively reviewed to determine each clinician's overutilisation rate, defined as the percentage of patients who underwent CT of the C-spine despite being classified as low risk by NEXUS criteria.</p><p><strong>Results: </strong>A total of 78 emergency medicine clinicians were randomised into three arms. Baseline overutilisation rates for each group were 46%-47% of CT of the C-spine studies. After three rounds of audit-and-feedback strategy, the clinicians in the digital feedback group had an overutilisation rate of 33%, compared with 44% in the control group (p=0.020). The hybrid feedback group had an overutilisation rate of 36% (p=0.055 vs control; p=0.577 vs digital feedback). Over the study period, the digital group saw a reduction of 1.26 CT of the C-spine studies per provider per month (p=0.049), and the hybrid feedback group saw a reduction of 1.43 CTs per provider per month (p=0.044).</p><p><strong>Conclusion: </strong>A digital audit-and-feedback strategy is effective for reducing overutilisation of CT imaging of the C-spine in the ED, while the effectiveness of a hybrid strategy requires further investigation.</p>","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":""},"PeriodicalIF":5.6,"publicationDate":"2025-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143779021","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Gabriela Fernández Castillo, Eduardo Salas, Eric J Thomas
{"title":"We will take some team resilience, please: Evidence-based recommendations for supporting diagnostic teamwork.","authors":"Gabriela Fernández Castillo, Eduardo Salas, Eric J Thomas","doi":"10.1136/bmjqs-2025-018685","DOIUrl":"https://doi.org/10.1136/bmjqs-2025-018685","url":null,"abstract":"","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":""},"PeriodicalIF":5.6,"publicationDate":"2025-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143779025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Helen Crocker, David A Cromwell, Shivali Modha, Alastair McIntosh Gray, Chris Graham, Lavanya Thana, Raymond Fitzpatrick, Charles Vincent, Helen Hogan, Michele Peters
{"title":"Patient-reported harm from NHS treatment or care, or the lack of access to care: a cross-sectional survey of general population prevalence, impact and responses.","authors":"Helen Crocker, David A Cromwell, Shivali Modha, Alastair McIntosh Gray, Chris Graham, Lavanya Thana, Raymond Fitzpatrick, Charles Vincent, Helen Hogan, Michele Peters","doi":"10.1136/bmjqs-2024-017213","DOIUrl":"https://doi.org/10.1136/bmjqs-2024-017213","url":null,"abstract":"<p><strong>Objectives: </strong>The aim of this article is to provide an estimate of the proportion of the general public reporting healthcare-related harm in Great Britain, its location, impact, responses post-harm and desired reactions from healthcare providers.</p><p><strong>Design: </strong>We used a cross-sectional survey, using quota sampling.</p><p><strong>Setting: </strong>This research was conducted in Great Britain.</p><p><strong>Participants: </strong>The survey had 10 064 participants (weighted analysis).</p><p><strong>Results: </strong>In our survey 9.7% participants reported harm caused by the National Health Service (NHS) in the last 3 years through treatment or care (6.2%) or the lack of access to care (3.5%). The main location where the harm first occurred was hospitals. A total of 37.6% of participants reported a moderate impact and 44.8% a severe impact of harm. The most common response to harm was to share their experience with others (67.1%). Almost 60% sought professional advice and support, with 11.6% contacting the Patient Advice and Liaison Service (PALS). Only 17% submitted a formal complaint, and 2.1% made a claim for financial compensation. People wanted treatment or care to redress the harm (44.4%) and an explanation (34.8%). Two-thirds of those making a complaint felt it was not handled well and approximately half were satisfied with PALS. Experiences and responses differed according to sex and age (eg, women reported more harm). People with long-term illness or disability, those in lower social grades, and people in other disadvantaged groups reported higher rates and more severe impact of harm.</p><p><strong>Conclusions: </strong>We found that 9.7% of the British general population reported harm by the NHS, a higher rate than reported in two previous surveys. Our study used a broader and more inclusive definition of harm and was conducted during the COVID-19 pandemic, making comparison to previous surveys challenging. People responded to harm in different ways, such as sharing experiences with others and seeking professional advice and support. Mostly, people who were harmed wanted help to redress the harm or to gain access to the care needed. Low satisfaction with PALS and complaints services may reflect that these services do not always deliver the required support. There is a need to better understand the patient perspective following harm and for further consideration of what a person-centred approach to resolution and recovery might look like.</p>","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":""},"PeriodicalIF":5.6,"publicationDate":"2025-04-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143771163","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Rudolf Schnetler, Anton van der Vegt, Vikrant R Kalke, Paul Lane, Ian Scott
{"title":"False hope of a single generalisable AI sepsis prediction model: bias and proposed mitigation strategies for improving performance based on a retrospective multisite cohort study.","authors":"Rudolf Schnetler, Anton van der Vegt, Vikrant R Kalke, Paul Lane, Ian Scott","doi":"10.1136/bmjqs-2024-018328","DOIUrl":"https://doi.org/10.1136/bmjqs-2024-018328","url":null,"abstract":"<p><strong>Objective: </strong>To identify bias in using a single machine learning (ML) sepsis prediction model across multiple hospitals and care locations; evaluate the impact of six different bias mitigation strategies and propose a generic modelling approach for developing best-performing models.</p><p><strong>Methods: </strong>We developed a baseline ML model to predict sepsis using retrospective data on patients in emergency departments (EDs) and wards across nine hospitals. We set model sensitivity at 70% and determined the number of alerts required to be evaluated (number needed to evaluate (NNE), 95% CI) for each case of true sepsis and the number of hours between the first alert and timestamped outcomes meeting sepsis-3 reference criteria (HTS3). Six bias mitigation models were compared with the baseline model for impact on NNE and HTS3.</p><p><strong>Results: </strong>Across 969 292 admissions, mean NNE for the baseline model was significantly lower for EDs (6.1 patients, 95% CI 6 to 6.2) than for wards (7.5 patients, 95% CI 7.4 to 7.5). Across all sites, median HTS3 was 20 hours (20-21) for wards vs 5 (5-5) for EDs. Bias mitigation models significantly impacted NNE but not HTS3. Compared with the baseline model, the best-performing models for NNE with reduced interhospital variance were those trained separately on data from ED patients or from ward patients across all sites. These models generated the lowest NNE results for all care locations in seven of nine hospitals.</p><p><strong>Conclusions: </strong>Implementing a single sepsis prediction model across all sites and care locations within multihospital systems may be unacceptable given large variances in NNE across multiple sites. Bias mitigation methods can identify models demonstrating improved performance across most sites in reducing alert burden but with no impact on the length of the prediction window.</p>","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":""},"PeriodicalIF":5.6,"publicationDate":"2025-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143728434","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kea Turner, Mona Al Taweel, Carrie Petrucci, Scott Rosas, Catima Potter, Emily Cramer, Ronald I Shorr, Lorraine C Mion, Molly McNett
{"title":"Selecting and tailoring implementation strategies for deimplementing fall prevention alarms in US hospitals: a group concept mapping study.","authors":"Kea Turner, Mona Al Taweel, Carrie Petrucci, Scott Rosas, Catima Potter, Emily Cramer, Ronald I Shorr, Lorraine C Mion, Molly McNett","doi":"10.1136/bmjqs-2024-018391","DOIUrl":"https://doi.org/10.1136/bmjqs-2024-018391","url":null,"abstract":"<p><strong>Objectives: </strong>Many hospitals use fall prevention alarms, despite the limited evidence of effectiveness. The objectives of this study were (1) to identify, conceptualise and select strategies to deimplement fall prevention alarms and (2) to obtain feedback from key stakeholders on tailoring selected deimplementation strategies for the local hospital context.</p><p><strong>Methods: </strong>Hospital staff working on fall prevention participated in group concept mapping (GCM) to brainstorm strategies that could be used for fall prevention alarm deimplementation, sort statements into conceptually similar categories and rate statements based on importance and current use. Hospital staff also participated in site-specific focus groups to discuss current fall prevention practices, strategies prioritised through GCM and theory-informed strategies recommended by the study team, and potential barriers/facilitators to deimplementing fall prevention alarms.</p><p><strong>Results: </strong>90 hospital staff across 13 hospitals brainstormed, rated and sorted strategies for alarm deimplementation. Strategies that were rated as highly important but underutilised included creating/revising staff roles to support fall prevention (eg, hiring or designating mobility technicians) and revising policies and procedures to encourage tailored rather than universal fall precautions. 192 hospital staff across 22 hospitals participated in site-specific focus groups. Participants provided feedback on each strategy's relevance for their site (eg, if site currently has a mobility technician) and local barriers or facilitators (eg, importance of having separate champions for day and night shift). Findings were used to develop a tailored implementation package for each site that included a core set of strategies (eg, external facilitation, education, audit-and-feedback, champions), a select set of site-specific strategies (eg, designating a mobility technician to support fall prevention) and guidance for how to operationalise and implement each strategy given local barriers and facilitators.</p><p><strong>Conclusion: </strong>Findings from this study can be used to inform future programmes and policies aimed at deimplementing fall prevention alarms in hospitals.</p>","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":""},"PeriodicalIF":5.6,"publicationDate":"2025-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143728438","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Insook Cho, Joon-Myoung Kwon, Whasuk Choe, Jiseon Cho, Sook Hyun Park, David W Bates
{"title":"Under-reporting of falls in hospitals: a multisite study in South Korea.","authors":"Insook Cho, Joon-Myoung Kwon, Whasuk Choe, Jiseon Cho, Sook Hyun Park, David W Bates","doi":"10.1136/bmjqs-2024-017993","DOIUrl":"https://doi.org/10.1136/bmjqs-2024-017993","url":null,"abstract":"<p><strong>Background: </strong>Inpatient falls are adverse events that often result in injury due to complex interactions between the hospital environment and patient risk factors and remain a significant problem in clinical settings.</p><p><strong>Objectives: </strong>This study aimed to identify (1) practice variations and key issues ranging from hospital fall management protocols to incident detection, and (2) potential approaches to address these challenges.</p><p><strong>Design: </strong>Retrospective cohort study.</p><p><strong>Setting: </strong>Four general hospitals in South Korea.</p><p><strong>Methods: </strong>Qualitative and quantitative data were analysed using the Donabedian quality outcomes model. Data were collected retrospectively during 2015-2023 from four general hospitals on local practice protocols, patient admission and nursing data from electronic records, and incident self-reports. Content analysis of practice protocol and manual chart reviews for hospital falls incidents was conducted at each site. Quantitative analyses of nursing activities and analysis of patient falls prevention interventions were also conducted at each site.</p><p><strong>Results: </strong>There were variations in fall definitions, risk-assessment tools and inclusion and exclusion criteria among the local fall management protocols. The original and modified versions of the heuristic tools performed poorly to moderately, with areas under the receiver operating characteristic curve of 0.54~0.74 and 0.59~0.80, respectively. Preventive intervention practices varied significantly among the sites, with risk-targeted and tailored interventions delivered to only 1.15%~49.5% of at-risk patients. Fall events were not recorded in self-reporting systems and nursing notes for 29.5%~90.6% and 4.4%~17.1% of patients, respectively.</p><p><strong>Conclusion: </strong>Challenges in fall prevention included weaknesses in the design and implementation of local fall protocols and low-quality incident self-reporting systems. Systematic and sustainable solutions are needed to help reduce hospital fall rates and injuries.</p>","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":""},"PeriodicalIF":5.6,"publicationDate":"2025-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143728454","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Stephanie C C van der Lubbe, Lay Hoon Goh, Evangelos Kontopantelis, Wilson Ws Tam, Jose M Valderas
{"title":"Measuring guideline concordance via electronic health records: a new model for estimating concordance scores.","authors":"Stephanie C C van der Lubbe, Lay Hoon Goh, Evangelos Kontopantelis, Wilson Ws Tam, Jose M Valderas","doi":"10.1136/bmjqs-2025-018494","DOIUrl":"https://doi.org/10.1136/bmjqs-2025-018494","url":null,"abstract":"<p><strong>Background: </strong>Guideline concordance is associated with improved patient outcomes. Accurately quantifying the concordance between provided care and guideline recommendations offers valuable insights into the alignment of care with established guidelines and supports proactive approaches for improving the quality of care. Traditional models for calculating guideline concordance are effective in assessing clinical performance via cohort averages. However, these models fail at the individual patient level by not accounting for past clinical activities and their timing, which may give a distorted impression of the actual alignment between guideline recommendations and received care.</p><p><strong>Objectives: </strong>To develop a model for evaluating guideline concordance that provides accurate concordance scores at the individual patient level.</p><p><strong>Methods: </strong>The newly developed ratio model incorporates past clinical activities and their timing (ie, past clinical trajectories), resulting in accurate, patient-centred concordance scores. We discuss its advantages and limitations and showcase its performance using clinical indicators for patients with type 2 diabetes mellitus.</p><p><strong>Results: </strong>The ratio model demonstrates enhanced precision in evaluating guideline concordance at the individual level and better reflects the clinical trajectory of individual patients. While primarily designed to produce accurate individual patient scores, the model is also effective for assessing clinical performance through cohort averages. The ratio model is adaptable to diverse clinical contexts requiring regular follow-up, including chronic disease management, vaccination programmes, cancer surveillance and routine health screenings.</p><p><strong>Conclusions: </strong>The ratio model provides accurate and patient-centred guideline concordance scores. The model's enhanced precision at the individual level creates opportunities for research and clinical applications, including integration into clinical decision support systems.</p>","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":""},"PeriodicalIF":5.6,"publicationDate":"2025-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143690914","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Increasing vaccine uptake in underserved populations using text message interventions: considerations and recommendations.","authors":"Gaby Judah","doi":"10.1136/bmjqs-2024-018245","DOIUrl":"https://doi.org/10.1136/bmjqs-2024-018245","url":null,"abstract":"","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":""},"PeriodicalIF":5.6,"publicationDate":"2025-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143673322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}