J. Thurell , L. Doppelbauer , E.M. Verheul , I. Petrov , M.M. Karsten , L.B. Koppert , J. Bergh , I. Fredriksson , P. Lindgren , N. Kiani , E. Hedayati
{"title":"Benchmarking cancer outcomes in Europe: a scoping review of methodologies and case-mix adjustments","authors":"J. Thurell , L. Doppelbauer , E.M. Verheul , I. Petrov , M.M. Karsten , L.B. Koppert , J. Bergh , I. Fredriksson , P. Lindgren , N. Kiani , E. Hedayati","doi":"10.1016/j.esmorw.2025.100176","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>Benchmarking hospital outcomes is crucial for identifying inequities and improving cancer care. Meaningful comparisons require selecting relevant outcomes and adjusting for case-mix factors such as age, comorbidity, and stage. Without case-mix adjustment, hospitals may be unfairly assessed based on patient mix rather than care quality. No prior review has examined benchmarking practices in European cancer care. This scoping review addresses: (i) Which health outcomes are frequently benchmarked? (ii) What case-mix factors are commonly used for adjustment? (iii) Which statistical approaches are utilized? (iv) How are case-mix models developed and evaluated?</div></div><div><h3>Materials and methods</h3><div>We conducted a systematic scoping review searching OVID MEDLINE, Web of Science, and EMBASE. Eligible studies focused on benchmarking populations with a cancer diagnosis, involved European hospitals, and evaluated health outcomes like survival. Abstract screening and full-text appraisal were done independently by two authors. Data were extracted into a pre-specified matrix, and results synthesized by research question.</div></div><div><h3>Results</h3><div>After screening 4953 abstracts, 65 studies were included. Key gaps include a lack of validated case-mix models, under-representation of long-term outcomes, and a tendency to ‘over-adjust’ by including treatment factors in case-mix models, potentially obscuring true differences in performance. Regression modeling remains the gold standard for adjustment. A consensus is needed on reporting and evaluating case-mix models, akin to TRIPOD guidelines.</div></div><div><h3>Conclusions</h3><div>A shift toward standardized, validated benchmarking practices is essential to drive health care improvements. Only through rigorous methodologies, standardized reporting, and international collaboration can hospital benchmarking become a transformative tool for improving cancer care quality and patient outcomes.</div></div>","PeriodicalId":100491,"journal":{"name":"ESMO Real World Data and Digital Oncology","volume":"9 ","pages":"Article 100176"},"PeriodicalIF":0.0000,"publicationDate":"2025-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ESMO Real World Data and Digital Oncology","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2949820125000657","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Background
Benchmarking hospital outcomes is crucial for identifying inequities and improving cancer care. Meaningful comparisons require selecting relevant outcomes and adjusting for case-mix factors such as age, comorbidity, and stage. Without case-mix adjustment, hospitals may be unfairly assessed based on patient mix rather than care quality. No prior review has examined benchmarking practices in European cancer care. This scoping review addresses: (i) Which health outcomes are frequently benchmarked? (ii) What case-mix factors are commonly used for adjustment? (iii) Which statistical approaches are utilized? (iv) How are case-mix models developed and evaluated?
Materials and methods
We conducted a systematic scoping review searching OVID MEDLINE, Web of Science, and EMBASE. Eligible studies focused on benchmarking populations with a cancer diagnosis, involved European hospitals, and evaluated health outcomes like survival. Abstract screening and full-text appraisal were done independently by two authors. Data were extracted into a pre-specified matrix, and results synthesized by research question.
Results
After screening 4953 abstracts, 65 studies were included. Key gaps include a lack of validated case-mix models, under-representation of long-term outcomes, and a tendency to ‘over-adjust’ by including treatment factors in case-mix models, potentially obscuring true differences in performance. Regression modeling remains the gold standard for adjustment. A consensus is needed on reporting and evaluating case-mix models, akin to TRIPOD guidelines.
Conclusions
A shift toward standardized, validated benchmarking practices is essential to drive health care improvements. Only through rigorous methodologies, standardized reporting, and international collaboration can hospital benchmarking become a transformative tool for improving cancer care quality and patient outcomes.
对医院结果进行基准测试对于确定不公平现象和改善癌症治疗至关重要。有意义的比较需要选择相关的结果并调整病例组合因素,如年龄、合并症和分期。如果没有病例组合调整,医院可能会根据患者组合而不是护理质量进行不公平的评估。没有先前的审查审查了欧洲癌症治疗的基准做法。这一范围审查涉及:(i)哪些健康结果经常被定为基准?通常使用哪些混合病例因素进行调整?采用了哪些统计方法?如何制定和评价病例混合模型?材料和方法我们在MEDLINE, Web of Science和EMBASE中进行了系统的范围综述。符合条件的研究集中于对诊断为癌症的人群进行基准测试,涉及欧洲医院,并评估生存等健康结果。摘要筛选和全文评价由两位作者独立完成。将数据提取到预先指定的矩阵中,并根据研究问题对结果进行综合。结果筛选4953篇摘要,纳入65项研究。主要的差距包括缺乏经过验证的病例混合模型,对长期结果的代表性不足,以及通过在病例混合模型中纳入治疗因素而“过度调整”的倾向,这可能掩盖了实际表现的真正差异。回归建模仍然是调整的黄金标准。需要就报告和评估病例混合模型达成共识,类似于TRIPOD指南。结论向标准化、有效的基准实践的转变对推动卫生保健的改善至关重要。只有通过严格的方法、标准化的报告和国际合作,医院基准才能成为提高癌症护理质量和患者治疗效果的变革性工具。