Richard Lilford, Yen-Fu Chen, Matt Sutton, Timothy Hofer
{"title":"Hospital league tables, targets, and performance incentives should be used with care","authors":"Richard Lilford, Yen-Fu Chen, Matt Sutton, Timothy Hofer","doi":"10.1136/bmj-2024-083517","DOIUrl":null,"url":null,"abstract":"Richard Lilford and colleagues argue that the UK government’s plans to use performance metrics to reward or punish hospitals risk doing more harm than good Healthcare consumes a lot of resources and various measures have been used to try to ensure they are used efficiently. In the UK, after the government increased investment in health services, the secretary of state for health and social care announced that “NHS England will carry out a review of NHS performance across England with the results made public in league tables”1 and threatened that managers would be sacked if they don’t improve hospital performance.2 The health secretary is advocating using a performance metric that evaluates an organisation as a whole. The use of this type of metric to improve healthcare is neither new nor unique; policy makers often turn to performance management in the form of incentives based on organisation-wide targets or league tables. For example, in the US the Leapfrog group generates a “single letter grade representing a hospital’s overall performance” for nearly 3000 general acute care hospitals,3 and the Centers for Medicare and Medicaid Services measures whole hospital performance using a much criticised star rating system.4 With the announcement of the abolition of NHS England in March 2025, the government clearly intends to take direct control of the NHS and influence NHS organisations through performance metrics coupled with incentives and sanctions. This makes it important to consider the evidence on their accuracy and whether they have their intended effect. The quality of a measurement is defined by its reliability and validity. An unreliable measure has a low ratio between the signal (the true differences between the objects of measurement) and noise (all other sources of variation in a measurement).56 Low reliability results in misclassification of hospitals. …","PeriodicalId":22388,"journal":{"name":"The BMJ","volume":"45 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"The BMJ","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1136/bmj-2024-083517","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Richard Lilford and colleagues argue that the UK government’s plans to use performance metrics to reward or punish hospitals risk doing more harm than good Healthcare consumes a lot of resources and various measures have been used to try to ensure they are used efficiently. In the UK, after the government increased investment in health services, the secretary of state for health and social care announced that “NHS England will carry out a review of NHS performance across England with the results made public in league tables”1 and threatened that managers would be sacked if they don’t improve hospital performance.2 The health secretary is advocating using a performance metric that evaluates an organisation as a whole. The use of this type of metric to improve healthcare is neither new nor unique; policy makers often turn to performance management in the form of incentives based on organisation-wide targets or league tables. For example, in the US the Leapfrog group generates a “single letter grade representing a hospital’s overall performance” for nearly 3000 general acute care hospitals,3 and the Centers for Medicare and Medicaid Services measures whole hospital performance using a much criticised star rating system.4 With the announcement of the abolition of NHS England in March 2025, the government clearly intends to take direct control of the NHS and influence NHS organisations through performance metrics coupled with incentives and sanctions. This makes it important to consider the evidence on their accuracy and whether they have their intended effect. The quality of a measurement is defined by its reliability and validity. An unreliable measure has a low ratio between the signal (the true differences between the objects of measurement) and noise (all other sources of variation in a measurement).56 Low reliability results in misclassification of hospitals. …
Richard Lilford和他的同事认为,英国政府计划使用绩效指标来奖励或惩罚医院,这可能弊大于利。医疗保健消耗了大量资源,并采取了各种措施来确保这些资源得到有效利用。在英国,在政府增加了对医疗服务的投资后,卫生和社会保健大臣宣布,“英格兰国家医疗服务体系将对整个英格兰的NHS绩效进行评估,并将结果公布在排行榜上”,并威胁说,如果管理人员不改善医院绩效,他们将被解雇卫生部长提倡使用一种绩效指标来对一个组织进行整体评估。使用这类指标来改善医疗保健既不新鲜也不独特;政策制定者往往转向绩效管理,采取基于全组织目标或排行榜的激励形式。例如,在美国,Leapfrog集团为近3000家普通急症护理医院编制了一个“代表医院整体表现的单个字母等级”,美国医疗保险和医疗补助服务中心(Centers For Medicare and Medicaid Services)使用一种备受批评的星级评级系统来衡量整个医院的表现随着2025年3月英国国家医疗服务体系的宣布废除,政府显然打算直接控制NHS,并通过绩效指标与激励和制裁相结合来影响NHS组织。这就使得我们有必要考虑其准确性的证据,以及它们是否具有预期的效果。测量的质量是由它的信度和效度来定义的。一个不可靠的测量在信号(被测量对象之间的真实差异)和噪声(测量中所有其他变异性的来源)之间的比率很低低信度导致医院误分类。…