Penicillin allergy risk stratification tool for use by non-allergists in the peri-operative setting: an agreement study and qualitative process evaluation.
Priyanthi Dias,Emma Walshaw,Sam Flatau,Eileen O'Grady,Philip M Hopkins,Lene Heise Garvey,Anna Littlejohns,Nikki Rousseau,Rupert M Pearse,Bethany Shinkins,Louise Savic
{"title":"Penicillin allergy risk stratification tool for use by non-allergists in the peri-operative setting: an agreement study and qualitative process evaluation.","authors":"Priyanthi Dias,Emma Walshaw,Sam Flatau,Eileen O'Grady,Philip M Hopkins,Lene Heise Garvey,Anna Littlejohns,Nikki Rousseau,Rupert M Pearse,Bethany Shinkins,Louise Savic","doi":"10.1111/anae.16758","DOIUrl":null,"url":null,"abstract":"INTRODUCTION\r\nMany patients are labelled incorrectly as 'penicillin allergic'. This label is associated with poor health outcomes, regardless of whether the allergy is genuine. We designed a study to assess agreement between allergy specialists (consultant allergists or immunologists) and non-allergists when using a risk stratification tool to determine suitability for a penicillin challenge test.\r\n\r\nMETHODS\r\nIn this two-centre mixed-method study, adult patients undergoing surgery who had been labelled penicillin allergic were assessed by a healthcare professional with no formal allergy training (consultant anaesthetist or peri-operative nurse) and an allergy specialist doctor using the risk stratification tool. Cohen's kappa was used to quantify agreement. We conducted a qualitative process evaluation based on individual and group interviews to explore user experience.\r\n\r\nRESULTS\r\nWe recruited 139 patients and 11 healthcare professionals; 101 patients completed both assessments (median (IQR [range]) age was 53 (40-66 [19-86]) y, 71% women). Allergist and non-allergist assessments agreed for 63 (62%) patients. In the remaining 38 (38%), most disagreements represented an overcautious approach by non-allergists, except in seven patients categorised as unsuitable (or uncertain) by the allergist but suitable by the non-allergist. Inter-rater agreement was moderate (unweighted κ 0.43, 95%CI 0.30-0.57; weighted κ 0.47, 95%CI 0.27-0.67). The prevalence and bias-adjusted score indicated poor inter-rater reliability (κ score 0.25, 95%CI 0.06-0.44). Qualitative analysis indicated low confidence in the tool among non-allergists, with a perceived need for allergy training and specialist support.\r\n\r\nDISCUSSION\r\nThis penicillin allergy risk stratification tool, designed for use by healthcare professionals with no formal allergy training, showed poor agreement with allergy expert assessments.","PeriodicalId":7742,"journal":{"name":"Anaesthesia","volume":"72 1","pages":""},"PeriodicalIF":6.9000,"publicationDate":"2025-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Anaesthesia","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/anae.16758","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ANESTHESIOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
INTRODUCTION
Many patients are labelled incorrectly as 'penicillin allergic'. This label is associated with poor health outcomes, regardless of whether the allergy is genuine. We designed a study to assess agreement between allergy specialists (consultant allergists or immunologists) and non-allergists when using a risk stratification tool to determine suitability for a penicillin challenge test.
METHODS
In this two-centre mixed-method study, adult patients undergoing surgery who had been labelled penicillin allergic were assessed by a healthcare professional with no formal allergy training (consultant anaesthetist or peri-operative nurse) and an allergy specialist doctor using the risk stratification tool. Cohen's kappa was used to quantify agreement. We conducted a qualitative process evaluation based on individual and group interviews to explore user experience.
RESULTS
We recruited 139 patients and 11 healthcare professionals; 101 patients completed both assessments (median (IQR [range]) age was 53 (40-66 [19-86]) y, 71% women). Allergist and non-allergist assessments agreed for 63 (62%) patients. In the remaining 38 (38%), most disagreements represented an overcautious approach by non-allergists, except in seven patients categorised as unsuitable (or uncertain) by the allergist but suitable by the non-allergist. Inter-rater agreement was moderate (unweighted κ 0.43, 95%CI 0.30-0.57; weighted κ 0.47, 95%CI 0.27-0.67). The prevalence and bias-adjusted score indicated poor inter-rater reliability (κ score 0.25, 95%CI 0.06-0.44). Qualitative analysis indicated low confidence in the tool among non-allergists, with a perceived need for allergy training and specialist support.
DISCUSSION
This penicillin allergy risk stratification tool, designed for use by healthcare professionals with no formal allergy training, showed poor agreement with allergy expert assessments.
期刊介绍:
The official journal of the Association of Anaesthetists is Anaesthesia. It is a comprehensive international publication that covers a wide range of topics. The journal focuses on general and regional anaesthesia, as well as intensive care and pain therapy. It includes original articles that have undergone peer review, covering all aspects of these fields, including research on equipment.