C.J. Cabilan , Robert Eley , Centaine Snoswell , Andrew T. Jones , Amy N.B. Johnston
{"title":"Inter-rater reliability of the occupational violence risk assessment tool for emergency departments","authors":"C.J. Cabilan , Robert Eley , Centaine Snoswell , Andrew T. Jones , Amy N.B. Johnston","doi":"10.1016/j.auec.2022.07.007","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>The three-item occupational violence (OV) risk assessment tool was developed and validated for use in emergency departments (EDs). It prompts review of each patient’s aggression history, behaviours, and clinical presentation. However, confidence around representativeness and generalisability are needed before widescale adoption; hence we measured the inter-rater reliability of the tool among a large group of emergency nurses.</p></div><div><h3>Methods</h3><p>A cross-sectional study was conducted between Sep 2021 and Jan 2022. Nurses were directed to a website that hosted an e-learning module about the tool. They were asked to apply the tool to two video scenarios of typical patient presentations. Demographic data, including years of emergency experience, were collected to contextualise their responses. Gwet’s Agreement Coefficients (AC1) were calculated to determine inter-rater reliability.</p></div><div><h3>Results</h3><p>There were 135 participants: typically female, under the age of 40 years, with more than 3 years of emergency nursing experience. Overall, there was excellent inter-rater agreement (AC1 =0.752, p = 0.001). This was consistent when years of ED experience was stratified: 0–2 years, AC1 = 0.764, p = 0.002; 3–5 years, AC1 = 0.826, p = 0.001; 6–10 years, AC1 = 0.751, p < 0.001; 11–15 years, AC1 = 0.659, p = 0.004; ≥ 16 years, AC1 = 0.799, p < 0.001.</p></div><div><h3>Conclusion</h3><p>The three-item OV risk assessment tool has excellent inter-rater reliability across a large sample of emergency nurses.</p></div>","PeriodicalId":55979,"journal":{"name":"Australasian Emergency Care","volume":null,"pages":null},"PeriodicalIF":2.1000,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Australasian Emergency Care","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2588994X22000501","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EMERGENCY MEDICINE","Score":null,"Total":0}
引用次数: 3
Abstract
Background
The three-item occupational violence (OV) risk assessment tool was developed and validated for use in emergency departments (EDs). It prompts review of each patient’s aggression history, behaviours, and clinical presentation. However, confidence around representativeness and generalisability are needed before widescale adoption; hence we measured the inter-rater reliability of the tool among a large group of emergency nurses.
Methods
A cross-sectional study was conducted between Sep 2021 and Jan 2022. Nurses were directed to a website that hosted an e-learning module about the tool. They were asked to apply the tool to two video scenarios of typical patient presentations. Demographic data, including years of emergency experience, were collected to contextualise their responses. Gwet’s Agreement Coefficients (AC1) were calculated to determine inter-rater reliability.
Results
There were 135 participants: typically female, under the age of 40 years, with more than 3 years of emergency nursing experience. Overall, there was excellent inter-rater agreement (AC1 =0.752, p = 0.001). This was consistent when years of ED experience was stratified: 0–2 years, AC1 = 0.764, p = 0.002; 3–5 years, AC1 = 0.826, p = 0.001; 6–10 years, AC1 = 0.751, p < 0.001; 11–15 years, AC1 = 0.659, p = 0.004; ≥ 16 years, AC1 = 0.799, p < 0.001.
Conclusion
The three-item OV risk assessment tool has excellent inter-rater reliability across a large sample of emergency nurses.
期刊介绍:
Australasian Emergency Care is an international peer-reviewed journal dedicated to supporting emergency nurses, physicians, paramedics and other professionals in advancing the science and practice of emergency care, wherever it is delivered. As the official journal of the College of Emergency Nursing Australasia (CENA), Australasian Emergency Care is a conduit for clinical, applied, and theoretical research and knowledge that advances the science and practice of emergency care in original, innovative and challenging ways. The journal serves as a leading voice for the emergency care community, reflecting its inter-professional diversity, and the importance of collaboration and shared decision-making to achieve quality patient outcomes. It is strongly focussed on advancing the patient experience and quality of care across the emergency care continuum, spanning the pre-hospital, hospital and post-hospital settings within Australasia and beyond.