Melissa Heufel, Sarah Kourouche, Rebecca Mitchell, Magnolia Cardona, Benjamin Thomas, Wing-Shan Angela Lo, Marghie Murgo, Debbie Vergan, Kate Curtis
{"title":"Development of an Audit Tool to Evaluate End of Life Care in the Emergency Department: A Face and Content Validity Study","authors":"Melissa Heufel, Sarah Kourouche, Rebecca Mitchell, Magnolia Cardona, Benjamin Thomas, Wing-Shan Angela Lo, Marghie Murgo, Debbie Vergan, Kate Curtis","doi":"10.1111/jep.70041","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Objectives</h3>\n \n <p>Emergency Departments (ED) are increasingly caring for patients with acute, chronic and terminal conditions requiring End of Life Care (EOLC). There is no published and validated tool available to evaluate EOLC delivery of patients dying in the ED. This study describes the face and content validity testing process to develop, refine and test a new and unique audit tool to evaluate EOLC in the ED.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>The face and content validation process used a three-round modified-Delphi technique. We consulted 11 experts to assess the proposed 89 items. Face validity explored the overall question of appropriateness and relevance; and content validity examined relevance ratings using the Content Validity Index (CVI) 4-point Likert scale in two rounds. Iterative assessment of ratings led to inclusion (CVI > 0.78), revision (CVI 0.65 to < 0.78) or exclusion (CVI < 0.65) of items from the tool.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>Of the initial 89 items, 66 were included (CVI > 0.78), 16 items revised (scores 0.65 to < 0.78), seven were removed (scores < 0.65) and two new items suggested. Items covered the constructs patient characteristics, circumstances of death, ED performance, communication and care planning, recognition of dying, care delivery, and needs of families and carers. Scale CVI achieved 0.90. The consolidated list of 81 items achieved acceptable face validity and excellent content validity.</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>Face and content validity of the ED EOLC audit tool achieved acceptable item-CVI scores and an excellent scale-CVI score. We recommend external validation of its components in real-life settings to monitor and set locally relevant clinical practice benchmarks.</p>\n </section>\n </div>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":"31 1","pages":""},"PeriodicalIF":2.1000,"publicationDate":"2025-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jep.70041","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of evaluation in clinical practice","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/jep.70041","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Objectives
Emergency Departments (ED) are increasingly caring for patients with acute, chronic and terminal conditions requiring End of Life Care (EOLC). There is no published and validated tool available to evaluate EOLC delivery of patients dying in the ED. This study describes the face and content validity testing process to develop, refine and test a new and unique audit tool to evaluate EOLC in the ED.
Methods
The face and content validation process used a three-round modified-Delphi technique. We consulted 11 experts to assess the proposed 89 items. Face validity explored the overall question of appropriateness and relevance; and content validity examined relevance ratings using the Content Validity Index (CVI) 4-point Likert scale in two rounds. Iterative assessment of ratings led to inclusion (CVI > 0.78), revision (CVI 0.65 to < 0.78) or exclusion (CVI < 0.65) of items from the tool.
Results
Of the initial 89 items, 66 were included (CVI > 0.78), 16 items revised (scores 0.65 to < 0.78), seven were removed (scores < 0.65) and two new items suggested. Items covered the constructs patient characteristics, circumstances of death, ED performance, communication and care planning, recognition of dying, care delivery, and needs of families and carers. Scale CVI achieved 0.90. The consolidated list of 81 items achieved acceptable face validity and excellent content validity.
Conclusion
Face and content validity of the ED EOLC audit tool achieved acceptable item-CVI scores and an excellent scale-CVI score. We recommend external validation of its components in real-life settings to monitor and set locally relevant clinical practice benchmarks.
期刊介绍:
The Journal of Evaluation in Clinical Practice aims to promote the evaluation and development of clinical practice across medicine, nursing and the allied health professions. All aspects of health services research and public health policy analysis and debate are of interest to the Journal whether studied from a population-based or individual patient-centred perspective. Of particular interest to the Journal are submissions on all aspects of clinical effectiveness and efficiency including evidence-based medicine, clinical practice guidelines, clinical decision making, clinical services organisation, implementation and delivery, health economic evaluation, health process and outcome measurement and new or improved methods (conceptual and statistical) for systematic inquiry into clinical practice. Papers may take a classical quantitative or qualitative approach to investigation (or may utilise both techniques) or may take the form of learned essays, structured/systematic reviews and critiques.