Merertu Kitila, James C Borders, Gintas P Krisciunas, Edel McNally, Jessica M Pisegna
{"title":"Confidence, Accuracy, and Reliability of Penetration-Aspiration Scale Ratings on Flexible Endoscopic Evaluations of Swallowing by Speech Pathologists.","authors":"Merertu Kitila, James C Borders, Gintas P Krisciunas, Edel McNally, Jessica M Pisegna","doi":"10.1007/s00455-023-10635-5","DOIUrl":null,"url":null,"abstract":"<p><p>This study investigated rater confidence when rating airway invasion with the penetration-aspiration scale (PAS) on flexible endoscopic evaluations of swallowing (FEES), raters' accuracy against a referent-standard, inter-rater reliability, and potential associations between clinician confidence, experience, and accuracy. Thirty-one clinicians who use FEES in their daily practice were asked to judge airway invasion with the PAS and to rate their confidence that their score was correct (0-100) for 40 video clips, five in each of the 8 PAS categories. We found that raters were most confident in rating PAS 1, 7, and 8. The average confidence score across all videos was 76/100. Confidence did not have a significant relationship with accuracy against the referent-standard. Accuracy was highest for PAS 1 (92%), followed by PAS 8 (80%), PAS 7 (77%), and PAS 4 (72%). Accuracy was below 60% for PAS 2, 3, 5, and 6, the lowest being for PAS 3 (49%). Mean accuracy for all ratings, compared to referent-standard ratings, was highest for the intermediate group (71%), followed by expert (68%) and novice (65%). In general, we found that certain PAS scores tend to be rated more accurately, and that participating SLPs had varied confidence in PAS ratings on FEES. Potential reasons for these findings as well as suggested next steps are discussed.</p>","PeriodicalId":11508,"journal":{"name":"Dysphagia","volume":null,"pages":null},"PeriodicalIF":2.2000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Dysphagia","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00455-023-10635-5","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/11/19 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"OTORHINOLARYNGOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
This study investigated rater confidence when rating airway invasion with the penetration-aspiration scale (PAS) on flexible endoscopic evaluations of swallowing (FEES), raters' accuracy against a referent-standard, inter-rater reliability, and potential associations between clinician confidence, experience, and accuracy. Thirty-one clinicians who use FEES in their daily practice were asked to judge airway invasion with the PAS and to rate their confidence that their score was correct (0-100) for 40 video clips, five in each of the 8 PAS categories. We found that raters were most confident in rating PAS 1, 7, and 8. The average confidence score across all videos was 76/100. Confidence did not have a significant relationship with accuracy against the referent-standard. Accuracy was highest for PAS 1 (92%), followed by PAS 8 (80%), PAS 7 (77%), and PAS 4 (72%). Accuracy was below 60% for PAS 2, 3, 5, and 6, the lowest being for PAS 3 (49%). Mean accuracy for all ratings, compared to referent-standard ratings, was highest for the intermediate group (71%), followed by expert (68%) and novice (65%). In general, we found that certain PAS scores tend to be rated more accurately, and that participating SLPs had varied confidence in PAS ratings on FEES. Potential reasons for these findings as well as suggested next steps are discussed.
期刊介绍:
Dysphagia aims to serve as a voice for the benefit of the patient. The journal is devoted exclusively to swallowing and its disorders. The purpose of the journal is to provide a source of information to the flourishing dysphagia community. Over the past years, the field of dysphagia has grown rapidly, and the community of dysphagia researchers have galvanized with ambition to represent dysphagia patients. In addition to covering a myriad of disciplines in medicine and speech pathology, the following topics are also covered, but are not limited to: bio-engineering, deglutition, esophageal motility, immunology, and neuro-gastroenterology. The journal aims to foster a growing need for further dysphagia investigation, to disseminate knowledge through research, and to stimulate communication among interested professionals. The journal publishes original papers, technical and instrumental notes, letters to the editor, and review articles.