Mohamed Aboueisha, Zaroug Jaleel, Hans C Baertsch, Cara Sauder, Albert L Merati, Michael M Johns, Neel K Bhatt
{"title":"Inter-rater and Intra-rater Reliability of Glottal Image Capture: A Mobile Application to Quantify Vocal Fold Bowing.","authors":"Mohamed Aboueisha, Zaroug Jaleel, Hans C Baertsch, Cara Sauder, Albert L Merati, Michael M Johns, Neel K Bhatt","doi":"10.1002/lary.31942","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Age-related vocal atrophy (ARVA) causes vocal fold bowing, impacting communication and quality of life. The assessment of vocal fold bowing is largely subjective. Glottal Image Capture (GlottIC) is a new mobile application that helps quantify vocal fold bowing. We aim through this study to assess its reliability, compare it to manual calculation method, and compare differences between visual-perceptual bowing severity ratings.</p><p><strong>Methods: </strong>Ten raters independently quantified Bowing Index (BI) using GlottIC from 10 videostroboscopic images among individuals with ARVA. There was 100% duplication of images to facilitate intra-rater reliability analyses using Pearson's correlation. Inter-rater reliability was quantified using Intraclass Correlation Coefficient (ICC) for experienced and novice raters. The correlation between manual calculations using ImageJ and GlottIC was analyzed.</p><p><strong>Results: </strong>The intra-rater reliability for total BI was strong (r = 0.822, p < 0.001). The inter-rater reliability for BI, calculated using ICC, was (ICC = 0.720; 95% CI: 0.579-0.852), indicating good consistency among the raters. Experts had higher ICC (ICC = 0.808; 95% CI: 0.678-0.906) compared to novice raters (ICC = 0.651; 95% CI: 0.468-0.816). There was a positive correlation between GlottIC and manual BI (r = 0.811, p < 0.001). As the BI increased, the bowing severity, based on visual-perceptual ratings, also increased (p < 0.001).</p><p><strong>Conclusion: </strong>GlottIC is a reliable mobile application that can quantify vocal fold bowing in patients with ARVA with high intra- and inter-rater reliability. GlottIC BI measurments are highly correlated with manual BI and visual-perceptual ratings of bowing severity. Further improvements in reliability may be achieved with more robust rater training and automated technologies.</p><p><strong>Level of evidence: </strong>Level 3 Laryngoscope, 2024.</p>","PeriodicalId":49921,"journal":{"name":"Laryngoscope","volume":" ","pages":""},"PeriodicalIF":2.2000,"publicationDate":"2024-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Laryngoscope","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1002/lary.31942","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MEDICINE, RESEARCH & EXPERIMENTAL","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Age-related vocal atrophy (ARVA) causes vocal fold bowing, impacting communication and quality of life. The assessment of vocal fold bowing is largely subjective. Glottal Image Capture (GlottIC) is a new mobile application that helps quantify vocal fold bowing. We aim through this study to assess its reliability, compare it to manual calculation method, and compare differences between visual-perceptual bowing severity ratings.
Methods: Ten raters independently quantified Bowing Index (BI) using GlottIC from 10 videostroboscopic images among individuals with ARVA. There was 100% duplication of images to facilitate intra-rater reliability analyses using Pearson's correlation. Inter-rater reliability was quantified using Intraclass Correlation Coefficient (ICC) for experienced and novice raters. The correlation between manual calculations using ImageJ and GlottIC was analyzed.
Results: The intra-rater reliability for total BI was strong (r = 0.822, p < 0.001). The inter-rater reliability for BI, calculated using ICC, was (ICC = 0.720; 95% CI: 0.579-0.852), indicating good consistency among the raters. Experts had higher ICC (ICC = 0.808; 95% CI: 0.678-0.906) compared to novice raters (ICC = 0.651; 95% CI: 0.468-0.816). There was a positive correlation between GlottIC and manual BI (r = 0.811, p < 0.001). As the BI increased, the bowing severity, based on visual-perceptual ratings, also increased (p < 0.001).
Conclusion: GlottIC is a reliable mobile application that can quantify vocal fold bowing in patients with ARVA with high intra- and inter-rater reliability. GlottIC BI measurments are highly correlated with manual BI and visual-perceptual ratings of bowing severity. Further improvements in reliability may be achieved with more robust rater training and automated technologies.
期刊介绍：
The Laryngoscope has been the leading source of information on advances in the diagnosis and treatment of head and neck disorders since 1890. The Laryngoscope is the first choice among otolaryngologists for publication of their important findings and techniques. Each monthly issue of The Laryngoscope features peer-reviewed medical, clinical, and research contributions in general otolaryngology, allergy/rhinology, otology/neurotology, laryngology/bronchoesophagology, head and neck surgery, sleep medicine, pediatric otolaryngology, facial plastics and reconstructive surgery, oncology, and communicative disorders. Contributions include papers and posters presented at the Annual and Section Meetings of the Triological Society, as well as independent papers, "How I Do It", "Triological Best Practice" articles, and contemporary reviews. Theses authored by the Triological Society’s new Fellows as well as papers presented at meetings of the American Laryngological Association are published in The Laryngoscope.
• Broncho-esophagology
• Communicative disorders
• Head and neck surgery
• Plastic and reconstructive facial surgery
• Oncology
• Speech and hearing defects
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
