Validating Smartphone-Based and Web-Based Applications for Remote Hearing Assessment.

IF 1 4区 医学 Q3 AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY
Boaz Mui, De Wet Swanepoel, Vinaya Manchaiah, Jameel Muzaffar, Niranjan Bidargaddi, Giriraj Singh Shekhawat
{"title":"Validating Smartphone-Based and Web-Based Applications for Remote Hearing Assessment.","authors":"Boaz Mui, De Wet Swanepoel, Vinaya Manchaiah, Jameel Muzaffar, Niranjan Bidargaddi, Giriraj Singh Shekhawat","doi":"10.3766/jaaa.240055","DOIUrl":null,"url":null,"abstract":"<p><p><b>Background:</b> High prevalence of hearing loss and its physical, mental, and social impacts when unaddressedunderscore a need for early identification. However, in-person hearing assessment may beinaccessible in certain countries and areas. As such, numerous smartphone-based and web-basedapplications (apps) have been developed to perform remote hearing assessment, and yet many ofthem remain unvalidated.<br /><b>Purpose:</b> The purpose of this study was to evaluate the performance, ecological validity, and usabilityof two freely available smartphone-based hearing assessment apps-Hearing Test (Android) and MimiHearing Test (iOS)-alongside a web-based app, MDHearing Aid.<br /><b>Research Design:</b> This is a cross-sectional validation study.<br /><b>Study Sample:</b> This study included 60 adults with hearing thresholds no greater than 20 dB HL or anydegree of sensorineural hearing loss.<br /><b>Data Collection and Analysis:</b> Participants completed standard audiometric testing followed byassessments using three apps in a controlled laboratory setting. The assessments were repeated byparticipants at home the subsequent day. The mHealth App Usability Questionnaire (MAUQ) wasadministered to evaluate the apps' usability. Performance metrics included sensitivity, specificity, accuracy,and test-retest reliability. Intraclass correlation coefficient (ICC) estimates were calculated tomeasure the apps' accuracy, test-retest reliability, and ecological validity.<br /><b>Results:</b> All apps had moderate to good sensitivity (0.67-1.00) and specificity (0.72-0.99). The HearingTest app showed poor accuracy at lower frequencies (ICC: 0.24-0.53) and moderate to good accuracy above 1000 Hz (ICC: 0.74-0.83). The Mimi Hearing Test showed poor accuracy at lower frequencies(ICC: 0.27-0.50) and moderate to good accuracy above 2000 Hz (ICC: 0.68-0.85). The web-basedMDHearing Aid test showed moderate to good accuracy across frequencies (ICC: 0.64-0.85). All appshad moderate to excellent test-retest reliability (ICC: 0.66-0.99) and showed poor ecological validity below500 Hz (ICC: 0.20-0.51) and moderate to excellent ecological validity above 1000 Hz (ICC: 0.54-0.95).Usability was rated highly across all apps, with MAUQ scores ranging from 5.4 to 5.9 out of 7.<br /><b>Conclusions:</b> The examined apps exhibit varied accuracy levels and generally reasonable sensitivity,specificity, test-retest reliability, ecological validity, and usability. With additional validation, the HearingTest app may be useful for hearing screening and monitoring in adults. There is a necessity for furtherresearch to unlock the examined apps' full clinical potential.</p>","PeriodicalId":50021,"journal":{"name":"Journal of the American Academy of Audiology","volume":" ","pages":""},"PeriodicalIF":1.0000,"publicationDate":"2025-03-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the American Academy of Audiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3766/jaaa.240055","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Background: High prevalence of hearing loss and its physical, mental, and social impacts when unaddressedunderscore a need for early identification. However, in-person hearing assessment may beinaccessible in certain countries and areas. As such, numerous smartphone-based and web-basedapplications (apps) have been developed to perform remote hearing assessment, and yet many ofthem remain unvalidated.
Purpose: The purpose of this study was to evaluate the performance, ecological validity, and usabilityof two freely available smartphone-based hearing assessment apps-Hearing Test (Android) and MimiHearing Test (iOS)-alongside a web-based app, MDHearing Aid.
Research Design: This is a cross-sectional validation study.
Study Sample: This study included 60 adults with hearing thresholds no greater than 20 dB HL or anydegree of sensorineural hearing loss.
Data Collection and Analysis: Participants completed standard audiometric testing followed byassessments using three apps in a controlled laboratory setting. The assessments were repeated byparticipants at home the subsequent day. The mHealth App Usability Questionnaire (MAUQ) wasadministered to evaluate the apps' usability. Performance metrics included sensitivity, specificity, accuracy,and test-retest reliability. Intraclass correlation coefficient (ICC) estimates were calculated tomeasure the apps' accuracy, test-retest reliability, and ecological validity.
Results: All apps had moderate to good sensitivity (0.67-1.00) and specificity (0.72-0.99). The HearingTest app showed poor accuracy at lower frequencies (ICC: 0.24-0.53) and moderate to good accuracy above 1000 Hz (ICC: 0.74-0.83). The Mimi Hearing Test showed poor accuracy at lower frequencies(ICC: 0.27-0.50) and moderate to good accuracy above 2000 Hz (ICC: 0.68-0.85). The web-basedMDHearing Aid test showed moderate to good accuracy across frequencies (ICC: 0.64-0.85). All appshad moderate to excellent test-retest reliability (ICC: 0.66-0.99) and showed poor ecological validity below500 Hz (ICC: 0.20-0.51) and moderate to excellent ecological validity above 1000 Hz (ICC: 0.54-0.95).Usability was rated highly across all apps, with MAUQ scores ranging from 5.4 to 5.9 out of 7.
Conclusions: The examined apps exhibit varied accuracy levels and generally reasonable sensitivity,specificity, test-retest reliability, ecological validity, and usability. With additional validation, the HearingTest app may be useful for hearing screening and monitoring in adults. There is a necessity for furtherresearch to unlock the examined apps' full clinical potential.

验证基于智能手机和基于网络的远程听力评估应用。
背景:听力损失的高患病率及其未得到解决的身体、精神和社会影响强调了早期识别的必要性。然而,在某些国家和地区可能无法进行面对面的听力评估。因此,已经开发了许多基于智能手机和网络的应用程序来进行远程听力评估,但其中许多应用程序仍未经验证。目的:本研究的目的是评估两种免费的基于智能手机的听力评估应用程序——听力测试(Android)和MimiHearing Test (iOS)——以及基于网络的应用程序MDHearing Aid的性能、生态效度和可用性。研究设计:这是一项横断面验证研究。研究样本:本研究包括60名听力阈值不大于20db HL或任何程度的感音神经性听力损失的成年人。数据收集和分析:参与者完成了标准的听力测试,然后在受控的实验室环境中使用三个应用程序进行评估。第二天,参与者在家中重复了这些评估。使用移动健康应用可用性问卷(MAUQ)来评估应用的可用性。性能指标包括敏感性、特异性、准确性和重测信度。计算类内相关系数(ICC)估计值来衡量应用程序的准确性、重测信度和生态效度。结果:所有app均具有中高灵敏度(0.67 ~ 1.00)和特异度(0.72 ~ 0.99)。HearingTest应用程序在较低频率下的准确性较差(ICC: 0.24-0.53),在1000 Hz以上的准确性中等至良好(ICC: 0.74-0.83)。Mimi听力测试显示较低频率的准确性较差(ICC: 0.27-0.50), 2000 Hz以上的准确性中等至良好(ICC: 0.68-0.85)。基于网络的md助听器测试显示出中等到良好的频率准确性(ICC: 0.64-0.85)。所有应用的重测信度均为中优(0.66 ~ 0.99),500 Hz以下的生态效度较差(0.20 ~ 0.51),1000 Hz以上的生态效度为中优(0.54 ~ 0.95)。所有应用的可用性都得到了很高的评价,MAUQ得分在5.4到5.9之间(满分7分)。结论:被检测的应用程序表现出不同的准确性水平,总体上合理的敏感性、特异性、重测信度、生态效度和可用性。经过额外的验证,HearingTest应用程序可能对成年人的听力筛查和监测有用。有必要进行进一步的研究,以释放被检测应用程序的全部临床潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
3.10
自引率
0.00%
发文量
46
审稿时长
6-12 weeks
期刊介绍: The Journal of the American Academy of Audiology (JAAA) is the Academy''s scholarly peer-reviewed publication, issued 10 times per year and available to Academy members as a benefit of membership. The JAAA publishes articles and clinical reports in all areas of audiology, including audiological assessment, amplification, aural habilitation and rehabilitation, auditory electrophysiology, vestibular assessment, and hearing science.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信