A hybrid deep learning framework for early detection of developmental disabilities using speech and behavioral biomarkers

IF 5.3 Q2 COMPUTER SCIENCE, THEORY & METHODS
Array Pub Date : 2026-03-01 Epub Date: 2026-02-06 DOI:10.1016/j.array.2026.100691
Abdullah Al-Saleh , Khalil Hamdi Ateyeh Al-Shqeerat , Ahmad Hamed AL Abadleh , Ashit Kumar Dutta , Ghanshyam G. Tejani , Seyed Jalaleddin Mousavirad
{"title":"A hybrid deep learning framework for early detection of developmental disabilities using speech and behavioral biomarkers","authors":"Abdullah Al-Saleh ,&nbsp;Khalil Hamdi Ateyeh Al-Shqeerat ,&nbsp;Ahmad Hamed AL Abadleh ,&nbsp;Ashit Kumar Dutta ,&nbsp;Ghanshyam G. Tejani ,&nbsp;Seyed Jalaleddin Mousavirad","doi":"10.1016/j.array.2026.100691","DOIUrl":null,"url":null,"abstract":"<div><div>Early and precise recognition of developmental disabilities (DDs) is essential for the timely intervention of preschool-age children. Although various predictive models have been developed in the past, they cannot provide accurate detections and face challenges like high false prediction, limited generalization, etc. To address these issues, a novel artificial intelligence (AI)-based algorithm was proposed for accurate DD detection. The proposed system integrates digital biomarkers from speech and behavioral domains for predicting DDs. Consequently, an Enhanced Gaussian-Based Noise Filtering (EGNF) is applied to speech data, and Z-score normalization is applied to behavioral data for preprocessing, which makes the raw data reliable for subsequent analysis. Further, feature extraction is performed using Convolutional-Bidirectional Long Short-Term Memory (Conv-BiLSTM) for speech data and Graph Attention Network (GAT) for behavioral data. Subsequently, a Hybrid Feature Selection (HFS) method was developed by combining the Harmony Search Algorithm (HSA) and ReliefF ranking for selecting informative and relevant attributes for model training. Finally, a hybrid classification model named DeepSTNet has been developed by integrating MnasNet and Independently Recurrent Neural Networks (IndRNN), which allows the capture of spatial and temporal long-term dependencies within the data, resulting in high detection performances. The proposed framework was implemented in Python and validated using comprehensive data formed by combining the Dysarthria Detection dataset and the Autism Dataset for Toddlers. The execution outcomes highlighted that the developed framework achieved an accuracy of 99.46%, a precision of 97.74%, and a recall of 98.05%, illustrating that this AI-centric system can be equipped by end users, including healthcare professionals and caregivers, with tools for early screening and detection of DDs.</div></div>","PeriodicalId":8417,"journal":{"name":"Array","volume":"29 ","pages":"Article 100691"},"PeriodicalIF":5.3000,"publicationDate":"2026-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Array","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2590005626000147","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/2/6 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"COMPUTER SCIENCE, THEORY & METHODS","Score":null,"Total":0}
引用次数: 0

Abstract

Early and precise recognition of developmental disabilities (DDs) is essential for the timely intervention of preschool-age children. Although various predictive models have been developed in the past, they cannot provide accurate detections and face challenges like high false prediction, limited generalization, etc. To address these issues, a novel artificial intelligence (AI)-based algorithm was proposed for accurate DD detection. The proposed system integrates digital biomarkers from speech and behavioral domains for predicting DDs. Consequently, an Enhanced Gaussian-Based Noise Filtering (EGNF) is applied to speech data, and Z-score normalization is applied to behavioral data for preprocessing, which makes the raw data reliable for subsequent analysis. Further, feature extraction is performed using Convolutional-Bidirectional Long Short-Term Memory (Conv-BiLSTM) for speech data and Graph Attention Network (GAT) for behavioral data. Subsequently, a Hybrid Feature Selection (HFS) method was developed by combining the Harmony Search Algorithm (HSA) and ReliefF ranking for selecting informative and relevant attributes for model training. Finally, a hybrid classification model named DeepSTNet has been developed by integrating MnasNet and Independently Recurrent Neural Networks (IndRNN), which allows the capture of spatial and temporal long-term dependencies within the data, resulting in high detection performances. The proposed framework was implemented in Python and validated using comprehensive data formed by combining the Dysarthria Detection dataset and the Autism Dataset for Toddlers. The execution outcomes highlighted that the developed framework achieved an accuracy of 99.46%, a precision of 97.74%, and a recall of 98.05%, illustrating that this AI-centric system can be equipped by end users, including healthcare professionals and caregivers, with tools for early screening and detection of DDs.
一个混合深度学习框架,用于使用语言和行为生物标志物早期检测发育障碍
早期准确识别发育障碍对于学龄前儿童的及时干预至关重要。虽然过去已经开发了各种预测模型,但它们不能提供准确的检测,并且面临着高假预测和有限泛化等挑战。为了解决这些问题,提出了一种基于人工智能(AI)的DD精确检测算法。该系统集成了语音和行为领域的数字生物标记物,用于预测dd。因此,对语音数据应用增强高斯噪声滤波(Enhanced Gaussian-Based Noise Filtering, EGNF),对行为数据应用Z-score归一化进行预处理,使原始数据为后续分析提供可靠依据。此外,使用卷积-双向长短期记忆(卷积- bilstm)对语音数据进行特征提取,使用图注意网络(GAT)对行为数据进行特征提取。随后,将Harmony Search Algorithm (HSA)和ReliefF排序相结合,提出了一种混合特征选择(Hybrid Feature Selection, HFS)方法,用于选择信息丰富且相关的属性进行模型训练。最后,通过集成MnasNet和独立递归神经网络(IndRNN),开发了一个名为DeepSTNet的混合分类模型,该模型允许捕获数据中的空间和时间长期依赖关系,从而提高检测性能。提出的框架是用Python实现的,并使用结合构音障碍检测数据集和幼儿自闭症数据集形成的综合数据进行验证。执行结果突出表明,开发的框架实现了99.46%的准确率,97.74%的精确度和98.05%的召回率,这表明最终用户(包括医疗保健专业人员和护理人员)可以为这个以人工智能为中心的系统配备早期筛查和检测dd的工具。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Array
Array Computer Science-General Computer Science
CiteScore
4.40
自引率
0.00%
发文量
93
审稿时长
45 days
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书