{"title":"Harnessing Multimodal Data and Deep Learning for Comprehensive Gait Analysis in Pediatric Cerebral Palsy","authors":"Jing Yang;Liangyu Li;Lip Yee Por;Sami Bourouis;Sami Dhahbi;Abdullah Ayub Khan","doi":"10.1109/TCE.2024.3482689","DOIUrl":null,"url":null,"abstract":"Cerebral palsy (CP) is a leading cause of motor dysfunction in children, significantly impacting gait and mobility. Accurate and early diagnosis of gait abnormalities in pediatric CP patients is crucial for effective intervention and management. However, making an early-stage CP diagnosis based only on a single vision modality such as an MRI has many difficulties. Because of the baby’s obstinate movements, the possibility of early recovery, the lack of a single vision modality, and the noisy or absent brain magnetic resonance imaging (MRI) slices, the task is getting harder and harder. This study employed a robust framework that leverages data from multiple sensor modalities, including wearable inertial measurement units (IMUs), pressure-sensitive mats, and motion capture systems integrated with MRI to generate multimodal data. This multimodal data was then processed using convolutional neural networks (CNNs) and long short-term memory (LSTM) networks to capture both spatial and temporal dynamics of gait patterns. In the experimentation, we achieved remarkable results with an accuracy of 95.33%, an AUC of 96.2%, an F1 score of 95.28%, and a misclassification rate of 0.0467. Also, the comparative analysis with state-of-the-art demonstrates that the proposed approach significantly outperforms traditional methods in identifying subtle gait abnormalities, providing a more detailed and accurate assessment of gait deviations in pediatric cerebral palsy patients.","PeriodicalId":13208,"journal":{"name":"IEEE Transactions on Consumer Electronics","volume":"70 3","pages":"5401-5410"},"PeriodicalIF":4.3000,"publicationDate":"2024-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Consumer Electronics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10720788/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Cerebral palsy (CP) is a leading cause of motor dysfunction in children, significantly impacting gait and mobility. Accurate and early diagnosis of gait abnormalities in pediatric CP patients is crucial for effective intervention and management. However, making an early-stage CP diagnosis based only on a single vision modality such as an MRI has many difficulties. Because of the baby’s obstinate movements, the possibility of early recovery, the lack of a single vision modality, and the noisy or absent brain magnetic resonance imaging (MRI) slices, the task is getting harder and harder. This study employed a robust framework that leverages data from multiple sensor modalities, including wearable inertial measurement units (IMUs), pressure-sensitive mats, and motion capture systems integrated with MRI to generate multimodal data. This multimodal data was then processed using convolutional neural networks (CNNs) and long short-term memory (LSTM) networks to capture both spatial and temporal dynamics of gait patterns. In the experimentation, we achieved remarkable results with an accuracy of 95.33%, an AUC of 96.2%, an F1 score of 95.28%, and a misclassification rate of 0.0467. Also, the comparative analysis with state-of-the-art demonstrates that the proposed approach significantly outperforms traditional methods in identifying subtle gait abnormalities, providing a more detailed and accurate assessment of gait deviations in pediatric cerebral palsy patients.
期刊介绍:
The main focus for the IEEE Transactions on Consumer Electronics is the engineering and research aspects of the theory, design, construction, manufacture or end use of mass market electronics, systems, software and services for consumers.