Jinyue Liu , Xiong Tan , Xiaohui Jia , Tiejun Li , Wei Li
{"title":"基于多传感器融合的越障步态相位识别方法","authors":"Jinyue Liu , Xiong Tan , Xiaohui Jia , Tiejun Li , Wei Li","doi":"10.1016/j.sna.2024.115645","DOIUrl":null,"url":null,"abstract":"<div><p>The analysis of human motion patterns and gait phase detection holds significant importance for both human motion analysis and precise control of exoskeleton devices. Presently, research on gait during obstacle crossing primarily focuses on the medical rehabilitation domain, with limited studies concerning gait phase analysis during obstacle crossing. This study conducts a detailed analysis of gait data during obstacle crossing and proposes a CNN-PCA-LSTM algorithm that fuses multi-sensor data to accurately identify gait phases when crossing obstacles in the horizontal direction. A wearable multi-sensor data acquisition system was designed, utilizing flexible capacitive pressure sensors to collect pressure data from the soles of both feet and IMUs to gather foot motion data. Kinematic simulation analyses of human obstacle-crossing motions were performed using Anybody software to determine various gait phases, validating the efficacy of the simulation model. Subsequently, one-dimensional and two-dimensional convolutional neural networks were separately employed to extract features from sole pressure data and foot motion data. Principal Component Analysis (PCA) was utilized to reduce the dimensionality of these feature datasets, which were then inputted into LSTM networks. Finally, the Softmax function was employed for the classification and recognition of gait phases when crossing obstacles in the horizontal direction. The experimental results indicate that employing the CNN-PCA-LSTM algorithm integrating multiple sensor data achieves a recognition accuracy of 97.91 % for identifying gait phases during horizontal obstacle crossing.</p></div>","PeriodicalId":21689,"journal":{"name":"Sensors and Actuators A-physical","volume":null,"pages":null},"PeriodicalIF":4.1000,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A gait phase recognition method for obstacle crossing based on multi-sensor fusion\",\"authors\":\"Jinyue Liu , Xiong Tan , Xiaohui Jia , Tiejun Li , Wei Li\",\"doi\":\"10.1016/j.sna.2024.115645\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>The analysis of human motion patterns and gait phase detection holds significant importance for both human motion analysis and precise control of exoskeleton devices. Presently, research on gait during obstacle crossing primarily focuses on the medical rehabilitation domain, with limited studies concerning gait phase analysis during obstacle crossing. This study conducts a detailed analysis of gait data during obstacle crossing and proposes a CNN-PCA-LSTM algorithm that fuses multi-sensor data to accurately identify gait phases when crossing obstacles in the horizontal direction. A wearable multi-sensor data acquisition system was designed, utilizing flexible capacitive pressure sensors to collect pressure data from the soles of both feet and IMUs to gather foot motion data. Kinematic simulation analyses of human obstacle-crossing motions were performed using Anybody software to determine various gait phases, validating the efficacy of the simulation model. Subsequently, one-dimensional and two-dimensional convolutional neural networks were separately employed to extract features from sole pressure data and foot motion data. Principal Component Analysis (PCA) was utilized to reduce the dimensionality of these feature datasets, which were then inputted into LSTM networks. Finally, the Softmax function was employed for the classification and recognition of gait phases when crossing obstacles in the horizontal direction. The experimental results indicate that employing the CNN-PCA-LSTM algorithm integrating multiple sensor data achieves a recognition accuracy of 97.91 % for identifying gait phases during horizontal obstacle crossing.</p></div>\",\"PeriodicalId\":21689,\"journal\":{\"name\":\"Sensors and Actuators A-physical\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.1000,\"publicationDate\":\"2024-07-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Sensors and Actuators A-physical\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0924424724006393\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Sensors and Actuators A-physical","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0924424724006393","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
A gait phase recognition method for obstacle crossing based on multi-sensor fusion
The analysis of human motion patterns and gait phase detection holds significant importance for both human motion analysis and precise control of exoskeleton devices. Presently, research on gait during obstacle crossing primarily focuses on the medical rehabilitation domain, with limited studies concerning gait phase analysis during obstacle crossing. This study conducts a detailed analysis of gait data during obstacle crossing and proposes a CNN-PCA-LSTM algorithm that fuses multi-sensor data to accurately identify gait phases when crossing obstacles in the horizontal direction. A wearable multi-sensor data acquisition system was designed, utilizing flexible capacitive pressure sensors to collect pressure data from the soles of both feet and IMUs to gather foot motion data. Kinematic simulation analyses of human obstacle-crossing motions were performed using Anybody software to determine various gait phases, validating the efficacy of the simulation model. Subsequently, one-dimensional and two-dimensional convolutional neural networks were separately employed to extract features from sole pressure data and foot motion data. Principal Component Analysis (PCA) was utilized to reduce the dimensionality of these feature datasets, which were then inputted into LSTM networks. Finally, the Softmax function was employed for the classification and recognition of gait phases when crossing obstacles in the horizontal direction. The experimental results indicate that employing the CNN-PCA-LSTM algorithm integrating multiple sensor data achieves a recognition accuracy of 97.91 % for identifying gait phases during horizontal obstacle crossing.
期刊介绍:
Sensors and Actuators A: Physical brings together multidisciplinary interests in one journal entirely devoted to disseminating information on all aspects of research and development of solid-state devices for transducing physical signals. Sensors and Actuators A: Physical regularly publishes original papers, letters to the Editors and from time to time invited review articles within the following device areas:
• Fundamentals and Physics, such as: classification of effects, physical effects, measurement theory, modelling of sensors, measurement standards, measurement errors, units and constants, time and frequency measurement. Modeling papers should bring new modeling techniques to the field and be supported by experimental results.
• Materials and their Processing, such as: piezoelectric materials, polymers, metal oxides, III-V and II-VI semiconductors, thick and thin films, optical glass fibres, amorphous, polycrystalline and monocrystalline silicon.
• Optoelectronic sensors, such as: photovoltaic diodes, photoconductors, photodiodes, phototransistors, positron-sensitive photodetectors, optoisolators, photodiode arrays, charge-coupled devices, light-emitting diodes, injection lasers and liquid-crystal displays.
• Mechanical sensors, such as: metallic, thin-film and semiconductor strain gauges, diffused silicon pressure sensors, silicon accelerometers, solid-state displacement transducers, piezo junction devices, piezoelectric field-effect transducers (PiFETs), tunnel-diode strain sensors, surface acoustic wave devices, silicon micromechanical switches, solid-state flow meters and electronic flow controllers.
Etc...