Intelligent 3D garment system of the human body based on deep spiking neural network

Q1 Computer Science
Minghua Jiang , Zhangyuan Tian , Chenyu Yu , Yankang Shi , Li Liu , Tao Peng , Xinrong Hu , Feng Yu
{"title":"Intelligent 3D garment system of the human body based on deep spiking neural network","authors":"Minghua Jiang ,&nbsp;Zhangyuan Tian ,&nbsp;Chenyu Yu ,&nbsp;Yankang Shi ,&nbsp;Li Liu ,&nbsp;Tao Peng ,&nbsp;Xinrong Hu ,&nbsp;Feng Yu","doi":"10.1016/j.vrih.2023.07.002","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>Intelligent garments, a burgeoning class of wearable devices, have extensive applications in domains such as sports training and medical rehabilitation. Nonetheless, existing research in the smart wearables domain predominantly emphasizes sensor functionality and quantity, often skipping crucial aspects related to user experience and interaction.</p></div><div><h3>Methods</h3><p>To address this gap, this study introduces a novel real-time 3D interactive system based on intelligent garments. The system utilizes lightweight sensor modules to collect human motion data and introduces a dual-stream fusion network based on pulsed neural units to classify and recognize human movements, thereby achieving real-time interaction between users and sensors. Additionally, the system in- corporates 3D human visualization functionality, which visualizes sensor data and recognizes human actions as 3D models in realtime, providing accurate and comprehensive visual feedback to help users better understand and analyze the details and features of human motion. This system has significant potential for applications in motion detection, medical monitoring, virtual reality, and other fields. The accurate classification of human actions con- tributes to the development of personalized training plans and injury prevention strategies.</p></div><div><h3>Conclusions</h3><p>This study has substantial implications in the domains of intelligent garments, human motion monitoring, and digital twin visualization. The advancement of this system is expected to propel the progress of wearable technology and foster a deeper comprehension of human motion.</p></div>","PeriodicalId":33538,"journal":{"name":"Virtual Reality Intelligent Hardware","volume":"6 1","pages":"Pages 43-55"},"PeriodicalIF":0.0000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S209657962300044X/pdf?md5=934866992a1e420fa2627cab1a89561d&pid=1-s2.0-S209657962300044X-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Virtual Reality Intelligent Hardware","FirstCategoryId":"1093","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S209657962300044X","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Computer Science","Score":null,"Total":0}
引用次数: 0

Abstract

Background

Intelligent garments, a burgeoning class of wearable devices, have extensive applications in domains such as sports training and medical rehabilitation. Nonetheless, existing research in the smart wearables domain predominantly emphasizes sensor functionality and quantity, often skipping crucial aspects related to user experience and interaction.

Methods

To address this gap, this study introduces a novel real-time 3D interactive system based on intelligent garments. The system utilizes lightweight sensor modules to collect human motion data and introduces a dual-stream fusion network based on pulsed neural units to classify and recognize human movements, thereby achieving real-time interaction between users and sensors. Additionally, the system in- corporates 3D human visualization functionality, which visualizes sensor data and recognizes human actions as 3D models in realtime, providing accurate and comprehensive visual feedback to help users better understand and analyze the details and features of human motion. This system has significant potential for applications in motion detection, medical monitoring, virtual reality, and other fields. The accurate classification of human actions con- tributes to the development of personalized training plans and injury prevention strategies.

Conclusions

This study has substantial implications in the domains of intelligent garments, human motion monitoring, and digital twin visualization. The advancement of this system is expected to propel the progress of wearable technology and foster a deeper comprehension of human motion.

基于深度尖峰神经网络的人体 3D 智能服装系统
背景智能服装是一类新兴的可穿戴设备,在运动训练和医疗康复等领域有着广泛的应用。然而,智能可穿戴设备领域的现有研究主要强调传感器的功能和数量,往往忽略了与用户体验和交互相关的重要方面。该系统利用轻量级传感器模块收集人体运动数据,并引入基于脉冲神经单元的双流融合网络对人体运动进行分类和识别,从而实现用户与传感器之间的实时互动。此外,该系统还加入了三维人体可视化功能,将传感器数据可视化,并将人体动作实时识别为三维模型,提供准确、全面的视觉反馈,帮助用户更好地理解和分析人体运动的细节和特征。该系统在运动检测、医疗监测、虚拟现实等领域的应用潜力巨大。对人体动作的准确分类有助于制定个性化的训练计划和伤害预防策略。该系统的发展有望推动可穿戴技术的进步,并促进对人体运动的深入理解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Virtual Reality  Intelligent Hardware
Virtual Reality Intelligent Hardware Computer Science-Computer Graphics and Computer-Aided Design
CiteScore
6.40
自引率
0.00%
发文量
35
审稿时长
12 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信