使用商用RGB-D传感器和深度神经网络跟踪处理工具估计婴儿上半身3D运动学

D. Balta, H. Kuo, Jing Wang, I. G. Porco, M. Schladen, A. Cereatti, P. Lum, U. Croce
{"title":"使用商用RGB-D传感器和深度神经网络跟踪处理工具估计婴儿上半身3D运动学","authors":"D. Balta, H. Kuo, Jing Wang, I. G. Porco, M. Schladen, A. Cereatti, P. Lum, U. Croce","doi":"10.1109/MeMeA54994.2022.9856585","DOIUrl":null,"url":null,"abstract":"Quantitative biomarkers of infant motion may be predictive of the development of movement disorders. This study presents and validates a low cost, markerless motion tracking method for the estimation of upper body kinematics of infants from which proper biomarkers may be extracted. The method requires a single RGB-D sensor, a 2D motion tracking software publicly available and a purposely developed algorithm for the estimation of the 3D coordinates of points tracked from the RGB images. The algorithm deals with various sources of errors in reconstructing the 3D coordinates of the tracked points and allows to estimate kinematic variables to be used to identify potential biomarkers. Both simulated and actual infant's motions were recorded. The infant's motion was recorded at 4, 5 and 6 months of age. Anthropometric measures are also estimated to validate the method on both simulated and actual infant's motion. Known point kinematics were obtained from a doll, with size and shape of an infant, lying on a turntable rotating at $33^{1}/3$ rpm. The doll's motion was recorded from two angles: parallel to the turntable rotation plane and angled at $\\boldsymbol{45^{\\circ}}$ with respect to it. The latter presents occlusions of tracked points similar to those expected during the recording of an infant's motion. The errors in estimating the selected anthropometric measurements during the infant's motion resulted to be similar to those obtained during the simulated infant's motion. The range of the elbow and shoulder angles estimated during the infant's motion resulted to be well above the error found during the turntable recordings. Similarly, the length of the hand path and mean velocity recorded during the infant's motion resulted to be much greater than the error found in the simulation. Moreover, changes over time of both anthropometric and kinematic variables may be appreciated. Therefore, the proposed method may be effectively used to explore biomarkers of early development of movement disorders. More accurate estimates may be expected if more performing hardware and tracking software are available.","PeriodicalId":106228,"journal":{"name":"2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA)","volume":"85 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Infant upper body 3D kinematics estimated using a commercial RGB-D sensor and a deep neural network tracking processing tool\",\"authors\":\"D. Balta, H. Kuo, Jing Wang, I. G. Porco, M. Schladen, A. Cereatti, P. Lum, U. Croce\",\"doi\":\"10.1109/MeMeA54994.2022.9856585\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Quantitative biomarkers of infant motion may be predictive of the development of movement disorders. This study presents and validates a low cost, markerless motion tracking method for the estimation of upper body kinematics of infants from which proper biomarkers may be extracted. The method requires a single RGB-D sensor, a 2D motion tracking software publicly available and a purposely developed algorithm for the estimation of the 3D coordinates of points tracked from the RGB images. The algorithm deals with various sources of errors in reconstructing the 3D coordinates of the tracked points and allows to estimate kinematic variables to be used to identify potential biomarkers. Both simulated and actual infant's motions were recorded. The infant's motion was recorded at 4, 5 and 6 months of age. Anthropometric measures are also estimated to validate the method on both simulated and actual infant's motion. Known point kinematics were obtained from a doll, with size and shape of an infant, lying on a turntable rotating at $33^{1}/3$ rpm. The doll's motion was recorded from two angles: parallel to the turntable rotation plane and angled at $\\\\boldsymbol{45^{\\\\circ}}$ with respect to it. The latter presents occlusions of tracked points similar to those expected during the recording of an infant's motion. The errors in estimating the selected anthropometric measurements during the infant's motion resulted to be similar to those obtained during the simulated infant's motion. The range of the elbow and shoulder angles estimated during the infant's motion resulted to be well above the error found during the turntable recordings. Similarly, the length of the hand path and mean velocity recorded during the infant's motion resulted to be much greater than the error found in the simulation. Moreover, changes over time of both anthropometric and kinematic variables may be appreciated. Therefore, the proposed method may be effectively used to explore biomarkers of early development of movement disorders. More accurate estimates may be expected if more performing hardware and tracking software are available.\",\"PeriodicalId\":106228,\"journal\":{\"name\":\"2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA)\",\"volume\":\"85 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-06-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/MeMeA54994.2022.9856585\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/MeMeA54994.2022.9856585","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

婴儿运动的定量生物标志物可以预测运动障碍的发展。本研究提出并验证了一种低成本,无标记的运动跟踪方法,用于估计婴儿的上半身运动学,从中可以提取适当的生物标记。该方法需要一个单一的RGB- d传感器,一个公开的2D运动跟踪软件和一个专门开发的算法,用于估计从RGB图像跟踪的点的3D坐标。该算法处理重建跟踪点的三维坐标中的各种误差来源,并允许估计用于识别潜在生物标志物的运动学变量。模拟和实际婴儿的动作都被记录下来。记录婴儿在4、5和6个月大时的运动。人体测量测量也估计验证方法在模拟和实际婴儿的运动。得到了一个娃娃的已知点运动学,娃娃的大小和形状为婴儿,躺在以$33^{1}/3$ rpm旋转的转盘上。从两个角度记录娃娃的运动:平行于转盘旋转平面和相对于它的角度为$\boldsymbol{45^{\circ}}$。后者呈现出跟踪点的闭塞,类似于婴儿运动记录期间的预期。在婴儿运动期间估计所选人体测量值的误差与在模拟婴儿运动期间获得的误差相似。在婴儿运动期间估计的肘部和肩部角度的范围远远高于在唱盘记录中发现的误差。同样,在婴儿运动过程中记录的手部路径长度和平均速度导致的误差远远大于模拟中发现的误差。此外,随着时间的推移,人体测量和运动学变量的变化可能会被理解。因此,该方法可以有效地用于探索运动障碍早期发展的生物标志物。如果有性能更好的硬件和跟踪软件,可能会有更准确的估计。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Infant upper body 3D kinematics estimated using a commercial RGB-D sensor and a deep neural network tracking processing tool
Quantitative biomarkers of infant motion may be predictive of the development of movement disorders. This study presents and validates a low cost, markerless motion tracking method for the estimation of upper body kinematics of infants from which proper biomarkers may be extracted. The method requires a single RGB-D sensor, a 2D motion tracking software publicly available and a purposely developed algorithm for the estimation of the 3D coordinates of points tracked from the RGB images. The algorithm deals with various sources of errors in reconstructing the 3D coordinates of the tracked points and allows to estimate kinematic variables to be used to identify potential biomarkers. Both simulated and actual infant's motions were recorded. The infant's motion was recorded at 4, 5 and 6 months of age. Anthropometric measures are also estimated to validate the method on both simulated and actual infant's motion. Known point kinematics were obtained from a doll, with size and shape of an infant, lying on a turntable rotating at $33^{1}/3$ rpm. The doll's motion was recorded from two angles: parallel to the turntable rotation plane and angled at $\boldsymbol{45^{\circ}}$ with respect to it. The latter presents occlusions of tracked points similar to those expected during the recording of an infant's motion. The errors in estimating the selected anthropometric measurements during the infant's motion resulted to be similar to those obtained during the simulated infant's motion. The range of the elbow and shoulder angles estimated during the infant's motion resulted to be well above the error found during the turntable recordings. Similarly, the length of the hand path and mean velocity recorded during the infant's motion resulted to be much greater than the error found in the simulation. Moreover, changes over time of both anthropometric and kinematic variables may be appreciated. Therefore, the proposed method may be effectively used to explore biomarkers of early development of movement disorders. More accurate estimates may be expected if more performing hardware and tracking software are available.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信