{"title":"Experimental Study of a Deep-Learning RGB-D Tracker for Virtual Remote Human Model Reconstruction.","authors":"Shahram Payandeh, Jeffrey Wael","doi":"10.1155/2021/5551753","DOIUrl":null,"url":null,"abstract":"<p><p>Tracking movements of the body in a natural living environment of a person is a challenging undertaking. Such tracking information can be used as a part of detecting any onsets of anomalies in movement patterns or as a part of a remote monitoring environment. The tracking information can be mapped and visualized using a virtual avatar model of the tracked person. This paper presents an initial novel experimental study of using a commercially available deep-learning body tracking system based on an RGB-D sensor for virtual human model reconstruction. We carried out our study in an indoor environment under natural conditions. To study the performance of the tracker, we experimentally study the output of the tracker which is in the form of a skeleton (stick-figure) data structure under several conditions in order to observe its robustness and identify its drawbacks. In addition, we show and study how the generic model can be mapped for virtual human model reconstruction. It was found that the deep-learning tracking approach using an RGB-D sensor is susceptible to various environmental factors which result in the absence and presence of noise in estimating the resulting locations of skeleton joints. This as a result introduces challenges for further virtual model reconstruction. We present an initial approach for compensating for such noise resulting in a better temporal variation of the joint coordinates in the captured skeleton data. We explored how the extracted joint position information of the skeleton data can be used as a part of the virtual human model reconstruction.</p>","PeriodicalId":45630,"journal":{"name":"International Journal of Telemedicine and Applications","volume":null,"pages":null},"PeriodicalIF":3.1000,"publicationDate":"2021-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8460365/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Telemedicine and Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1155/2021/5551753","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2021/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Tracking movements of the body in a natural living environment of a person is a challenging undertaking. Such tracking information can be used as a part of detecting any onsets of anomalies in movement patterns or as a part of a remote monitoring environment. The tracking information can be mapped and visualized using a virtual avatar model of the tracked person. This paper presents an initial novel experimental study of using a commercially available deep-learning body tracking system based on an RGB-D sensor for virtual human model reconstruction. We carried out our study in an indoor environment under natural conditions. To study the performance of the tracker, we experimentally study the output of the tracker which is in the form of a skeleton (stick-figure) data structure under several conditions in order to observe its robustness and identify its drawbacks. In addition, we show and study how the generic model can be mapped for virtual human model reconstruction. It was found that the deep-learning tracking approach using an RGB-D sensor is susceptible to various environmental factors which result in the absence and presence of noise in estimating the resulting locations of skeleton joints. This as a result introduces challenges for further virtual model reconstruction. We present an initial approach for compensating for such noise resulting in a better temporal variation of the joint coordinates in the captured skeleton data. We explored how the extracted joint position information of the skeleton data can be used as a part of the virtual human model reconstruction.
期刊介绍:
The overall aim of the International Journal of Telemedicine and Applications is to bring together science and applications of medical practice and medical care at a distance as well as their supporting technologies such as, computing, communications, and networking technologies with emphasis on telemedicine techniques and telemedicine applications. It is directed at practicing engineers, academic researchers, as well as doctors, nurses, etc. Telemedicine is an information technology that enables doctors to perform medical consultations, diagnoses, and treatments, as well as medical education, away from patients. For example, doctors can remotely examine patients via remote viewing monitors and sound devices, and/or sampling physiological data using telecommunication. Telemedicine technology is applied to areas of emergency healthcare, videoconsulting, telecardiology, telepathology, teledermatology, teleophthalmology, teleoncology, telepsychiatry, teledentistry, etc. International Journal of Telemedicine and Applications will highlight the continued growth and new challenges in telemedicine, applications, and their supporting technologies, for both application development and basic research. Papers should emphasize original results or case studies relating to the theory and/or applications of telemedicine. Tutorial papers, especially those emphasizing multidisciplinary views of telemedicine, are also welcome. International Journal of Telemedicine and Applications employs a paperless, electronic submission and evaluation system to promote a rapid turnaround in the peer-review process.