{"title":"Passive Observer of Activities for Aging in Place Using a Network of RGB-D Sensors.","authors":"Shahram Payandeh, Jim Park","doi":"10.1155/2020/8867926","DOIUrl":null,"url":null,"abstract":"<p><p>Aging in place is a notion which supports the independent living of older adults at their own place of residence for as long as possible. To support this alternative living which can be in contrast to various other types of assisted living options, modes of monitoring technology need to be explored and studied in order to determine a balance between the preservation of privacy and adequacy of sensed information for better estimation and visualization of movements and activities. In this paper, we explore such monitoring paradigm on how a network of RGB-D sensors can be utilized for this purpose. This type of sensor offers both visual and depth sensing modalities from the scene where the information can be fused and coded for better protection of privacy. For this purpose, we introduce the novel notion of passive observer. This observer is only triggered by detecting the absence of movements of older adults in the scene. This is accomplished by classifying and localizing objects in the monitoring scene from both before and after the detection of movements. A deep learning tool is utilized for visual classification of known objects in the physical scene followed by virtual reality reconstructing of the scene where the shape and location of objects are recreated. Such reconstruction can be used as a visual summary in order to identify objects which were handled by an older adult in-between observation. The simplified virtual scene can be used, for example, by caregivers or monitoring personnel in order to assist in detecting any anomalies. This virtual visualization can offer a high level of privacy protection without having any direct visual access to the monitoring scene. In addition, using the scene graph representation, an automatic decision-making tool is proposed where spatial relationships between the objects can be used to estimate the expected activities. The results of this paper are demonstrated through two case studies.</p>","PeriodicalId":45630,"journal":{"name":"International Journal of Telemedicine and Applications","volume":null,"pages":null},"PeriodicalIF":3.1000,"publicationDate":"2020-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1155/2020/8867926","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Telemedicine and Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1155/2020/8867926","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2020/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 3
Abstract
Aging in place is a notion which supports the independent living of older adults at their own place of residence for as long as possible. To support this alternative living which can be in contrast to various other types of assisted living options, modes of monitoring technology need to be explored and studied in order to determine a balance between the preservation of privacy and adequacy of sensed information for better estimation and visualization of movements and activities. In this paper, we explore such monitoring paradigm on how a network of RGB-D sensors can be utilized for this purpose. This type of sensor offers both visual and depth sensing modalities from the scene where the information can be fused and coded for better protection of privacy. For this purpose, we introduce the novel notion of passive observer. This observer is only triggered by detecting the absence of movements of older adults in the scene. This is accomplished by classifying and localizing objects in the monitoring scene from both before and after the detection of movements. A deep learning tool is utilized for visual classification of known objects in the physical scene followed by virtual reality reconstructing of the scene where the shape and location of objects are recreated. Such reconstruction can be used as a visual summary in order to identify objects which were handled by an older adult in-between observation. The simplified virtual scene can be used, for example, by caregivers or monitoring personnel in order to assist in detecting any anomalies. This virtual visualization can offer a high level of privacy protection without having any direct visual access to the monitoring scene. In addition, using the scene graph representation, an automatic decision-making tool is proposed where spatial relationships between the objects can be used to estimate the expected activities. The results of this paper are demonstrated through two case studies.
期刊介绍:
The overall aim of the International Journal of Telemedicine and Applications is to bring together science and applications of medical practice and medical care at a distance as well as their supporting technologies such as, computing, communications, and networking technologies with emphasis on telemedicine techniques and telemedicine applications. It is directed at practicing engineers, academic researchers, as well as doctors, nurses, etc. Telemedicine is an information technology that enables doctors to perform medical consultations, diagnoses, and treatments, as well as medical education, away from patients. For example, doctors can remotely examine patients via remote viewing monitors and sound devices, and/or sampling physiological data using telecommunication. Telemedicine technology is applied to areas of emergency healthcare, videoconsulting, telecardiology, telepathology, teledermatology, teleophthalmology, teleoncology, telepsychiatry, teledentistry, etc. International Journal of Telemedicine and Applications will highlight the continued growth and new challenges in telemedicine, applications, and their supporting technologies, for both application development and basic research. Papers should emphasize original results or case studies relating to the theory and/or applications of telemedicine. Tutorial papers, especially those emphasizing multidisciplinary views of telemedicine, are also welcome. International Journal of Telemedicine and Applications employs a paperless, electronic submission and evaluation system to promote a rapid turnaround in the peer-review process.