Passive Observer of Activities for Aging in Place Using a Network of RGB-D Sensors.

IF 3.1 Q2 HEALTH CARE SCIENCES & SERVICES
International Journal of Telemedicine and Applications Pub Date : 2020-10-23 eCollection Date: 2020-01-01 DOI:10.1155/2020/8867926
Shahram Payandeh, Jim Park
{"title":"Passive Observer of Activities for Aging in Place Using a Network of RGB-D Sensors.","authors":"Shahram Payandeh,&nbsp;Jim Park","doi":"10.1155/2020/8867926","DOIUrl":null,"url":null,"abstract":"<p><p>Aging in place is a notion which supports the independent living of older adults at their own place of residence for as long as possible. To support this alternative living which can be in contrast to various other types of assisted living options, modes of monitoring technology need to be explored and studied in order to determine a balance between the preservation of privacy and adequacy of sensed information for better estimation and visualization of movements and activities. In this paper, we explore such monitoring paradigm on how a network of RGB-D sensors can be utilized for this purpose. This type of sensor offers both visual and depth sensing modalities from the scene where the information can be fused and coded for better protection of privacy. For this purpose, we introduce the novel notion of passive observer. This observer is only triggered by detecting the absence of movements of older adults in the scene. This is accomplished by classifying and localizing objects in the monitoring scene from both before and after the detection of movements. A deep learning tool is utilized for visual classification of known objects in the physical scene followed by virtual reality reconstructing of the scene where the shape and location of objects are recreated. Such reconstruction can be used as a visual summary in order to identify objects which were handled by an older adult in-between observation. The simplified virtual scene can be used, for example, by caregivers or monitoring personnel in order to assist in detecting any anomalies. This virtual visualization can offer a high level of privacy protection without having any direct visual access to the monitoring scene. In addition, using the scene graph representation, an automatic decision-making tool is proposed where spatial relationships between the objects can be used to estimate the expected activities. The results of this paper are demonstrated through two case studies.</p>","PeriodicalId":45630,"journal":{"name":"International Journal of Telemedicine and Applications","volume":null,"pages":null},"PeriodicalIF":3.1000,"publicationDate":"2020-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1155/2020/8867926","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Telemedicine and Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1155/2020/8867926","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2020/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 3

Abstract

Aging in place is a notion which supports the independent living of older adults at their own place of residence for as long as possible. To support this alternative living which can be in contrast to various other types of assisted living options, modes of monitoring technology need to be explored and studied in order to determine a balance between the preservation of privacy and adequacy of sensed information for better estimation and visualization of movements and activities. In this paper, we explore such monitoring paradigm on how a network of RGB-D sensors can be utilized for this purpose. This type of sensor offers both visual and depth sensing modalities from the scene where the information can be fused and coded for better protection of privacy. For this purpose, we introduce the novel notion of passive observer. This observer is only triggered by detecting the absence of movements of older adults in the scene. This is accomplished by classifying and localizing objects in the monitoring scene from both before and after the detection of movements. A deep learning tool is utilized for visual classification of known objects in the physical scene followed by virtual reality reconstructing of the scene where the shape and location of objects are recreated. Such reconstruction can be used as a visual summary in order to identify objects which were handled by an older adult in-between observation. The simplified virtual scene can be used, for example, by caregivers or monitoring personnel in order to assist in detecting any anomalies. This virtual visualization can offer a high level of privacy protection without having any direct visual access to the monitoring scene. In addition, using the scene graph representation, an automatic decision-making tool is proposed where spatial relationships between the objects can be used to estimate the expected activities. The results of this paper are demonstrated through two case studies.

Abstract Image

Abstract Image

Abstract Image

使用RGB-D传感器网络的被动观察老化活动。
居家养老是指老年人尽可能长时间地在自己的居住地独立生活。为了支持这种可以与各种其他类型的辅助生活选择形成对比的替代生活,需要探索和研究监测技术模式,以确定隐私保护与感知信息的充分性之间的平衡,以便更好地估计和可视化运动和活动。在本文中,我们探讨了如何将RGB-D传感器网络用于此目的的监测范例。这种类型的传感器提供视觉和深度感应模式,从现场的信息可以融合和编码,以更好地保护隐私。为此,我们引入了被动观察者的新概念。这个观察者只有在发现场景中没有老年人的动作时才会被触发。这是通过在检测到运动之前和之后对监控场景中的物体进行分类和定位来实现的。利用深度学习工具对物理场景中的已知物体进行视觉分类,然后对场景进行虚拟现实重建,重新创建物体的形状和位置。这种重建可以用作视觉总结,以便识别在观察之间由老年人处理的物体。简化的虚拟场景可以被护理人员或监控人员使用,以帮助检测任何异常情况。这种虚拟可视化可以提供高级别的隐私保护,而无需对监控场景进行任何直接的视觉访问。此外,利用场景图表示,提出了一种自动决策工具,可以利用对象之间的空间关系来估计预期的活动。通过两个案例对本文的研究结果进行了验证。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
6.90
自引率
2.30%
发文量
19
审稿时长
12 weeks
期刊介绍: The overall aim of the International Journal of Telemedicine and Applications is to bring together science and applications of medical practice and medical care at a distance as well as their supporting technologies such as, computing, communications, and networking technologies with emphasis on telemedicine techniques and telemedicine applications. It is directed at practicing engineers, academic researchers, as well as doctors, nurses, etc. Telemedicine is an information technology that enables doctors to perform medical consultations, diagnoses, and treatments, as well as medical education, away from patients. For example, doctors can remotely examine patients via remote viewing monitors and sound devices, and/or sampling physiological data using telecommunication. Telemedicine technology is applied to areas of emergency healthcare, videoconsulting, telecardiology, telepathology, teledermatology, teleophthalmology, teleoncology, telepsychiatry, teledentistry, etc. International Journal of Telemedicine and Applications will highlight the continued growth and new challenges in telemedicine, applications, and their supporting technologies, for both application development and basic research. Papers should emphasize original results or case studies relating to the theory and/or applications of telemedicine. Tutorial papers, especially those emphasizing multidisciplinary views of telemedicine, are also welcome. International Journal of Telemedicine and Applications employs a paperless, electronic submission and evaluation system to promote a rapid turnaround in the peer-review process.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信