Medical Assessment Test of Extrapersonal Neglect Using Virtual Reality: A Preliminary Study

Daniel Lanzoni, A. Vitali, D. Regazzoni, C. Rizzi
{"title":"Medical Assessment Test of Extrapersonal Neglect Using Virtual Reality: A Preliminary Study","authors":"Daniel Lanzoni, A. Vitali, D. Regazzoni, C. Rizzi","doi":"10.1115/detc2020-22416","DOIUrl":null,"url":null,"abstract":"\n The research work presents a preliminary study to create a virtual reality platform for the medical assessment of spatial extrapersonal neglect, a syndrome affecting human awareness of a hemi-space that may be caused by cerebral lesions. Nowadays, the extrapersonal neglect is assessed by using real objects positioned in the space around the patient, with a poor capability of repetition and data gathering. Therefore, the aim of this research work is the introduction of a virtual reality solution based on consumer technology for the assessment of the extrapersonal neglect. By starting from the needs of the involved medical personnel, an online serious-game platform has been developed, which permits to perform a test and a real-time evaluation by means of objective data tracked by exploited technologies, i.e. an HTC Vive Pro head mounted display and ad-hoc IT solutions. The test is based on a virtual environment composed by a table on which twenty objects have been placed, ten on the right side and ten on the left side. The whole 3D virtual environment has been developed using low-cost and free development tools, such as Unity and Blender.\n The interaction with the virtual environment is based on voice recognition technology, therefore the patient interact with the application by pronouncing the name of each object aloud. The VR application has been developed according to an online gaming software architecture, which permits to share the 3D scene by exploiting a Wi-Fi hotspot network. Furthermore, the on-line gaming software architecture allows sending and receiving data between the doctor’s laptop and the VR system used by the patient on another laptop. The therapist can see through his/her personal computer a real time faithful replica of the test performed by the patient in order to have a fast feedback on patient’s field of view orientation during the evaluation of 3D objects.\n A preliminary test has been carried out to evaluate the ease of use for medical personnel of the developed VR platform. The big amount of recorded data and the possibility to manage the selection of objects when the voice commands are not correctly interpreted has been greatly appreciated. The review of the performed test represents for doctors the possibility of objectively reconstructing the improvements of patients during the whole period of the rehabilitation process. Medical feedback highlighted how the developed prototype can already be tested involving patients and thus, a procedure for enrolling a group of patients has been planned. Finally, future tests have been planned to compare the developed solution with the Caterine Bergero Scale to define a future standardization.","PeriodicalId":164403,"journal":{"name":"Volume 9: 40th Computers and Information in Engineering Conference (CIE)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Volume 9: 40th Computers and Information in Engineering Conference (CIE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1115/detc2020-22416","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The research work presents a preliminary study to create a virtual reality platform for the medical assessment of spatial extrapersonal neglect, a syndrome affecting human awareness of a hemi-space that may be caused by cerebral lesions. Nowadays, the extrapersonal neglect is assessed by using real objects positioned in the space around the patient, with a poor capability of repetition and data gathering. Therefore, the aim of this research work is the introduction of a virtual reality solution based on consumer technology for the assessment of the extrapersonal neglect. By starting from the needs of the involved medical personnel, an online serious-game platform has been developed, which permits to perform a test and a real-time evaluation by means of objective data tracked by exploited technologies, i.e. an HTC Vive Pro head mounted display and ad-hoc IT solutions. The test is based on a virtual environment composed by a table on which twenty objects have been placed, ten on the right side and ten on the left side. The whole 3D virtual environment has been developed using low-cost and free development tools, such as Unity and Blender. The interaction with the virtual environment is based on voice recognition technology, therefore the patient interact with the application by pronouncing the name of each object aloud. The VR application has been developed according to an online gaming software architecture, which permits to share the 3D scene by exploiting a Wi-Fi hotspot network. Furthermore, the on-line gaming software architecture allows sending and receiving data between the doctor’s laptop and the VR system used by the patient on another laptop. The therapist can see through his/her personal computer a real time faithful replica of the test performed by the patient in order to have a fast feedback on patient’s field of view orientation during the evaluation of 3D objects. A preliminary test has been carried out to evaluate the ease of use for medical personnel of the developed VR platform. The big amount of recorded data and the possibility to manage the selection of objects when the voice commands are not correctly interpreted has been greatly appreciated. The review of the performed test represents for doctors the possibility of objectively reconstructing the improvements of patients during the whole period of the rehabilitation process. Medical feedback highlighted how the developed prototype can already be tested involving patients and thus, a procedure for enrolling a group of patients has been planned. Finally, future tests have been planned to compare the developed solution with the Caterine Bergero Scale to define a future standardization.
利用虚拟现实技术进行超人格忽视医学评估测试的初步研究
该研究工作提出了一项初步研究,旨在创建一个虚拟现实平台,用于空间外个人忽视的医学评估,这是一种影响人类对半空间意识的综合征,可能由大脑病变引起。目前,超个人忽视的评估是通过放置在患者周围空间的真实物体来进行的,重复能力和数据收集能力较差。因此,本研究工作的目的是引入一种基于消费者技术的虚拟现实解决方案来评估超个人忽视。从相关医务人员的需求出发,开发了一个在线严肃游戏平台,允许通过利用技术(即HTC Vive Pro头戴式显示器和特设IT解决方案)跟踪的客观数据进行测试和实时评估。该测试基于一个虚拟环境,该环境由一张桌子组成,桌子上放置了20个物体,10个在右边,10个在左边。整个3D虚拟环境的开发使用了低成本和免费的开发工具,如Unity和Blender。与虚拟环境的交互基于语音识别技术,因此患者通过大声读出每个对象的名称与应用程序进行交互。该虚拟现实应用程序是根据在线游戏软件架构开发的,该架构允许通过利用Wi-Fi热点网络共享3D场景。此外,在线游戏软件架构允许在医生的笔记本电脑和患者在另一台笔记本电脑上使用的VR系统之间发送和接收数据。治疗师可以通过他/她的个人电脑看到患者进行测试的实时忠实副本,以便在评估3D物体期间快速反馈患者的视野方向。已经开展了初步测试,以评估开发的VR平台对医务人员的易用性。大量的记录数据和在语音命令没有被正确解释时管理对象选择的可能性受到了极大的赞赏。对所进行的测试的回顾代表了医生在整个康复过程中客观地重建患者改善的可能性。医学反馈强调,开发的原型已经可以在患者身上进行测试,因此,已经计划了一个招募一组患者的程序。最后,未来的测试计划将开发的解决方案与Caterine Bergero Scale进行比较,以确定未来的标准化。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信