{"title":"Study on Wearable Gaze-Based Communication System for Patients with Amyotrophic Lateral Sclerosis (ALS)","authors":"Sawada Nonoka, Akira Uehara, Hiroaki Kawamoto, Yoshiyuki Sankai","doi":"10.1109/SII58957.2024.10417526","DOIUrl":null,"url":null,"abstract":"This study centers its attention on communication among ALS patients with severe symptoms, which is essential to daily life and the part that remains a difficulty. Also, communication is important to promote social participation and ability of independence. To promote social participation and improve the ability of independence without the restrictions for patients, the purpose of this study is to develop a wearable interface that enables communication based on the patient's voluntary intent, without temporal, spatial, or physical restrictions, and to confirm the feasibility of intention transmission using a new text entry algorithm. The developed interface utilized a see-through type head-mounted display (HMD) with a gaze estimation sensor to enable patients themselves to transition between cyberspace and physical space and to communicate by the system without restrictions of posture or usage environment during daily life activities. The letter selection is triggered by a change in the direction of the gaze trajectory. This method of letter selection reduces the burden on the user by avoiding the effects of dwell time and other factors associated with gazing input. The key layout for text input UI considers the characteristics of human eye movements, to minimize key selection errors and allows for quick viewpoint movement. To confirm the feasibility of the basic performance, we conducted the experiment with three able-bodied participants using the developed system and a conventional system as a comparison system, respectively. As a result, the developed system was able to input sentences in the same amount of time as the conventional system. The results show that the developed system has the basic performance of a communication interface with a new character input method based on eye movement functions. Therefore, we confirmed the feasibility of transmitting intention using a new text entry algorithm to enable communication without the restrictions.","PeriodicalId":518021,"journal":{"name":"2024 IEEE/SICE International Symposium on System Integration (SII)","volume":"9 1","pages":"165-171"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2024 IEEE/SICE International Symposium on System Integration (SII)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SII58957.2024.10417526","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
This study centers its attention on communication among ALS patients with severe symptoms, which is essential to daily life and the part that remains a difficulty. Also, communication is important to promote social participation and ability of independence. To promote social participation and improve the ability of independence without the restrictions for patients, the purpose of this study is to develop a wearable interface that enables communication based on the patient's voluntary intent, without temporal, spatial, or physical restrictions, and to confirm the feasibility of intention transmission using a new text entry algorithm. The developed interface utilized a see-through type head-mounted display (HMD) with a gaze estimation sensor to enable patients themselves to transition between cyberspace and physical space and to communicate by the system without restrictions of posture or usage environment during daily life activities. The letter selection is triggered by a change in the direction of the gaze trajectory. This method of letter selection reduces the burden on the user by avoiding the effects of dwell time and other factors associated with gazing input. The key layout for text input UI considers the characteristics of human eye movements, to minimize key selection errors and allows for quick viewpoint movement. To confirm the feasibility of the basic performance, we conducted the experiment with three able-bodied participants using the developed system and a conventional system as a comparison system, respectively. As a result, the developed system was able to input sentences in the same amount of time as the conventional system. The results show that the developed system has the basic performance of a communication interface with a new character input method based on eye movement functions. Therefore, we confirmed the feasibility of transmitting intention using a new text entry algorithm to enable communication without the restrictions.
这项研究主要关注有严重症状的 ALS 患者之间的交流,交流是日常生活中必不可少的,也是仍然存在困难的部分。此外,交流对于促进社会参与和提高独立能力也很重要。为了在不限制患者的情况下促进其社会参与和提高其独立能力,本研究的目的是开发一种可穿戴界面,该界面可根据患者的自愿意图进行交流,不受时间、空间或物理限制,并使用一种新的文本输入算法确认意图传输的可行性。所开发的界面利用了带有凝视估计传感器的透视型头戴式显示器(HMD),使患者本人能够在网络空间和物理空间之间转换,并在日常生活活动中不受姿势或使用环境的限制通过系统进行交流。字母选择由注视轨迹的方向变化触发。这种字母选择方法避免了与注视输入相关的停留时间和其他因素的影响,从而减轻了用户的负担。文本输入用户界面的按键布局考虑到了人眼运动的特点,以尽量减少按键选择错误,并允许视点快速移动。为了证实基本性能的可行性,我们分别使用开发的系统和传统系统作为对比系统,对三名健全的参与者进行了实验。结果显示,开发的系统能够在与传统系统相同的时间内输入句子。结果表明,开发的系统具有通信接口的基本性能,并具有基于眼动功能的新字符输入法。因此,我们证实了使用新的文字输入算法传递意图的可行性,从而使通信不受任何限制。