Design and development of a rehabilitative eye-tracking based home automation system

Georges Boustany, Alaa El Deen Itani, Rayan Youssef, Omar Chami, Z. O. Abu-Faraj
{"title":"Design and development of a rehabilitative eye-tracking based home automation system","authors":"Georges Boustany, Alaa El Deen Itani, Rayan Youssef, Omar Chami, Z. O. Abu-Faraj","doi":"10.1109/MECBME.2016.7745401","DOIUrl":null,"url":null,"abstract":"Locked-in syndrome is known to be a condition in which a patient loses the ability to control nearly all voluntary muscles in the body except for the eye. In today's world, healthcare facilities have the means and equipment necessary to help such patients and take care of their needs, which includes medical care and patient comfort. However, such dedicated professional services are not commonly provided at the patient's dwelling, and more can still be done when it comes to patient's comfort and self-reliance. This paper delineates the design and development of an eye-tracking based home automation system that provides the targeted locked-in patient with the ability to control appliances using his/her eyes. In the developed system, eye movement, pupil position, size, and velocity are determined using a built-in laptop camera in conjunction with a series of algorithms coded in MATLAB®. The camera is adjusted in such a way so as to be leveled horizontally with the eye-sight of the patient. Further algorithms are to allow the user to control and move the mouse cursor with his/her eye movements. A specially designed graphical user interface provides the individual with the options as to what he/she wishes to control. An Arduino microcontroller differentiates the received instructions from the user and provides an output to the intended device. The controlled appliances within the patient's habitat are doors, window shutters, lightings, bed control, television set, and heating ventilation and air-conditioning. Further modular improvement of this system could be introduced as need arises. The system was validated using a series of tests on normal control individuals. The validation results show high accuracy and precision. The significance of this system lies in helping locked-in patients gain control over some aspects of their lives; accordingly, they will no longer require continuous assistance to secure their comfort but rather be self-reliant.","PeriodicalId":430369,"journal":{"name":"2016 3rd Middle East Conference on Biomedical Engineering (MECBME)","volume":"36 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"9","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 3rd Middle East Conference on Biomedical Engineering (MECBME)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/MECBME.2016.7745401","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 9

Abstract

Locked-in syndrome is known to be a condition in which a patient loses the ability to control nearly all voluntary muscles in the body except for the eye. In today's world, healthcare facilities have the means and equipment necessary to help such patients and take care of their needs, which includes medical care and patient comfort. However, such dedicated professional services are not commonly provided at the patient's dwelling, and more can still be done when it comes to patient's comfort and self-reliance. This paper delineates the design and development of an eye-tracking based home automation system that provides the targeted locked-in patient with the ability to control appliances using his/her eyes. In the developed system, eye movement, pupil position, size, and velocity are determined using a built-in laptop camera in conjunction with a series of algorithms coded in MATLAB®. The camera is adjusted in such a way so as to be leveled horizontally with the eye-sight of the patient. Further algorithms are to allow the user to control and move the mouse cursor with his/her eye movements. A specially designed graphical user interface provides the individual with the options as to what he/she wishes to control. An Arduino microcontroller differentiates the received instructions from the user and provides an output to the intended device. The controlled appliances within the patient's habitat are doors, window shutters, lightings, bed control, television set, and heating ventilation and air-conditioning. Further modular improvement of this system could be introduced as need arises. The system was validated using a series of tests on normal control individuals. The validation results show high accuracy and precision. The significance of this system lies in helping locked-in patients gain control over some aspects of their lives; accordingly, they will no longer require continuous assistance to secure their comfort but rather be self-reliant.
基于康复眼动追踪的家庭自动化系统的设计与开发
闭锁综合征是一种患者失去控制除眼睛外几乎所有身体随意肌的能力的疾病。在当今世界,医疗保健设施有必要的手段和设备来帮助这类患者并满足他们的需求,其中包括医疗护理和患者舒适度。然而,这种专门的专业服务通常不会在病人的住所提供,当涉及到病人的舒适和自力更生时,仍然可以做更多的工作。本文描述了一种基于眼动追踪的家庭自动化系统的设计和开发,该系统为锁定的患者提供了使用他/她的眼睛控制电器的能力。在开发的系统中,使用内置的笔记本电脑摄像头结合MATLAB®编码的一系列算法来确定眼球运动,瞳孔位置,大小和速度。以这样一种方式调整摄像机,使其与患者的视线水平水平。进一步的算法是允许用户通过他/她的眼球运动来控制和移动鼠标光标。一个特别设计的图形用户界面为个人提供了他/她希望控制的选项。Arduino微控制器区分来自用户的接收指令,并向预期设备提供输出。患者居住区内的受控设备包括门、百叶窗、照明、床控、电视机、采暖通风和空调。根据需要,还可以对该系统进行进一步的模块化改进。该系统通过对正常对照个体的一系列测试进行了验证。验证结果表明,该方法具有较高的准确度和精密度。这个系统的意义在于帮助闭锁病人获得对他们生活的某些方面的控制;因此,他们将不再需要持续的援助来确保他们的舒适,而是自力更生。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信