Franklin Rosado, Iliana Rumbo, Felicia Daza, Hernis Mercado, Diana Mier
{"title":"Morse code-based communication system focused on amyotrophic lateral sclerosis patients","authors":"Franklin Rosado, Iliana Rumbo, Felicia Daza, Hernis Mercado, Diana Mier","doi":"10.1109/STSIVA.2016.7743358","DOIUrl":null,"url":null,"abstract":"This application is based on face recognition and facial features techniques to extract Regions Of Interest (ROI) by applying Haar filters and cascade classifier with OpenCV implemented in Visual Studio C#. Likewise, a software program was developed to transform blinkings into words, along with a graphical user interface, in which the spanish language alphabet letters and predifined phrases are displayed., as a consequence, the ALS patient has the possibility to structure sentences, thus, facilitating his/her communication process with relatives and medical staff. Several tests were applied to five ALS patients (50 years, on average) with an advanced stage of the disease, that's to say, they have lost their speech ability and movement in both upper and lower extremities. They were trained in how to use the application software by means of simple tasks such as reading the spanish alphabet. A first group was formed to help them out with the Morse code, what made them easier to understand the spanish alphabet and its assignment to each blinking. This test was done by using two different environments, namely, one environment with low light intensity and the other one with normal light intensity. A second group was formed with patients without any previous knowledge.","PeriodicalId":373420,"journal":{"name":"2016 XXI Symposium on Signal Processing, Images and Artificial Vision (STSIVA)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 XXI Symposium on Signal Processing, Images and Artificial Vision (STSIVA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/STSIVA.2016.7743358","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 5
Abstract
This application is based on face recognition and facial features techniques to extract Regions Of Interest (ROI) by applying Haar filters and cascade classifier with OpenCV implemented in Visual Studio C#. Likewise, a software program was developed to transform blinkings into words, along with a graphical user interface, in which the spanish language alphabet letters and predifined phrases are displayed., as a consequence, the ALS patient has the possibility to structure sentences, thus, facilitating his/her communication process with relatives and medical staff. Several tests were applied to five ALS patients (50 years, on average) with an advanced stage of the disease, that's to say, they have lost their speech ability and movement in both upper and lower extremities. They were trained in how to use the application software by means of simple tasks such as reading the spanish alphabet. A first group was formed to help them out with the Morse code, what made them easier to understand the spanish alphabet and its assignment to each blinking. This test was done by using two different environments, namely, one environment with low light intensity and the other one with normal light intensity. A second group was formed with patients without any previous knowledge.
该应用程序基于人脸识别和面部特征技术,通过在Visual Studio c#中实现的OpenCV中应用Haar滤波器和级联分类器来提取感兴趣区域(ROI)。同样,他们还开发了一种软件程序,可以将眨眼转换为单词,以及一个图形用户界面,其中显示西班牙语字母和预定义短语。,因此,ALS患者有可能组织句子,从而促进他/她与亲属和医务人员的沟通过程。研究人员对5名ALS患者(平均年龄50岁)进行了几项测试,这些患者已经处于疾病晚期,也就是说,他们已经失去了语言能力和上下肢的运动能力。他们接受了如何通过阅读西班牙字母等简单任务来使用应用软件的培训。第一个小组的成立是为了帮助他们学习莫尔斯电码,莫尔斯电码使他们更容易理解西班牙字母及其对每次眨眼的分配。本试验采用两种不同的环境进行,一种是低光强环境,另一种是正常光强环境。第二组是由之前一无所知的患者组成的。