多模态人机界面的跨领域应用

A. Czyżewski
{"title":"多模态人机界面的跨领域应用","authors":"A. Czyżewski","doi":"10.1109/SPA.2015.7365104","DOIUrl":null,"url":null,"abstract":"Summary form only given. Developed multimodal interfaces for education applications and for disabled people are presented, including interactive electronic whiteboard based on video image analysis, application for controlling computers with mouth gestures and audio interface for speech stretching for hearing impaired and stuttering people and intelligent pen allowing for diagnosing and ameliorating developmental dyslexia. The eye-gaze tracking system named “CyberEye” is presented including the method of analysis of visual activity of patients remaining in vegetative state helping to assessment of their awareness. The scent emitting multimodal computer interface is also discussed. A new approach to diagnosing Parkinson's disease is shown which is used to evaluate motor and behavioral symptoms of the neurodegenerative disease. The paper is concluded with some more topics & demonstrations of technologies developed for applications to intelligent surveillance systems, environment monitoring systems and automated solutions for enhancement of degraded audio recordings.","PeriodicalId":423880,"journal":{"name":"2015 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA)","volume":"239 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-12-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Cross-domain applications of multimodal human-computer interfaces\",\"authors\":\"A. Czyżewski\",\"doi\":\"10.1109/SPA.2015.7365104\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Summary form only given. Developed multimodal interfaces for education applications and for disabled people are presented, including interactive electronic whiteboard based on video image analysis, application for controlling computers with mouth gestures and audio interface for speech stretching for hearing impaired and stuttering people and intelligent pen allowing for diagnosing and ameliorating developmental dyslexia. The eye-gaze tracking system named “CyberEye” is presented including the method of analysis of visual activity of patients remaining in vegetative state helping to assessment of their awareness. The scent emitting multimodal computer interface is also discussed. A new approach to diagnosing Parkinson's disease is shown which is used to evaluate motor and behavioral symptoms of the neurodegenerative disease. The paper is concluded with some more topics & demonstrations of technologies developed for applications to intelligent surveillance systems, environment monitoring systems and automated solutions for enhancement of degraded audio recordings.\",\"PeriodicalId\":423880,\"journal\":{\"name\":\"2015 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA)\",\"volume\":\"239 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-12-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2015 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SPA.2015.7365104\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SPA.2015.7365104","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

只提供摘要形式。本文介绍了为教育应用和残疾人开发的多模式界面,包括基于视频图像分析的交互式电子白板,用嘴型手势控制计算机的应用,为听力受损和口吃者提供语音扩展的音频接口,以及用于诊断和改善发展性阅读障碍的智能笔。介绍了一种名为CyberEye的眼球追踪系统,包括分析植物人视觉活动的方法,以帮助评估他们的意识。并对多模态计算机界面进行了讨论。一种新的诊断帕金森氏病的方法是用来评估神经退行性疾病的运动和行为症状。最后,本文介绍了智能监控系统、环境监控系统和增强退化录音的自动化解决方案的应用技术。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Cross-domain applications of multimodal human-computer interfaces
Summary form only given. Developed multimodal interfaces for education applications and for disabled people are presented, including interactive electronic whiteboard based on video image analysis, application for controlling computers with mouth gestures and audio interface for speech stretching for hearing impaired and stuttering people and intelligent pen allowing for diagnosing and ameliorating developmental dyslexia. The eye-gaze tracking system named “CyberEye” is presented including the method of analysis of visual activity of patients remaining in vegetative state helping to assessment of their awareness. The scent emitting multimodal computer interface is also discussed. A new approach to diagnosing Parkinson's disease is shown which is used to evaluate motor and behavioral symptoms of the neurodegenerative disease. The paper is concluded with some more topics & demonstrations of technologies developed for applications to intelligent surveillance systems, environment monitoring systems and automated solutions for enhancement of degraded audio recordings.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信