Proceedings of the 16th International Conference on Multimodal Interaction最新文献_第4页

Smart Multimodal Interaction through Big Data 通过大数据实现智能多模式交互

Proceedings of the 16th International Conference on Multimodal Interaction Pub Date : 2014-11-12 DOI: 10.1145/2663204.2669985

Cafer Tosun

引用次数: 0

Measuring Child Visual Attention using Markerless Head Tracking from Color and Depth Sensing Cameras 利用彩色和深度感测相机的无标记头部跟踪测量儿童视觉注意力

Proceedings of the 16th International Conference on Multimodal Interaction Pub Date : 2014-11-12 DOI: 10.1145/2663204.2663235

Jonathan Bidwell, Irfan Essa, A. Rozga, G. Abowd

{"title":"Measuring Child Visual Attention using Markerless Head Tracking from Color and Depth Sensing Cameras","authors":"Jonathan Bidwell, Irfan Essa, A. Rozga, G. Abowd","doi":"10.1145/2663204.2663235","DOIUrl":"https://doi.org/10.1145/2663204.2663235","url":null,"abstract":"A child's failure to respond to his or her name being called is an early warning sign for autism and response to name is currently assessed as a part of standard autism screening and diagnostic tools. In this paper, we explore markerless child head tracking as an unobtrusive approach for automatically predicting child response to name. Head turns are used as a proxy for visual attention. We analyzed 50 recorded response to name sessions with the goal of predicting if children, ages 15 to 30 months, responded to name calls by turning to look at an examiner within a defined time interval. The child's head turn angles and hand annotated child name call intervals were extracted from each session. Human assisted tracking was employed using an overhead Kinect camera, and automated tracking was later employed using an additional forward facing camera as a proof-of-concept. We explore two distinct analytical approaches for predicting child responses, one relying on rule-based approached and another on random forest classification. In addition, we derive child response latency as a new measurement that could provide researchers and clinicians with finer grain quantitative information currently unavailable in the field due to human limitations. Finally we reflect on steps for adapting our system to work in less constrained natural settings.","PeriodicalId":389037,"journal":{"name":"Proceedings of the 16th International Conference on Multimodal Interaction","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128415214","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 11

An Outline of Opportunities for Multimodal Research 多模式研究的机会概述

Proceedings of the 16th International Conference on Multimodal Interaction Pub Date : 2014-11-12 DOI: 10.1145/2663204.2668320

D. Heylen, A. Vinciarelli

引用次数: 0

Data-Driven Model of Nonverbal Behavior for Socially Assistive Human-Robot Interactions 社会辅助人机交互的非语言行为数据驱动模型

Proceedings of the 16th International Conference on Multimodal Interaction Pub Date : 2014-11-12 DOI: 10.1145/2663204.2663263

H. Admoni, B. Scassellati

引用次数: 43

Glass Shooter: Exploring First-Person Shooter Game Control with Google Glass 玻璃射击:探索第一人称射击游戏控制谷歌玻璃

Proceedings of the 16th International Conference on Multimodal Interaction Pub Date : 2014-11-12 DOI: 10.1145/2663204.2669623

Chun-Yen Hsu, Ying-Chao Tung, Han-Yu Wang, Silvia Chyou, Jer-Wei Lin, Mike Y. Chen

引用次数: 3

The hybrid Agent MARCO 混合特工MARCO

Proceedings of the 16th International Conference on Multimodal Interaction Pub Date : 2014-11-12 DOI: 10.1145/2663204.2669629

Nicolas Riesterer, C. Becker-Asano, J. Hué, C. Dornhege, B. Nebel

引用次数: 1

Increasing Customers' Attention using Implicit and Explicit Interaction in Urban Advertisement 城市广告中内隐与外显互动提升顾客注意力

Proceedings of the 16th International Conference on Multimodal Interaction Pub Date : 2014-11-12 DOI: 10.1145/2663204.2663268

Matthias Wölfel, Luigi Bucchino

引用次数: 1

Multi-Resident Human Behaviour Identification in Ambient Assisted Living Environments 环境辅助生活环境中多居民人类行为识别

Proceedings of the 16th International Conference on Multimodal Interaction Pub Date : 2014-11-12 DOI: 10.1145/2663204.2666286

H. Alemdar

引用次数: 3

Exploring multimodality for translator-computer interaction 探索翻译-计算机交互的多模态

Proceedings of the 16th International Conference on Multimodal Interaction Pub Date : 2014-11-12 DOI: 10.1145/2663204.2666280

Julián Zapata

引用次数: 6

Written Activity, Representations and Fluency as Predictors of Domain Expertise in Mathematics 写作活动、表征和流畅性:数学领域专长的预测因子

Proceedings of the 16th International Conference on Multimodal Interaction Pub Date : 2014-11-12 DOI: 10.1145/2663204.2663245

S. Oviatt, Adrienne Cohen

{"title":"Written Activity, Representations and Fluency as Predictors of Domain Expertise in Mathematics","authors":"S. Oviatt, Adrienne Cohen","doi":"10.1145/2663204.2663245","DOIUrl":"https://doi.org/10.1145/2663204.2663245","url":null,"abstract":"The emerging field of multimodal learning analytics evaluates natural communication modalities (digital pen, speech, images) to identify domain expertise, learning, and learning-oriented precursors. Using the Math Data Corpus, this research investigated students' digital pen input as small groups collaborated on solving math problems. Compared with non-experts, findings indicated that domain experts have an opposite pattern of accelerating total written activity as problem difficulty increases, a lower written and spoken disfluency rate, and they express different content--including a higher ratio of nonlinguistic symbolic representations and structured diagrams to elemental marks. Implications are discussed for developing reliable multimodal learning analytics systems that incorporate digital pen input to automatically track the consolidation of domain expertise. This includes prediction based on a combination of activity patterns, fluency, and content analysis. New MMLA systems are expected to have special utility on cell phones, which already have multimodal interfaces and are the dominant educational platform worldwide.","PeriodicalId":389037,"journal":{"name":"Proceedings of the 16th International Conference on Multimodal Interaction","volume":"98 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133182717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 12