Simone Ghisio, Erica Volta, Paolo Alborno, M. Gori, G. Volpe
{"title":"An open platform for full-body multisensory serious-games to teach geometry in primary school","authors":"Simone Ghisio, Erica Volta, Paolo Alborno, M. Gori, G. Volpe","doi":"10.1145/3139513.3139523","DOIUrl":"https://doi.org/10.1145/3139513.3139523","url":null,"abstract":"Recent results from psychophysics and developmental psychology show that children have a preferential sensory channel to learn specific concepts. In this work, we explore the possibility of developing and evaluating novel multisensory technologies for deeper learning of arithmetic and geometry. The main novelty of such new technologies comes from the renewed understanding of the role of communication between sensory modalities during development that is that specific sensory systems have specific roles for learning specific concepts. Such understanding suggests that it is possible to open a new teaching/learning channel, personalized for each student based on the child’s sensory skills. Multisensory interactive technologies exploiting full-body movement interaction and including a hardware and software platform to support this approach will be presented and discussed. The platform is part of a more general framework developed in the context of the EU-ICT-H2020 weDRAW Project that aims to develop new multimodal technologies for multisensory serious-games to teach mathematics concepts in the primary school.","PeriodicalId":441030,"journal":{"name":"Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132755567","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Simone Ghisio, Paolo Alborno, Erica Volta, M. Gori, G. Volpe
{"title":"A multimodal serious-game to teach fractions in primary school","authors":"Simone Ghisio, Paolo Alborno, Erica Volta, M. Gori, G. Volpe","doi":"10.1145/3139513.3139524","DOIUrl":"https://doi.org/10.1145/3139513.3139524","url":null,"abstract":"Multisensory learning is considered a relevant pedagogical framework for education since a very long time and several authors support the use of a multisensory and kinesthetic approach in children learning. Moreover, results from psychophysics and developmental psychology show that children have a preferential sensory channel to learn specific concepts (spatial and/or temporal), hence a further evidence for the need of a multisensory approach. In this work, we present an example of serious game for learning a particularly complicated mathematical concept: fractions. The main novelty of our proposal comes from the role covered by the communication between sensory modalities in particular, movement, vision, and sound. The game has been developed in the context of the EU-ICT-H2020 weDRAW Project aiming at developing new multimodal technologies for multisensory serious-games on mathematical concepts for primary school children.","PeriodicalId":441030,"journal":{"name":"Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education","volume":"102 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131744973","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Using force-feedback devices in educational settings: a short review","authors":"G. Baud-Bovy, N. Balzarotti","doi":"10.1145/3139513.3139518","DOIUrl":"https://doi.org/10.1145/3139513.3139518","url":null,"abstract":"In this short review, we aim at providing an update about recent research on force-feedback devices in educational settings, with a particular focus on primary school teaching. This review describes haptic devices and education virtual environments before entering into the details of domain-specific applications of this technology in schools. Currently, the number of studies that investigated the potential of haptic devices in educational settings is limited, in particular for primary schools. The absence of longitudinal studies makes it difficult to reach any strong conclusion about the learning outcomes of this technology. Additional research is needed about how this technology might contribute to teach specific concepts at different ages. In particular, we point out the need to do more research on how to combine haptic feedback with visual and audio information, which seems important both on the basis of the results of previous studies and on recent research in neuroscience demonstrating the importance of multi-modal integration in the cognitive development of children. Demonstrating the potential benefit of haptic devices in a learning environment is also important to create a demand for this technology which might lead to the commercialization of haptic devices with an affordable price for schools.","PeriodicalId":441030,"journal":{"name":"Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116754080","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Air violin: a machine learning approach to fingering gesture recognition","authors":"D. Dalmazzo, R. Ramírez","doi":"10.1145/3139513.3139526","DOIUrl":"https://doi.org/10.1145/3139513.3139526","url":null,"abstract":"We train and evaluate two machine learning models for predicting fingering in violin performances using motion and EMG sensors integrated in the Myo device. Our aim is twofold: first, provide a fingering recognition model in the context of a gamification virtual violin application where we measure both right hand (i.e. bow) and left hand (i.e. fingering) gestures, and second, implement a tracking system for a computer assisted pedagogical tool for self-regulated learners in high-level music education. Our approach is based on the principle of mapping-by-demonstration in which the model is trained by the performer. We evaluated a model based on Decision Trees and compared it with a Hidden Markovian Model.","PeriodicalId":441030,"journal":{"name":"Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124614854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}