{"title":"Long short-term memory fuzzy finite state machine for human activity modelling","authors":"Gadelhag Mohmed, Ahmad Lotfi, A. Pourabdollah","doi":"10.1145/3316782.3322781","DOIUrl":"https://doi.org/10.1145/3316782.3322781","url":null,"abstract":"A challenging key aspect of recognising and modelling human activity is to design a model that can deal with the uncertainty in human behaviour. Several machine learning and deep learning techniques are employed to model the Activity of Daily Living (ADL). This paper provides a new method based on Fuzzy Finite State Machine (FFSM) and Long Short-Term Memory (LSTM) neural network for modelling and recognising human activities. The learning capability in the LSTM allows the system to learn the relations in the temporal data to identify the parameters of the rule-based system through time steps in the learning mode. The learned parameters are then used for generating the fuzzy rules that govern the transitions between the system's states. Experimental results are presented to demonstrate the effectiveness of the proposed approach.","PeriodicalId":264425,"journal":{"name":"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115184118","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hannes Ritschel, A. Seiderer, Kathrin Janowski, Stefan Wagner, E. André
{"title":"Adaptive linguistic style for an assistive robotic health companion based on explicit human feedback","authors":"Hannes Ritschel, A. Seiderer, Kathrin Janowski, Stefan Wagner, E. André","doi":"10.1145/3316782.3316791","DOIUrl":"https://doi.org/10.1145/3316782.3316791","url":null,"abstract":"In the future, an increasing amount of social robots will be found in our domestic environments to support and facilitate everyday life. Especially in the context of assistive, health-related support, more and more robotic products are on the way to the consumer market. While one can observe that many commercial efforts are put into the visual appearance, embodiment, motion and sound of companion robots, this paper focuses on the robot's conversational skills. We investigate how to adapt the robot's linguistic style to the individual user's preferences. This includes two forms of robot persona in the context of information retrieval tasks and games, as well as politeness with regard to recommendations. Therefore, we present an autonomous companion robot, which adapts its spoken language based on explicit human feedback. It provides several functionalities for information retrieval, reminders, communication and entertainment as well as health-related recommendations. Results of the in-situ study with elderly participants indicate that human preferences vary with regard to the robot's employed politeness strategies. Furthermore, the participants preferred assistant persona over companion persona in the information retrieval context.","PeriodicalId":264425,"journal":{"name":"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments","volume":"1089 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116039354","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Session details: Multimodal interfaces and HCI","authors":"C. Thomay","doi":"10.1145/3337988","DOIUrl":"https://doi.org/10.1145/3337988","url":null,"abstract":"","PeriodicalId":264425,"journal":{"name":"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments","volume":"61 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124888415","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Inés Torres, J. M. Olaso, C. Montenegro, Riberto Santana, A. Vázquez, R. Justo, J. A. Lozano, Stephan Schlögl, G. Chollet, Nazim Dugan, M. Irvine, Neil Glackin, C. Pickard, A. Esposito, G. Cordasco, A. Troncone, D. Petrovska-Delacrétaz, Aymen Mtibaa, Mohamed Amine Hmani, M. Korsnes, L. J. Martinussen, Sergio Escalera, C. P. Cantariño, O. Deroo, O. Gordeeva, J. Tenorio-Laranga, E. González-Fraile, B. Fernández-Ruanova, A. Gonzalez-Pinto
{"title":"The EMPATHIC project: mid-term achievements","authors":"M. Inés Torres, J. M. Olaso, C. Montenegro, Riberto Santana, A. Vázquez, R. Justo, J. A. Lozano, Stephan Schlögl, G. Chollet, Nazim Dugan, M. Irvine, Neil Glackin, C. Pickard, A. Esposito, G. Cordasco, A. Troncone, D. Petrovska-Delacrétaz, Aymen Mtibaa, Mohamed Amine Hmani, M. Korsnes, L. J. Martinussen, Sergio Escalera, C. P. Cantariño, O. Deroo, O. Gordeeva, J. Tenorio-Laranga, E. González-Fraile, B. Fernández-Ruanova, A. Gonzalez-Pinto","doi":"10.1145/3316782.3322764","DOIUrl":"https://doi.org/10.1145/3316782.3322764","url":null,"abstract":"The goal of active aging is to promote changes in the elderly community so as to maintain an active, independent and socially-engaged lifestyle. Technological advancements currently provide the necessary tools to foster and monitor such processes. This paper reports on mid-term achievements of the European H2020 EMPATHIC project, which aims to research, innovate, explore and validate new interaction paradigms and platforms for future generations of personalized virtual coaches to assist the elderly and their carers to reach the active aging goal, in the vicinity of their home. The project focuses on evidence-based, user-validated research and integration of intelligent technology, and context sensing methods through automatic voice, eye and facial analysis, integrated with visual and spoken dialogue system capabilities. In this paper, we describe the current status of the system, with a special emphasis on its components and their integration, the creation of a Wizard of Oz platform, and findings gained from user interaction studies conducted throughout the first 18 months of the project.","PeriodicalId":264425,"journal":{"name":"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127285505","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Antona, Danae Ioannidi, Michalis Foukarakis, Justyna Gerłowska, K. Rejdak, C. Abdelnour, Joan Hernández, N. Tantinyà, N. Roberto
{"title":"My robot is happy today: how older people with mild cognitive impairments understand assistive robots' affective output","authors":"M. Antona, Danae Ioannidi, Michalis Foukarakis, Justyna Gerłowska, K. Rejdak, C. Abdelnour, Joan Hernández, N. Tantinyà, N. Roberto","doi":"10.1145/3316782.3322777","DOIUrl":"https://doi.org/10.1145/3316782.3322777","url":null,"abstract":"This paper presents the research conducted towards developing the affective output channel of an assistive robot, called RAMCIP, targeted to elderly users with mild cognitive impairments (MCI) or early stages of Alzheimer Disease (AD). An animated screen allowing the robot to express emotions through facial expressions has been developed, along with a framework for the corresponding modifications of the robot's speech prosody. Both of the above affective robot output elements are dynamically adapted during RAMCIP use based on an affective output policy. The paper reports the results of four experiments, which have been conducted with MCI and early AD patients in order to validate the developed facial expression and speech intonation affective output modalities. The above research efforts have led to the development of the corresponding software prototypes, which have been integrated in the RAMCIP robot.","PeriodicalId":264425,"journal":{"name":"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114688093","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Michalis Papakostas, Varun Kanal, M. Abujelala, K. Tsiakas, F. Makedon
{"title":"Physical fatigue detection through EMG wearables and subjective user reports: a machine learning approach towards adaptive rehabilitation","authors":"Michalis Papakostas, Varun Kanal, M. Abujelala, K. Tsiakas, F. Makedon","doi":"10.1145/3316782.3322772","DOIUrl":"https://doi.org/10.1145/3316782.3322772","url":null,"abstract":"Physical fatigue due to muscle exhaustion is a symptom that can be very common in daily life. However fatigue can sometimes be suspect of more severe diseases such as multiple sclerosis and needs to be assessed appropriately. Despite the need to monitor fatigue, describing it in an objective and quantifiable manner is still an open problem due to the great levels of subjectivity involved. In this work we propose a novel method towards detecting physical fatigue. We design our approach based on objective EMG measurements and we aim to identify the presence of physical fatigue based on subjective user-reports. Based on our analysis we highlight the significance of our findings and we discuss how machine learning based modeling can become useful towards understanding fatigue and designing adaptive rehabilitation scenarios.","PeriodicalId":264425,"journal":{"name":"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments","volume":"129 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114357013","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hannes Ritschel, Kathrin Janowski, A. Seiderer, Stefan Wagner, E. André
{"title":"Insights on usability and user feedback for an assistive robotic health companion with adaptive linguistic style","authors":"Hannes Ritschel, Kathrin Janowski, A. Seiderer, Stefan Wagner, E. André","doi":"10.1145/3316782.3322737","DOIUrl":"https://doi.org/10.1145/3316782.3322737","url":null,"abstract":"Socially assistive robots help the human in everyday tasks. In particular, they can also provide assistance with regard to health and wellbeing, which is an important opportunity to support the independence of the elderly. Since spoken language often carries the essential information, the robot's verbal communication style is of special interest. In order to explore individual user's preferences with regard to the robot's linguistic style we built an autonomous, assistive health companion. It is operated with a custom hardware control panel and offers games, jokes, health-related recommendations, applications for information retrieval and communication. This paper reports on insights from the in-situ user study with regard to the system's usability and participants' feedback.","PeriodicalId":264425,"journal":{"name":"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127876367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
C. Thomay, Benedikt Gollan, Michael Haslgrübler, A. Ferscha, Josef Heftberger
{"title":"A multi-sensor algorithm for activity and workflow recognition in an industrial setting","authors":"C. Thomay, Benedikt Gollan, Michael Haslgrübler, A. Ferscha, Josef Heftberger","doi":"10.1145/3316782.3321523","DOIUrl":"https://doi.org/10.1145/3316782.3321523","url":null,"abstract":"In the recent revival of human labour in industry, and the subsequent push to optimally combine the strengths of man and machine in industrial processes, there is an increased need for methods allowing machines to understand and interpret the actions of their users. An important aspect of this is the understanding and evaluation of the progress of the workflows that are to be executed. Methods for this require both an appropriate choice of sensors, as well as algorithms capable of quickly and efficiently evaluating activity and workflow progress. In this paper we present such an algorithm, which provides activity and workflow recognition using both depth and RGB cameras as input. The algorithm's main purpose is to be used in an industrial training station, allowing novice workers to learn the necessary steps in assembling nordic ski products without the need for human supervision. We will describe how the algorithm recognizes predefined workflows in the sensor data, and present a comprehensive evaluation of the algorithm's performance on a real data recording of operators performing their work in an industrial setting. We will show that the algorithm fulfills the necessary requirements and is ready to be implemented in the training station application.","PeriodicalId":264425,"journal":{"name":"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments","volume":"155 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114401537","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Meaghan Harraghy, Diane Calderon, Rebecca Lietz, J. Brady, F. Makedon, Eric Becker
{"title":"A review of wearable heart rate sensors in research","authors":"Meaghan Harraghy, Diane Calderon, Rebecca Lietz, J. Brady, F. Makedon, Eric Becker","doi":"10.1145/3316782.3321550","DOIUrl":"https://doi.org/10.1145/3316782.3321550","url":null,"abstract":"This paper explores types of wearable heart rate sensors and their reliability. An overview of data collection, brands, and recent findings are included. Wearable sensors, especially those on the wrist in activity trackers and smartwatches are a non-invasive way to track heart rate and receive other measurements of health and activity. Heart rate is based on the amount of activity someone does, but can also be linked to emotions including stress and the external environment. Wearable heart rate sensors are proving increasing accuracy and continue to be prominent in the consumer and research environment.","PeriodicalId":264425,"journal":{"name":"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117191076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Challenges of comparing and matching roads from different spatial datasets","authors":"Mousa Almotairi, Tariq Alsahfi, R. Elmasri","doi":"10.1145/3316782.3316787","DOIUrl":"https://doi.org/10.1145/3316782.3316787","url":null,"abstract":"Road network map is one of the datasets that are used in many different applications. Many smart cities have more than one Road Network map from different sources (government authorities, private enterprise, or volunteered). Be that as it may, there is a high chance of mismatches between road maps that represent the same area for different reasons. These reasons include: one of the datasets is not updated; datasets have different names for the same road; and so on. As a result, matching the roads in such datasets with each other is challenging. This paper introduces a framework that demonstrates methods of how two datasets for the same area can be matched to each other even though there are some data discrepancies. In addition, it gives an overview of each component of the framework and focuses mainly on the similarity measurements. These measurements are local divergence measurements and global divergence measurement. Local divergence measurements compare two roads from different datasets to each other to see if they are similar or not by deciding if these two roads have a similar shape as well as the same length. On the other hand, global divergence measurement is used in order to ensure that these two roads are similar in the real world, not different roads that happen to be beside each other having similar length and shape. This paper discusses several types of applications that could utilize this framework not only for matching different road maps and unify the information for smart cities usages but also data enrichment and being up-to-date.","PeriodicalId":264425,"journal":{"name":"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments","volume":"87 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133220233","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}