{"title":"A Multimodal Framework for Recognizing Emotional Feedback in Conversational Recommender Systems","authors":"B. D. Carolis, M. Degemmis, P. Lops","doi":"10.1145/2809643.2809647","DOIUrl":"https://doi.org/10.1145/2809643.2809647","url":null,"abstract":"A conversational recommender system should interactively assist users in order to understand their needs and preferences and produce personalized recommendations accordingly. While traditional recommender systems use a single-shot approach, the conversational ones refine their suggestions during the conversation since they gain more knowledge about the user. This approach can be useful in case the recommender is embodied in a conversational agent acting as a shopping assistant in a smart retail context. In this case, knowledge about the user preferences may be acquired during the conversation and by observing the user behavior. In such a setting, besides \"rational\" information, the agent may grasp information also about extra-rational factors such as attitudes, emotions, likes and dislikes. This paper describes the study performed in order to develop a multimodal framework for recognizing the shopping attitude of the user during the interaction with DIVA, a Dress-shopping InteractiVe Assistant. In particular, speech prosody, gestures and facial expressions have been taken into account for providing feedback to the system and refining the recommendation accordingly.","PeriodicalId":250425,"journal":{"name":"Proceedings of the 3rd Workshop on Emotions and Personality in Personalized Systems 2015","volume":"114 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132574535","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Discount Sensitive Recommender System for Retail Business","authors":"Masahiro Sato, Hidetaka Izumo, Takashi Sonoda","doi":"10.1145/2809643.2809646","DOIUrl":"https://doi.org/10.1145/2809643.2809646","url":null,"abstract":"User preferences for items are not the only determinant of purchase. Price promotion influences user's buying habits and changes items that are put in a basket. Such a reaction to discount depends on the user personality. In this paper, we propose a recommendation algorithm with personalized discount sensitivity. The effectiveness of the proposed model was verified using a public retail dataset. Correlation between personal persistence in repeat purchases and discount sensitivity of users was also investigated.","PeriodicalId":250425,"journal":{"name":"Proceedings of the 3rd Workshop on Emotions and Personality in Personalized Systems 2015","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133184145","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Predicting Personality Traits with Instagram Pictures","authors":"B. Ferwerda, M. Schedl, M. Tkalcic","doi":"10.1145/2809643.2809644","DOIUrl":"https://doi.org/10.1145/2809643.2809644","url":null,"abstract":"Instagram is a popular social networking application, which allows photo-sharing and applying different photo filters to adjust the appearance of a picture. By applying photo filters, users are able to create a style that they want to express to their audience. In this study we tried to infer personality traits from the way users take pictures and apply filters to them. To investigate this relationship, we conducted an online survey where we asked participants to fill in a personality questionnaire, and grant us access to their Instagram account through the Instagram API. Among 113 participants and 22,398 extracted Instagram pictures, we found distinct picture features (e.g., hue, brightness, saturation) that are related to personality traits. Our findings suggest a relationship between personality traits and the way users want to make their pictures look. This allow for new ways to extract personality traits from social media trails, and new ways to facilitate personalized systems.","PeriodicalId":250425,"journal":{"name":"Proceedings of the 3rd Workshop on Emotions and Personality in Personalized Systems 2015","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116192238","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A General Architecture for an Emotion-aware Content-based Recommender System","authors":"F. Narducci, M. Degemmis, P. Lops","doi":"10.1145/2809643.2809648","DOIUrl":"https://doi.org/10.1145/2809643.2809648","url":null,"abstract":"Emotions play a crucial role in the decision making process. Frequently, choices are strongly influenced by the mood of the moment, and the same person could take different decisions at different time on the same topic. Recommender systems, that are definitively recognized as tools for supporting the decision making process, demonstrated to be more accurate exploiting emotive labels in several work. For this reason a large number of researchers are focusing their attention on the analysis of the emotions by exploiting data that users daily disseminate on the Web (e.g.: Social Networks, Blogs, Forums, etc.). In this paper we propose a general architecture for implementing an emotion-aware content-based recommender system. Furthermore, we developed a web service that researchers can freely exploit for their own implementations. We carried out a user study on the domain of music recommendation, particularly influenced by the user emotion, and results are very promising.","PeriodicalId":250425,"journal":{"name":"Proceedings of the 3rd Workshop on Emotions and Personality in Personalized Systems 2015","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131417291","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Vitoantonio Bevilacqua, L. Carnimeo, P. Guccione, G. Mastronardi, A. Uva, M. Fiorentino, G. Monno, F. Marino, M. Dotoli, N. Costantino, M. Dassisti, N. Carbonara
{"title":"A Multimodal System for Nonverbal Human Feature Recognition in Emotional Framework","authors":"Vitoantonio Bevilacqua, L. Carnimeo, P. Guccione, G. Mastronardi, A. Uva, M. Fiorentino, G. Monno, F. Marino, M. Dotoli, N. Costantino, M. Dassisti, N. Carbonara","doi":"10.1145/2809643.2809645","DOIUrl":"https://doi.org/10.1145/2809643.2809645","url":null,"abstract":"A correct recognition of nonverbal expressions is currently one of the most important challenges of research in the field of human computer interaction. The ability to recognize human actions could change the way to interact with machines in several environments and contexts, or even the way to live. In this paper, we describe the advances of a previous study finalized to design, implement and validate an innovative recognition system already developed by some of the authors. It was aimed at recognizing two opposite emotional conditions (resonance and dissonance) of a candidate to a job position interacting with the recruiter during a job interview. Results in terms of the accuracy, resonance rate, and dissonance rate of the three new optimized neural network-based (NN) classifiers are discussed. Comparison with previous results of three NN classifiers is also presented based on three single domains: facial, vocal and gestural.","PeriodicalId":250425,"journal":{"name":"Proceedings of the 3rd Workshop on Emotions and Personality in Personalized Systems 2015","volume":"280 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129980671","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Personality in Recommender Systems","authors":"Li Chen","doi":"10.1145/2809643.2815363","DOIUrl":"https://doi.org/10.1145/2809643.2815363","url":null,"abstract":"The personality-based recommender systems (RS) has emerged as a new type of RS in recent years, given that personality contains valuable information enabling systems to better understand users' preferences [7]. This presentation first gives an overview of the state-of-the-art in this area, including the approaches developed for enhancing collaborative filtering (CF) by computing users' or items' personality similarity [1,4,5,8], as well as the one that incorporates personality into matrix factorization to predict items that users are able to rate for active learning [3]. We then discuss several open issues. One issue is how to utilize personality to improve recommendation diversity. Diversity refers to the system's ability in returning different items in one set, which may help users more effectively explore the product space and discover unexpected items [6]. Our recent studies identified the effect of personality on users' diversity differences [2], and demonstrated that people perceive the system, which considers personality in adjusting recommendations' diversity degree, more competent and satisfying [9]. We also show how to acquire personality through unobtrusive and implicit way, so as to save users' efforts in answering personality quizzes. Through testing an inference model in movie domain that unifies both types of domain-dependent and -independent features for deriving users' personality from their behavior, we proved that the implicitly inferred personality can also be helpful to augment the system's recommendation accuracy [10]. Other open issues include how to develop personality-based cross domain RS for addressing the critical cold-start problem, how to exploit the influence of personality on users' emotions for boosting context-aware RS, and how to elicit more domain-independent features for generalizing the personality inference procedure.","PeriodicalId":250425,"journal":{"name":"Proceedings of the 3rd Workshop on Emotions and Personality in Personalized Systems 2015","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131707627","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Emotion-Based Movie Recommendations: How Far Can We Take This?","authors":"S. Berkovsky","doi":"10.1145/2809643.2815362","DOIUrl":"https://doi.org/10.1145/2809643.2815362","url":null,"abstract":"One of the underlying targets of movies is to evoke emotions in their viewers. When the viewers connect emotionally to a movie scenes and characters, then the watching experience naturally becomes stronger and more memorable. The importance of emotions is recognised by the movie industry and pre-screening sessions are regularly held to figure out if a movie reaches the desired emotional impact. Although there exists a large body of research on movie recommendations, the established recommendation techniques generally overlook the emotional aspects of movie watching. Collaborative methods rely on statistical correlations between movie ratings, whereas content-based and conversational methods primarily exploit implicit or explicit user preferences towards certain content features of movies. In this talk, we propose that recent developments in sensing technologies, affective computing, and data mining pave the way for a new generation of emotion-based movie recommender systems. We argue that the emotions evoked over the course of watching a movie offer a fertile ground for user modelling and movie recommendations. The evoked emotions can be considered as implicit user feedback regarding the emotional triggers planted in the movie by its creators. Clearly, users may respond in different ways to the same triggers, providing detailed information on their affective state and personality. This emotional information may be substantially richer than traditional ratings or feature preference scores typically exploited by recommender systems. Hence, it can fuel the delivery of better movie recommendations. We will discuss several challenges referring to the use of emotions in movie recommendations. How to accurately and unobtrusively capture user emotions evoked while watching a movie? What techniques can reliably interpret the captured emotions in context of the movie content and its emotional triggers? How can the information on the evoked user emotions and affective state augment the movie recommendation task? How to integrate these emotion-based recommendations with other recommendation techniques? Many of these questions are only partially answered and call for future research. Last but not the least, an important question to consider refers to the broad applicability of emotion-based personalisation. Emotional aspects of item consumption or purchase are not limited to movie watching, and similar challenges are faced in the music, retailing, advertisement, and other domains. Taking the emotion-based user modelling and recommendation beyond movie recommendations has a strong untapped potential both in the research and business worlds.","PeriodicalId":250425,"journal":{"name":"Proceedings of the 3rd Workshop on Emotions and Personality in Personalized Systems 2015","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132216440","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Samer Schaat, A. Miladinović, S. Wilker, Stefan Kollmann, Stephan Dickert, Erdem Geveze, V. Gruber
{"title":"Emotion in Consumer Simulations for the Development and Testing of Recommendations for Marketing Strategies","authors":"Samer Schaat, A. Miladinović, S. Wilker, Stefan Kollmann, Stephan Dickert, Erdem Geveze, V. Gruber","doi":"10.1145/2809643.2809649","DOIUrl":"https://doi.org/10.1145/2809643.2809649","url":null,"abstract":"To examine the impact factors and mechanisms of the decision to switch to green electricity, we develop a socio-cognitive agent-based simulation. Following seminal research in the field of decision making we focus on emotion and social norms as core mechanisms in consumer decisions. A survey of possible consumers provides the information how to calibrate the simulation, by which means a first validation is reached. Further data analysis supports model validation and exploration. Overall, this methodology provides the premises of using simulations for recommending marketing strategies that support the distribution of environmental-friendly energy providers.","PeriodicalId":250425,"journal":{"name":"Proceedings of the 3rd Workshop on Emotions and Personality in Personalized Systems 2015","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117043234","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}