{"title":"Biases in Automated Music Playlist Generation: A Comparison of Next-Track Recommending Techniques","authors":"D. Jannach, Iman Kamehkhosh, Geoffray Bonnin","doi":"10.1145/2930238.2930283","DOIUrl":"https://doi.org/10.1145/2930238.2930283","url":null,"abstract":"Playlist generation is a special form of music recommendation where the problem is to create a sequence of tracks to be played next, given a number of seed tracks. In academia, the evaluation of playlisting techniques is often done by assessing with the help of information retrieval measures if an algorithm is capable of selecting those tracks that also a human would pick next. Such approaches however cannot capture other factors, e.g., the homogeneity of the tracks that can determine the quality perception of playlists. In this work, we report the results of a multi-metric comparison of different academic approaches and a commercial playlisting service. Our results show that all tested techniques generate playlists with certain biases, e.g., towards very popular tracks, and often create playlists continuations that are quite different from those that are created by real users.","PeriodicalId":339100,"journal":{"name":"Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122135483","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Vail, Joseph F. Grafsgaard, K. Boyer, E. Wiebe, James C. Lester
{"title":"Gender Differences in Facial Expressions of Affect During Learning","authors":"A. Vail, Joseph F. Grafsgaard, K. Boyer, E. Wiebe, James C. Lester","doi":"10.1145/2930238.2930257","DOIUrl":"https://doi.org/10.1145/2930238.2930257","url":null,"abstract":"Affective support is crucial during learning, with recent evidence suggesting it is particularly important for female students. Facial expression is a rich channel for affect detection, but a key open question is how facial displays of affect differ by gender during learning. This paper presents an analysis suggesting that facial expressions for women and men differ systematically during learning. Using facial video automatically tagged with facial action units, we find that despite no differences between genders in incoming knowledge, self-efficacy, or personality profile, women displayed one lower facial action unit significantly more than men, while men displayed brow lowering and lip fidgeting more than women. However, numerous facial actions including brow raising and nose wrinkling were strongly correlated with learning in women, whereas only one facial action unit, eyelid raiser, was associated with learning for men. These results suggest that the entire affect adaptation pipeline, from detection to response, may benefit from gender-specific models in order to support students more effectively.","PeriodicalId":339100,"journal":{"name":"Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116301717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jonathan Herzig, Guy Feigenblat, Michal Shmueli-Scheuer, D. Konopnicki, A. Rafaeli
{"title":"Predicting Customer Satisfaction in Customer Support Conversations in Social Media Using Affective Features","authors":"Jonathan Herzig, Guy Feigenblat, Michal Shmueli-Scheuer, D. Konopnicki, A. Rafaeli","doi":"10.1145/2930238.2930285","DOIUrl":"https://doi.org/10.1145/2930238.2930285","url":null,"abstract":"Providing customer support through social media channels is gaining popularity. In such a context, predicting customer satisfaction in an early stage of a service conversation is important. Such an analysis can help personalize agent assignment to maximize customer satisfaction, and prioritize conversations. In this paper, we show that affective features such as customer's and agent's personality traits and emotion expression improve prediction of customer satisfaction when added to more typical text based features. We only utilize information extracted from the first customer conversation turn and previous customer and agent social network activity. Thus, our customer satisfaction classifier outputs its prediction in an early stage of the conversation, before any interaction has taken place between the customer and an agent. Our model was trained and tested on a Twitter conversations dataset of two customer support services, and shows an improvement of 30% in F1-score for predicting dissatisfaction.","PeriodicalId":339100,"journal":{"name":"Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117027323","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
C. Musto, P. Lops, Pierpaolo Basile, M. Degemmis, G. Semeraro
{"title":"Semantics-aware Graph-based Recommender Systems Exploiting Linked Open Data","authors":"C. Musto, P. Lops, Pierpaolo Basile, M. Degemmis, G. Semeraro","doi":"10.1145/2930238.2930249","DOIUrl":"https://doi.org/10.1145/2930238.2930249","url":null,"abstract":"The ever increasing interest in semantic technologies and the availability of several open knowledge sources have fueled recent progress in the field of recommender systems. In this paper we feed recommender systems with features coming from the Linked Open Data (LOD) cloud - a huge amount of machine-readable knowledge encoded as RDF statements - with the aim of improving recommender systems effectiveness. In order to exploit the natural graph-based structure of RDF data, we study the impact of the knowledge coming from the LOD cloud on the overall performance of a graph-based recommendation algorithm. In more detail, we investigate whether the integration of LOD-based features improves the effectiveness of the algorithm and to what extent the choice of different feature selection techniques influences its performance in terms of accuracy and diversity. The experimental evaluation on two state of the art datasets shows a clear correlation between the feature selection technique and the ability of the algorithm to maximize a specific evaluation metric. Moreover, the graph-based algorithm leveraging LOD-based features is able to overcome several state of the art baselines, such as collaborative filtering and matrix factorization, thus confirming the effectiveness of the proposed approach.","PeriodicalId":339100,"journal":{"name":"Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization","volume":"50 4","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120886586","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Picture-based Approach to Group Recommender Systems in the E-Tourism Domain","authors":"Amra Delic","doi":"10.1145/2930238.2930368","DOIUrl":"https://doi.org/10.1145/2930238.2930368","url":null,"abstract":"This PhD research aims to integrate group decision making into a personality based recommender systems in a domain with complex and emotional products i.e., e-tourism domain. In this domain, decisions, especially in groups, are often non rational. Based on the ongoing research on picture-based recommender systems at the e-commerce group, TU Wien and the software of Pixtri OG, the research will develop new methods to model group recommendations and support emotion-aware group decision processes, based on and evaluated by a world-wide study.","PeriodicalId":339100,"journal":{"name":"Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization","volume":"2015 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128808915","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Harnessing Crowdsourced Recommendation Preference Data from Casual Gameplay","authors":"Barry Smyth, Rachael Rafter, Sam Banks","doi":"10.1145/2930238.2930260","DOIUrl":"https://doi.org/10.1145/2930238.2930260","url":null,"abstract":"Recommender systems have become a familiar part of our online experiences, suggesting movies to watch, music to listen to, and books to read, among other things. To make relevant suggestions, recommender systems need an accurate picture of our preferences and interests and sometimes even our friends and influencers. This information can be difficult to come by and expensive to source. In this paper we describe a game-with-a-purpose designed to infer useful recommendation data as a side-effect of gameplay. The game is a simple, single-player matching game in which players attempt to match movies with their friends. It has been developed as a Facebook app and harnesses the social graph and likes of players as a source of game data. We describe the basic game mechanics and evaluate the utility of the recommendation knowledge that can be inferred from its gameplay as part of a live-user trial.","PeriodicalId":339100,"journal":{"name":"Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization","volume":"115 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134645124","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Open Social Learner Models for Self-Regulated Learning and Learning Motivation","authors":"Julio Guerra","doi":"10.1145/2930238.2930375","DOIUrl":"https://doi.org/10.1145/2930238.2930375","url":null,"abstract":"Open Learner Models (OLM) have demonstrated a multitude of benefits supporting metacognition and engaging learners. Although researchers have study different representations of OLM, a broader view that situates OLM in Self-Regulated Learning (SRL) is missing. An important element in SRL that can bring a better understanding of these tools and their effects concerns to learning motivation theories. In this work I connect these aspects and propose to study the effects of OLM and motivational factors drawn from learning motivation theories. To account for a broader spectrum of OLM representations, I proposed to explore the addition of social information and different levels of granularity in the OLM. I propose to evaluate different designs and then to evaluate the resulting interface in field studies. With the proposed work I expect to gain a deeper understanding of the effects of OLM tools which can be used to guide the development of better tools, better personalization and adaptive mechanisms, better use of such tools in supporting Self-Regulated Learning, and ultimately impact positively in learning.","PeriodicalId":339100,"journal":{"name":"Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization","volume":"100 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133824856","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Identifying Grey Sheep Users in Collaborative Filtering: A Distribution-Based Technique","authors":"Benjamin Gras, A. Brun, A. Boyer","doi":"10.1145/2930238.2930242","DOIUrl":"https://doi.org/10.1145/2930238.2930242","url":null,"abstract":"The collaborative filtering (CF) approach in recommender systems assumes that users' preferences are consistent among users. Although accurate, this approach fails on some users. We presume that some of these users belong to a small community of users who have unusual preferences, such users are not compliant with the CF underlying assumption. They are grey sheep users. This paper aims at accurately identifying grey sheep users. We introduce a new distribution-based grey sheep users identification technique, that borrows from outlier detection and from information retrieval, while taking into account the specificities of preference data on which CF relies: extreme sparsity, imprecision and users' bias. The experimental evaluation conducted on a state-of-the-art dataset shows that this new distribution-based technique outperforms state-of-the-art grey sheep users identification techniques.","PeriodicalId":339100,"journal":{"name":"Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization","volume":"278 5","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114105152","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
R. Frenoy, Yann Soullard, I. Thouvenin, O. Gapenne
{"title":"Adaptive Training Environment without Prior Knowledge: Modeling Feedback Selection as a Multi-armed Bandit Problem","authors":"R. Frenoy, Yann Soullard, I. Thouvenin, O. Gapenne","doi":"10.1145/2930238.2930256","DOIUrl":"https://doi.org/10.1145/2930238.2930256","url":null,"abstract":"Pedagogical Action Selection (PAS) is a major issue for intelligent tutoring and training systems. Expert knowledge provides useful insights to build strategies that relate students representation to PAS, but it can be difficult to collect. Furthermore, the influence of a specific action may vary across students, which is rarely reflected in expert knowledge. As part of an automatic gesture training system, we propose to model the co-evolution between a student and a training environment in order to provide personalized action selection. The proposed approach is based on three models representing the student, the environment, and the interactions between these two entities. The latter model sees the PAS as a multi-armed bandit problem, each arm representing a possible action. Thus, PAS personalization only relies on the interactions between the student and the learning environment, without any prior knowledge. Two experiments, one in a simulated environment and a second in a calligraphy training environment, highlight the model ability to personalize action selection, and the benefits of this ability on students skill acquisition.","PeriodicalId":339100,"journal":{"name":"Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116017355","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
P. Donnelly, Nathaniel Blanchard, Borhan Samei, A. Olney, Xiaoyi Sun, Brooke Ward, Sean Kelly, M. Nystrand, S. D’Mello
{"title":"Automatic Teacher Modeling from Live Classroom Audio","authors":"P. Donnelly, Nathaniel Blanchard, Borhan Samei, A. Olney, Xiaoyi Sun, Brooke Ward, Sean Kelly, M. Nystrand, S. D’Mello","doi":"10.1145/2930238.2930250","DOIUrl":"https://doi.org/10.1145/2930238.2930250","url":null,"abstract":"We investigate automatic analysis of teachers' instructional strategies from audio recordings collected in live classrooms. We collected a data set of teacher audio and human-coded instructional activities (e.g., lecture, question and answer, group work) in 76 middle school literature, language arts, and civics classes from eleven teachers across six schools. We automatically segment teacher audio to analyze speech vs. rest patterns, generate automatic transcripts of the teachers' speech to extract natural language features, and compute low-level acoustic features. We train supervised machine learning models to identify occurrences of five key instructional segments (Question & Answer, Procedures and Directions, Supervised Seatwork, Small Group Work, and Lecture) that collectively comprise 76% of the data. Models are validated independently of teacher in order to increase generalizability to new teachers from the same sample. We were able to identify the five instructional segments above chance levels with F1 scores ranging from 0.64 to 0.78. We discuss key findings in the context of teacher modeling for formative assessment and professional development.","PeriodicalId":339100,"journal":{"name":"Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization","volume":"86 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131521472","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}