{"title":"Supporting End-User Understanding of Classification Errors","authors":"Emma Beauxis-Aussalet, J. Doorn, L. Hardman","doi":"10.1145/3232078.3232096","DOIUrl":"https://doi.org/10.1145/3232078.3232096","url":null,"abstract":"Classifiers are applied in many domains where classification errors have significant implications. However, end-users may not always understand the errors and their impact, as error visualizations are typically designed for experts and for improving classifiers. We discuss a visualization design that addresses the specific needs of classifiers' end-users. We evaluate this design with users from three levels of expertise, and compare it with ROC curves and confusion matrices. We identify key difficulties with understanding the classification errors, and how visualization designs addressed or aggravated them. The main issues concerned confusions of the actual and predicted classes (e.g., confusion of False Positives and False Negatives). The machine learning terminology, complexity of ROC curves, and symmetry of confusion matrices aggravated the confusions. The end-user-oriented visualization reduced the difficulties by using several visual features to clarify the actual and predicted classes, and more tangible metrics and representation. Our results contribute to supporting end-users' understanding of classification errors, and informed decisions when choosing or tuning classifiers.","PeriodicalId":263115,"journal":{"name":"Proceedings of the 36th European Conference on Cognitive Ergonomics","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125403388","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Interactive Narratives for Profiling Ethics Orientation","authors":"C. Santos, Vassilis-Javed Khan, P. Markopoulos","doi":"10.1145/3232078.3232081","DOIUrl":"https://doi.org/10.1145/3232078.3232081","url":null,"abstract":"Two-dimensional1 arrays of bi-component structures made of cobalt and permalloy elliptical dots with thickness of 25 nm, length 1 μm and width of 225 nm, have been prepared by a self-aligned shadow deposition technique. Brillouin light scattering has been exploited to study the frequency dependence.","PeriodicalId":263115,"journal":{"name":"Proceedings of the 36th European Conference on Cognitive Ergonomics","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126697654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jonas Lundberg, C. Westin, Mattias Arvola, Stefan Holmlid, B. Josefsson
{"title":"Cognitive Work Analysis and Conceptual Designing for Unmanned Air Traffic Management in Cities","authors":"Jonas Lundberg, C. Westin, Mattias Arvola, Stefan Holmlid, B. Josefsson","doi":"10.1145/3232078.3232082","DOIUrl":"https://doi.org/10.1145/3232078.3232082","url":null,"abstract":"Cognitive1 Work Analysis (CWA) is an appropriate approach in high-stakes domains, such as Air Traffic Management (ATM). It provides focus on human expert performance in regular as well as contingency situations. However, CWA is not suitable for the design of a first-of-a-kind system, since there is nothing to analyze before the start of the design process. In 2017, unmanned traffic management (UTM) for intense drone traffic in cities was such a system. Making things worse, the UTM system has to be in place before the traffic, since it provides basic safety. In this paper we present conceptual designing as a bootstrapping approach to CWA for UTM as a first-of-a-kind system.","PeriodicalId":263115,"journal":{"name":"Proceedings of the 36th European Conference on Cognitive Ergonomics","volume":"371 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132445401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"From Word Play to World Play: Introducing Humor in Human-Computer Interaction","authors":"A. Nijholt","doi":"10.1145/3232078.3232239","DOIUrl":"https://doi.org/10.1145/3232078.3232239","url":null,"abstract":"Humor is important in our life, whether it is at home, at work, or in public spaces. Smart technology is increasingly becoming part of our daily life. Can smart technology, sensors and actuators, not only be used to introduce smartness in our environments, but also to introduce amusement? So far understanding of humor has escaped algorithmic approaches. Nevertheless, humor research knowledge is available and is increasing. First philosophers, then psychologists, then linguists and AI researchers made humor topic of their research. The aim of this paper is to introduce humor research to the human-computer interaction community. In particular we look at how our digitally enhanced physical worlds, or smart environments, can facilitate humor creation.","PeriodicalId":263115,"journal":{"name":"Proceedings of the 36th European Conference on Cognitive Ergonomics","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134359955","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Mild Place Illusion: A Virtual Reality Factor to Spark Creativity in Writing","authors":"Frederica Gonçalves, Pedro F. Campos","doi":"10.1145/3232078.3232085","DOIUrl":"https://doi.org/10.1145/3232078.3232085","url":null,"abstract":"Developments in Virtual Reality (VR) technology have modified the creative potential of each individual. We introduce a new concept, called \"mild place illusion\", as a new paradigm for designing VR-based user interfaces targeted at stimulating creativity. We show that for creative tasks - such as creative writing, new product ideation, and brainstorming - a \"just-enough\" amount of place illusion leads to a greater self-perception of creativity, as opposed to a \"full-level\" place illusion. This is a somewhat unexpected result since one would suppose, a priori, to have the full-level place illusion as the optimal setup for stimulating creativity. We considered that the methodology in this work was fairly complex, but our results show -- through a data triangulation approach -- that we were able to identify more consistent and personal creative experiences. Therefore, the main contribution of this paper is a new paradigm for designing VR user interfaces targeted at stimulating creativity by showing that a \"one-illusion interspace\" leads to a greater self-perception of creativity.","PeriodicalId":263115,"journal":{"name":"Proceedings of the 36th European Conference on Cognitive Ergonomics","volume":"83 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115766788","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Using a mixed-methods assessment approach in a gaming-simulation environment to increase resilience","authors":"P. Berggren, J. V. Laere, B. Johansson","doi":"10.1145/3232078.3232100","DOIUrl":"https://doi.org/10.1145/3232078.3232100","url":null,"abstract":"Critical infrastructures for fuel, food, transport and the payment system become inceasingly entangled. Disruptions in the payment system can quickly lead to cascading effects and even the responses of actors in the various sectors are interrelated, which can cause escalation if the collaborative responses are not well-aligned. Our contribution to the track of Human Factors and simulation discusses how gaming-simulation can be used as a training environment where groups of practitioners can learn to develop in-depth understanding of system behaviour (i.e. cascading effects of disruptions) and learn how to develop collaborative resilience across many different critical infrastructures. More specifically, our paper focuses on the development and application of a mixed-methods assessment approach in the simulation-game. The assessment method captures qualitative as well as quantitative aspects of resilience and team-work. It can be used to assess the value of our simulation-game and to increase insight in what collective resilience actually implies.","PeriodicalId":263115,"journal":{"name":"Proceedings of the 36th European Conference on Cognitive Ergonomics","volume":"54 6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130469542","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}