Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization最新文献

Lowering the Barrier for Successful Replication and Evaluation 降低成功复制和评估的障碍

Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization Pub Date : 2018-10-01 DOI: 10.1109/BELIV.2018.8634201

Hendrik Lücke-Tieke, Marcel Beuth, Philipp Schader, T. May, J. Bernard, J. Kohlhammer

引用次数: 5

Design Study Contributions Come in Different Guises: Seven Guiding Scenarios 设计研究的贡献有不同的面貌:七个指导方案

Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization Pub Date : 2016-10-24 DOI: 10.1145/2993901.2993913

M. Sedlmair

引用次数: 18

Evaluating Information Visualization on Mobile Devices: Gaps and Challenges in the Empirical Evaluation Design Space 评估移动设备上的信息可视化:经验评估设计空间的差距和挑战

Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization Pub Date : 2016-10-24 DOI: 10.1145/2993901.2993906

Kerstin Blumenstein, C. Niederer, Markus Wagner, Grischa Schmiedl, A. Rind, W. Aigner

引用次数: 20

A Nested Workflow Model for Visual Analytics Design and Validation 可视化分析设计和验证的嵌套工作流模型

Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization Pub Date : 2016-10-24 DOI: 10.1145/2993901.2993915

P. Federico, Albert Amor-Amoros, S. Miksch

引用次数: 8

Cognitive Stages in Visual Data Exploration 视觉数据探索中的认知阶段

Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization Pub Date : 2016-10-24 DOI: 10.1145/2993901.2993902

M. A. Yalçın, N. Elmqvist, B. Bederson

{"title":"Cognitive Stages in Visual Data Exploration","authors":"M. A. Yalçın, N. Elmqvist, B. Bederson","doi":"10.1145/2993901.2993902","DOIUrl":"https://doi.org/10.1145/2993901.2993902","url":null,"abstract":"Data exploration requires forming analysis goals, planning actions and evaluating results effectively, all of which are complex cognitive activities. Therefore, the data exploration and analysis process can be improved through a principled and comprehensive approach to analyzing the cognitive activities of the user given a data exploration tool. However, many taxonomies and evaluations focus on a specific tool or specific design guides instead of cognitive activities comprehensively. In this paper, we first present the Cognitive Exploration Framework that identifies six stages of cognitive activities in visual data exploration. These stages are a combination of two activities---planning and assessing---across data analysis, interaction, and visualization. Cognitive barriers in each stage can lower the success and speed of data exploration. The framework also identifies the factors of decision-making, existing knowledge and motivation that influence cognitive activities. We argue that cognitive stages can be supported by improving the design of tools rather than their computing capabilities. We demonstrate how the framework clarifies the structured relationship between design guides to specific cognitive stages. In particular, the framework can also be used to guide evaluation of data exploration tools. To reveal cognitive barriers in each stage, we focused on the failures instead of success stories, and on motivating self-driven open-ended exploration instead of using benchmarked tasks on fixed datasets. With these goals, we studied short-term casual use of an exploratory tool by novices with limited training. Our results reveal cognitive barriers across all stages. We also discuss directions for future research and applications.","PeriodicalId":235801,"journal":{"name":"Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization","volume":"120 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114256299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 23

Beyond Usability and Performance: A Review of User Experience-focused Evaluations in Visualization 超越可用性和性能:以用户体验为中心的可视化评估综述

Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization Pub Date : 2016-10-24 DOI: 10.1145/2993901.2993903

B. Saket, A. Endert, J. Stasko

引用次数: 92

Why Evaluating Uncertainty Visualization is Error Prone 为什么评估不确定性可视化容易出错

Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization Pub Date : 2016-10-24 DOI: 10.1145/2993901.2993919

J. Hullman

引用次数: 22

Information Theoretic Measures for Visual Analytics: The Silver Ticket? 视觉分析的信息理论措施:银券?

Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization Pub Date : 2016-10-24 DOI: 10.1145/2993901.2993920

Laura A. McNamara, Travis L. Bauer, Michael J. Haass, Laura E. Matzen

{"title":"Information Theoretic Measures for Visual Analytics: The Silver Ticket?","authors":"Laura A. McNamara, Travis L. Bauer, Michael J. Haass, Laura E. Matzen","doi":"10.1145/2993901.2993920","DOIUrl":"https://doi.org/10.1145/2993901.2993920","url":null,"abstract":"In this paper, we argue that information theoretic measures may provide a robust, broadly applicable, repeatable metric to assess how a system enables people to reduce high-dimensional data into topically relevant subsets of information. Explosive growth in electronic data necessitates the development of systems that balance automation with human cognitive engagement to facilitate pattern discovery, analysis and characterization, variously described as \"cognitive augmentation\" or \"insight generation.\" However, operationalizing the concept of insight in any measurable way remains a difficult challenge for visualization researchers. The \"golden ticket\" of insight evaluation would be a precise, generalizable, repeatable, and ecologically valid metric that indicates the relative utility of a system in heightening cognitive performance or facilitating insights. Unfortunately, the golden ticket does not yet exist. In its place, we are exploring information theoretic measures derived from Shannon's ideas about information and entropy as a starting point for precise, repeatable, and generalizable approaches for evaluating analytic tools. We are specifically concerned with needle-in-haystack workflows that require interactive search, classification, and reduction of very large heterogeneous datasets into manageable, task-relevant subsets of information. We assert that systems aimed at facilitating pattern discovery, characterization and analysis -- i.e., \"insight\" - must afford an efficient means of sorting the needles from the chaff; and simple compressibility measures provide a way of tracking changes in information content as people shape meaning from data.","PeriodicalId":235801,"journal":{"name":"Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization","volume":"63 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132576981","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Using Concrete and Realistic Data in Evaluating Initial Visualization Designs 使用具体和现实的数据评估初始可视化设计

Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization Pub Date : 2016-10-24 DOI: 10.1145/2993901.2993917

S. Knudsen, Jeppe Gerner Pedersen, Thor Herdal, J. E. Larsen

{"title":"Using Concrete and Realistic Data in Evaluating Initial Visualization Designs","authors":"S. Knudsen, Jeppe Gerner Pedersen, Thor Herdal, J. E. Larsen","doi":"10.1145/2993901.2993917","DOIUrl":"https://doi.org/10.1145/2993901.2993917","url":null,"abstract":"We explore means of designing and evaluating initial visualization ideas, with concrete and realistic data in cases where data is not readily available. Our approach is useful in exploring new domains and avenues for visualization, and contrasts other visualization work, which typically operate under the assumption that data has already been collected, and is ready to be visualized. We argue that it is sensible to understand data requirements and evaluate the potential value of visualization before devising means of automatic data collection. We base our exploration on three cases selected to span a range of factors, such as the role of the person doing the data collection and the type of instrumentation used. The three cases relate to visualizing sports, construction, and cooking domain data, and use primarily time-domain data and visualizations. For each case, we briefly describe the design case and problem, the manner in which we collected data, and the findings obtained from evaluations. Afterwards, we describe four factors of our data collection approach, and discuss potential outcomes from it.","PeriodicalId":235801,"journal":{"name":"Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132401932","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

A Survey on Interaction Log Analysis for Evaluating Exploratory Visualizations 用于评价探索性可视化的交互日志分析综述

Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization Pub Date : 2016-10-24 DOI: 10.1145/2993901.2993912

Omar Eltayeby, Wenwen Dou

引用次数: 12