Analyzing the benefits of integrative multi-dimensional assessments of usability features in interaction-centered user studies

Abstract

Today, usability measures for the evaluation of systems and interfaces are mostly assessed in an isolated way. This paper addresses the question whether an integrative multi-dimensional feature evaluation can lead to different and more holistic results. We combined traditional measures (e.g., time to task completion) with advanced measures, like eye tracking, biosignal data logging and assessment of user emotions. For the evaluation of emotions, we used verbal methods (PAD Semantic Scale and a questionnaire) and a nonverbal method with EmoCards. The overall goal was to document and analyze the interaction as completely as possible (including effectiveness, efficiency and user satisfaction), focusing especially on objective measurements. Furthermore, the recording and assessment of emotions, which are part of the user experience, should give insights into user satisfaction.