Evaluating a user interface with ergonomic criteria

Abstract

The usefulness of a set of ergonomic criteria for the evaluation of user interfaces was assessed using a mixed two‐factors experimental design. Two groups of usability specialists (control, criteria) were asked to evaluate the interface of a musical database management system in two phases. In the first phase of the experiment, all the participants relied solely on their expertise; in the second phase they were instructed to evaluate the management system again but this time through the replay of their previous exploration: Participants in the criteria group used a set of ergonomic criteria whereas the participants in the control group did not. In the first phase, the two groups did not differ in terms of: (a) the number of usability problems detected, and (b) the proportions of usability problems uncovered as well as the proportion of usability problems found in common, with respect to the number of single evaluations (one by participant) that were computed into combined evaluations (i.e., aggregates). I...