Developing a Criteria-Based Evaluation Tool for User Experience Design that Balances Standardization and Creativity

Abstract

Design systems are increasing in popularity, created to ensure a consistent aesthetic of graphics and interactions in websites and apps, and guide product development. They tend to include a set of standards, principles, and documentation. Due to their often-rigid requirements on structure and uniformity, traditional design systems can discourage creativity and customization. To forge a balance, the work develops a criteria-based evaluation tool, or ‘scorecard’ for assessing design components that incorporate principles of consistent, standardized practice, yet prioritize creative freedom. The evaluation scorecard allows inconsistencies to be managed in a collaborative and consensus-based manner. Users select parameters and metrics to evaluate the various elements of a design component. The tool calculates a score based on the number of parameters passed or failed. Scores below team-desired thresholds signal a need for further modification or redesign. Usability feedback using talk-aloud and surveys in a focus group format assess the ease of use and efficiency of the tool and identify gaps in functionality.