Towards good practice In engaging users In evaluation of computer model Software: Introducing the critical appraisal approach (CAA)

Abstract

Good practices in model software development are essential for boosting uptake. While user-centric approaches are much advocated, challenges remain in including users in development due to diverse definitions for ‘users’, their perceived credibility as an information source, and the influence of market-based innovation choices and the anticipation of (future) demands. While enhancing user feedback could help in addressing these challenges, there is a notable lack of guidance for best practices focused on users, as the emphasis has traditionally been on developers.

To tackle this gap, we propose a Critical Appraisal Approach (CAA) for model software evaluation, informed by the Basin Futures model software and detailed steps in its evaluation, thereby providing guidance to support associated best practices for such software. The paper shows the CAA can assist in 1) enhancing shared understanding between users and developers, 2) coordinating development and evaluation, and 3) aligning development with market dynamics.