Multi-criteria assessment of a whole-of-government planning methodology using MYRIAD

The present work describes the application of a multi-criteria assessment tool called MYRIAD to the evaluation of a methodology that was developed to improve team understanding of a complex situation. The methodology aims to support a multi-disciplinary team working collaboratively on the development of a mission plan during an expeditionary stability operation. We conducted a case study assessing collaborative understanding and team performance while subject matter experts employed the methodology as a complement to the standard planning process. Results were analyzed using MYRIAD, a preference modeling system that allows combining disparate measures into a coherent assessment capturing several key logical relationships between metrics - ones that may not be modeled using the traditional weighted sum approach. MYRIAD was also used to perform a sensitivity analysis in order to derive from the preference model which aspects of the planning methodology would lead to the greatest overall improvement. Results helped identifying priority areas for future development.