Summative evaluation for design science artifact using structured walkthrough

Abstract

Artifact evaluation is important as it helps to validate and provide direct attention to the artifact's rigor, usefulness, clarity and completeness in the field of design science. In the case of Knowledge Audit Process for Inter-agencies (KAP-I) Framework, both formative and summative evaluation were implemented to ensure all evaluation criteria are met. The summative evaluation for the artifact was carried out through a structured walkthrough, a technique in simulation that provides feedbacks from the real world. An inter-agencies collaboration case study was engaged to simulate the framework. A total of six suggestions of amendments were addressed. The positive comments gathered and highlighted from the summative evaluation exercise proved that the formative evaluation had been well served. Despite the changes made towards the refined KAP-I Framework, the main processes and flows of the KAP-I Framework remain and it also proved that the KAP-I Framework is fit for the inter-agencies setup and KAP-I Framework has achieved its rigor, usefulness, clarity and completeness.