Evaluation in participatory design: a literature survey

This paper focuses on evaluation in Participatory Design (PD), and especially upon how the central aims of mutual learning, empowerment, democracy and workplace quality have been assessed. We surveyed all Participatory Design Conference papers (1990-2014) and papers from special journal issues on PD, focusing on systematic, explicit evaluations. The survey resulted in 143 papers of which 66 were deemed relevant. Of these, 17 papers deal with evaluation of the above mentioned aims. Based on evaluation theory, we propose seven key questions through which to characterize evaluations in PD and analyze the 17 papers. Our analysis reveals that formal evaluations of PD's aims are rare; generally lack details on methods; are researcher- and not participant-led, and that a corpus of work around evaluations needs to be developed. We suggest more explicit, systematic evaluations of PD's central aims to enhance accountability, learning and knowledge building, and to strengthen PD internally and externally.