{"title":"AI for Evaluators: Opportunities and Risks","authors":"Aaron Wilson Kates, Kurt Wilson","doi":"10.56645/jmde.v19i45.907","DOIUrl":"https://doi.org/10.56645/jmde.v19i45.907","url":null,"abstract":"We are all familiar with how computers and smartphones have transformed work and productivity. We now stand at a new threshold with another technology that is predicted to further transform the way we work: Artificial Intelligence (AI). 
 In this article, we hope to take a sober and practical look at AI from the perspective of professional evaluators. We examine how we might use it, how it might transform the nature of our tasks, what threats it might pose to our field, and what evaluators might do to protect themselves and our society from potential adverse effects of this emerging technology.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135437762","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Evaluation of Equity-Focused Community Coalitions: A Review of the Empirical Literature","authors":"Jill Chouinard, Tiffany L. S. Tovey, Kristin Kidd","doi":"10.56645/jmde.v19i45.743","DOIUrl":"https://doi.org/10.56645/jmde.v19i45.743","url":null,"abstract":"Conducting evaluation and research with community coalitions involved in health equity initiatives is inherently complex. In this paper we provide a review and synthesis of the empirical literature on the evaluation of equity-focused community coalitions. We explore issues, challenges, and barriers experienced by evaluators, as well as techniques and approaches that were considered beneficial. Our review identified 11 peer reviewed articles, from which we identified seven overlapping themes: (1) framing equity in the evaluation process, (2) use of multiple theoretical frameworks, (3) use of systems-focused approaches, (4) strategic use of intersectoral partnerships and collaborations, (5) intentional communication and building trusting relationships, (6) challenges dedicating purposeful time to the work, and (7) issues of cultural and contextual clarity and responsiveness. Our findings point to a significant focus on context, history, learning, communication, relationships, and power. The cultural complexity and historical scope of each context, diversity of stakeholders, and enormity of the systemic issues involved, shape and challenge the evaluation and research process in fundamental ways, requiring a creative and kinetic thinking -- a shifting from methodological certainty to an acknowledged uncertainty, where mixing, blending and the innovative use of approaches and theories becomes a way of moving beyond the colonizing past.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135437758","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Commitment Mural: Let’s Decolonize Evaluation Together","authors":"Gunjan Veda, B. Chilisa","doi":"10.56645/jmde.v19i44.795","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.795","url":null,"abstract":"In this mural we demonstrate liberation of evaluation from normalized publication structures. The article is a challenge to publication structures, more specifically journals, to open space for diversity of expression of thought. In this mural, practitioners, academics, policymakers, development partners, VOPEs (Voluntary Organizations for Professional Evaluations), speak to the strategies to decolonize evaluation. The immediate impact of this mural is a demonstrated commitment to decolonize evaluation by more than 50 individuals and entities. Taking up the commitment will be a demonstrable change that came with the mural. The mural also provides an open space for the exchange of ideas, and strategies to decolonize evaluation. Moreover, the contributing voices are preserved in their own voices and their contribution to global knowledge production is acknowledged. This is indeed a departure from the ethics of confidentiality in research where the participants in an evaluation inquiry largely remain anonymous even in the co-creation of knowledge. We believe that when participants in an evaluation inquiry come across their commitments in evaluation journals, they are encouraged to further form coalitions with like minds and hold themselves accountable collectively to liberate evaluation from the remnants of colonialism.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48734200","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Steps Toward Evaluation as Decluttering: Learnings from Hawaiian Epistemology","authors":"April Nakaima, Sanjeev Sridharan","doi":"10.56645/jmde.v19i44.809","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.809","url":null,"abstract":"This paper discusses one of the more contemporary challenges in development and in global health--lots of good ideas from well-meaning insiders and outsiders that end up cluttering both the physical and mental spaces of what can be loosely termed as “attempts” at development. Given the place-based nature of indigenous thought, we turn to Hawaiian epistemology at looking to insights for clarity on how one can negotiate interactions to declutter place and also confuse identity. We believe that evaluation as a field can help in bringing greater recognition of the need for models of development and learning that respect the importance of de-cluttering. Implications for a decolonized approach to evaluation are discussed \u0000 ","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41287123","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Decolonizing Evaluation: Truth, Power, and the Global Evaluation Knowledge Base","authors":"Hur Hassnain","doi":"10.56645/jmde.v19i44.803","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.803","url":null,"abstract":"Evaluations play a critical role in shaping the way international development interventions are designed and managed. This contributes to the fact that there are intrinsic power dynamics at play during the production of evaluation knowledge. In the wake of growing commitments to deal with the repercussions of a colonial past and a prolonged history of white supremacy, there has been growing recognition of the need to decolonize evaluation theory and practice to help foster equality and ensure that evaluation knowledge is generated, shared, and understood universally. Increased efforts are being made to understand the risks involved if evaluations fail to utilize decolonized evaluation methods and approaches. We are faced with questions such as: How can we decolonize evaluation and disrupt unequal power relations? How can the evaluation process itself be transformative and an opportunity for co-liberation? What practical tools and steps facilitate power sharing? How can evaluation be used to advance decolonization and social justice? \u0000This paper describes the connection between truth and power and how that relates to the evaluation and decolonization debates. It provides potential starting points for decolonizing evaluation practice, including some examples where this has already been tested. To conclude it focuses on the universalisation of evaluation knowledge and the need to ensure that evaluation knowledge is translated and disseminated via inclusive forms of communication to ensure that learning can be better understood and hence translated into action orientated practice from grassroot to government level. \u0000The aim of this paper is to advance the discussion on decolonizing evaluation practice and provide some potential ways forward in terms of transforming evaluation theory and practice. \u0000Keywords \u0000Decolonizing evaluation, development, results, learning, accountability","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42782591","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Ubuntu and Afrofeminism for Decolonizing Evaluation","authors":"Fatimata Kane, T. Archibald","doi":"10.56645/jmde.v19i44.793","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.793","url":null,"abstract":"Background: African evaluation has been at the forefront of innovating the praxis of decolonizing evaluation, especially through ‘Made in Africa Evaluation’ (MAE) and related efforts. Still, there is a wealth of additional African epistemologies and philosophical paradigms which either have not been adequately discussed in the literature, or have not yet made their way into the discourse and practice of MAE. \u0000Purpose: The purpose of this conceptual paper is to propose a theoretical framework that can be used to further inform indigenous and decolonizing evaluation approaches in African contexts and beyond. Specifically, we address the often-cited notion of ubuntu, informed by African philosophical literature beyond the field of evaluation, and we propose Sylvia Tamale’s decolonizing and Afro-feminist lens as a complementary philosophical framing with great potential applications in indigenous and decolonizing evaluation in African contexts and beyond. \u0000Setting: Not applicable. \u0000Intervention: Not applicable. \u0000Research Design: This conceptual study draws on philosophical literature from African philosophy and political science to weave together notions of ubuntu with decolonizing Afro-Feminism. \u0000Data Collection and Analysis: Not applicable. \u0000Findings: We propose that a decolonizing, indigenous evaluation approach rooted in Ubuntu and Afro-Feminism would: question categorial, dichotomous, hierarchical logics (e.g., methodological hierarchical hegemonies); recognize masculinist, imperialist, modernist ideals inscribed in institutions (e.g., via government rationality, therefore also via evaluation); foreground intersectionality; and make room for “the moral economy” and other deeply communitarian framings.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41976732","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Deconstructing the Imperial Episteme: Decolonizing Knowledge Production in Program Evaluation","authors":"Satlaj Dighe, Cynthia Matthias","doi":"10.56645/jmde.v19i44.781","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.781","url":null,"abstract":"Scholars, practitioners, and activists have all contributed to the discussion of decolonization of evaluation practice in recent years as attention has increasingly focused on the persistent harms of colonization. While these discussions have led to the development of evaluation frameworks rooted in Indigenous and locally-situated understandings, values, and methods, little attention has been paid to the colonial origins of Western-based evaluation practices that continue to pervade the field. This article seeks to contribute to the conversation about decolonization by focusing on the ways in which Western social theory, born of colonizing nations, has been influenced by the processes of colonization. Drawing on scholars and theorists from the Global South, this article highlights specific apparatuses for dismantling imperial ways of thinking and ways of knowing, and proposes a path forward for evaluators who wish to grapple with the deeply imperial epistemological roots of our field of practice.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42849347","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Paradigm-Based Evaluation for Eco-Just Systems Transformation","authors":"Beverly Parsons, Katherine Winters","doi":"10.56645/jmde.v19i44.799","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.799","url":null,"abstract":"Social and ecological systems shape the extent to which humans and the rest of nature live together in a state of well-being. In this article, we work with two intertwined paradigms (i.e., worldviews) that underlie our social and ecological systems. We describe these paradigms, their historical roots, and their differing connections to clusters of system science concepts. We then explain how we are using these paradigms and system science concepts as the basis of an evaluation design process to support systems transformation toward a just and ecologically healthy civilization. The connection of this evaluation orientation to the decolonization and Indigenization of our social and ecological systems is woven throughout the article.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44607953","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Beyond Ubuntu: Nnoboa and Sankofa as Decolonizing and Indigenous Evaluation Epistemic Foundations from Ghana","authors":"Douglas Asante, T. Archibald","doi":"10.56645/jmde.v19i44.789","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.789","url":null,"abstract":"Background: Evaluation is an increasingly vital component of community and economic development projects in Africa. Yet questions remain about how relevant most evaluation approaches for the African evaluation context. Within the ‘Made in Africa’ (MAE) approach, ubuntu is frequently cited as an African philosophical concept with salience to MAE. There is a need to further expand and explicate other African philosophies that can serve as epistemological guideposts for African evaluation—and other decolonizing, indigenous evaluation approaches more broadly. \u0000Purpose: Drawing on Ghanaian epistemologies and frameworks, the purpose of this paper is to propose the Nnoboa system of communal collaboration in farming and industry, as well as the notion of Sankofa as a traditional philosophical concept that irrupts and challenges hegemonic Eurocentric notions of the linearity of time, to yield a Ghanaian indigenous knowledge of evaluation. \u0000Setting: Not applicable. \u0000Intervention: Not applicable. \u0000Research Design: This conceptual study draws on literature on culturally responsive evaluation (CRE), MAE, and (from beyond the field of evaluation), descriptions of Nnoboa and Sankofa to propose a conceptual synthesis applicable to decolonizing, indigenous evaluation. \u0000Data Collection and Analysis: Not applicable. \u0000Findings: We propose that Nnoboa and Sankofa represent an addition to the decolonizing and indigenous evaluation knowledge base, building on and going beyond the reliance of CRE and MAE in ubuntu. We propose this Ghanaian approach has potential applications across MAE and CRE more broadly.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41951952","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Decolonizing Evaluation of Indigenous Guidance and Counseling Approaches: A Review of Selected Evaluated Programs","authors":"Hildah L. Mokgolodi","doi":"10.56645/jmde.v19i44.779","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.779","url":null,"abstract":"Indigenous guidance and counselling approaches in Africa have been discussed in different counselling forums and platforms. While there are several, including Ubuntu philosophies from which indigenous counselling therapies used in clinical work are developed (Chigangaidze, 2021; van Dyk & Matoane, 2010), the researcher experiences these therapies as being pushed to align with the colonial counselling therapies. In this research article, the researcher makes an analysis of five articles on evaluations of indigenous guidance and or counselling therapies. Although most programmes developed for indigenous people may follow curricula and culturally suitable activities (Ridani, Shand, Christensen, Mckay, Tighe, Burns, & Hunter, 2015), rather than to appreciate the metaphysical and cognitions, connectedness and relatedness of Africanism, evaluations seem to be linear from the literature reviewed (Poirier, 2015; Craig,1979), pointing to the grip colonialism still has on evaluation of counselling therapies. This understanding has led one to wonder if evaluation of African indigenous counselling procedures has been decolonized or continue to follow colonial methods of evaluation. The author proposes in this article, the use of African-Relational models of evaluation, in assessing indigenous counselling programmes, where African researchers can make conclusions that resonate with African contexts (Chilisa, Major, Gaotlhobogwe, & Mokgolodi, 2016).","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49595117","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}