January O'Connor, Marko Parman, Nicole Bowman, Stephanie D. H. Evergreen
{"title":"Decolonizing Data Visualization: A History and Future of Indigenous Data Visualization","authors":"January O'Connor, Marko Parman, Nicole Bowman, Stephanie D. H. Evergreen","doi":"10.56645/jmde.v19i44.783","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.783","url":null,"abstract":"On the whole, the field of data visualization is white. Contemporary views of historical data visualization tend to trace back to a few iconic visuals tied to European wars and conquests. The modern explosion of the field has been centered around the ideas of white men, as if they invented data visualization. Yet, Indigenous populations world-wide have been incorporating data visualization into their record keeping for centuries before anyone had heard of Edward Tufte. In this article, three Indigenous evaluators (Mohican/Munsee, Cherokee, and Tlingit) along with a non-Indigenous co-conspirator, will discuss their journeys creating space to weave together Western notions of data visualization best practices and Indigenous ways of knowing and storytelling. The authors focus their evaluative work on the support of Indigenous communities and will reflect on what has worked in communicating data, what hasn't, and how far data visualization has to go in all four directions.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48473224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Foreword","authors":"I. Goldman","doi":"10.56645/jmde.v19i44.929","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.929","url":null,"abstract":"This special edition of JMDE is a watershed for the International Evaluation Academy - the first science output, and on such an important topic. The collaboration with JMDE has been outstanding, and we would like to pay tribute to Michael Harnar, Bagele Chilisa, and Nicky Bowman for their dedicated work shepherding this edition. We hope this can be an important contribution to rethinking how evaluation can be fit for purpose in a world of polycrises, where the traditional Western growth models have led us to the brink of catastrophe. We need different ways of looking at the world, and learning from indigenous and decolonized approaches will be key in us garnering the wisdom to learn and transform how we use evaluation in the service of humanity and Nature, rather than for continued exploitation and despoilation.\u0000We hope this will be the first of many collaborations with the Journal.\u0000We wish you all fruitful reading and engagement.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45078337","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Decolonizing Evaluation of Indigenous Land-Based Programs: A Settler Perspective on What We Can Learn from the LANDBACK Movement","authors":"Debbie DeLancey","doi":"10.56645/jmde.v19i44.773","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.773","url":null,"abstract":"There is increasing recognition of the importance of land-based programming in promoting Indigenous cultural resurgence and community-building. This article explores the challenges associated with evaluation of on the land programs, and considers ontological and epistemological challenges associated with applying a postpositivist western evaluation approach. It is suggested that Indigenous-led evaluation should be mandated for Indigenous land-based programs, consistent with emerging recognition of Indigenous peoples’ rights to sovereignty over programs and services.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45866562","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Pursuit of Social, Economic, and Environmental Justice through Evaluation: Learning from Indigenous Scholars and the Fifth Branch of the Evaluation Theory Tree","authors":"D. Mertens","doi":"10.56645/jmde.v19i44.749","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.749","url":null,"abstract":"The world faces a climate crisis that calls for increased attention to social, economic, and environmental justice. Non-Indigenous evaluators can choose to continue their work business-as-usual, or they can choose to learn from Indigenous evaluators. The exclusion of Indigenous scholars from the evaluation theory tree results in an opportunity lost to improve theory and practice across all communities. A fifth branch on the evaluation theory tree, Context and Needs, aligns with the Indigenous paradigm and serves to stimulate questions about evaluation theory and practice that inherently address issues of justice and the importance of recognizing the interconnectedness of all living and nonliving things.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43415829","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Special Issue Editors' Introductory Note: The Why and How of the Decolonization Discourse","authors":"B. Chilisa, Nicole Bowman","doi":"10.56645/jmde.v19i44.919","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.919","url":null,"abstract":"The theme of the special issue decolonizing evaluation: towards a fifth paradigm, an initiative of the International Evaluation academy (IEA), was inspired by the concerns that while evaluation reports largely tell stories of success, on the ground there is minimal change, communities remain impoverished, interventions cause harm to the environment and evaluation allow that to happen.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49287493","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Vivien Ahrens, E. Cruz, Mariana Pasturczak, L. Bakken, T. R. Moore
{"title":"Between Funding Requirements and Community Priorities: Centro Hispano of Dane County’s Transformative Approach to Program Evaluation","authors":"Vivien Ahrens, E. Cruz, Mariana Pasturczak, L. Bakken, T. R. Moore","doi":"10.56645/jmde.v19i44.787","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.787","url":null,"abstract":"Evaluation approaches that aim to support large-scale social change need to address neoliberal logic ingrained in the way evaluation has been institutionalized in the US since the early 1900s. Harmful dynamics resulting from evaluation’s institutional history include (1) a focus on accountability and effectiveness, (2) the perpetuation of deficit-based narratives about communities of color, and (3) a top-down approach to program development, in which funders define program goals and assessment criteria and outside academics are hired to provide research services. In consequence, evaluation contributes to the extraction and devaluation of community expertise rather than fostering learning, collaboration, critical reflection, and healing. \u0000This article highlights ways of addressing these harmful dynamics through a case study that exemplifies an innovative evaluation approach focused on community strengths and values, healing ethno-racial trauma, and critical consciousness building. We call for funders to rethink their requirements for evaluation and emphasize the need to support evaluation infrastructure, time for critical reflection, and the development of community- and asset-based, culturally responsive evaluation approaches and tools.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42768516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Liberated or Recolonized: Making the Case for Embodied Evaluation in Peacebuilding","authors":"Ruby Quantson Davis","doi":"10.56645/jmde.v19i44.811","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.811","url":null,"abstract":"The quest to liberate and decolonize evaluation could create a recolonizing process in development evaluation unless practitioners pay attention to an embodied process that allows persons and communities in the global south to bring all of their epistemologies to an evaluation process. This will enable evaluation to be a learning process through which communities gain insights from their programs through their own ways of knowing. Constrained by time, resources, and limited commitment to the decolonization agenda, organizations and experts in evaluation could cause further harm to indigenous and local ways of knowing through half-baked decolonization processes . Through the lens of peacebuilding, this paper proposes an embodied evaluation as a practical way to decolonize evaluation, and reduce the risk of recolonizing the concepts and processes of project evaluation while addressing some of the power imbalances that lie beneath traditional evaluation and development. This paper suggests that monitoring , evaluation and learning of projects should be led by those most affected and closest to the problem being addressed and experts who assist in these processes should a assume a collaborative approach that requires the embodiment of the process and experiences of the affected. This approach is likely to generate reports through the world views of those affected and reduce dominance and imposition of external methodologies that distort outcomes of programmes. This paper is a reflection on practice, and a prompt for further research on embodied evaluation as a decolonizing agenda.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48073028","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evaluation Transformation Implies Its Decolonization","authors":"R. Picciotto","doi":"10.56645/jmde.v19i44.797","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.797","url":null,"abstract":"Transformational evaluation implies a decolonization process focused on relieving the misery and suffering of the oppressed. To inform such a reorientation, this article describes the challenges of social transformation; probes the links between capitalism, slavery and racism; takes stock of the post-colonial development order; examines the legacy of the evaluation occupation; and recommends new policy directions inspired by indigenous evaluation. ","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46024570","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Framing Anticolonialism in Evaluation: Bridging Decolonizing Methodologies and Culturally Responsive Evaluation","authors":"Lorien S. Jordan, Jori Hall","doi":"10.56645/jmde.v19i44.769","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.769","url":null,"abstract":"Background: Evaluation is grounded in academically imperialistic research methodologies, paradigms, and epistemologies, which have lasting effects on communities of study. Confronting Westernized evaluation's monoculturalism, scholars call for decolonization, to produce locally-determined, strengths-based, culturally-situated, and valid understandings. This endeavor is complicated, requiring a paradigm shift for Westernized evaluators. \u0000Purpose: In this paper, we describe the anticolonial culturally responsive framework occurring in the intersections between culturally responsive (CRE) and decolonizing (DF) approaches. Anticolonialism honors decolonizing without displacing the authority of Indigeneity, simultaneously foregrounding the interweaving of evaluator, evaluand, and disciplinary culture. Interrogating academic imperialism through anticolonialism, confronts the social processes and cultural ideologies that produce and reproduce social inequality in evaluations. \u0000Setting: Not applicable. \u0000Data Collection and Analysis: We draw on scholars and scholarship who have advanced culturally responsive, decolonizing, and anticolonial evaluation and methodological fields. \u0000Findings: The anticolonial culturally responsive framework is an invitation for evaluators trained in imperialistic Westernized approaches or who embody the colonial world through our race, language, knowledge, and culture. Our goal is not to displace the primacy and urgency of vitalizing Indigenous and decolonizing frameworks. Instead, we offer a tentative approach committed to pluriversality, justice, self-determination, and the possibility of collaboration between knowledge systems and knowers.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48836228","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Entering the Ethical Space Between Epistemologies: A Step Toward Decolonizing the Heart and Mind","authors":"J. Billman","doi":"10.56645/jmde.v19i44.759","DOIUrl":"https://doi.org/10.56645/jmde.v19i44.759","url":null,"abstract":"At a tipping point marked by knowledge fragmentation, the evaluation field’s ability to address the complex problems confronting the world today is threatened. Contributing to this is the field’s narrowed epistemological foundation which places limits on what counts as knowledge, alienating many engaged with it. Privileging empirical knowledge over traditional and revealed (i.e., spiritual) knowledge places the reigning evaluation paradigms at odds with Indigenous paradigms and presents numerous risks to individuals, communities, and ecosystems. Yet, if we enter the space between epistemologies (Emine, 2007), we discover that the founders of western philosophy, Aristotle and Descartes, held many ideas in common with Indigenous philosophies. Here I deconstruct Western thought to show how Aristotle and Descartes upheld an immaterial reality, with Descartes grounding all his understanding in revealed knowledge. After providing a bombardment of multidisciplinary support for revealed knowledge, I argue that embracing the Knowledge Trinity advances the decolonization of evaluator self and mind and provides a new epistemological foundation upon which to construct a Decolonizing Paradigm.","PeriodicalId":91909,"journal":{"name":"Journal of multidisciplinary evaluation","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49215975","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}