{"title":"Editor's Remarks / Un mot de la rédactrice","authors":"Jill A. Chouinard","doi":"10.3138/cjpe.37.2.ed","DOIUrl":"https://doi.org/10.3138/cjpe.37.2.ed","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47796876","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Involving Youth in Empowerment Evaluation: Evaluators’ Perspectives","authors":"Sarah Heath, K. Moreau","doi":"10.3138/cjpe.73987","DOIUrl":"https://doi.org/10.3138/cjpe.73987","url":null,"abstract":"Empowerment Evaluation (EE) aims to teach program stakeholders, including beneficiaries, how to conduct their own evaluations. In this mixed methods research project we sought to investigate and formally document the involvement of youth in EE of programs targeting youth. Phase 1 surveyed evaluators about the extent to which they involve youth in EE. Phase 2 involved interviews with evaluators and explored what factor(s) facilitate and hinder: the involvement of youth in EE of programs targeting youth. The findings show that youth are involved to some extent in EE, and there are factors that can facilitate and hinder the involvement of youth in EE.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48455300","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Making Relationships Count: Measuring Trust in Relationships Between a Catholic Development Agency and Māori Communities","authors":"Gretchen Leuthart, G. Prinsen","doi":"10.3138/cjpe.66908","DOIUrl":"https://doi.org/10.3138/cjpe.66908","url":null,"abstract":"Relationships affect outcomes in the international development sector, yet there are few frameworks or indicators to measure trust as a foundation of relationships. This article describes an emergent framework for evaluating trust in crosscultural relationships. It is based on a case study of Caritas Aotearoa New Zealand and its Indigenous partners. Perspectives on monitoring and evaluation (M&E) and measuring trust are explored from an Indigenous world view. Interviews with five people representing all parties suggest various types of behaviours that indicate trust. Through this exploration, culturally competent M&E and the centrality of relationships in expanding evaluation practice are revealed.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43108446","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Jean M. Breny and Shannon L. McMorrow. (2021). Photovoice for Social Justice: Visual Representation in Action.","authors":"Kenza Bennani","doi":"10.3138/cjpe.75648","DOIUrl":"https://doi.org/10.3138/cjpe.75648","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45336186","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Challenges Evaluating an Equity-Focused Community Coalition Initiative","authors":"Nicole M. Augustine, J. Chouinard","doi":"10.3138/cjpe.70523","DOIUrl":"https://doi.org/10.3138/cjpe.70523","url":null,"abstract":"In this practice note, the authors reflect on their experiences evaluating a three-year behavioural health equity initiative that was conducted with eight community coalitions located across the southeastern United States. The main focus of the practice note is on the challenges the authors experienced in their evaluation, most of which were largely outside their control: unpredictable funding cycle, complexity of problem, level of local knowledge, level of data literacy, and collaborative approach not realized. While they acknowledge the complexity of behavioural health equity issues, they conclude with four key implications for practice that they note can help relieve the stress of some of the challenges they experienced.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48824167","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Evaluation Marketplace in Canada: What Qualifications Do Employers Demand?","authors":"Hanna Holman, Dave Guyadeen, Daniel Henstra","doi":"10.3138/cjpe.72343","DOIUrl":"https://doi.org/10.3138/cjpe.72343","url":null,"abstract":"This study examined the key qualifications—education, knowledge areas, professional qualities, skills, and tasks—demanded of evaluators by employers in the public, private, and not-for-profi t sectors. Through a content analysis of 50 employment advertisements, it found that the qualifications demanded by employers generally align with the skills identified as important in the evaluation literature and with competencies identified by the Canadian Evaluation Society. The study also found that there is an opportunity to promote the Credentialed Evaluator (CE) designation to those interested in enhancing the evaluation capacity of their organizations.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43416512","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jessica Renger, R. Renger, Richard N. Van Eck, M. Basson, Jirina Renger
{"title":"New Insights for Tracking and Reporting Milestones","authors":"Jessica Renger, R. Renger, Richard N. Van Eck, M. Basson, Jirina Renger","doi":"10.3138/cjpe.74487","DOIUrl":"https://doi.org/10.3138/cjpe.74487","url":null,"abstract":"Despite being a common evaluation metric, milestones are poorly defined, and guidance for their use is underdeveloped in the evaluation literature. This practice note attempts to address this oversight by providing evaluation-specific guidance for tracking and reporting milestones. Using a case study, we share our initial approach to tracking and reporting milestones, as well as how critical reflection guided by the evaluation standards provided us with key insights that allowed us to make improvements to our initial process. We hope this practice note acts as a springboard for elevating the critical dialogue surrounding milestones in the evaluation literature.","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48354126","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Un mot de la rédactrice","authors":"Jill A. Chouinard","doi":"10.3138/cjpe.37.3.ed-fr","DOIUrl":"https://doi.org/10.3138/cjpe.37.3.ed-fr","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47059079","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Editor’s Remarks","authors":"Jill A. Chouinard","doi":"10.3138/cjpe.37.3.ed-en","DOIUrl":"https://doi.org/10.3138/cjpe.37.3.ed-en","url":null,"abstract":"","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":" ","pages":""},"PeriodicalIF":0.8,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48976708","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ralph Renger, Jessica Renger, Richard N Van Eck, Marc D Basson, Jirina Renger
{"title":"Evaluation Utility Metrics (EUMs) in Reflective Practice.","authors":"Ralph Renger, Jessica Renger, Richard N Van Eck, Marc D Basson, Jirina Renger","doi":"10.3138/cjpe.72386","DOIUrl":"https://doi.org/10.3138/cjpe.72386","url":null,"abstract":"<p><p>The article proposes three evaluation utility metrics to assist evaluators in evaluating the quality of their evaluation. After an overview of reflective practice in evaluation, the different ways in which evaluators can hold themselves accountable are discussed. It is argued that reflective practice requires evaluators to go beyond evaluation <i>quality</i> (i.e., technical quality and methodological rigor) when assessing evaluation practice to include an evaluation of evaluation <i>utility</i> (i.e., specific actions taken in response to evaluation recommendations). Three Evaluation Utility Metrics (EUMs) are proposed to evaluate utility: whether recommendations are considered (EUM<sub>c</sub>), adopted (EUM<sub>a</sub>), and (if adopted) level of influence of recommendations (EUM<sub>li</sub>). The authors then reflect on their experience in using the EUMs, noting the importance of managing expectations through negotiation to ensure EUM data is collected and the need to consider contextual nuances (e.g., adoption and influence of recommendations are influenced by multiple factors beyond the control of the evaluators). Recommendations for increasing EUM rates by paying attention to the frequency and timing of recommendations are also shared. Results of implementing these EUMs in a real-world evaluation provide evidence of their potential value: practice tips led to an EUM<sub>c</sub> = 100% and EUM<sub>a</sub> > 80%. Methods for considering and applying all three EUMs together to facilitate practice improvement are also discussed.</p>","PeriodicalId":43924,"journal":{"name":"Canadian Journal of Program Evaluation","volume":"37 1","pages":"142-154"},"PeriodicalIF":0.8,"publicationDate":"2022-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9380988/pdf/nihms-1751090.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40422453","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}