African Evaluation Journal最新文献_第7页

Can massive open online courses fill African evaluation capacity gaps? 大规模开放在线课程能否填补非洲评估能力的空白?

African Evaluation Journal Pub Date : 2019-06-26 DOI: 10.4102/AEJ.V7I1.372

Caitlin Blaser Mapitsa, Linda S. Khumalo, H. Engel, Dominique Wooldridge

{"title":"Can massive open online courses fill African evaluation capacity gaps?","authors":"Caitlin Blaser Mapitsa, Linda S. Khumalo, H. Engel, Dominique Wooldridge","doi":"10.4102/AEJ.V7I1.372","DOIUrl":"https://doi.org/10.4102/AEJ.V7I1.372","url":null,"abstract":"Background: Theory of Change for Development is a free online course developed at an African institution to strengthen evaluation capacity in the region. Massive Open Online Courses (MOOCs) provide a platform for building skills at scale in the region. Scholars of evaluation have long pointed to a gap between supply and demand that frustrates both evaluation practitioners and commissioners. This article explores the possibilities and limitations of MOOCs to bridge this gap. Objectives: This article seeks to explore the role open online training can play in evaluation capacity development. It considers the implications of one course’s experience of evaluation-sector-blended learning and instructional design in Africa for strengthening regional communities of practice, and for evaluation capacity development. Method: This article draws on current theories on online learning, specific course data from the Theory of Change course as well as experiential learning from two processes of revision and delivery of the MOOC to explore open online learning as an approach to evaluation capacity development. Results: This study has found that MOOCs can play important roles in evaluation capacity development. They can raise awareness of methods and tools that are not part of traditional monitoring and evaluation curriculum, their reach for evaluation practitioners is wide and they build much needed networks in the sector. However, their role in skills development has limits, particularly if they are delivered in isolation of other accessible contact learning options. Conclusion: Massive Open Online Courses should be one part of an evaluation capacity development strategy. They support blended learning, expand access to certain core practical skills and link evaluation practitioners to other real outlets of learning and exchange.","PeriodicalId":37531,"journal":{"name":"African Evaluation Journal","volume":"15 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74846945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Revisiting decoloniality for more effective research and evaluation 重新审视非殖民化问题，以便进行更有效的研究和评价

African Evaluation Journal Pub Date : 2019-06-24 DOI: 10.4102/AEJ.V7I1.363

F. Cloete, Christelle Auriacombe

{"title":"Revisiting decoloniality for more effective research and evaluation","authors":"F. Cloete, Christelle Auriacombe","doi":"10.4102/AEJ.V7I1.363","DOIUrl":"https://doi.org/10.4102/AEJ.V7I1.363","url":null,"abstract":"Background: There is increasing global resistance against a perceived Eurocentric value hegemony in knowledge generation, implementation and evaluation. A persistent colonial value mindset is accused of imposing outdated and inappropriate policies on former colonised and other countries and needs to be changed to more appropriate processes and results to improve conditions in those countries in the 21st century. Objectives: This article intends to summarise some lessons from the impact of historical colonial value systems and practices in current knowledge generation, transfer and application processes and results in Africa (especially in South Africa). The objective is to identify concrete directions towards ‘decolonising’ research and evaluation processes and products to be more relevant, appropriate and, therefore, more effective to achieve sustainable empowerment and other desired developmental outcomes not only in lesser developed countries but also in traditionally more developed Western nations. Method: A comparative literature review was undertaken to identify and assess the current state of the debate on the perceived need to decolonise research and evaluation practices in different contexts. The Africa-rooted evaluation movement was used as a case study for this purpose. Results: The current decoloniality discourse is ineffective and needs to be taken in another direction. Mainstreaming culturally sensitive and responsive, contextualised participatory research and evaluation designs and methodology implementation in all facets and at all stages of research and evaluation projects has the potential to fulfil the requirements and demands of the research and evaluation decoloniality movement. Conclusion: This will improve the effectiveness of research and evaluation processes and results.","PeriodicalId":37531,"journal":{"name":"African Evaluation Journal","volume":"49 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77606224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 17

Benefits of transport subsidisation: Comparing findings from a customer perception survey and Most Significant Change Technique interviews 交通补贴的好处:比较顾客感知调查和最显著变化技术访谈的结果

African Evaluation Journal Pub Date : 2019-06-20 DOI: 10.4102/AEJ.V7I1.371

B. Rabie, A. Burger

{"title":"Benefits of transport subsidisation: Comparing findings from a customer perception survey and Most Significant Change Technique interviews","authors":"B. Rabie, A. Burger","doi":"10.4102/AEJ.V7I1.371","DOIUrl":"https://doi.org/10.4102/AEJ.V7I1.371","url":null,"abstract":"Background: An evaluation of a transport subsidisation programme in the Western Cape, South Africa, was undertaken to capture the outcomes and benefits of the service from the perspective of the bus user. Objectives: The objective of this article was to compare the findings from the adopted parallel mixed-methods design that included a perception survey and the Most Significant Change (MSC) technique. The article presented the advantages of each approach and reflected on the benefits and challenges in applying the MSC technique. Method: Data on the intended outcomes of the Provincial Transport Operations Grant programme were collected from 458 commuters on four bus routes through a structured close-ended questionnaire. The MSC technique was applied to collect 69 stories of change that captured changes regarded as most significant by beneficiaries of the public transport subsidy. Results: It was found that the survey better captured the intended and predetermined objectives of the programme, while the large response group allowed for comparisons and cross-tabulations. The MSC interviews better captured the real-life experience of participants and identified the benefits most valued by commuters, including outcomes not specifically anticipated by the programme. It also served to clarify contradicting responses or ratings on the closed-ended questionnaire and informed further bivariate analysis of the structured questionnaire data. Conclusion: To maximise benefits from the MSC technique, sufficient time is needed to solicit value responses from respondents, while decision-makers should allow time for multiple iterations and discussions at different levels of the hierarchy.","PeriodicalId":37531,"journal":{"name":"African Evaluation Journal","volume":"234 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80311683","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Evaluating operationalisation of integrated monitoring and evaluation system in Kisumu County: Implications for policy makers 评价基苏木县综合监测和评价系统的运作情况:对决策者的影响

African Evaluation Journal Pub Date : 2019-06-20 DOI: 10.4102/AEJ.V7I1.385

Enock Warinda

{"title":"Evaluating operationalisation of integrated monitoring and evaluation system in Kisumu County: Implications for policy makers","authors":"Enock Warinda","doi":"10.4102/AEJ.V7I1.385","DOIUrl":"https://doi.org/10.4102/AEJ.V7I1.385","url":null,"abstract":"Background: Evaluation findings are increasingly becoming valuable for policy makers in Kenya. The Directorate of Monitoring and Evaluation is responsible for providing reliable data findings for decision-makers. They are in turn expected to access the data and information through the National Integrated Monitoring and Evaluation System (NIMES). Unfortunately, the directorate hardly receives timely data as required, thus is unable to make timely decision within the ministry of agriculture, livestock and irrigation in Kisumu County.Objectives: The aim of this study was to assess the extent of operationalisation of NIMES through utilisation of the electronic project management information system (e-ProMIS) within the three agricultural departments.Methods: Through single-point face-to-face interviews using semi-structured questionnaires, mixed methods approach and Likert scale were applied to assess the level of operationalisation of, staff competences in, and satisfaction with NIMES. Both random and purposive sampling was used. Using mixed methods approach, primary and secondary data were collected from 10 key indicators and fitted in a binary logistic regression model to assess the level of operationalisation of NIMES.Results: This article shows that operationalisation of NIMES is unsatisfactory, and data collected are incorrectly formatted. None of the departmental personnel charged with uploading relevant data in e-ProMIS neither accessed nor utilised the platform. There were no champions supporting NIMES, thus no reports generated from the system.Conclusions: Factors hindering operationalisation of NIMES were: dysfunctional monitoring and evaluation (M&E) systems, limited human capacity on M&E, lack of NIMES champions, limited availability of data, unclear information flow to decision makers and inadequate integration of NIMES in planning and budgeting.","PeriodicalId":37531,"journal":{"name":"African Evaluation Journal","volume":"47 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89316971","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

The B Movement in East Africa: A shift in the culture of business 东非的B运动:商业文化的转变

African Evaluation Journal Pub Date : 2019-04-29 DOI: 10.4102/AEJ.V7I1.333

Olivia W. Muiru

{"title":"The B Movement in East Africa: A shift in the culture of business","authors":"Olivia W. Muiru","doi":"10.4102/AEJ.V7I1.333","DOIUrl":"https://doi.org/10.4102/AEJ.V7I1.333","url":null,"abstract":"There is a culture shift underway to harness the power of business to help address society’s greatest challenges. B Lab East Africa and its network of global partner organisations are uniquely positioned to accelerate this culture shift and ensure it is both meaningful and lasting. We use an integrated approach to systemic change by: (1) building a global community of thousands of credible leaders, Certified B Corporations (B Corps), that meet the highest standards of performance, accountability and transparency, (2) creating pathways that drive millions of businesses to follow these leaders in managing their impact with as much rigour as their profits, and aligning their interests with those of society and (3) inspiring billions to support business as a force for good. B Lab East Africa is engaging with hundreds of African businesses, large and small, as well as investors in assessing, comparing and improving their social and environmental impact. To align their strategies with impact, businesses need to understand where they stand against their perceived impact, how they compare to their peers and how they might improve. To do so, the B Impact Assessment (BIA) offers measurable ways that companies can have a positive impact. It offers step-by-step guidance to assess business practices and tools to make positive changes. By actively measuring their impact, leveraging resource to improve impact and engaging with all stakeholders on impact, we believe this will lead to a more shared and durable prosperity for all.","PeriodicalId":37531,"journal":{"name":"African Evaluation Journal","volume":"9 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78522828","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

The branch performance tool: A methodological approach for continuous monitoring of programme efficiencies of service delivery interventions 分支机构绩效工具:持续监测服务提供干预措施的方案效率的方法学方法

African Evaluation Journal Pub Date : 2019-03-28 DOI: 10.4102/AEJ.V7I1.262

S. Suranga, Kalhara Senadhira, R. Rajakaruna

{"title":"The branch performance tool: A methodological approach for continuous monitoring of programme efficiencies of service delivery interventions","authors":"S. Suranga, Kalhara Senadhira, R. Rajakaruna","doi":"10.4102/AEJ.V7I1.262","DOIUrl":"https://doi.org/10.4102/AEJ.V7I1.262","url":null,"abstract":"Background: Programme efficiency is a vital factor in achieving Sustainable Development Goals (SDGs) in an environment of scarce resources. The branch performance tool (BPT) developed by the International Planned Parenthood Federation (IPPF) is an effective tool for continuous monitoring of programme efficiency in the health sector. Objectives: The aim of this study was to assess the effectiveness of BPT in improving programme efficiencies and provide recommendations for further improvements. Methods: The service delivery data, collected through an Internet-based Monitoring and Evaluation Information Management System (MEIMS), as well as costing data over a period of three consecutive years (2013–2015), were fed into the BPT. Data on performance against key efficiency indicators (KPI), measured through data envelopment analysis at each service delivery point (SDP), were used to inform the development of an action plan at the end of each year. Lessons learnt on the best practices of well-performing SDPs and on the improvement opportunities of low-efficient SDPs identified through the BPT were presented during programmatic review workshops and formed the basis of management action. Results: The organisation met all its efficiency targets in 2013–2015, including increase in number of clients per staff day from 1.9 to 3.0, spike in the cost recovery ratio from 20% to 29%, reduction in cost per SRH service from $3.6 to $2.7 and decrease in overhead cost as a percentage of total organisation level cost from 20.5% to 12.8%. Conclusions: Branch performance tool is effective for evidence-based decision-making on programme efficiency of service delivery interventions in the health sector. It has potential for further improvement and replication in the health sector, which will contribute to the pursuit of SDG3.","PeriodicalId":37531,"journal":{"name":"African Evaluation Journal","volume":"45 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90903190","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Table of Contents Vol 6, No 1 & 2 (2018) 目录第6卷第1、2期(2018)

African Evaluation Journal Pub Date : 2018-12-14 DOI: 10.4102/aej.v6i1.365

Editorial Office

引用次数: 0

Policy indicator consistency and coherence in measuring public sector development programmes in South Africa 衡量南非公共部门发展方案的政策指标一致性和连贯性

African Evaluation Journal Pub Date : 2018-11-14 DOI: 10.4102/AEJ.V6I2.338

F. Cloete

{"title":"Policy indicator consistency and coherence in measuring public sector development programmes in South Africa","authors":"F. Cloete","doi":"10.4102/AEJ.V6I2.338","DOIUrl":"https://doi.org/10.4102/AEJ.V6I2.338","url":null,"abstract":"Background : The South African (SA) government has over time developed separate policy indicator frameworks to measure governmental programme performances. They include a series of national development indicators to measure long-term societal transformation impacts, medium-term strategic framework indicators to measure the implementation of the National Development Plan, indicators to measure progress towards achieving the government’s 14 strategic programme outcomes and a separate set of environmental indicators. However, serious doubts exist about the efficiency of implementation management efforts to achieve optimal coherence among these frameworks to maximise the best good policy governance outcomes and make it possible to measure South Africa’s compliance with the United Nations’ Sustainable Development Goals (SDGs) Programme. Objectives : The aim of the study was to review the coherence of implementation management of these different competing systems to maximise good governance outcomes in South Africa, and to propose strategies for improvement. Method : The above indicator sets are summarised and critically assessed against the need to align them also with the envisaged SDG indicators. Results : The contents and management of the current SA policy indicators can and should be significantly improved. Conclusion : A more flexible and responsive integrated SA indicator set needs to be developed to comply better with the emerging international SDG system. This necessitates a longer term strategic approach to the SA system than the current short-term tactical approach.","PeriodicalId":37531,"journal":{"name":"African Evaluation Journal","volume":"34 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2018-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74731855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5

Editorial: Measuring social impact investment 社论:衡量社会影响投资

African Evaluation Journal Pub Date : 2018-11-14 DOI: 10.4102/AEJ.V6I2.357

Mark Abrahams, S. Walaza

引用次数: 2

Evaluative tools in impact investing: Three case studies on the use of theories of change 影响投资中的评估工具:关于变革理论应用的三个案例研究

African Evaluation Journal Pub Date : 2018-11-12 DOI: 10.4102/AEJ.V6I2.340

Noel Verrinder, Kagiso Zwane, D. Nixon, Sara Vaca

{"title":"Evaluative tools in impact investing: Three case studies on the use of theories of change","authors":"Noel Verrinder, Kagiso Zwane, D. Nixon, Sara Vaca","doi":"10.4102/AEJ.V6I2.340","DOIUrl":"https://doi.org/10.4102/AEJ.V6I2.340","url":null,"abstract":"Impact investing is becoming one of the largest forces in driving social and environmental change globally. However, how one defines, measures and communicates this impact is not well defined or consistently implemented. This can prevent investors from making well-informed decisions and allows for ‘impact washing’. The evaluation community has many tools that could be adapted and used in the world of impact investing. Theories of change allow for the better communication of impact, identification of indicators to be measured and critical interrogation of logic. The attributes of theories of change could assist in steering the growing force of impact investing towards gathering more investment and achieving greater impact. This paper is exploratory and examines the development and use of theories of change as a tool for impact investing and seeks to identify the benefits of the tool. We qualitatively review three case studies of organisations that have implemented theories of change and identify common key themes. We find that theories of change are a useful tool for the communication of impact, identification of indicators to be measured and for the critical interrogation of logic. However, theories of change do not provide a panacea to the impact challenge; the need to rigorously measure impact is not fulfilled by merely identifying what needs to be measured. Regardless, the use of theories of change adds an advantage in a space where others have not gone to the same length to show their commitment to driving change.","PeriodicalId":37531,"journal":{"name":"African Evaluation Journal","volume":"64 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2018-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91075040","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 13