Tailoring a complexity-aware theory of change for out-of-school children education program: reflections on an evaluation of Korea–Qatar innovation initiative
{"title":"Tailoring a complexity-aware theory of change for out-of-school children education program: reflections on an evaluation of Korea–Qatar innovation initiative","authors":"Moon Suk Hong, Gahyung Kim, You Jin Chun","doi":"10.1007/s12564-025-10069-8","DOIUrl":null,"url":null,"abstract":"<div><p>The objective of this study is to explore and discuss the conceptual and methodological importance for a more holistic and complexity-aware framework by employing the Theory of Change into the design and evaluation of international education initiatives. Through a critical analysis of the KOICA–Qatar’s Education Above All Foundation partnership project, which aimed to support Out-of-School Children (OOSC) in Cambodia, Iran, Myanmar, and Nepal, we identified several key lessons learned. First, the joint program narrowed both the conceptual and practical dimensions of educational interventions by prioritizing simplistic numerical metrics—specifically the return of OOSC/Y to formal schooling—thereby aligning with the prevailing trends in accountability and transparency in evaluating global educational programs. Secondly, the education projects within the large scale of KOICA-Qatar Education Above All Program assumed that educational impact directly resulted from program outputs, revealing a lack of clear linkage between overarching program-level educational outcomes—namely, quality education for all—and the outputs of individual sub-projects, such as student enrollment figures. Thirdly, an overemphasis on linear project-level logic, while neglecting the interconnected influence of noneducational factors—such as legal and social protection, sanitation, and health—limited the ability to effectively navigate the complexities of OOSC programs. We propose that moving beyond the conventional linear approach to educational programs requires tailoring a complexity-aware Theory of Change. Integrating Theory of Change Analysis (TOCA) into the strategic framework for educational development and the OOSC program model can enhance our capacity to plan and evaluate diverse pathways for achieving positive social and educational impact while accounting for various program assumptions, risks, and other complex macro-level factors.</p></div>","PeriodicalId":47344,"journal":{"name":"Asia Pacific Education Review","volume":"27 3","pages":"1063 - 1076"},"PeriodicalIF":2.2000,"publicationDate":"2025-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Asia Pacific Education Review","FirstCategoryId":"95","ListUrlMain":"https://link.springer.com/article/10.1007/s12564-025-10069-8","RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
The objective of this study is to explore and discuss the conceptual and methodological importance for a more holistic and complexity-aware framework by employing the Theory of Change into the design and evaluation of international education initiatives. Through a critical analysis of the KOICA–Qatar’s Education Above All Foundation partnership project, which aimed to support Out-of-School Children (OOSC) in Cambodia, Iran, Myanmar, and Nepal, we identified several key lessons learned. First, the joint program narrowed both the conceptual and practical dimensions of educational interventions by prioritizing simplistic numerical metrics—specifically the return of OOSC/Y to formal schooling—thereby aligning with the prevailing trends in accountability and transparency in evaluating global educational programs. Secondly, the education projects within the large scale of KOICA-Qatar Education Above All Program assumed that educational impact directly resulted from program outputs, revealing a lack of clear linkage between overarching program-level educational outcomes—namely, quality education for all—and the outputs of individual sub-projects, such as student enrollment figures. Thirdly, an overemphasis on linear project-level logic, while neglecting the interconnected influence of noneducational factors—such as legal and social protection, sanitation, and health—limited the ability to effectively navigate the complexities of OOSC programs. We propose that moving beyond the conventional linear approach to educational programs requires tailoring a complexity-aware Theory of Change. Integrating Theory of Change Analysis (TOCA) into the strategic framework for educational development and the OOSC program model can enhance our capacity to plan and evaluate diverse pathways for achieving positive social and educational impact while accounting for various program assumptions, risks, and other complex macro-level factors.
本研究的目的是通过将变革理论应用于国际教育计划的设计和评估,探索和讨论概念和方法上的重要性,以建立一个更全面、更复杂的框架。koica与卡塔尔的教育至上基金会合作项目旨在支持柬埔寨、伊朗、缅甸和尼泊尔的失学儿童,通过对该项目的批判性分析,我们发现了一些重要的经验教训。首先,联合项目通过优先考虑简单的数字指标(特别是OOSC/Y重返正规学校),缩小了教育干预的概念和实践维度,从而与评估全球教育项目的问责制和透明度方面的主流趋势保持一致。其次,KOICA-Qatar education Above All Program中的大型教育项目假设教育影响直接来自项目产出,这表明总体项目层面的教育成果(即全民素质教育)与单个子项目的产出(如学生入学人数)之间缺乏明确的联系。第三,过分强调线性项目级逻辑,而忽视了非教育因素的相互影响,如法律和社会保护、卫生和健康,这限制了有效应对OOSC项目复杂性的能力。我们建议,超越传统的线性方法来教育项目需要剪裁一个复杂的变化意识理论。将变化分析理论(TOCA)整合到教育发展战略框架和OOSC项目模型中,可以提高我们规划和评估实现积极社会和教育影响的各种途径的能力,同时考虑到各种项目假设、风险和其他复杂的宏观层面因素。
期刊介绍:
The Asia Pacific Education Review (APER) aims to stimulate research, encourage academic exchange, and enhance the professional development of scholars and other researchers who are interested in educational and cultural issues in the Asia Pacific region. APER covers all areas of educational research, with a focus on cross-cultural, comparative and other studies with a broad Asia-Pacific context.
APER is a peer reviewed journal produced by the Education Research Institute at Seoul National University. It was founded by the Institute of Asia Pacific Education Development, Seoul National University in 2000, which is owned and operated by Education Research Institute at Seoul National University since 2003.
APER requires all submitted manuscripts to follow the seventh edition of the Publication Manual of the American Psychological Association (APA; http://www.apastyle.org/index.aspx).