How to compare multiple intervention effects: Educational research using network meta-analysis

IF 1.5 Q2 EDUCATION & EDUCATIONAL RESEARCH

International Journal of Research & Method in Education Pub Date : 2022-02-09 DOI:10.1080/1743727X.2022.2035352

Cheyeon Ha

{"title":"How to compare multiple intervention effects: Educational research using network meta-analysis","authors":"Cheyeon Ha","doi":"10.1080/1743727X.2022.2035352","DOIUrl":null,"url":null,"abstract":"ABSTRACT This study aims to introduce network meta-analysis (NMA) to provide educational researchers with an extended view of the reviewing educational research. Meta-analytic methods have been widely used in educational research reviews. However, weaknesses have emerged in the multi-group comparison analysis of educational studies where different interventions are applied because general meta-analysis is structured for a two-group comparison (i.e. treatment versus control group) of the same structure. Alternatively, when synthesizing experimental results of previous studies, NMA aims to verify related effect sizes by considering various experimental environments and research variables. Using NMA with simulation data, along with five types of online learning designs, this study describes how educational researchers could compare complex intervention effects between ten networks derived from five groups. The use of NMA in review research can provide rich interpretations of multi-group comparison results. Additionally, it can reflect on the complexity of real-world experimental design conditions.","PeriodicalId":51655,"journal":{"name":"International Journal of Research & Method in Education","volume":null,"pages":null},"PeriodicalIF":1.5000,"publicationDate":"2022-02-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Research & Method in Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/1743727X.2022.2035352","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}

引用次数: 0

Abstract

ABSTRACT This study aims to introduce network meta-analysis (NMA) to provide educational researchers with an extended view of the reviewing educational research. Meta-analytic methods have been widely used in educational research reviews. However, weaknesses have emerged in the multi-group comparison analysis of educational studies where different interventions are applied because general meta-analysis is structured for a two-group comparison (i.e. treatment versus control group) of the same structure. Alternatively, when synthesizing experimental results of previous studies, NMA aims to verify related effect sizes by considering various experimental environments and research variables. Using NMA with simulation data, along with five types of online learning designs, this study describes how educational researchers could compare complex intervention effects between ten networks derived from five groups. The use of NMA in review research can provide rich interpretations of multi-group comparison results. Additionally, it can reflect on the complexity of real-world experimental design conditions.

查看原文本刊更多论文

如何比较多重干预效果:基于网络元分析的教育研究

摘要本研究旨在引入网络元分析(NMA)，为教育研究者提供一个审视教育研究的扩展视角。元分析方法在教育研究综述中得到了广泛应用。然而，在应用不同干预措施的教育研究的多组比较分析中出现了弱点，因为一般荟萃分析的结构是相同结构的两组比较(即治疗组与对照组)。在综合前人研究的实验结果时，NMA的目的是通过考虑不同的实验环境和研究变量来验证相关的效应量。利用NMA和模拟数据，以及五种类型的在线学习设计，本研究描述了教育研究人员如何比较来自五组的十个网络之间的复杂干预效果。在综述研究中使用NMA可以为多组比较结果提供丰富的解释。此外，它可以反映现实世界实验设计条件的复杂性。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

International Journal of Research & Method in Education EDUCATION & EDUCATIONAL RESEARCH-

CiteScore

4.70

自引率

5.00%

发文量

期刊介绍： The International Journal of Research & Method in Education is an interdisciplinary, peer-reviewed journal that draws contributions from a wide community of international researchers. Contributions are expected to develop and further international discourse in educational research with a particular focus on method and methodological issues. The journal welcomes papers engaging with methods from within a qualitative or quantitative framework, or from frameworks which cut across and or challenge this duality. Papers should not solely focus on the practice of education; there must be a contribution to methodology. International Journal of Research & Method in Education is committed to publishing scholarly research that discusses conceptual, theoretical and methodological issues, provides evidence, support for or informed critique of unusual or new methodologies within educational research and provides innovative, new perspectives and examinations of key research findings. The journal’s enthusiasm to foster debate is also recognised in a keenness to include engaged, thought-provoking response papers to previously published articles. The journal is also interested in papers that discuss issues in the teaching of research methods for educational researchers. Contributors to International Journal of Research & Method in Education should take care to communicate their findings or arguments in a succinct, accessible manner to an international readership of researchers, policy-makers and practitioners from a range of disciplines including but not limited to philosophy, sociology, economics, psychology, and history of education. The Co-Editors welcome suggested topics for future Special Issues. Initial ideas should be discussed by email with the Co-Editors before a formal proposal is submitted for consideration.