T. Little, Daniel Bontempo, Charlie Rioux, Allison Tracy
{"title":"纵向多群体模型的优点:干预评估多层次模型的替代方案","authors":"T. Little, Daniel Bontempo, Charlie Rioux, Allison Tracy","doi":"10.1080/1743727X.2021.1973992","DOIUrl":null,"url":null,"abstract":"ABSTRACT Multilevel modelling (MLM) is the most frequently used approach for evaluating interventions with clustered data. MLM, however, has some limitations that are associated with numerous obstacles to model estimation and valid inferences. Longitudinal multiple-group (LMG) modelling is a longstanding approach for testing intervention effects using cluster-sampled data that has been superseded by the rise of MLM approaches, but the LMG approach can have advantages when research questions do not pertain to predicting variability at the higher levels. In this paper, we first review the advantages and limitations of MLM and LMG approaches. Second, steps in the estimation of an LMG model are presented, with some recent upgrades and changes in the modelling strategy that have particular utility for evaluating interventions. We discuss the advantages of the LMG approach as a guided confirmatory model-testing framework and how the approach places a premium on avoiding Type II errors, particularly when complex interactions are potentially at play.","PeriodicalId":51655,"journal":{"name":"International Journal of Research & Method in Education","volume":null,"pages":null},"PeriodicalIF":1.5000,"publicationDate":"2021-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"On the merits of longitudinal multiple group modelling: an alternative to multilevel modelling for intervention evaluations\",\"authors\":\"T. Little, Daniel Bontempo, Charlie Rioux, Allison Tracy\",\"doi\":\"10.1080/1743727X.2021.1973992\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ABSTRACT Multilevel modelling (MLM) is the most frequently used approach for evaluating interventions with clustered data. MLM, however, has some limitations that are associated with numerous obstacles to model estimation and valid inferences. Longitudinal multiple-group (LMG) modelling is a longstanding approach for testing intervention effects using cluster-sampled data that has been superseded by the rise of MLM approaches, but the LMG approach can have advantages when research questions do not pertain to predicting variability at the higher levels. In this paper, we first review the advantages and limitations of MLM and LMG approaches. Second, steps in the estimation of an LMG model are presented, with some recent upgrades and changes in the modelling strategy that have particular utility for evaluating interventions. We discuss the advantages of the LMG approach as a guided confirmatory model-testing framework and how the approach places a premium on avoiding Type II errors, particularly when complex interactions are potentially at play.\",\"PeriodicalId\":51655,\"journal\":{\"name\":\"International Journal of Research & Method in Education\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2021-09-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Research & Method in Education\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/1743727X.2021.1973992\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Research & Method in Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/1743727X.2021.1973992","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
On the merits of longitudinal multiple group modelling: an alternative to multilevel modelling for intervention evaluations
ABSTRACT Multilevel modelling (MLM) is the most frequently used approach for evaluating interventions with clustered data. MLM, however, has some limitations that are associated with numerous obstacles to model estimation and valid inferences. Longitudinal multiple-group (LMG) modelling is a longstanding approach for testing intervention effects using cluster-sampled data that has been superseded by the rise of MLM approaches, but the LMG approach can have advantages when research questions do not pertain to predicting variability at the higher levels. In this paper, we first review the advantages and limitations of MLM and LMG approaches. Second, steps in the estimation of an LMG model are presented, with some recent upgrades and changes in the modelling strategy that have particular utility for evaluating interventions. We discuss the advantages of the LMG approach as a guided confirmatory model-testing framework and how the approach places a premium on avoiding Type II errors, particularly when complex interactions are potentially at play.
期刊介绍:
The International Journal of Research & Method in Education is an interdisciplinary, peer-reviewed journal that draws contributions from a wide community of international researchers. Contributions are expected to develop and further international discourse in educational research with a particular focus on method and methodological issues. The journal welcomes papers engaging with methods from within a qualitative or quantitative framework, or from frameworks which cut across and or challenge this duality. Papers should not solely focus on the practice of education; there must be a contribution to methodology. International Journal of Research & Method in Education is committed to publishing scholarly research that discusses conceptual, theoretical and methodological issues, provides evidence, support for or informed critique of unusual or new methodologies within educational research and provides innovative, new perspectives and examinations of key research findings. The journal’s enthusiasm to foster debate is also recognised in a keenness to include engaged, thought-provoking response papers to previously published articles. The journal is also interested in papers that discuss issues in the teaching of research methods for educational researchers. Contributors to International Journal of Research & Method in Education should take care to communicate their findings or arguments in a succinct, accessible manner to an international readership of researchers, policy-makers and practitioners from a range of disciplines including but not limited to philosophy, sociology, economics, psychology, and history of education. The Co-Editors welcome suggested topics for future Special Issues. Initial ideas should be discussed by email with the Co-Editors before a formal proposal is submitted for consideration.