Reporting practices in applied linguistics quantitative research articles across a decade: A methodological synthesis

IF 4.9 1区文学 Q1 EDUCATION & EDUCATIONAL RESEARCH

System Pub Date : 2025-02-27 DOI:10.1016/j.system.2025.103627

Fahimeh Marefat , Mohammad Hassanzadeh , Sina Noureddini , Mostafa Ranjbar

{"title":"Reporting practices in applied linguistics quantitative research articles across a decade: A methodological synthesis","authors":"Fahimeh Marefat , Mohammad Hassanzadeh , Sina Noureddini , Mostafa Ranjbar","doi":"10.1016/j.system.2025.103627","DOIUrl":null,"url":null,"abstract":"<div><div>The standards for quantitative second language (L2) research paradigm are becoming increasingly stringent. Meanwhile, the purpose of methodological synthesis is to describe, examine, and appraise field-wide practices to augment the quality of future research. The current study strove to follow this line of inquiry by examining study quality and reporting practices in 382 experimental research articles (RAs) from seven international journals with an eye to any evolving pattern over time. In so doing, an integrated-moderated coding scheme was created. Then, the frequency counts and all related practices for the period between 2011 and 2021 were documented. The overall analysis revealed substantial adherence to methodological quality standards, including the reporting of sample size, pretesting, as well as descriptive and inferential statistics. Nevertheless, issues such as inadequate integration of probability sampling, delayed posttesting, advanced statistical techniques, and data-accountable graphs were evident as well, albeit slightly improving over time. Findings are expected to enhance the methodological awareness of L2 researchers as well as those who aspire to adopt a holistic and collaborative approach to methodological syntheses.</div></div>","PeriodicalId":48185,"journal":{"name":"System","volume":"131 ","pages":"Article 103627"},"PeriodicalIF":4.9000,"publicationDate":"2025-02-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"System","FirstCategoryId":"98","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0346251X25000375","RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}

引用次数: 0

Abstract

The standards for quantitative second language (L2) research paradigm are becoming increasingly stringent. Meanwhile, the purpose of methodological synthesis is to describe, examine, and appraise field-wide practices to augment the quality of future research. The current study strove to follow this line of inquiry by examining study quality and reporting practices in 382 experimental research articles (RAs) from seven international journals with an eye to any evolving pattern over time. In so doing, an integrated-moderated coding scheme was created. Then, the frequency counts and all related practices for the period between 2011 and 2021 were documented. The overall analysis revealed substantial adherence to methodological quality standards, including the reporting of sample size, pretesting, as well as descriptive and inferential statistics. Nevertheless, issues such as inadequate integration of probability sampling, delayed posttesting, advanced statistical techniques, and data-accountable graphs were evident as well, albeit slightly improving over time. Findings are expected to enhance the methodological awareness of L2 researchers as well as those who aspire to adopt a holistic and collaborative approach to methodological syntheses.

查看原文本刊更多论文

十年来应用语言学定量研究文章的报告实践：方法论综合

定量第二语言研究范式的标准越来越严格。同时，方法综合的目的是描述、检查和评价领域范围内的实践，以提高未来研究的质量。目前的研究努力遵循这条调查路线，通过检查来自7个国际期刊的382篇实验研究文章（RAs）的研究质量和报告实践，着眼于任何随时间变化的模式。这样，就创建了一个集成的调节编码方案。然后，记录了2011年至2021年期间的频率计数和所有相关实践。总的分析表明，在很大程度上遵守了方法学质量标准，包括报告样本量、预测试以及描述性和推断性统计。然而，诸如概率抽样集成不足、延迟的后测试、先进的统计技术和数据负责的图表等问题也很明显，尽管随着时间的推移略有改善。研究结果有望提高第二语言研究人员以及那些渴望采用整体和协作方法进行方法综合的研究人员的方法意识。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

System Multiple-

CiteScore

8.80

自引率

8.30%

发文量

202

审稿时长

64 days

期刊介绍： This international journal is devoted to the applications of educational technology and applied linguistics to problems of foreign language teaching and learning. Attention is paid to all languages and to problems associated with the study and teaching of English as a second or foreign language. The journal serves as a vehicle of expression for colleagues in developing countries. System prefers its contributors to provide articles which have a sound theoretical base with a visible practical application which can be generalized. The review section may take up works of a more theoretical nature to broaden the background.