Mobile-assisted language learning with commercial apps: A focused methodological review of quantitative/mixed methods research and ethics

Abstract

Researchers have increasingly investigated the effectiveness of commercial mobile-assisted language learning (MALL) applications (apps) such as Duolingo, Babbel, Busuu, Memrise, and Rosetta Stone, with several methodological reviews that have been published to date. However, prior reviews have often lumped together MALL studies involving commercial apps with those that investigate teacher-generated MALL activities. Such reviews also provide limited discussions of important issues involving research ethics. This study aims to fill these gaps by conducting a focused review of studies from the past 10 years (2014–2023) that have appeared in six key CALL journals. Investigated are 1) the research methods used in commercial MALL app studies using quantitative or mixed methods (e.g., samples, target languages, instruments), and 2) the extent to which researchers have discussed issues of research ethics (e.g., disclosing funding, conflicts of interest). The findings illustrate trends in the popularity of certain target languages, topics, and instruments, along with issues involving the reporting of key statistical information. Some authors also provide wide-ranging discussions of ethics; however, many studies lack transparency concerning potential conflicts of interest. Based on these findings, recommendations are provided for conducting future research with commercial MALL apps.