A Machine Learning-based Application to Pratice Foreign Languages Using Images and Photographs

Abstract

Most of the population uses a mobile device every day, hence, these devices pose an important opportunity for applications such as learning. A mobile App, based on Machine Learning algorithms and Google tools, was developed and used to aid the students in learning a new language. The App is capable of providing a translation of the objects found in a photograph or a gallery image and producing multiple option quizzes from the studied objects. The effect of the App in the learning process of a foreign language was tested by conducting an experiment, and the results were compared with those of a control group. Whether the motivation and learning engagement in the students increased, was analyzed. The results indicate that the experimental group performed better than the control group, and the App had good user acceptance, as most of the participants mentioned the App was engaging and fun to use.