Real-Time Web Scraping for Analyzing Moodle Course Material Clickstream

Abstract

In this study, in learning analysis using Moodle, real-time processing using web scraping was proposed to reduce teachers' system operation burden and acquire analysis results faster while giving lessons. With the developed web scraping function, Moodle course logs can now be downloaded automatically. In addition, by integrating with the previously developed preprocessing system, teachers can see the clickstream of the learner's material in real-time in a time-series cross-section by simply launching the program during class. It has also become clear that the use of web scraping technology will increase the possibility of analyzing and automating learning logs in real-time from various aspects.