Multi-dimensional evaluation of E-learning systems in the higher education context: An empirical investigation of a computer literacy course

Research addressing the conceptualization and measurement of learning management systems (LMS) within educational organizations as both a web-based learning system for e-learning and as a supportive tool for blended learning environments is receiving attention, and this research study proposes a conceptual e-learning assessment model, HELAM (Hexagonal e-Learning Assessment Model), suggesting a multi-dimensional approach for LMS evaluation via six dimensions: (1) system quality, (2) service quality, (3) content quality, (4) learner perspective, (5) instructor attitudes, and (6) supportive issues. A questionnaire based on HELAM has been applied to 160 undergraduate Level 1 students who were enrolled with the computer literacy course entitled “IS100 - Introduction to Information System Technologies and Applications” at Middle East Technical University, Turkey. IS100 course is a basic level computer literacy core course designed for all first-year students throughout the university. In this course “Blended learning” learning style was used, which defined as combination of face-to-face and online learning. In IS100 course NetClass learning management system was used as a supportive tool. The proposed assessment model has been tested for content validity, reliability, and criterion-based predictive validity. Furthermore, explanatory factor analysis was conducted to primarily establish the factor structure of the model. The statistical analyses demonstrate that the learners' perceived satisfaction from the NetClass learning management system overall is high. Findings of this research will be valuable for both academics and practitioners of e-learning systems.