Genie-on-demand: A custom AI chatbot for enhancing learning performance, self-efficacy, and technology acceptance in occupational health and safety for engineering education

Abstract

Occupational Health and Safety (OHS) education is essential for preparing engineering students to maintain safety standards and prevent workplace hazards. Traditional learning resources, such as textbooks, can be time-consuming and inadequate for immediate, context-specific queries. Advanced AI chatbots offer interactive and immediate feedback, but they often lack specificity and depend on users' prompting skills, which not all students possess. This study introduces “Genie-on-Demand,” a custom AI chatbot designed to address students' queries with precise, curriculum-aligned responses. Educators can train the chatbot using specific learning materials by uploading PDFs, ensuring relevant and accurate answers. A quasi-experimental study was conducted with 106 electrical engineering students divided into three groups: those using the custom chatbot, those using a conventional chatbot (ChatGPT), and those employing traditional learning methods. Results demonstrated that the custom chatbot significantly improved learning performance, self-efficacy, and technology acceptance compared to other methods. Students reported increased confidence and effectiveness in using the custom chatbot as a learning assistant. This study highlights the potential of customized AI solutions in education, with versatile applications across various disciplines.