Monitoring Student Frustration Level Using Blackbox Logs

Abstract

we use the worldwide source code repository Blackbox to detect frustration among the learners. This study measures frustration by calculating individual student Error Quotient (EQ) score per laboratory session. So higher the EQ score higher is the frustration, similarly lower the EQ score lower is the frustration. The threshold of 0.5 is set, so if the score is greater than or equal to 0.5 the student is said to be frustrated. Similarly, the average score across each laboratory session for each individual student is calculated. The result shows that 13 out of 20 students were frustrated for Object Oriented Programming (OOP) laboratory sessions. The validation was carried out by human observers with the inter rater reliability of Cohens' Kappa as exceptionally high.