Workshop on evaluating medical apps using the mobile app Rubric for learning.

Abstract

Objective: With rising digital tool use and lack of standard evaluation criteria in medical education, students should learn to assess the quality of medical apps. We designed a workshop to equip medical students with app evaluation skills. This study describes the workshop and experiences of students and faculty with the Mobile App Rubric for Learning (MARuL) instrument. Methods: The study used qualitative design and consecutive sampling, including all third-year medical students enrolled in a medical informatics course. Faculty facilitators introduced students to the MARuL instrument and trained them on its use. Students, grouped based on their familiarity with medical apps, conducted evaluations, and feedback was collected through an online form. The data were analyzed using thematic content analysis. Faculty also reflected on the workshop's implementation and the effectiveness of the instrument. Results: A total of 275 students participated, identifying challenges such as the instrument's length, complex terminology, scoring difficulties, limited answer options, and the lack of open-ended questions. Faculty reported difficulties in explaining the MARuL and conducting the workshop effectively. Conclusion:The findings suggest the importance of integrating standard medical apps evaluation tools into the medical curriculum. These tools should be time-efficient, easy to understand, and simple to interpret for their utilization in an educational setting.