Analysis of Free Description in Lecture Questionnaires Using Word Rank Affiliation Probability

Abstract

To enrich structural university and graduate school education, faculty development (FD) activities are conducted to improve faculty education and research guidance capabilities. In terms of the content of FD activities, classroom observation between faculty members and participation in seminars and training events at the institution level can be considered. As a part of these activities, many universities request students to fill out lecture questionnaires as a means of evaluating the facultys educational activities. However, the evaluation discrepancies between students and the faculty is a problem faced while analyzing these lecture questionnaires. In this study, we estimated the evaluation for some of the comment evaluations (sheet section) given in the free answer section of the lecture questionnaire. The evaluation was conducted manually from differing standpoints for students and faculty. Moreover, we evaluated the estimation of words included in the content, extracted useful comments, and evaluated the faculty. Furthermore, we assessed the differences between evaluators with different standpoints. In particular, in this study, an evaluation estimate of both words and comments, as well as a recursive evaluation of comments and words was performed. For the comment evaluation method, the six-stage Likert scale was used. When ranking evaluations, the evaluation adopted a contaminated normal distribution for the affiliation probability.