The Effects of Additional Factors on Subjective Quality Assessments

Abstract

In Quality of Experience, the users’ degrees of delight or annoyance are quantized by direct human interaction via subjective quality assessments. There are many factors that may influence the users’ responses, and standards have been laid down to strictly control the monitoring conditions. In this paper, we analyze limitations of Mean Opinion Score (MOS) assessment to portray the influence of additional factors on user behavior while assessing multimedia content. We show that the frequency of watching online video content as well as the user delight with the content play a significant role in her final feedback. Our study emphasizes the need to use additional metrics along with MOS for content ratings to obtain a more accurate measure of the user experience.