Usability study of ITU-T P.1201 Amd.2 standard for video quality estimation in HTTP-Based online streaming services

Abstract

The demands for standardized evaluation of user experience with multimedia services in mobile networks are constantly growing. Therefore, most of the standardization bodies are active in this domain. As a result, several standards for QoE prediction in video streaming systems have been introduced recently. One of them is ITU-T P.1201 with its Amendment n. 2, which has been developed for TCP-based video streaming QoE assesment. The QoE modeling is known as highly complex discipline influenced by many factors, therefore any new standard should be carefully evaluated for its usability for specific applications. Following this, the performance evaluation of ITU-T P.1201 standard as potential QoE assessment tool for online video-streaming services is provided in this paper. The analysis was done based on the subjective experiments performed in laboratory conditions. Moreover, a set of packet-based features appropriate for long-term QoE models independent of future video streaming applications changes are studied to understand their impact on QoE prediction performance. The Pearson correlation and Root Mean Square Error criteria are used to perform a numerical comparison. The most appropriate features' combinations are introduced together with practical conclusions at the end of this paper.