G. Wallendael, Paulien Coppens, Tom Paridaens, Niels Van Kets, W. V. D. Broeck, P. Lambert
{"title":"Perceptual quality of 4K-resolution video content compared to HD","authors":"G. Wallendael, Paulien Coppens, Tom Paridaens, Niels Van Kets, W. V. D. Broeck, P. Lambert","doi":"10.1109/QoMEX.2016.7498935","DOIUrl":"https://doi.org/10.1109/QoMEX.2016.7498935","url":null,"abstract":"With the introduction of 4K UHD video and display resolution, questions arise on the perceptual differences between 4K UHD and upsampled HD video content. In this paper, a striped pair comparison has been performed on a diverse set of 4K UHD video sources. The goal was to subjectively assess the perceived sharpness of 4K UHD and downscaled/upscaled HD video. A striped pair comparison has been applied in order to make the test as straightforward as possible for a non-expert participant population. Under these conditions and over this set of sequences, on average, on 54.8% of the sequences (17 out of 31), 4K UHD resolution content could be identified as being sharper compared to its HD down and upsampled alternative. The probabilities in which 4K UHD could be differentiated from downscaled/upscaled HD range from 83.3% for the easiest to assess sequence down to 39.7% for the most difficult sequence. Although significance tests demonstrate there is a positive sharpness difference from camera quality 4K UHD content compared to the HD downscaled/upscaled variations, it is very content dependent and all circumstances have been chosen in favor of the 4K UHD representation. The results of this test can contribute to the research process of developing metrics indicating visibility of high resolution features within specific content.","PeriodicalId":6645,"journal":{"name":"2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)","volume":"30 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89742301","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Estimation of perceptual redundancies of HEVC encoded dynamic textures","authors":"Karam Naser, V. Ricordel, P. Callet","doi":"10.1109/QoMEX.2016.7498931","DOIUrl":"https://doi.org/10.1109/QoMEX.2016.7498931","url":null,"abstract":"Statistical redundancies have been the dominant target in the image/video compression standards. Perceptually, there exists further redundancies that can be removed to further enhance the compression efficiency. In this paper, we considered short term homogeneous patches that fall into the foveal vision as dynamic textures, for which a psychophysical test was used to estimate their amount of perceptual redundancies. We demonstrated the possible rate saving by utilizing these redundancies. We further designed a learning model that can precisely predict the amount of redundancies and accordingly proposed a generalized perceptual optimization framework.","PeriodicalId":6645,"journal":{"name":"2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)","volume":"11 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80882697","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sharath Chandra Guntuku, S. Roy, Weisi Lin, Kelvin Ng, W. Ng, V. Jakhetiya
{"title":"Personalizing User Interfaces for improving quality of experience in VoD recommender systems","authors":"Sharath Chandra Guntuku, S. Roy, Weisi Lin, Kelvin Ng, W. Ng, V. Jakhetiya","doi":"10.1109/QoMEX.2016.7498940","DOIUrl":"https://doi.org/10.1109/QoMEX.2016.7498940","url":null,"abstract":"Recommending content to users involves understanding a) what to present and b) how to present them, so as to increase quality of experience (QoE) and thereby, content consumption. This work attempts to address the question of how to present contents in a way so that the user finds it easy to get to desired content. While the process of User Interface (UI) design is dependent on several human factors, there are basic design components and their combination that have to be common to any recommender system user interface. Personalization of the UI design process involves picking the right components and their combination, and presenting a UI to suit the usage behavior of an individual user, so as to enhance the QoE. This work proposes a system that learns from a user's content consumption patterns and makes some recommendations regarding how to present the content for the user (in the context of Video-On-Demand/Live-TV services on Computer displays), so as to enhance the QoE of the recommender system.","PeriodicalId":6645,"journal":{"name":"2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)","volume":"13 1 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83473813","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Colm Sloan, N. Harte, D. Kelly, A. Kokaram, Andrew Hines
{"title":"Bitrate classification of twice-encoded audio using objective quality features","authors":"Colm Sloan, N. Harte, D. Kelly, A. Kokaram, Andrew Hines","doi":"10.1109/QoMEX.2016.7498956","DOIUrl":"https://doi.org/10.1109/QoMEX.2016.7498956","url":null,"abstract":"When a user uploads audio files to a music streaming service, these files are subsequently re-encoded to lower bitrates to target different devices, e.g. low bitrate for mobile. To save time and bandwidth uploading files, some users encode their original files using a lossy codec. The metadata for these files cannot always be trusted as users might have encoded their files more than once. Determining the lowest bitrate of the files allows the streaming service to skip the process of encoding the files to bitrates higher than that of the uploaded files, saving on processing and storage space. This paper presents a model that uses quality predictions from ViSQOLAudio, a full reference objective audio quality metric, as features in combination with a multi-class support vector machine classifier. An experiment on twice-encoded files found that low bitrate codecs could be classified using audio quality features. The experiment also provides insights into the implications of multiple transcodes from a quality perspective.","PeriodicalId":6645,"journal":{"name":"2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)","volume":"89 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78398305","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"(Re-)actions speak louder than words? A novel test method for tracking user behavior in web video services","authors":"W. Robitza, A. Raake","doi":"10.1109/QoMEX.2016.7498926","DOIUrl":"https://doi.org/10.1109/QoMEX.2016.7498926","url":null,"abstract":"Assuring user engagement has become a key issue for Internet Service Providers and Over-the-Top Providers. How long are users consuming a service? When are they likely to abandon it due to quality problems? Rather than just estimating perceived audiovisual quality, future quality prediction models will also factor in possible user behavior. This contribution presents a novel test method to assess short-term user behavior in web video services, in a controlled living-room-like environment. We show that typical behavioral responses (such as seeking, reloading, or selecting another video) can be elicited, with the real purpose of the test hidden from the viewers. We can also see that when users are not focused on judging quality, their perception of errors changes significantly. This paper highlights the strong impact of laboratory test situations on users' behavior and discusses the challenges revolving around finding valid test methods.","PeriodicalId":6645,"journal":{"name":"2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)","volume":"41 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75546460","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Friedemann Köster, Dennis Guse, Christian Miethaner, S. Möller
{"title":"Towards training naïve participants for a perceptual annotation task designed for experts","authors":"Friedemann Köster, Dennis Guse, Christian Miethaner, S. Möller","doi":"10.1109/QoMEX.2016.7498921","DOIUrl":"https://doi.org/10.1109/QoMEX.2016.7498921","url":null,"abstract":"Technical Causes Analysis (P.TCA) is a method for identifying technical causes of sub-optimum speech transmission quality. Originally created as an expert procedure for the annotation of speech samples, its applicability to naïve listener was also studied. Due to the low agreement of naïve listener annotations, it was suggested that detailed training methods are necessary to lift naïve annotations to an agreement level of experts. The aim of this work was to develop training methods for naïve annotators. For this, two different training procedures were developed and tested in two separate annotation experiments. The results are analyzed and discussed regarding the effects of the trainings and their implications for the P.TCA annotation scheme. The outcome shows that these training methods did not meet the expectations for improving the inter-rater agreement of naïve annotators. It is concluded that trainings of 15 to 20 minutes rather confuse naïve annotators by conveying too much information in too little time, and that they are not sufficient to prepare naïve annotators. It is argued that much more extensive training is needed to raise naïve annotators to expert level, and that such a training must include both, in-depth introduction to the annotation process as well as detailed presentation and exercise regarding the P.TCA degradations.","PeriodicalId":6645,"journal":{"name":"2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)","volume":"46 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74274539","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Michele A. Saad, Patrick McKnight, Jake Quartuccio, David G. Nicholas, Ramesh Jaladi, P. Corriveau
{"title":"Consumer-photo quality assessment: Challenges and pitfalls in crowdsourcing","authors":"Michele A. Saad, Patrick McKnight, Jake Quartuccio, David G. Nicholas, Ramesh Jaladi, P. Corriveau","doi":"10.1109/QoMEX.2016.7498970","DOIUrl":"https://doi.org/10.1109/QoMEX.2016.7498970","url":null,"abstract":"We discuss caveats and challenges in crowdsourcing subjective image quality evaluation studies that use real consumer photos with non-simulated distortions. The subtle nature of consumer image artifacts as well as the nuanced quality differences among photos from various consumer devices, necessitate that crowdsourcing studies be designed with extra caution. In this work, we point out certain caveats to look for in the literature, and we draw attention to and discuss the consequences of various design choices on the subjective responses received. The design choices include: 1) stimulus viewing mode, 2) stimulus habituation, 3) study length, and 4) the location of a number of attention items within the study. We show how these design parameters are key to maximizing response correspondence with lab-based responses, and we emphasize to how this differs from tests that utilize simulated image distortions.","PeriodicalId":6645,"journal":{"name":"2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)","volume":"333 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76564381","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Johannes Nowak, Kai-Peter Jurgeit, Judith Liebetrau
{"title":"Assessment of spherical microphone array auralizations using open-profiling of quality (OPQ)","authors":"Johannes Nowak, Kai-Peter Jurgeit, Judith Liebetrau","doi":"10.1109/QoMEX.2016.7498928","DOIUrl":"https://doi.org/10.1109/QoMEX.2016.7498928","url":null,"abstract":"Open-profiling of quality (OPQ) was recently proposed for quality assessment of mobile 3D devices. It combines quantitative and qualitative analyses in a mixed-method approach, allowing statements on overall quality and its relation to specific sensory aspects of the reproduction. In the scope of this article, the applicability of OPQ is investigated and discussed when assessing the reproduction quality of virtual acoustic environments (VAEs). Based on binaural auralizations of real spherical microphone array recordings, the influence of the used array configuration is analyzed for different test stimuli and the results compared to ideal free-field simulations. Despite certain limitations, results show that OPQ is suitable for quality evaluations of VAEs as it provides detailed insight into perceptual aspects of the technical system, directly establishing their relation to overall preference.","PeriodicalId":6645,"journal":{"name":"2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)","volume":"23 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77389626","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Francombe, Tim S. Brookes, R. Mason, James Woodcock
{"title":"Determining and labeling the preference dimensions of spatial audio replay","authors":"J. Francombe, Tim S. Brookes, R. Mason, James Woodcock","doi":"10.1109/QoMEX.2016.7498948","DOIUrl":"https://doi.org/10.1109/QoMEX.2016.7498948","url":null,"abstract":"There are currently many spatial audio reproduction systems in domestic use (e.g. mono, stereo, surround sound, sound bars, and headphones). In an experiment, pairwise preference magnitude ratings for a range of such systems were collected from trained and untrained listeners. The ratings were analysed using internal preference mapping to: (i) uncover the principal perceptual dimensions of listener preference; (ii) label the dimensions based on important perceptual attributes; and (iii) observe differences between trained and untrained listeners. To aid with labelling the dimensions, perceptual attributes were elicited alongside the preference ratings and were analysed by: (i) considering a metric derived from the frequency of use of each attribute and the magnitude of the related preference judgements; and (ii) observing attribute use for comparisons between specific methods. The first preference dimension accounted for over 90% of the variance in ratings; all participants exhibited a preference for reproduction methods that were positively correlated with the first dimension (most notably 5-, 9-, and 22-channel surround sound). This dimension was related to multiple important attributes, including those associated with spatial capability and absence of distortions. The second dimension accounted for only a very small proportion of the variance, and appeared to separate the headphone method from the other methods. The trained and untrained listeners generally showed opposite preferences in the second dimension, suggesting that trained listeners have a higher preference for headphone reproduction than untrained listeners.","PeriodicalId":6645,"journal":{"name":"2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)","volume":"74 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81542383","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Perception of quality in cloud computing based services","authors":"Aleksandar Karadimce, D. Davcev","doi":"10.1109/QoMEX.2016.7498925","DOIUrl":"https://doi.org/10.1109/QoMEX.2016.7498925","url":null,"abstract":"Cloud computing consists of hardware and software resources, available on the Internet as a set of services for users. This technology aims to provide stable, reliable and encapsulated dynamic information and communication environment for end users to be able to simultaneously access shared resources that are available anywhere and at any time. The major benefit of cloud computing is used to improve the perception of quality for the client requests. Commonly in the communications industry, the term Quality of Experience (QoE) is used as a measure for the user perception of service from the user's point of view. In this research, we propose a classification of cloud-based services based on objective and subjective characteristics for perception of quality. The main contribution in this paper is a novel approach based on Bayesian modeling for efficient assessment of QoE perception for cloud-based services considering the level of interactivity, service complexity, usage domain, and multimedia-intensity.","PeriodicalId":6645,"journal":{"name":"2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)","volume":"23 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84244895","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}