{"title":"The influence of relative disparity and planar motion velocity on visual discomfort of stereoscopic videos","authors":"Jing Li, M. Barkowsky, P. Callet","doi":"10.1109/QoMEX.2011.6065695","DOIUrl":"https://doi.org/10.1109/QoMEX.2011.6065695","url":null,"abstract":"The vergence-accommodation conflict, excessive screen disparity, binocular distortions and the motion component in stereoscopic videos are considered as main factors that may induce visual discomfort. In our previous study which was based on the experts-only experiment, we also found that the large relative disparity between the foreground and background and the fast planar motion were more likely to induce visual discomfort. In this study, we conducted the same subjective experiment but on non-expert observers. The subjective experiment results coincided with our previous findings. The two objective visual discomfort models developed in our previous study have been evaluated and showed high correlation with subjective data. Finally, we found that the observers could be classified into different clusters according to their visual discomfort sensitivity to the velocity or the relative disparity. For some observers, the velocity is the predominant factor that may induce visual discomfort; some consider that the relative disparity is the key factor, and some are sensitive to both the velocity and relative disparity.","PeriodicalId":6441,"journal":{"name":"2011 Third International Workshop on Quality of Multimedia Experience","volume":"151 1","pages":"155-160"},"PeriodicalIF":0.0,"publicationDate":"2011-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77268078","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"SOS: The MOS is not enough!","authors":"T. Hossfeld, R. Schatz, S. Egger","doi":"10.1109/QoMEX.2011.6065690","DOIUrl":"https://doi.org/10.1109/QoMEX.2011.6065690","url":null,"abstract":"When it comes to analysis and interpretation of the results of subjective QoE studies, one often witnesses a lack of attention to the diversity in subjective user ratings. In extreme cases, solely Mean Opinion Scores (MOS) are reported, causing the loss of important information on the user rating diversity. In this paper, we emphasize the importance of considering the Standard deviation of Opinion Scores (SOS) and analyze important characteristics of this measure. As a result, we formulate the SOS hypothesis which postulates a square relationship between the MOS and the SOS. We demonstrate the validity and applicability of the SOS hypothesis for a wide range of studies. The main benefit of the SOS hypothesis is that it allows for a compact, yet still comprehensive statistical summary of subjective user tests. Furthermore, it supports checking the reliability of test result data sets as well as their comparability across different QoE studies.","PeriodicalId":6441,"journal":{"name":"2011 Third International Workshop on Quality of Multimedia Experience","volume":"206 1","pages":"131-136"},"PeriodicalIF":0.0,"publicationDate":"2011-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76067036","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multimedia user feedback based on augmenting user tags with EEG emotional states","authors":"S. Davis, E. Cheng, I. Burnett, C. Ritz","doi":"10.1109/QOMEX.2011.6065693","DOIUrl":"https://doi.org/10.1109/QOMEX.2011.6065693","url":null,"abstract":"Efficient content-based access to large multimedia collections requires annotations that are human-meaningful, and user tagging of media is one means to obtain such semantic metadata. Tags can also act as user feedback essential for quality of multimedia experience assessment; however, tags can lack user context and become ambiguous between different users. Further, user tagging is a deliberate and discrete event where a user's response to the media can significantly vary in-between tagging events. This paper extends upon the authors' social multimedia adaptation framework to explore the use of EEG biosignals obtained from consumer EEG headsets to form context around explicit tagging activities and as user emotional feedback in-between user tagging events. Preliminary user studies investigating grouped participant responses indicate the most indicative emotional states to be short-term excitement, engagement and frustration in addition to gyroscope information.","PeriodicalId":6441,"journal":{"name":"2011 Third International Workshop on Quality of Multimedia Experience","volume":"19 1","pages":"143-148"},"PeriodicalIF":0.0,"publicationDate":"2011-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87728798","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards an inter-observer analysis framework for multimedia quality assessment","authors":"U. Engelke, Yohann Pitrey, P. Callet","doi":"10.1109/QoMEX.2011.6065700","DOIUrl":"https://doi.org/10.1109/QoMEX.2011.6065700","url":null,"abstract":"In multimedia quality assessment, observer ratings are typically averaged into mean opinion scores (MOS) to obtain a subjective ground truth for a set of stimuli. Valuable information about individual observer rating behaviour and inter-observer differences is lost that can be useful to improve subjective experiment procedures and quality of experience prediction models. In this paper, we present an inter-observer analysis framework that addresses quality assessment from a different angle, setting the focus on observer differences rather than stimuli differences. The framework consists of procedures for inter-observer analysis as well as the necessary considerations during preparation and post-processing. The aim of this paper is to raise awareness that consideration of MOS alone simplifies quality assessment too much in the context of multimedia quality assessment.","PeriodicalId":6441,"journal":{"name":"2011 Third International Workshop on Quality of Multimedia Experience","volume":"28 1","pages":"183-188"},"PeriodicalIF":0.0,"publicationDate":"2011-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83328007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Asiya Khan, Lingfen Sun, J. O. Fajardo, Ianire Taboada, F. Liberal, E. Ifeachor
{"title":"Impact of end devices on subjective video quality assessment for QCIF video sequences","authors":"Asiya Khan, Lingfen Sun, J. O. Fajardo, Ianire Taboada, F. Liberal, E. Ifeachor","doi":"10.1109/QoMEX.2011.6065699","DOIUrl":"https://doi.org/10.1109/QoMEX.2011.6065699","url":null,"abstract":"The aim of this paper is to assess the impact of devices on Quality of Experience (QoE) of the user. As the types of video content viewed over handheld devices increases e.g. streaming video, it is important to evaluate the impact of the end device on video quality assessment. In this paper subjective tests were conducted with QCIF (176×144) videos over two devices — Personal Computer (PC) and mobile handset with 90 test conditions. The dataset was generated with a combination of parameters associated with the access network (block error rates and mean burst lengths), H.264 codec related parameter (sender bitrates) and content types. Subjects favoured PC test over handset test in almost all test scenarios. These studies should help in context-aware services in deciding the appropriate encoding parameters based on type of device being used to receive content.","PeriodicalId":6441,"journal":{"name":"2011 Third International Workshop on Quality of Multimedia Experience","volume":"61 1","pages":"177-182"},"PeriodicalIF":0.0,"publicationDate":"2011-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84207387","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Toon De Pessemier, K. Moor, Adrian Juan Verdejo, D. V. Deursen, W. Joseph, L. Marez, L. Martens, R. Walle
{"title":"Exploring the acceptability of the audiovisual quality for a mobile video session based on objectively measured parameters","authors":"Toon De Pessemier, K. Moor, Adrian Juan Verdejo, D. V. Deursen, W. Joseph, L. Marez, L. Martens, R. Walle","doi":"10.1109/QoMEX.2011.6065689","DOIUrl":"https://doi.org/10.1109/QoMEX.2011.6065689","url":null,"abstract":"Although Quality of Experience (QoE) plays a major role in the design and development of mobile applications and services, QoE assessment is still challenging, especially in real-life (so called ‘living lab’) contexts. This paper presents results from an exploratory, interdisciplinary study on QoE and more specifically, on the acceptability of varying audiovisual qualities during video watching on a mobile device, in a realistic setting. The subjectively measured acceptability is modeled by means of a decision tree which uses information about the network type, transport protocol, technical video characteristics, and user behavior. The proposed model may contribute to the estimation of users' subjective evaluation of the quality during mobile video watching and to QoE optimization by dynamically altering the parameters that have the largest influence on this subjective evaluation.","PeriodicalId":6441,"journal":{"name":"2011 Third International Workshop on Quality of Multimedia Experience","volume":"13 1","pages":"125-130"},"PeriodicalIF":0.0,"publicationDate":"2011-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77932499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards assigning value to multimedia QOE","authors":"M. Quintero, A. Raake","doi":"10.1109/QoMEX.2011.6065704","DOIUrl":"https://doi.org/10.1109/QoMEX.2011.6065704","url":null,"abstract":"The development of multimedia services with a high level of acceptance has created the necessity of migrating from traditional concepts like quality of service (QoS) to the more user-centric concept of quality of experience (QoE), where service performance is assessed in terms of user-perceived quality. However, due to the specific nature of current laboratory tests, it is difficult to extrapolate the results obtained in the laboratory to the real world. In this document, we take up the initiative made by different authors to assess the ecosystem of multimedia services from an interdisciplinary perspective. In this paper, we present results of a series of studies conducted to analyze the overall perception of VoIP-based speech communication service quality from a user perspective. The aim is to link QoS-related technical characteristics of IP-based multimedia services with QoE not only in terms of lab-QoE, but in terms of the value users associate with it.","PeriodicalId":6441,"journal":{"name":"2011 Third International Workshop on Quality of Multimedia Experience","volume":"34 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2011-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85455564","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Christian Keimel, Julian Habigt, Manuel Klimpke, K. Diepold
{"title":"Design of no-reference video quality metrics with multiway partial least squares regression","authors":"Christian Keimel, Julian Habigt, Manuel Klimpke, K. Diepold","doi":"10.1109/QoMEX.2011.6065711","DOIUrl":"https://doi.org/10.1109/QoMEX.2011.6065711","url":null,"abstract":"No-reference video quality metrics are becoming ever more popular, as they are more useful in real-life applications compared to full-reference metrics. One way to design such metrics is by applying data analysis methods on both objectively measurable features and data from subjective testing. Partial least squares regression (PLSR) is one such method. In order to apply such methods, however, we have to temporally pool over all frames of a video, loosing valuable information about the quality variation over time. Hence, we extend the PLSR into a higher dimensional space with multiway PLSR in this contribution and thus consider video in all its dimensions. We designed a H.264/AVC bitstream no-reference video quality metric in order to verify multiway PLSR against PLSR with respect to the prediction performance. Our results show that the inclusion of the temporal dimension with multiway PLSR improves the quality prediction and its correlation with the actual quality.","PeriodicalId":6441,"journal":{"name":"2011 Third International Workshop on Quality of Multimedia Experience","volume":"2672 1","pages":"49-54"},"PeriodicalIF":0.0,"publicationDate":"2011-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87034523","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
N. Staelens, I. Sedano, M. Barkowsky, L. Janowski, K. Brunnström, P. Callet
{"title":"Standardized toolchain and model development for video quality assessment — The mission of the Joint Effort Group in VQEG","authors":"N. Staelens, I. Sedano, M. Barkowsky, L. Janowski, K. Brunnström, P. Callet","doi":"10.1109/QoMEX.2011.6065713","DOIUrl":"https://doi.org/10.1109/QoMEX.2011.6065713","url":null,"abstract":"Since 1997, the Video Quality Experts Group (VQEG) has been active in the field of subjective and objective video quality assessment. The group has validated competitive quality metrics throughout several projects. Each of these projects requires mandatory actions such as creating a testplan and obtaining databases consisting of degraded video sequences with corresponding subjective quality ratings. Recently, VQEG started a new open initiative, the Joint Effort Group (JEG), for encouraging joint collaboration on all mandatory actions needed to validate video quality metrics. Within the JEG, effort is made to advance the field of both subjective and objective video quality measurement by providing proper software tools and subjective databases to the community. One of the subprojects of the JEG is the joint development of a hybrid H.264/AVC objective quality metric. In this paper, we introduce the JEG and provide an overview of the different ongoing activities within this newly started group.","PeriodicalId":6441,"journal":{"name":"2011 Third International Workshop on Quality of Multimedia Experience","volume":"51 1","pages":"61-66"},"PeriodicalIF":0.0,"publicationDate":"2011-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76545261","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Frame-layer packet-based parametric video quality model for encrypted video in IPTV services","authors":"Marie-Neige Garcia, A. Raake","doi":"10.1109/QoMEX.2011.6065685","DOIUrl":"https://doi.org/10.1109/QoMEX.2011.6065685","url":null,"abstract":"This paper presents a parametric video quality model for monitoring the perceived quality of High Definition (HD, 1920×1080) encrypted videos for IPTV services. The model has been developed based on the results of extensive subjective video quality tests. In this study we focus on the modeling of the quality impact of packet-loss in case slicing has been applied as basis for subsequent packet-loss-concealment (PLC) for H.264 encoding. We introduce a parameter which describes the spatial-extent and duration of the loss by considering “frame-layer” information such as the frame type. This parameter is combined with an erroneous Group-Of-Picture (GOP) counter for predicting the perceived quality. With the slice size as additional parameter, the model coefficients are independent of the GOP structure, of the packet-loss distribution and of the number of slices per frame. The model thus is more general, and shows higher performance than models not considering “frame-layer” information.","PeriodicalId":6441,"journal":{"name":"2011 Third International Workshop on Quality of Multimedia Experience","volume":"24 1","pages":"102-106"},"PeriodicalIF":0.0,"publicationDate":"2011-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79648232","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}