J. Falk, Siri Eksvärd, B. Schenkman, Börje Andrén, K. Brunnström
{"title":"Legibility and readability in Augmented Reality","authors":"J. Falk, Siri Eksvärd, B. Schenkman, Börje Andrén, K. Brunnström","doi":"10.1109/QoMEX51781.2021.9465455","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465455","url":null,"abstract":"Digital technology offers multimodal presentation of information, that can be used for translating foreign languages or for alleviating hearing impairment or deafness communication problems. Today, there exists various aids that can be used for speech-to text translations, but there are some challenges with these. One potential solution for this is to make use of a combination of Augmented Reality (AR) and speech-to-text systems, where speech is converted into text that is then presented in AR-glasses. In AR, one crucial problem is the legibility and readability of text under different environmental conditions. Different types of AR glasses have different ergonomic characteristics, which implies that certain glasses might be more suitable for such a system than others. In this investigation, two different AR-glasses were evaluated based on among other things their optical, visual, and ergonomic characteristics. User tests were conducted to evaluate the legibility and readability of text under different environmental contexts. The results indicate that legibility and readability are affected by factors such as ambient illuminance, background properties and how the text is presented with respect to polarity, opacity, size, and number of lines. The characteristics of the glasses impacts the user experience, but which glasses that is preferred depends on the individual.","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"182 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132332362","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ayyoub Ahar, Manuela Pereira, Tobias Birnbaum, A. Pinheiro, P. Schelkens
{"title":"Validation of dynamic subjective quality assessment methodology for holographic coding solutions","authors":"Ayyoub Ahar, Manuela Pereira, Tobias Birnbaum, A. Pinheiro, P. Schelkens","doi":"10.1109/QoMEX51781.2021.9465388","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465388","url":null,"abstract":"In preparation of the Call for Proposals on JPEG Pleno Holography, multiple exploration studies are ongoing to define the general procedure for performance assessment of proposed coding solutions. The performance of proposals will be compared against JPEG 2000 and H.265/HEVC intra coding, both serving as anchor codecs. In this paper, we report on the results of a dynamic subjective visual quality assessment procedure. A subset of 8 holograms, selected from the JPEG Pleno Database, is compressed both in hologram and object plane at three different bit rates. Chosen bit rates vary per hologram depending on their content characteristics. Then, for each hologram and its compressed versions, pseudo-video sequences are generated from the reconstructed views along a scan path that involves focus and viewing angle changes and that is hologram specific. A double stimulus simultaneous test, combined with a 5-level impairment-scale scoring protocol is deployed where videos created from the reference and the decoded holograms are visualized side by side on a professional 4K display. Results demonstrate that this test procedure requires deep scenes and sufficient scene complexity throughout the depth stack to allow for adequate stress testing of the codecs under test, particularly those solutions that adhere to compression in the object plane.","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125246984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Remapping of Hidden Area Mesh Pixels for Codec Speed-up in Remote VR","authors":"Viktor Kelkkanen, Markus Fiedler, David Lindero","doi":"10.1109/QoMEX51781.2021.9465408","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465408","url":null,"abstract":"Rendering VR-content generally requires large image resolutions. This is both due to the display being positioned close to the eyes of the user and to the super-sampling typically used in VR. Due to the requirements of low latency and large resolutions in VR, remote rendering can be difficult to support at sufficient speeds in this medium.In this paper, we propose a method that can reduce the required resolution of non-panoramic VR images from a codec perspective. Because VR images are viewed close-up from within a headset with specific lenses, there are regions of the images that will remain unseen by the user. This unseen area is referred to as the Hidden-Area Mesh (HAM) and makes up 19% of the screen on the HTC Vive VR headset as one example. By remapping the image in a specific manner, we can cut out the HAM, reduce the resolution by the size of the mesh and thus reduce the amount of data that needs to be processed by encoder and decoder. Results from a prototype remote renderer show that by using the proposed Hidden-Area Mesh Remapping (HAMR), an implementation-dependent speed-up of 10–13% in encoding, 17–18% in decoding and 7–11% in total can be achieved while the negative impact on objective image quality in terms of SSIM and VMAF remains small.","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"73 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130563903","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"[Copyright notice]","authors":"","doi":"10.1109/qomex51781.2021.9465395","DOIUrl":"https://doi.org/10.1109/qomex51781.2021.9465395","url":null,"abstract":"","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"2020 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131615581","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Measuring Speech Quality of System Input while Observing only System Output","authors":"S. Voran","doi":"10.1109/QoMEX51781.2021.9465448","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465448","url":null,"abstract":"We present a set of relatively small-scale proof-of-concept experiments where we construct no-reference (NR) speech quality estimators that give reliable values of system-under-test (SUT) input speech quality in spite of the fact that NR estimators can only access SUT output speech. We then explain why this success is not as counter-intuitive as it might initially seem. Next we demonstrate that this advance can be used to adjust NR relative speech quality values to obtain the much more desirable and useful NR absolute speech quality values. The experiments start with over seven hours of studio-quality speech. A processor adds filtering, reverberation, and noise to simulate the somewhat lower quality speech that often must be used to test systems. Four different established full-reference speech quality estimators provide ground-truth values for these experiments.","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"64 6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130937977","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Influence of Language Differences in Crowdsourcing Speech Quality Assessment Studies","authors":"Rafael Zequeira Jiménez, Babak Naderi, S. Möller","doi":"10.1109/QoMEX51781.2021.9465437","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465437","url":null,"abstract":"The quality of the speech signal is essential as it influences the user experience of voiced interactive systems. Speech quality studies have traditionally been conducted in restricted laboratory rooms with professional audio equipment. Nowadays, crowd-sourcing represents a valid alternative for the rapid assessment of large speech databases at a fraction of the cost and time of traditional laboratory practices. However, crowd-sourcing users perform tasks in an unsupervised manner. Thus, it is challenging to control whether their skills match those of the study’s intended audience. This is important in speech quality evaluations as some listeners may end up participating in a listening test of a target language other than their mother tongue. This paper investigates the influence of assessing the quality of a German speech dataset with native English and Spanish speakers. To this end, three studies were conducted in crowdsourcing where listeners evaluated the quality of speech stimuli following the ITU-T Rec. P.808. A strong Pearson correlation and low RMSE was found between the laboratory ratings and the scores collected in all crowdsourcing studies, despite the listeners’ mother tongue. Still, a bias was seen between the mean opinion scores from the German crowd-workers and the native English and Spanish speakers. The non-German participants tended to overestimate the quality of the speech stimuli.","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115426122","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards Blind Audio Quality Assessment using a Convolutional-Recurrent Neural Network","authors":"Xiguang Zheng, Chen Zhang","doi":"10.1109/QoMEX51781.2021.9465476","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465476","url":null,"abstract":"Blind estimation of audio quality is desired for practical applications since the original reference audio signal is sometimes unavailable. The subjective quality degradation of the audio signals can be caused by the low bitrate compression and multiple compression during the content submission and distribution stages. Existing methods have been proposed to classify the audio signals by the encoding bitrates with the informed audio codec name as well as the estimated MDCT framing grid and window type sequences during the encoding stage. In this work, a convolutional-recurrent neural network is proposed to perform blind AAC bitrates classification. Compared to the existing methods, the proposed method can perform the AAC bitrate classification directly from the MDCT coefficients without any prior knowledge of the encoding framing grid and window type sequences. The proposed method is further extended to perform multi-codec bitrate-related perceptual audio quality classification, which has not been extensively studied in the existing literature. For the AAC bitrate classification task, the evaluation results show the proposed method can achieve similar accuracy for most of the bitrates without using any framing grid information compared to the existing methods. For the multi-codec bitrate-related perceptual audio quality classification task, the proposed method can achieve 95% accuracy to classify three perceptual classes for the double compressed unseen data using three common audio codecs.","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"113 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122356423","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Multi-View Stereoscopic Video Database With Green Screen (MTF) For Video Transition Quality-of-Experience Assessment","authors":"Nour Hobloss, Lu Zhang, Marco Cagnazzo","doi":"10.1109/QoMEX51781.2021.9465458","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465458","url":null,"abstract":"We introduce a multi-view stereoscopic video database with a green screen, called MTF, for the usages in computer vision applications, in particular for free navigation, free-viewpoint television, and video transition quality-of-experience (QoE) assessment. The MTF contains full-HD videos of real storytelling made up of 3 scenes. One particularity of this dataset is that to understand its storytelling, users must change their point of view in the scene at a given time. To this end, we usually need to generate a transition to link two points of view in the same scene. Computer vision techniques that enable such transitions like view synthesis methods, rely on a set of images of the scene to render some new views from different viewpoints of this scene. However, these methods may have many failure cases that lead to artifacts in the final rendered video transition. In most view synthesis QoE tests, the contents are not designed to make the transition between two points of view useful or interesting for the viewers, e.g. they don’t need to make a transition to capture more information to better understand the content. We thus, assume that participants will harshly judge artifacts and imperfections in the rendered transition. Thus, the MTF is expected to enable a better analysis of the visual impact of persistent artifacts in the final rendered transition. In our dataset, all the scenes are recorded in a green screen studio, which is often used to superimpose special effects and scenery during editing according to specific needs. Our dataset also presents a wide baseline camera-setup, a challenging constraint for view synthesis techniques. Finally, The MTF can also be used as a complementary dataset with others in literature in various computer vision applications, such as video compression, 3D video content, immersive virtual reality environment, optical flow estimation…","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"47 9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132481255","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
W. Robitza, Rakesh Rao Ramachandra Rao, Steve Goering, A. Raake
{"title":"Impact of Spatial and Temporal Information on Video Quality and Compressibility","authors":"W. Robitza, Rakesh Rao Ramachandra Rao, Steve Goering, A. Raake","doi":"10.1109/QoMEX51781.2021.9465452","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465452","url":null,"abstract":"Spatial Information (SI) and Temporal Information (TI) are frequently-used metrics to classify the spatiotemporal complexity of video content. However, they are mostly used on original video sources, and their impact on actual encoding efficiency is not known. In this paper, we propose a method to determine the compressibility of video sources, that is, how good video quality can be under a given bitrate constraint. We show how various aggregations of SI and TI correlate with compressibility scores obtained from a public dataset of H.264/HEVCN P9 content. We observe that the minimum TI value as well as an existing criticality metric from the literature are good indicators for compressibility, as judged by subjective ratings as well as VMAF and P.1204.3 objective scores.","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132238625","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Emotional Experience Analysis in Response to HDR and SDR content","authors":"M. Riaz, Muhammad Majid, J. Mir","doi":"10.1109/QoMEX51781.2021.9465393","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465393","url":null,"abstract":"High dynamic range (HDR) content provides a better quality of experience than the standard dynamic range (SDR) content due to a wide luminance range, enhanced contrast, and saturated colors. Emotional experience analysis while watching SDR content has been an active research area in affective computing. However, the impact of HDR content on human emotional experience is not explored. This paper presents a statistical analysis of emotional experience in response to HDR and SDR content. To this end, SDR and HDR versions of four audio-visual clips are shown to two different groups, each comprising of 20 male and 10 female subjects. Each subject’s emotional experience is recorded in terms of valence, arousal, and dominance scores after watching each clip. A t-test reveals that HDR and SDR content is statistically different in valence, arousal, and dominance scores for overall and gender-based analysis. The subject ratings show that the HDR content enhances the emotional experience in terms of valence and dominance scores.","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"88 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121280753","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}