2021 13th International Conference on Quality of Multimedia Experience (QoMEX)最新文献_第4页

A Full- and No-Reference Metrics Accuracy Analysis for Volumetric Media Streaming 容量媒体流的全参考和无参考度量精度分析

2021 13th International Conference on Quality of Multimedia Experience (QoMEX) Pub Date : 2021-06-14 DOI: 10.1109/QoMEX51781.2021.9465420

S. V. Damme, M. T. Vega, F. Turck

{"title":"A Full- and No-Reference Metrics Accuracy Analysis for Volumetric Media Streaming","authors":"S. V. Damme, M. T. Vega, F. Turck","doi":"10.1109/QoMEX51781.2021.9465420","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465420","url":null,"abstract":"Volumetric media streaming will be one of the fundamental technologies to enable near future immersive multimedia experiences. In it, objects represented as sets of points (i.e. point-clouds), are presented to remote users wearing Head-Mounted Displays (HMDs). Due to the stringent bandwidth and latency requirements of such applications, small changes in the network can affect the user in unexpected manners (physical discomfort, lack of concentration, etc.). Therefore, there is a need for assessing the perceived quality of this type of applications in real-time, i.e, the Quality of Experience (QoE). Given that subjective evaluations are not feasible for (near) real-time applications, objectively measuring this quality will be a must. While traditional objective metrics could potentially be used to fulfill the task, it is still unclear how accurate they are to assess volumetric media. To this end, this paper presents a thorough correlation analysis of both Full Reference (FR) and No Reference (NR) objective metrics to subjective Mean Opinion Scores (MOS) for different volumetric streaming scenarios. To enhance the accuracy, multiple Region-Of-Interest (ROI) selection and weighting procedures have been applied and their influence on the results have been investigated. Our results show that the classical video quality metric Video Multimethod Assessment Fusion (VMAF) is well-suited as an objective benchmark for volumetric media streaming in terms of correlation to subjective scores, while a combination of NR features could provide a suitable real-time assessment. Finally, ROI selection proves to widen the range of objective metrics, which is an important issue to apply traditional objective metrics to volumetric media.","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123455988","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

On Inter-Rater Reliability for Crowdsourced QoE 众包QoE的内部可靠性研究

2021 13th International Conference on Quality of Multimedia Experience (QoMEX) Pub Date : 2021-06-14 DOI: 10.1109/QoMEX51781.2021.9465382

T. Hossfeld, Michael Seufert, Babak Naderi

{"title":"On Inter-Rater Reliability for Crowdsourced QoE","authors":"T. Hossfeld, Michael Seufert, Babak Naderi","doi":"10.1109/QoMEX51781.2021.9465382","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465382","url":null,"abstract":"Crowdsourcing offers a faster, cheaper, and more scalable approach than the traditional laboratory quality assessment tests. However, participants perform the test in their own working environment, using their own hardware and without direct supervision of a test moderator, leading to different types of biases on the ratings. In this paper, we compare several reliability metrics that are commonly applied to the subjective ratings in terms of their sensitivity to identify typical issues of crowdsourced media quality tests. Following the subject bias theory, we simulate the ratings of different user groups with different bias and various magnitudes of uncertainty, while also considering the presence of unreliable raters. We apply traditional reliability metrics on the ratings and compare their sensitivity in identifying the severity of the raters’ biases and uncertainties. Our results show that the average Spearman’s rank correlation coefficient between raters can serve as a strong indicator for issues with the crowdsourcing study. This means that scoring too low for this metric should encourage researchers to revisit their study design in order to eventually improve the reliability of results from crowdsourcing-based quality studies.","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"102 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115563266","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

MARMnet: On the Application of AI to Video Quality Control for Broadcasting Companies 人工智能在广播公司视频质量控制中的应用

2021 13th International Conference on Quality of Multimedia Experience (QoMEX) Pub Date : 2021-06-14 DOI: 10.1109/QoMEX51781.2021.9465478

Riccardo Musmeci, Adriano Manfré, T. Ohtani, S. Suzuki

{"title":"MARMnet: On the Application of AI to Video Quality Control for Broadcasting Companies","authors":"Riccardo Musmeci, Adriano Manfré, T. Ohtani, S. Suzuki","doi":"10.1109/QoMEX51781.2021.9465478","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465478","url":null,"abstract":"Video Quality Control (VQC) is the process that media and broadcasting companies employ in order to detect potential anomalies in contents to release to the final users. This process is currently performed by human operators and presents many drawbacks in terms of costs and time spent on such activity. As an example, the operators leverage on expensive equipment that in few years needs to be changed. Additionally, the report generated by the operators present inconsistency in terms of anomalies identified. In this paper, we take the initial steps towards the integration of Artificial Intelligence into the VQC pipeline in order to introduce speed and uniformity in the report generation. Our solution, called Augmented Video Quality Control (AVQC), relies on the power of MARMnet, an ad-hoc neural network able to detect two anomalies of interest. Such model enables the AVQC to report the anomaly in half of the time needed by the current process. Moreover, quantitative and qualitative results show that MARMnet provides high performances in detecting the two anomalies in the videos to analyze.","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114382215","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Factors influencing QoE of video consultations 影响视频咨询QoE的因素

2021 13th International Conference on Quality of Multimedia Experience (QoMEX) Pub Date : 2021-06-14 DOI: 10.1109/QoMEX51781.2021.9465376

Even Brattbak Øie, Kamil Koniuch, Natalia Cieplińska, K. Moor

引用次数: 6

A Questionnaire to Assess Virtual Conference Participation Experience 一份评估虚拟会议参与体验的问卷

2021 13th International Conference on Quality of Multimedia Experience (QoMEX) Pub Date : 2021-06-14 DOI: 10.1109/QoMEX51781.2021.9465406

O. Hohlfeld, Dennis Guse, K. Moor

引用次数: 5

Beyond Shopping: The Motivations and Experience of Live Stream Shopping Viewers 超越购物:直播购物观众的动机和体验

2021 13th International Conference on Quality of Multimedia Experience (QoMEX) Pub Date : 2021-06-14 DOI: 10.1109/QoMEX51781.2021.9465387

Xiaoxing Liu, S. H. Kim

引用次数: 3

Evaluating the translation of speech to virtually-performed sign language on AR glasses 评估AR眼镜上语音到虚拟手语的翻译

2021 13th International Conference on Quality of Multimedia Experience (QoMEX) Pub Date : 2021-06-14 DOI: 10.1109/QoMEX51781.2021.9465430

Lan Thao Nguyen, Florian Schicktanz, Aeneas Stankowski, Eleftherios Avramidis

引用次数: 6

The Effects of Network Latency on Competitive First-Person Shooter Game Players 网络延迟对竞争性第一人称射击游戏玩家的影响

2021 13th International Conference on Quality of Multimedia Experience (QoMEX) Pub Date : 2021-06-14 DOI: 10.1109/QoMEX51781.2021.9465419

Shengmei Liu, M. Claypool, Atsuo Kuwahara, James J. Scovell, Jamie Sherman

引用次数: 14

Towards High Resolution Video Quality Assessment in the Crowd 面向人群的高分辨率视频质量评估

2021 13th International Conference on Quality of Multimedia Experience (QoMEX) Pub Date : 2021-06-14 DOI: 10.1109/QoMEX51781.2021.9465425

Rakesh Rao Ramachandra Rao, Steve Goering, A. Raake

{"title":"Towards High Resolution Video Quality Assessment in the Crowd","authors":"Rakesh Rao Ramachandra Rao, Steve Goering, A. Raake","doi":"10.1109/QoMEX51781.2021.9465425","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465425","url":null,"abstract":"Assessing high resolution video quality is usually performed using controlled, defined, and standardized lab tests. This method of acquiring human ratings in a lab environment is time-consuming and may also not reflect the typical viewing conditions. To overcome these disadvantages, crowd testing paradigms have been used for assessing video quality in general. Crowdsourcing-based tests enable a more diverse set of participants and also use a realistic hardware setup and viewing environment of typical users. However, obtaining valid ratings for high-resolution video quality poses several problems. Example issues are that streaming of such high-bandwidth content may not be feasible for some users, or that crowd participants lack an appropriate, high-resolution display device. In this paper, we propose a method to overcome such problems and conduct a crowd test using for higher resolution content by using a 540 p cutout from the center of the original 2160p video. To this aim, we use the videos from Test#1 of the publicly available dataset AVT-VQDB-UHD-1, which contains videos up to a resolution of UHD-1. The quality-labels available from that lab test allow us to compare the results with the crowd test presented in this paper. It is shown that there is a Pearson correlation of 0.96 between the lab and crowd tests and hence such crowd tests can reliably be used for video assessment of higher resolution content. The overall implementation of the crowd test framework and the results are made publicly available for further research and reproducibility1.","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134570531","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 13

QoE Assessment of FPV Drone Control in a Cloud Gaming Based Simulation 基于云游戏仿真的FPV无人机控制QoE评估

2021 13th International Conference on Quality of Multimedia Experience (QoMEX) Pub Date : 2021-06-14 DOI: 10.1109/QoMEX51781.2021.9465385

Matko Silic, M. Sužnjević, Lea Skorin-Kapov

{"title":"QoE Assessment of FPV Drone Control in a Cloud Gaming Based Simulation","authors":"Matko Silic, M. Sužnjević, Lea Skorin-Kapov","doi":"10.1109/QoMEX51781.2021.9465385","DOIUrl":"https://doi.org/10.1109/QoMEX51781.2021.9465385","url":null,"abstract":"The technology of Unmanned Aerial Vehicles (UAVs), or simply drones, has gained much attention over the past two decades, with a rapid decrease in cost and increase in potential applications such as surveillance, journalism, agriculture, film-making, entertainment, etc. With the growth in the popularity of First-person view (FPV) drone piloting comes the challenge of transmitting control information and streaming video at very low latencies to enable proper real-time control. Due to strict latency requirements, FPV technology stagnated, with analog video transmission currently representing the most common implementation. In this paper, we present our preliminary research directed towards developing a digital alternative to this technology. We report on a user study designed to assess the Quality of Experience (QoE) of an FPV system coupled with a cloud-based drone flight simulator, with the focus being on video quality in ideal network conditions. Obtained results show that video encoding parameters have a significant impact on user perceived QoE. Furthermore, our findings highlight the relevance of simulator sickness in this kind of system.","PeriodicalId":160378,"journal":{"name":"2021 13th International Conference on Quality of Multimedia Experience (QoMEX)","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132394180","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5