QoE Evaluation for VR with Vibrotactile Feedback Based on Inter-user Brain Spatial Information

IF 5.6 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
Yan Zhang, Rui Song, Riting Xia, Zhenwei Shi
{"title":"QoE Evaluation for VR with Vibrotactile Feedback Based on Inter-user Brain Spatial Information","authors":"Yan Zhang, Rui Song, Riting Xia, Zhenwei Shi","doi":"10.1145/3777459","DOIUrl":null,"url":null,"abstract":"Subjective measurement remains one of the most widely used approaches for evaluating Quality of Experience (QoE) in tactile virtual environments. However, its reliability is often compromised by factors such as conscious bias, variations in user expressiveness, and contextual influences, which may distort the accuracy of evaluation outcomes. In light of the fact that Electroencephalography (EEG) provides a direct window into neurophysiological correlates of emotion and cognitive states, this article proposes an objective QoE evaluation method for Virtual Reality (VR) with vibrotactile feedback based on Inter-user Brain Spatial Information (IBSI). The proposed IBSI feature extraction method enhances the conventional Common Spatial Pattern (CSP) algorithm through the introduction of a regularization constraint term designed to mitigate overfitting. Moreover, the covariance matrix of each non-target user is weighted according to its Kullback–Leibler divergence from the target user, enhancing cross-user alignment and supporting effective transfer of neural information. To validate the performance of the proposed method, we design a VR shooting interaction experiment involving 64 participants. The study comprises three main phases: preparation, interaction, and subjective feedback. During the preparation phase, participants receive task explanations and familiarize themselves with the VR environment. In the interaction phase, participants complete a standardized shooting task, while EEG data are recorded synchronously. Finally, subjective feedback is collected through questionnaires. QoE assessment is accomplished by classifying IBSI features using classical classifiers, with subjective QoE ratings serving as ground truth. Experimental results show that our method outperforms existing methods in classification accuracy, and the dominant activation pattern in the alpha rhythm is consistent with neural mechanisms associated with motor perception. Meanwhile, the mutual interpretability between subjective and objective data characterizing QoE further validates the rationality of the experimental paradigm.","PeriodicalId":50937,"journal":{"name":"ACM Transactions on Multimedia Computing Communications and Applications","volume":"22 1","pages":"1-20"},"PeriodicalIF":5.6000,"publicationDate":"2025-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACM Transactions on Multimedia Computing Communications and Applications","FirstCategoryId":"0","ListUrlMain":"https://doi.org/10.1145/3777459","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Subjective measurement remains one of the most widely used approaches for evaluating Quality of Experience (QoE) in tactile virtual environments. However, its reliability is often compromised by factors such as conscious bias, variations in user expressiveness, and contextual influences, which may distort the accuracy of evaluation outcomes. In light of the fact that Electroencephalography (EEG) provides a direct window into neurophysiological correlates of emotion and cognitive states, this article proposes an objective QoE evaluation method for Virtual Reality (VR) with vibrotactile feedback based on Inter-user Brain Spatial Information (IBSI). The proposed IBSI feature extraction method enhances the conventional Common Spatial Pattern (CSP) algorithm through the introduction of a regularization constraint term designed to mitigate overfitting. Moreover, the covariance matrix of each non-target user is weighted according to its Kullback–Leibler divergence from the target user, enhancing cross-user alignment and supporting effective transfer of neural information. To validate the performance of the proposed method, we design a VR shooting interaction experiment involving 64 participants. The study comprises three main phases: preparation, interaction, and subjective feedback. During the preparation phase, participants receive task explanations and familiarize themselves with the VR environment. In the interaction phase, participants complete a standardized shooting task, while EEG data are recorded synchronously. Finally, subjective feedback is collected through questionnaires. QoE assessment is accomplished by classifying IBSI features using classical classifiers, with subjective QoE ratings serving as ground truth. Experimental results show that our method outperforms existing methods in classification accuracy, and the dominant activation pattern in the alpha rhythm is consistent with neural mechanisms associated with motor perception. Meanwhile, the mutual interpretability between subjective and objective data characterizing QoE further validates the rationality of the experimental paradigm.
基于用户间脑空间信息的触觉振动反馈VR QoE评价
主观测量仍然是评估触觉虚拟环境中体验质量(QoE)最广泛使用的方法之一。然而,它的可靠性经常受到诸如有意识的偏见、用户表达的变化和上下文影响等因素的影响,这些因素可能会扭曲评估结果的准确性。鉴于脑电图(EEG)为了解情绪和认知状态的神经生理关联提供了一个直接窗口,本文提出了一种基于用户间脑空间信息(interuser Brain Spatial Information, IBSI)的振动触觉反馈虚拟现实(VR)客观QoE评价方法。提出的IBSI特征提取方法通过引入旨在减轻过拟合的正则化约束项来增强传统的公共空间模式(CSP)算法。此外,每个非目标用户的协方差矩阵根据其与目标用户的Kullback-Leibler散度进行加权,增强了跨用户对齐,支持神经信息的有效传递。为了验证该方法的有效性,我们设计了一个有64名参与者的VR射击交互实验。研究包括三个主要阶段:准备、互动和主观反馈。在准备阶段,参与者接受任务解释并熟悉VR环境。在交互阶段,参与者完成标准化射击任务,同时同步记录脑电图数据。最后,通过问卷调查收集主观反馈。QoE评估是通过使用经典分类器对IBSI特征进行分类来完成的,主观QoE评级作为基本事实。实验结果表明,该方法在分类精度上优于现有方法,并且α节律的主导激活模式与运动感知相关的神经机制一致。同时,表征QoE的主客观数据之间的相互可解释性进一步验证了实验范式的合理性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
8.50
自引率
5.90%
发文量
285
审稿时长
7.5 months
期刊介绍: The ACM Transactions on Multimedia Computing, Communications, and Applications is the flagship publication of the ACM Special Interest Group in Multimedia (SIGMM). It is soliciting paper submissions on all aspects of multimedia. Papers on single media (for instance, audio, video, animation) and their processing are also welcome. TOMM is a peer-reviewed, archival journal, available in both print form and digital form. The Journal is published quarterly; with roughly 7 23-page articles in each issue. In addition, all Special Issues are published online-only to ensure a timely publication. The transactions consists primarily of research papers. This is an archival journal and it is intended that the papers will have lasting importance and value over time. In general, papers whose primary focus is on particular multimedia products or the current state of the industry will not be included.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书