在二分语音接收任务中加入虚拟现实代理:心灵的启示

IF 2.6 2区 医学 Q1 AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY
Ear and Hearing Pub Date : 2025-03-01 Epub Date: 2024-10-11 DOI:10.1097/AUD.0000000000001597
Bethany Plain, Hidde Pielage, Adriana A Zekveld, Michael Richter, Tanveer A Bhuiyan, Sjors R B van de Ven, Sophia E Kramer
{"title":"在二分语音接收任务中加入虚拟现实代理:心灵的启示","authors":"Bethany Plain, Hidde Pielage, Adriana A Zekveld, Michael Richter, Tanveer A Bhuiyan, Sjors R B van de Ven, Sophia E Kramer","doi":"10.1097/AUD.0000000000001597","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>Listening effort is moderated by not only task difficulty, but also success importance. In real communication scenarios, success importance varies based upon the social context. However, in the laboratory, it can be challenging to manipulate social context without compromising experimental control. Outside of hearing sciences, studies have applied virtual reality (VR) to incorporate social context in a controlled and repeatable manner. Several of these studies have demonstrated that social manipulations in VR can reliably elicit changes in cardiovascular measures. Here, we investigated the effect of adding VR agents to a speech reception task, while measuring from the cardiovascular system.</p><p><strong>Design: </strong>Twenty-eight, normally hearing participants undertook a dichotic speech reception task. Sentences in stationary noise were presented dichotically, that is, different sentences presented simultaneously to each ear. Participants were tasked to either repeat one of the sentences (single-sentence condition) or both of the sentences (dual-sentence condition). The task was conducted under two VR conditions: (1) in the presence of agents, who provided sporadic performance feedback and (2) in the presence of nonagent controls, without any feedback given. Alongside task performance, we quantified changes in cardiovascular measures, relative to pretask baselines: heart rate variability, pre-ejection period, heart rate, and blood pressure. After each condition, participants rated their subjective effort, difficulty, performance, and engagement.</p><p><strong>Results: </strong>Performance and the subjective perception of performance were lower, while subjective effort and difficulty were higher, in the dual-sentence condition, compared with the single-sentence condition. Heart rate was the only cardiovascular measure that was sensitive to the experimental manipulations. Contrary to our expectations, heart rate increased in the nonagent control conditions, compared with the agent conditions. An exploratory analysis revealed heart rate fluctuations within a trial: heart rate was higher during the first 6 sec of the trial (reflecting the presentence masking noise and the sentence presentation) in the dual-sentence condition, compared with the single-sentence condition.</p><p><strong>Conclusions: </strong>This study was the first to incorporate VR agents who provided performance feedback during a dichotic speech reception task. Our results suggest that the VR agents did not increase success importance, which could be attributed to a lack of realism of the agents. We also demonstrated that the cardiovascular response to experimental manipulations may differ depending on the data window selected for analysis.</p>","PeriodicalId":55172,"journal":{"name":"Ear and Hearing","volume":" ","pages":"444-460"},"PeriodicalIF":2.6000,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11825489/pdf/","citationCount":"0","resultStr":"{\"title\":\"Incorporating Virtual Reality Agents During a Dichotic Speech Reception Task: Insights From the Heart.\",\"authors\":\"Bethany Plain, Hidde Pielage, Adriana A Zekveld, Michael Richter, Tanveer A Bhuiyan, Sjors R B van de Ven, Sophia E Kramer\",\"doi\":\"10.1097/AUD.0000000000001597\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objectives: </strong>Listening effort is moderated by not only task difficulty, but also success importance. In real communication scenarios, success importance varies based upon the social context. However, in the laboratory, it can be challenging to manipulate social context without compromising experimental control. Outside of hearing sciences, studies have applied virtual reality (VR) to incorporate social context in a controlled and repeatable manner. Several of these studies have demonstrated that social manipulations in VR can reliably elicit changes in cardiovascular measures. Here, we investigated the effect of adding VR agents to a speech reception task, while measuring from the cardiovascular system.</p><p><strong>Design: </strong>Twenty-eight, normally hearing participants undertook a dichotic speech reception task. Sentences in stationary noise were presented dichotically, that is, different sentences presented simultaneously to each ear. Participants were tasked to either repeat one of the sentences (single-sentence condition) or both of the sentences (dual-sentence condition). The task was conducted under two VR conditions: (1) in the presence of agents, who provided sporadic performance feedback and (2) in the presence of nonagent controls, without any feedback given. Alongside task performance, we quantified changes in cardiovascular measures, relative to pretask baselines: heart rate variability, pre-ejection period, heart rate, and blood pressure. After each condition, participants rated their subjective effort, difficulty, performance, and engagement.</p><p><strong>Results: </strong>Performance and the subjective perception of performance were lower, while subjective effort and difficulty were higher, in the dual-sentence condition, compared with the single-sentence condition. Heart rate was the only cardiovascular measure that was sensitive to the experimental manipulations. Contrary to our expectations, heart rate increased in the nonagent control conditions, compared with the agent conditions. An exploratory analysis revealed heart rate fluctuations within a trial: heart rate was higher during the first 6 sec of the trial (reflecting the presentence masking noise and the sentence presentation) in the dual-sentence condition, compared with the single-sentence condition.</p><p><strong>Conclusions: </strong>This study was the first to incorporate VR agents who provided performance feedback during a dichotic speech reception task. Our results suggest that the VR agents did not increase success importance, which could be attributed to a lack of realism of the agents. We also demonstrated that the cardiovascular response to experimental manipulations may differ depending on the data window selected for analysis.</p>\",\"PeriodicalId\":55172,\"journal\":{\"name\":\"Ear and Hearing\",\"volume\":\" \",\"pages\":\"444-460\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2025-03-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11825489/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ear and Hearing\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1097/AUD.0000000000001597\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/10/11 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ear and Hearing","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/AUD.0000000000001597","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/10/11 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

目标倾听的努力不仅受任务难度的影响,也受成功重要性的影响。在真实的交流场景中,成功的重要性因社会环境而异。然而,在实验室中,要在不影响实验控制的情况下操纵社会环境是一项挑战。在听力科学领域之外,已有研究应用虚拟现实技术(VR),以可控和可重复的方式将社交背景融入其中。其中有几项研究表明,VR 中的社交操作能可靠地引起心血管测量的变化。在此,我们研究了在语音接收任务中加入 VR 代理的效果,同时对心血管系统进行了测量:设计:28 名听力正常的参与者进行了一项二分语音接收任务。静态噪声中的句子以二分法呈现,即每只耳朵同时听到不同的句子。参与者的任务是重复其中一个句子(单句条件)或两个句子(双句条件)。任务在两种虚拟现实条件下进行:(1) 在有代理在场的情况下进行,代理提供零星的表现反馈;(2) 在无代理控制在场的情况下进行,代理不提供任何反馈。除了任务表现,我们还量化了心血管指标相对于任务前基线的变化:心率变异性、射血前周期、心率和血压。每个条件结束后,参与者对自己的主观努力程度、难度、表现和参与度进行评分:结果:与单句子条件相比,双句子条件下的表现和对表现的主观感受较低,而主观努力和难度较高。心率是唯一对实验操作敏感的心血管指标。与我们的预期相反,在非代理控制条件下,心率比代理条件下有所增加。探索性分析揭示了试验中的心率波动:与单句子条件相比,双句子条件下试验的前 6 秒心率较高(反映了存在的掩蔽噪声和句子呈现):本研究首次在二分语音接收任务中加入了提供表现反馈的虚拟现实代理。我们的研究结果表明,虚拟现实代理并没有提高成功的重要性,这可能是由于虚拟现实代理缺乏真实感所致。我们还证明,心血管对实验操作的反应可能因所选分析数据窗口的不同而不同。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Incorporating Virtual Reality Agents During a Dichotic Speech Reception Task: Insights From the Heart.

Objectives: Listening effort is moderated by not only task difficulty, but also success importance. In real communication scenarios, success importance varies based upon the social context. However, in the laboratory, it can be challenging to manipulate social context without compromising experimental control. Outside of hearing sciences, studies have applied virtual reality (VR) to incorporate social context in a controlled and repeatable manner. Several of these studies have demonstrated that social manipulations in VR can reliably elicit changes in cardiovascular measures. Here, we investigated the effect of adding VR agents to a speech reception task, while measuring from the cardiovascular system.

Design: Twenty-eight, normally hearing participants undertook a dichotic speech reception task. Sentences in stationary noise were presented dichotically, that is, different sentences presented simultaneously to each ear. Participants were tasked to either repeat one of the sentences (single-sentence condition) or both of the sentences (dual-sentence condition). The task was conducted under two VR conditions: (1) in the presence of agents, who provided sporadic performance feedback and (2) in the presence of nonagent controls, without any feedback given. Alongside task performance, we quantified changes in cardiovascular measures, relative to pretask baselines: heart rate variability, pre-ejection period, heart rate, and blood pressure. After each condition, participants rated their subjective effort, difficulty, performance, and engagement.

Results: Performance and the subjective perception of performance were lower, while subjective effort and difficulty were higher, in the dual-sentence condition, compared with the single-sentence condition. Heart rate was the only cardiovascular measure that was sensitive to the experimental manipulations. Contrary to our expectations, heart rate increased in the nonagent control conditions, compared with the agent conditions. An exploratory analysis revealed heart rate fluctuations within a trial: heart rate was higher during the first 6 sec of the trial (reflecting the presentence masking noise and the sentence presentation) in the dual-sentence condition, compared with the single-sentence condition.

Conclusions: This study was the first to incorporate VR agents who provided performance feedback during a dichotic speech reception task. Our results suggest that the VR agents did not increase success importance, which could be attributed to a lack of realism of the agents. We also demonstrated that the cardiovascular response to experimental manipulations may differ depending on the data window selected for analysis.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Ear and Hearing
Ear and Hearing 医学-耳鼻喉科学
CiteScore
5.90
自引率
10.80%
发文量
207
审稿时长
6-12 weeks
期刊介绍: From the basic science of hearing and balance disorders to auditory electrophysiology to amplification and the psychological factors of hearing loss, Ear and Hearing covers all aspects of auditory and vestibular disorders. This multidisciplinary journal consolidates the various factors that contribute to identification, remediation, and audiologic and vestibular rehabilitation. It is the one journal that serves the diverse interest of all members of this professional community -- otologists, audiologists, educators, and to those involved in the design, manufacture, and distribution of amplification systems. The original articles published in the journal focus on assessment, diagnosis, and management of auditory and vestibular disorders.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信