Bethany Plain, Hidde Pielage, Adriana A Zekveld, Michael Richter, Tanveer A Bhuiyan, Sjors R B van de Ven, Sophia E Kramer
{"title":"在二分语音接收任务中加入虚拟现实代理:心灵的启示","authors":"Bethany Plain, Hidde Pielage, Adriana A Zekveld, Michael Richter, Tanveer A Bhuiyan, Sjors R B van de Ven, Sophia E Kramer","doi":"10.1097/AUD.0000000000001597","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>Listening effort is moderated by not only task difficulty, but also success importance. In real communication scenarios, success importance varies based upon the social context. However, in the laboratory, it can be challenging to manipulate social context without compromising experimental control. Outside of hearing sciences, studies have applied virtual reality (VR) to incorporate social context in a controlled and repeatable manner. Several of these studies have demonstrated that social manipulations in VR can reliably elicit changes in cardiovascular measures. Here, we investigated the effect of adding VR agents to a speech reception task, while measuring from the cardiovascular system.</p><p><strong>Design: </strong>Twenty-eight, normally hearing participants undertook a dichotic speech reception task. Sentences in stationary noise were presented dichotically, that is, different sentences presented simultaneously to each ear. Participants were tasked to either repeat one of the sentences (single-sentence condition) or both of the sentences (dual-sentence condition). The task was conducted under two VR conditions: (1) in the presence of agents, who provided sporadic performance feedback and (2) in the presence of nonagent controls, without any feedback given. Alongside task performance, we quantified changes in cardiovascular measures, relative to pretask baselines: heart rate variability, pre-ejection period, heart rate, and blood pressure. After each condition, participants rated their subjective effort, difficulty, performance, and engagement.</p><p><strong>Results: </strong>Performance and the subjective perception of performance were lower, while subjective effort and difficulty were higher, in the dual-sentence condition, compared with the single-sentence condition. Heart rate was the only cardiovascular measure that was sensitive to the experimental manipulations. Contrary to our expectations, heart rate increased in the nonagent control conditions, compared with the agent conditions. An exploratory analysis revealed heart rate fluctuations within a trial: heart rate was higher during the first 6 sec of the trial (reflecting the presentence masking noise and the sentence presentation) in the dual-sentence condition, compared with the single-sentence condition.</p><p><strong>Conclusions: </strong>This study was the first to incorporate VR agents who provided performance feedback during a dichotic speech reception task. Our results suggest that the VR agents did not increase success importance, which could be attributed to a lack of realism of the agents. We also demonstrated that the cardiovascular response to experimental manipulations may differ depending on the data window selected for analysis.</p>","PeriodicalId":55172,"journal":{"name":"Ear and Hearing","volume":" ","pages":"444-460"},"PeriodicalIF":2.6000,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11825489/pdf/","citationCount":"0","resultStr":"{\"title\":\"Incorporating Virtual Reality Agents During a Dichotic Speech Reception Task: Insights From the Heart.\",\"authors\":\"Bethany Plain, Hidde Pielage, Adriana A Zekveld, Michael Richter, Tanveer A Bhuiyan, Sjors R B van de Ven, Sophia E Kramer\",\"doi\":\"10.1097/AUD.0000000000001597\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objectives: </strong>Listening effort is moderated by not only task difficulty, but also success importance. In real communication scenarios, success importance varies based upon the social context. However, in the laboratory, it can be challenging to manipulate social context without compromising experimental control. Outside of hearing sciences, studies have applied virtual reality (VR) to incorporate social context in a controlled and repeatable manner. Several of these studies have demonstrated that social manipulations in VR can reliably elicit changes in cardiovascular measures. Here, we investigated the effect of adding VR agents to a speech reception task, while measuring from the cardiovascular system.</p><p><strong>Design: </strong>Twenty-eight, normally hearing participants undertook a dichotic speech reception task. Sentences in stationary noise were presented dichotically, that is, different sentences presented simultaneously to each ear. Participants were tasked to either repeat one of the sentences (single-sentence condition) or both of the sentences (dual-sentence condition). The task was conducted under two VR conditions: (1) in the presence of agents, who provided sporadic performance feedback and (2) in the presence of nonagent controls, without any feedback given. Alongside task performance, we quantified changes in cardiovascular measures, relative to pretask baselines: heart rate variability, pre-ejection period, heart rate, and blood pressure. After each condition, participants rated their subjective effort, difficulty, performance, and engagement.</p><p><strong>Results: </strong>Performance and the subjective perception of performance were lower, while subjective effort and difficulty were higher, in the dual-sentence condition, compared with the single-sentence condition. Heart rate was the only cardiovascular measure that was sensitive to the experimental manipulations. Contrary to our expectations, heart rate increased in the nonagent control conditions, compared with the agent conditions. An exploratory analysis revealed heart rate fluctuations within a trial: heart rate was higher during the first 6 sec of the trial (reflecting the presentence masking noise and the sentence presentation) in the dual-sentence condition, compared with the single-sentence condition.</p><p><strong>Conclusions: </strong>This study was the first to incorporate VR agents who provided performance feedback during a dichotic speech reception task. Our results suggest that the VR agents did not increase success importance, which could be attributed to a lack of realism of the agents. We also demonstrated that the cardiovascular response to experimental manipulations may differ depending on the data window selected for analysis.</p>\",\"PeriodicalId\":55172,\"journal\":{\"name\":\"Ear and Hearing\",\"volume\":\" \",\"pages\":\"444-460\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2025-03-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11825489/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ear and Hearing\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1097/AUD.0000000000001597\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/10/11 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ear and Hearing","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/AUD.0000000000001597","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/10/11 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY","Score":null,"Total":0}
Incorporating Virtual Reality Agents During a Dichotic Speech Reception Task: Insights From the Heart.
Objectives: Listening effort is moderated by not only task difficulty, but also success importance. In real communication scenarios, success importance varies based upon the social context. However, in the laboratory, it can be challenging to manipulate social context without compromising experimental control. Outside of hearing sciences, studies have applied virtual reality (VR) to incorporate social context in a controlled and repeatable manner. Several of these studies have demonstrated that social manipulations in VR can reliably elicit changes in cardiovascular measures. Here, we investigated the effect of adding VR agents to a speech reception task, while measuring from the cardiovascular system.
Design: Twenty-eight, normally hearing participants undertook a dichotic speech reception task. Sentences in stationary noise were presented dichotically, that is, different sentences presented simultaneously to each ear. Participants were tasked to either repeat one of the sentences (single-sentence condition) or both of the sentences (dual-sentence condition). The task was conducted under two VR conditions: (1) in the presence of agents, who provided sporadic performance feedback and (2) in the presence of nonagent controls, without any feedback given. Alongside task performance, we quantified changes in cardiovascular measures, relative to pretask baselines: heart rate variability, pre-ejection period, heart rate, and blood pressure. After each condition, participants rated their subjective effort, difficulty, performance, and engagement.
Results: Performance and the subjective perception of performance were lower, while subjective effort and difficulty were higher, in the dual-sentence condition, compared with the single-sentence condition. Heart rate was the only cardiovascular measure that was sensitive to the experimental manipulations. Contrary to our expectations, heart rate increased in the nonagent control conditions, compared with the agent conditions. An exploratory analysis revealed heart rate fluctuations within a trial: heart rate was higher during the first 6 sec of the trial (reflecting the presentence masking noise and the sentence presentation) in the dual-sentence condition, compared with the single-sentence condition.
Conclusions: This study was the first to incorporate VR agents who provided performance feedback during a dichotic speech reception task. Our results suggest that the VR agents did not increase success importance, which could be attributed to a lack of realism of the agents. We also demonstrated that the cardiovascular response to experimental manipulations may differ depending on the data window selected for analysis.
期刊介绍:
From the basic science of hearing and balance disorders to auditory electrophysiology to amplification and the psychological factors of hearing loss, Ear and Hearing covers all aspects of auditory and vestibular disorders. This multidisciplinary journal consolidates the various factors that contribute to identification, remediation, and audiologic and vestibular rehabilitation. It is the one journal that serves the diverse interest of all members of this professional community -- otologists, audiologists, educators, and to those involved in the design, manufacture, and distribution of amplification systems. The original articles published in the journal focus on assessment, diagnosis, and management of auditory and vestibular disorders.