Tina M. Grieco-Calub, Yousaf Ilyas, Kristina M. Ward, Alex E. Clain, Janet Olson
{"title":"听觉经验对学龄前儿童口语加工过程中眼睛注视说话人的影响。","authors":"Tina M. Grieco-Calub, Yousaf Ilyas, Kristina M. Ward, Alex E. Clain, Janet Olson","doi":"10.3758/s13414-024-03001-6","DOIUrl":null,"url":null,"abstract":"<div><p>Speechreading—gathering speech information from talkers’ faces—supports speech perception when speech acoustics are degraded. Benefitting from speechreading, however, requires listeners to visually fixate talkers during face-to-face interactions. The purpose of this study is to test the hypothesis that preschool-aged children allocate their eye gaze to a talker when speech acoustics are degraded. We implemented a looking-while-listening paradigm to quantify children’s eye gaze to an unfamiliar female talker and two images of familiar objects presented on a screen while the children listened to speech. We tested 31 children (12 girls), ages 26–48 months, who had normal hearing (NH group, <i>n</i> = 19) or bilateral sensorineural hearing loss and used hearing devices (D/HH group, <i>n</i> = 12). Children’s eye gaze was video-recorded as the talker verbally labeled one of the images, either in quiet or in the presence of an unfamiliar two-talker male speech masker. Children’s eye gaze to the target image, distractor image, and female talker was coded every 33 ms off-line by trained observers. Bootstrapped differences of time series (BDOTS) analyses and ternary plots were used to determine differences in visual fixations of the talker between listening conditions in the NH and D/HH groups. Results suggest that the NH group visually fixated the talker more in the masker condition than in quiet. We did not observe statistically discernable differences in visual fixations of the talker between the listening conditions for the D/HH group. Gaze patterns of the NH group in the masker condition looked like gaze patterns of the D/HH group.</p></div>","PeriodicalId":55433,"journal":{"name":"Attention Perception & Psychophysics","volume":"87 2","pages":"531 - 544"},"PeriodicalIF":1.7000,"publicationDate":"2025-01-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Effect of hearing experience on preschool-aged children’s eye gaze to a talker during spoken language processing\",\"authors\":\"Tina M. Grieco-Calub, Yousaf Ilyas, Kristina M. Ward, Alex E. Clain, Janet Olson\",\"doi\":\"10.3758/s13414-024-03001-6\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Speechreading—gathering speech information from talkers’ faces—supports speech perception when speech acoustics are degraded. Benefitting from speechreading, however, requires listeners to visually fixate talkers during face-to-face interactions. The purpose of this study is to test the hypothesis that preschool-aged children allocate their eye gaze to a talker when speech acoustics are degraded. We implemented a looking-while-listening paradigm to quantify children’s eye gaze to an unfamiliar female talker and two images of familiar objects presented on a screen while the children listened to speech. We tested 31 children (12 girls), ages 26–48 months, who had normal hearing (NH group, <i>n</i> = 19) or bilateral sensorineural hearing loss and used hearing devices (D/HH group, <i>n</i> = 12). Children’s eye gaze was video-recorded as the talker verbally labeled one of the images, either in quiet or in the presence of an unfamiliar two-talker male speech masker. Children’s eye gaze to the target image, distractor image, and female talker was coded every 33 ms off-line by trained observers. Bootstrapped differences of time series (BDOTS) analyses and ternary plots were used to determine differences in visual fixations of the talker between listening conditions in the NH and D/HH groups. Results suggest that the NH group visually fixated the talker more in the masker condition than in quiet. We did not observe statistically discernable differences in visual fixations of the talker between the listening conditions for the D/HH group. Gaze patterns of the NH group in the masker condition looked like gaze patterns of the D/HH group.</p></div>\",\"PeriodicalId\":55433,\"journal\":{\"name\":\"Attention Perception & Psychophysics\",\"volume\":\"87 2\",\"pages\":\"531 - 544\"},\"PeriodicalIF\":1.7000,\"publicationDate\":\"2025-01-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Attention Perception & Psychophysics\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://link.springer.com/article/10.3758/s13414-024-03001-6\",\"RegionNum\":4,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"PSYCHOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Attention Perception & Psychophysics","FirstCategoryId":"102","ListUrlMain":"https://link.springer.com/article/10.3758/s13414-024-03001-6","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PSYCHOLOGY","Score":null,"Total":0}
引用次数: 0
摘要
语音阅读-从说话者的面部收集语音信息-支持语音声学退化时的语音感知。然而,从演讲阅读中获益需要听众在面对面的交流中把目光固定在说话者身上。本研究的目的是验证一个假设,即学龄前儿童在语音退化时将目光分配给说话者。我们实施了一种边听边看的模式,以量化孩子们在听演讲时对一个不熟悉的女性说话者和屏幕上显示的两幅熟悉物体的图像的目光。我们测试了31名儿童(12名女孩),年龄为26-48个月,听力正常(NH组,n = 19)或双侧感音神经性听力损失并使用助听器(D/HH组,n = 12)。当说话者在安静的情况下或在一个不熟悉的、会说话的男性面具在场的情况下,对其中一幅图像进行口头标记时,儿童的眼睛注视被录了下来。儿童对目标图像、干扰图像和女性说话者的目光每隔33毫秒由训练有素的观察者进行离线编码。采用bootstrap difference of time series (BDOTS)分析和三元图来确定NH组和D/HH组听音条件下说话者视觉注视的差异。结果表明,NH组在蒙面状态下比在安静状态下更能在视觉上注视说话者。在D/HH组的不同听力条件下,我们没有观察到统计学上可辨别的说话者的视觉注视差异。NH组在蒙面条件下的凝视模式与D/HH组的凝视模式相似。
Effect of hearing experience on preschool-aged children’s eye gaze to a talker during spoken language processing
Speechreading—gathering speech information from talkers’ faces—supports speech perception when speech acoustics are degraded. Benefitting from speechreading, however, requires listeners to visually fixate talkers during face-to-face interactions. The purpose of this study is to test the hypothesis that preschool-aged children allocate their eye gaze to a talker when speech acoustics are degraded. We implemented a looking-while-listening paradigm to quantify children’s eye gaze to an unfamiliar female talker and two images of familiar objects presented on a screen while the children listened to speech. We tested 31 children (12 girls), ages 26–48 months, who had normal hearing (NH group, n = 19) or bilateral sensorineural hearing loss and used hearing devices (D/HH group, n = 12). Children’s eye gaze was video-recorded as the talker verbally labeled one of the images, either in quiet or in the presence of an unfamiliar two-talker male speech masker. Children’s eye gaze to the target image, distractor image, and female talker was coded every 33 ms off-line by trained observers. Bootstrapped differences of time series (BDOTS) analyses and ternary plots were used to determine differences in visual fixations of the talker between listening conditions in the NH and D/HH groups. Results suggest that the NH group visually fixated the talker more in the masker condition than in quiet. We did not observe statistically discernable differences in visual fixations of the talker between the listening conditions for the D/HH group. Gaze patterns of the NH group in the masker condition looked like gaze patterns of the D/HH group.
期刊介绍:
The journal Attention, Perception, & Psychophysics is an official journal of the Psychonomic Society. It spans all areas of research in sensory processes, perception, attention, and psychophysics. Most articles published are reports of experimental work; the journal also presents theoretical, integrative, and evaluative reviews. Commentary on issues of importance to researchers appears in a special section of the journal. Founded in 1966 as Perception & Psychophysics, the journal assumed its present name in 2009.