人机交互中分心和犹豫的脑电图相关性:一项实验室连接的初步研究

Birte Richter, F. Putze, Gabriel Ivucic, Mara Brandt, Christian Schütze, Rafael Reisenhofer, B. Wrede, T. Schultz
{"title":"人机交互中分心和犹豫的脑电图相关性:一项实验室连接的初步研究","authors":"Birte Richter, F. Putze, Gabriel Ivucic, Mara Brandt, Christian Schütze, Rafael Reisenhofer, B. Wrede, T. Schultz","doi":"10.3390/mti7040037","DOIUrl":null,"url":null,"abstract":"In this paper, we investigate the effect of distractions and hesitations as a scaffolding strategy. Recent research points to the potential beneficial effects of a speaker’s hesitations on the listeners’ comprehension of utterances, although results from studies on this issue indicate that humans do not make strategic use of them. The role of hesitations and their communicative function in human-human interaction is a much-discussed topic in current research. To better understand the underlying cognitive processes, we developed a human–robot interaction (HRI) setup that allows the measurement of the electroencephalogram (EEG) signals of a human participant while interacting with a robot. We thereby address the research question of whether we find effects on single-trial EEG based on the distraction and the corresponding robot’s hesitation scaffolding strategy. To carry out the experiments, we leverage our LabLinking method, which enables interdisciplinary joint research between remote labs. This study could not have been conducted without LabLinking, as the two involved labs needed to combine their individual expertise and equipment to achieve the goal together. The results of our study indicate that the EEG correlates in the distracted condition are different from the baseline condition without distractions. Furthermore, we could differentiate the EEG correlates of distraction with and without a hesitation scaffolding strategy. This proof-of-concept study shows that LabLinking makes it possible to conduct collaborative HRI studies in remote laboratories and lays the first foundation for more in-depth research into robotic scaffolding strategies.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"EEG Correlates of Distractions and Hesitations in Human-Robot Interaction: A LabLinking Pilot Study\",\"authors\":\"Birte Richter, F. Putze, Gabriel Ivucic, Mara Brandt, Christian Schütze, Rafael Reisenhofer, B. Wrede, T. Schultz\",\"doi\":\"10.3390/mti7040037\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper, we investigate the effect of distractions and hesitations as a scaffolding strategy. Recent research points to the potential beneficial effects of a speaker’s hesitations on the listeners’ comprehension of utterances, although results from studies on this issue indicate that humans do not make strategic use of them. The role of hesitations and their communicative function in human-human interaction is a much-discussed topic in current research. To better understand the underlying cognitive processes, we developed a human–robot interaction (HRI) setup that allows the measurement of the electroencephalogram (EEG) signals of a human participant while interacting with a robot. We thereby address the research question of whether we find effects on single-trial EEG based on the distraction and the corresponding robot’s hesitation scaffolding strategy. To carry out the experiments, we leverage our LabLinking method, which enables interdisciplinary joint research between remote labs. This study could not have been conducted without LabLinking, as the two involved labs needed to combine their individual expertise and equipment to achieve the goal together. The results of our study indicate that the EEG correlates in the distracted condition are different from the baseline condition without distractions. Furthermore, we could differentiate the EEG correlates of distraction with and without a hesitation scaffolding strategy. This proof-of-concept study shows that LabLinking makes it possible to conduct collaborative HRI studies in remote laboratories and lays the first foundation for more in-depth research into robotic scaffolding strategies.\",\"PeriodicalId\":408374,\"journal\":{\"name\":\"Multimodal Technol. Interact.\",\"volume\":\"2 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-03-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Multimodal Technol. Interact.\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3390/mti7040037\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Multimodal Technol. Interact.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3390/mti7040037","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

在本文中,我们研究了分心和犹豫作为脚手架策略的效果。最近的研究指出,说话者的犹豫对听者理解话语的潜在有益影响,尽管有关这一问题的研究结果表明,人类并没有策略性地利用这些犹豫。犹豫在人际交往中的作用及其交际功能是当前研究的热点。为了更好地理解潜在的认知过程,我们开发了一个人机交互(HRI)设置,允许测量人类参与者在与机器人交互时的脑电图(EEG)信号。因此,我们解决了是否发现基于分心和相应的机器人犹豫支架策略对单次脑电图的影响的研究问题。为了进行实验,我们利用LabLinking方法,使远程实验室之间的跨学科联合研究成为可能。如果没有LabLinking,这项研究是不可能进行的,因为涉及的两个实验室需要结合各自的专业知识和设备来共同实现目标。研究结果表明,分心状态下的脑电相关系数与无分心状态下的脑电相关系数存在差异。此外,我们可以区分有和没有犹豫支架策略的分心的脑电图相关。这项概念验证研究表明,LabLinking使在远程实验室进行协作HRI研究成为可能,并为更深入地研究机器人脚手架策略奠定了第一个基础。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
EEG Correlates of Distractions and Hesitations in Human-Robot Interaction: A LabLinking Pilot Study
In this paper, we investigate the effect of distractions and hesitations as a scaffolding strategy. Recent research points to the potential beneficial effects of a speaker’s hesitations on the listeners’ comprehension of utterances, although results from studies on this issue indicate that humans do not make strategic use of them. The role of hesitations and their communicative function in human-human interaction is a much-discussed topic in current research. To better understand the underlying cognitive processes, we developed a human–robot interaction (HRI) setup that allows the measurement of the electroencephalogram (EEG) signals of a human participant while interacting with a robot. We thereby address the research question of whether we find effects on single-trial EEG based on the distraction and the corresponding robot’s hesitation scaffolding strategy. To carry out the experiments, we leverage our LabLinking method, which enables interdisciplinary joint research between remote labs. This study could not have been conducted without LabLinking, as the two involved labs needed to combine their individual expertise and equipment to achieve the goal together. The results of our study indicate that the EEG correlates in the distracted condition are different from the baseline condition without distractions. Furthermore, we could differentiate the EEG correlates of distraction with and without a hesitation scaffolding strategy. This proof-of-concept study shows that LabLinking makes it possible to conduct collaborative HRI studies in remote laboratories and lays the first foundation for more in-depth research into robotic scaffolding strategies.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信