A Systematic Review and Taxonomy of Human-Agent Teaming Testbeds.

IF 3.3 3区 心理学 Q1 BEHAVIORAL SCIENCES
Hyesun Chung, Timothy Holder, Julie A Shah, X Jessie Yang
{"title":"A Systematic Review and Taxonomy of Human-Agent Teaming Testbeds.","authors":"Hyesun Chung, Timothy Holder, Julie A Shah, X Jessie Yang","doi":"10.1177/00187208251376898","DOIUrl":null,"url":null,"abstract":"<p><p>ObjectiveWe developed a taxonomy for human-agent teams (HATs) and conducted a literature review of existing HAT testbeds using our proposed taxonomy.BackgroundWith the increasing interest in HATs, numerous research studies in this field have utilized different testbeds. Despite this, there is a lack of comprehensive understanding regarding the capabilities and limitations of the existing testbeds.MethodWe first developed a taxonomy for HATs by modifying the existing framework for classifying human teams. Our proposed taxonomy comprises ten attributes. Subsequently, using the taxonomy, we analyzed 103 testbeds identified from 235 empirical research studies. After coding each testbed, we conducted frequency analyses on each attribute to determine the distribution of the testbeds.ResultsRegarding team composition, the majority of testbeds afford single human participants paired with few agents, typically in subordinate roles. Also, in most testbeds, the leadership structure is designated, with humans assuming leadership roles, or none. The communication dynamics present an area for further exploration, especially with larger team sizes. Additionally, nearly all reviewed testbeds focus on long-term teams, overlooking dynamics in ad hoc teams, which are common in real-world settings.ConclusionOur findings underscore the importance of further research into diverse team attributes, such as team composition, leadership structure, communication structure, direction, and medium. It would facilitate a deeper understanding of complex team dynamics in HATs and lead to designing effective teams.ApplicationThe current study would be valuable for discussing future research directions when developing new testbeds or designing novel experiments leveraging existing ones.</p>","PeriodicalId":56333,"journal":{"name":"Human Factors","volume":" ","pages":"187208251376898"},"PeriodicalIF":3.3000,"publicationDate":"2025-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Human Factors","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/00187208251376898","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"BEHAVIORAL SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

ObjectiveWe developed a taxonomy for human-agent teams (HATs) and conducted a literature review of existing HAT testbeds using our proposed taxonomy.BackgroundWith the increasing interest in HATs, numerous research studies in this field have utilized different testbeds. Despite this, there is a lack of comprehensive understanding regarding the capabilities and limitations of the existing testbeds.MethodWe first developed a taxonomy for HATs by modifying the existing framework for classifying human teams. Our proposed taxonomy comprises ten attributes. Subsequently, using the taxonomy, we analyzed 103 testbeds identified from 235 empirical research studies. After coding each testbed, we conducted frequency analyses on each attribute to determine the distribution of the testbeds.ResultsRegarding team composition, the majority of testbeds afford single human participants paired with few agents, typically in subordinate roles. Also, in most testbeds, the leadership structure is designated, with humans assuming leadership roles, or none. The communication dynamics present an area for further exploration, especially with larger team sizes. Additionally, nearly all reviewed testbeds focus on long-term teams, overlooking dynamics in ad hoc teams, which are common in real-world settings.ConclusionOur findings underscore the importance of further research into diverse team attributes, such as team composition, leadership structure, communication structure, direction, and medium. It would facilitate a deeper understanding of complex team dynamics in HATs and lead to designing effective teams.ApplicationThe current study would be valuable for discussing future research directions when developing new testbeds or designing novel experiments leveraging existing ones.

人-智能体组队实验平台的系统综述与分类。
目的研究人类智能体团队(HAT)的分类方法,并对现有HAT测试平台进行文献综述。随着人们对hat的兴趣日益浓厚,该领域的许多研究都使用了不同的测试平台。尽管如此,对现有测试平台的能力和局限性缺乏全面的了解。方法首先对现有的人类团队分类框架进行修改,建立了HATs分类体系。我们建议的分类法包括十个属性。随后,使用分类法,我们分析了从235个实证研究中确定的103个试验台。在对每个测试平台进行编码后,我们对每个属性进行频率分析,以确定测试平台的分布。关于团队组成,大多数测试平台提供单个人类参与者与少数代理配对,通常是从属角色。同样,在大多数测试平台中,领导结构是指定的,由人类承担领导角色,或者没有。沟通动态是一个有待进一步探索的领域,尤其是在团队规模较大的情况下。此外,几乎所有评审的测试平台都关注于长期的团队,忽略了特别团队中的动态,这在现实环境中很常见。结论本研究结果强调了对团队组成、领导结构、沟通结构、方向和媒介等多元化团队属性的进一步研究的重要性。这将有助于更深入地理解HATs中复杂的团队动态,并导致设计有效的团队。本研究对未来开发新实验平台或利用现有实验平台设计新实验的研究方向具有重要意义。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Human Factors
Human Factors 管理科学-行为科学
CiteScore
10.60
自引率
6.10%
发文量
99
审稿时长
6-12 weeks
期刊介绍: Human Factors: The Journal of the Human Factors and Ergonomics Society publishes peer-reviewed scientific studies in human factors/ergonomics that present theoretical and practical advances concerning the relationship between people and technologies, tools, environments, and systems. Papers published in Human Factors leverage fundamental knowledge of human capabilities and limitations – and the basic understanding of cognitive, physical, behavioral, physiological, social, developmental, affective, and motivational aspects of human performance – to yield design principles; enhance training, selection, and communication; and ultimately improve human-system interfaces and sociotechnical systems that lead to safer and more effective outcomes.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信