Reducing the Costs of Automation Failure by Providing Voluntary Automation Checking Tools.

IF 2.9 3区 心理学 Q1 BEHAVIORAL SCIENCES
Human Factors Pub Date : 2024-07-01 Epub Date: 2023-07-27 DOI:10.1177/00187208231190980
Vanessa Bowden, Dale Long, Shayne Loft
{"title":"Reducing the Costs of Automation Failure by Providing Voluntary Automation Checking Tools.","authors":"Vanessa Bowden, Dale Long, Shayne Loft","doi":"10.1177/00187208231190980","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>We investigated the extent to which a voluntary-use range and bearing line (RBL) tool improves return-to-manual performance when supervising high-degree conflict detection automation in simulated air traffic control.</p><p><strong>Background: </strong>High-degree automation typically benefits routine performance and reduces workload, but can degrade return-to-manual performance if automation fails. We reasoned that providing a voluntary checking tool (RBL) would support automation failure detection, but also that automation induced complacency could extend to nonoptimal use of such tools.</p><p><strong>Method: </strong>Participants were assigned to one of three conditions, where conflict detection was either performed: manually, with RBLs available to use (Manual + RBL), automatically with RBLs (Auto + RBL), or automatically without RBLs (Auto). Voluntary-use RBLs allowed participants to reliably check aircraft conflict status. Automation failed once.</p><p><strong>Results: </strong>RBLs improved automation failure detection - with participants intervening faster and making fewer false alarms when provided RBLs compared to not (Auto + RBL vs Auto). However, a cost of high-degree automation remained, with participants slower to intervene to the automation failure than to an identical manual conflict event (Auto + RBL vs Manual + RBL). There was no difference in RBL engagement time between Auto + RBL and Manual + RBL conditions, suggesting participants noticed the conflict event at the same time.</p><p><strong>Conclusions: </strong>The cost of automation may have arisen from participants' reconciling which information to trust: the automation (which indicated no conflict and had been perfectly reliable prior to failing) or the RBL (which indicated a conflict).</p><p><strong>Applications: </strong>Providing a mechanism for checking the validity of high-degree automation may facilitate human supervision of automation.</p>","PeriodicalId":56333,"journal":{"name":"Human Factors","volume":null,"pages":null},"PeriodicalIF":2.9000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11089824/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Human Factors","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/00187208231190980","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/7/27 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"BEHAVIORAL SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Objective: We investigated the extent to which a voluntary-use range and bearing line (RBL) tool improves return-to-manual performance when supervising high-degree conflict detection automation in simulated air traffic control.

Background: High-degree automation typically benefits routine performance and reduces workload, but can degrade return-to-manual performance if automation fails. We reasoned that providing a voluntary checking tool (RBL) would support automation failure detection, but also that automation induced complacency could extend to nonoptimal use of such tools.

Method: Participants were assigned to one of three conditions, where conflict detection was either performed: manually, with RBLs available to use (Manual + RBL), automatically with RBLs (Auto + RBL), or automatically without RBLs (Auto). Voluntary-use RBLs allowed participants to reliably check aircraft conflict status. Automation failed once.

Results: RBLs improved automation failure detection - with participants intervening faster and making fewer false alarms when provided RBLs compared to not (Auto + RBL vs Auto). However, a cost of high-degree automation remained, with participants slower to intervene to the automation failure than to an identical manual conflict event (Auto + RBL vs Manual + RBL). There was no difference in RBL engagement time between Auto + RBL and Manual + RBL conditions, suggesting participants noticed the conflict event at the same time.

Conclusions: The cost of automation may have arisen from participants' reconciling which information to trust: the automation (which indicated no conflict and had been perfectly reliable prior to failing) or the RBL (which indicated a conflict).

Applications: Providing a mechanism for checking the validity of high-degree automation may facilitate human supervision of automation.

通过提供自愿自动化检查工具,降低自动化失败的成本。
目标我们研究了在模拟空中交通管制中监督高度冲突检测自动化时,自愿使用测距和方位线(RBL)工具能在多大程度上提高人工返回性能:高度自动化通常有利于提高日常性能并减少工作量,但如果自动化失败,则会降低人工返回性能。我们推断,提供自愿检查工具(RBL)将有助于自动化故障检测,但自动化导致的自满情绪也可能导致此类工具的非最佳使用:方法:参与者被分配到三种情况中的一种,冲突检测在三种情况下进行:手动使用 RBL(手动 + RBL)、自动使用 RBL(自动 + RBL)或自动不使用 RBL(自动)。自愿使用 RBL 使参与者能够可靠地检查飞机冲突状态。结果RBL提高了自动化故障检测能力--与不使用RBL(自动 + RBL vs 自动)相比,使用RBL的参与者干预更快,误报更少。但是,高度自动化的代价依然存在,参与者对自动化故障的干预速度比对相同的人工冲突事件的干预速度要慢(自动 + RBL vs 手动 + RBL)。自动 + RBL 与手动 + RBL 条件下的 RBL 参与时间没有差异,这表明参与者在同一时间注意到了冲突事件:自动操作的成本可能来自于参与者需要协调信任哪种信息:自动操作(表明没有冲突,并且在失败之前是完全可靠的)还是 RBL(表明有冲突):应用:提供一种检查高度自动化有效性的机制,可以促进人类对自动化的监督。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Human Factors
Human Factors 管理科学-行为科学
CiteScore
10.60
自引率
6.10%
发文量
99
审稿时长
6-12 weeks
期刊介绍: Human Factors: The Journal of the Human Factors and Ergonomics Society publishes peer-reviewed scientific studies in human factors/ergonomics that present theoretical and practical advances concerning the relationship between people and technologies, tools, environments, and systems. Papers published in Human Factors leverage fundamental knowledge of human capabilities and limitations – and the basic understanding of cognitive, physical, behavioral, physiological, social, developmental, affective, and motivational aspects of human performance – to yield design principles; enhance training, selection, and communication; and ultimately improve human-system interfaces and sociotechnical systems that lead to safer and more effective outcomes.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信