Journal of Cognitive Engineering and Decision Making最新文献

A Taxonomy for AI Hazard Analysis 人工智能危害分析分类标准

IF 2

Journal of Cognitive Engineering and Decision Making Pub Date : 2024-01-09 DOI: 10.1177/15553434231224096

M.L Cummings

引用次数: 0

Is the Pull-Down Effect Overstated? An Examination of Trust Propagation Among Fighter Pilots in a High-Fidelity Simulation 拉低效应被夸大了吗？在高仿真模拟中考察战斗机飞行员之间的信任传播

IF 2

Journal of Cognitive Engineering and Decision Making Pub Date : 2024-01-09 DOI: 10.1177/15553434231225909

Joseph B. Lyons, Janine D. Mator, Tony Orr, Gene M. Alarcon, Kristen Barrera

{"title":"Is the Pull-Down Effect Overstated? An Examination of Trust Propagation Among Fighter Pilots in a High-Fidelity Simulation","authors":"Joseph B. Lyons, Janine D. Mator, Tony Orr, Gene M. Alarcon, Kristen Barrera","doi":"10.1177/15553434231225909","DOIUrl":"https://doi.org/10.1177/15553434231225909","url":null,"abstract":"Research on trust propagation has primarily been conducted with undergraduates using low-fidelity scenarios. It is unclear if the pull-down effect (e.g., system-wide trust) occurs in more applied domains with actual operators. A sample of experienced US Air Force fighter pilots ( n = 13) engaged in six trials using a high-fidelity simulation for Collaborative Combat Aircraft (CCA). The pilots were given command of four CCAs to complete realistic targeting missions. They were asked to monitor the CCAs, report any errors, evaluate a number of potential targets, select a valid target, and select one of the CCAs to perform a strike. One of the CCAs evidenced an error in four of the six trials (17% of all observations), and if the pilots did not report the error, they were prompted to it by an experimenter playing the role of Air Battle Manager. After each trial, reliance intentions and subjective workload were assessed for each of the four CCAs. The presence of an error reduced trust and increased workload for that CCA referent only. There was no evidence of a pull-down effect, nor did the composition of the CCA group (homogenous vs. heterogenous) influence trust propagation. Implications for trust research are discussed.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"59 51","pages":""},"PeriodicalIF":2.0,"publicationDate":"2024-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139441495","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Understanding Automation Failure 了解自动化故障

IF 2

Journal of Cognitive Engineering and Decision Making Pub Date : 2024-01-04 DOI: 10.1177/15553434231222059

M. Endsley

{"title":"Understanding Automation Failure","authors":"M. Endsley","doi":"10.1177/15553434231222059","DOIUrl":"https://doi.org/10.1177/15553434231222059","url":null,"abstract":"The implementation of automation in many domains has led to well-documented accidents and incidents, resulting from reduced situation awareness that occurs when operators are out-of-loop (OOTL), automation confusion, and automation interaction difficulties. Wickens coined the term lumberjack effect to summarize the finding that while automation works well most of the time in typical or normal situations, the performance problems that occur in novel or unexpected situations also increase the likelihood of catastrophic errors. Skraaning and Jamieson have criticized the lumberjack effect due to a study in which they failed to find it. I show that this claim is unsupported due to a number of methodological limitations in their study and conceptual errors. They also provide a model of automation failure that fails to clearly delineate the many barriers to accidents that are available, instead emphasizing the ways in which automation can fail technically and different types of human error. An alternate automation failure model is presented that provides a broader socio-technical perspective emphasizing the design features, processes, capabilities, organizational policies, and training that support people in improving system safety when automation fails.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"43 15","pages":""},"PeriodicalIF":2.0,"publicationDate":"2024-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139385107","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Integrating Function Allocation and Operational Event Sequence Diagrams to Support Human-Robot Coordination: Case Study of a Robotic Date Thinning System 整合功能分配和操作事件序列图以支持人机协调：机器人枣树疏伐系统案例研究

IF 2

Journal of Cognitive Engineering and Decision Making Pub Date : 2023-12-07 DOI: 10.1177/15553434231199727

Yael Salzer, Noy Saraf, A. Bechar, Yuval Cohen, Ze’ev Schmilovitch, Sigal Berman, Y. Yovel, A. Sadowsky, Ellen J. Bass

{"title":"Integrating Function Allocation and Operational Event Sequence Diagrams to Support Human-Robot Coordination: Case Study of a Robotic Date Thinning System","authors":"Yael Salzer, Noy Saraf, A. Bechar, Yuval Cohen, Ze’ev Schmilovitch, Sigal Berman, Y. Yovel, A. Sadowsky, Ellen J. Bass","doi":"10.1177/15553434231199727","DOIUrl":"https://doi.org/10.1177/15553434231199727","url":null,"abstract":"State-of-the-art robots show promise in supporting but not completely replacing human work in most precision agriculture applications. For many potential agricultural robot applications, there are no comparable systems nor readily available information on the human operator activities to guide the systems engineering process. Such is the situation for Medjool date thinning, a tedious and hazardous manual operation for which technological assistance has yet to be developed. Here we describe using cognitive system engineering methods to develop operational concepts and human-robot coordination requirements for a pioneer system, a Robotic Medjool Date Thinning System (RDTS). We leveraged the abstraction hierarchy to characterize the RDTS’s envisioned goals and functionality. We developed alternative functional allocations to explore the design space based on the availability of different enabling technologies. After downselecting to the function allocation, including the technologies expected to be developed, we created operational event sequence diagrams to visualize the operation flow and to identify requirements related to the human operator and the joint human-robot system. Applying these methods in the early design stages helped to refine the human-robot coordination requirements and to identify gaps in the operational concept—they show great potential to support the introduction of agricultural robots and bring them to fruition.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"91 6","pages":""},"PeriodicalIF":2.0,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138590456","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Adapting Cognitive Task Analysis Methods for Use in a Large Sample Simulation Study of High-Risk Healthcare Events. 适应认知任务分析方法用于高风险医疗事件的大样本模拟研究

IF 2

Journal of Cognitive Engineering and Decision Making Pub Date : 2023-12-01 Epub Date: 2023-08-04 DOI: 10.1177/15553434231192283

Laura G Militello, Megan E Salwei, Carrie Reale, Christen Sushereba, Jason M Slagle, David Gaba, Matthew B Weinger, John Rask, Janelle Faiman, Michael Andreae, Amanda R Burden, Shilo Anders

{"title":"Adapting Cognitive Task Analysis Methods for Use in a Large Sample Simulation Study of High-Risk Healthcare Events.","authors":"Laura G Militello, Megan E Salwei, Carrie Reale, Christen Sushereba, Jason M Slagle, David Gaba, Matthew B Weinger, John Rask, Janelle Faiman, Michael Andreae, Amanda R Burden, Shilo Anders","doi":"10.1177/15553434231192283","DOIUrl":"10.1177/15553434231192283","url":null,"abstract":"<p><p>Cognitive task analysis (CTA) methods are traditionally used to conduct small-sample, in-depth studies. In this case study, CTA methods were adapted for a large multi-site study in which 102 anesthesiologists worked through four different high-fidelity simulated high-consequence incidents. Cognitive interviews were used to elicit decision processes following each simulated incident. In this paper, we highlight three practical challenges that arose: (1) standardizing the interview techniques for use across a large, distributed team of diverse backgrounds; (2) developing effective training; and (3) developing a strategy to analyze the resulting large amount of qualitative data. We reflect on how we addressed these challenges by increasing standardization, developing focused training, overcoming social norms that hindered interview effectiveness, and conducting a staged analysis. We share findings from a preliminary analysis that provides early validation of the strategy employed. Analysis of a subset of 64 interview transcripts using a decompositional analysis approach suggests that interviewers successfully elicited descriptions of decision processes that varied due to the different challenges presented by the four simulated incidents. A holistic analysis of the same 64 transcripts revealed individual differences in how anesthesiologists interpreted and managed the same case.</p>","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"1 1","pages":"315-331"},"PeriodicalIF":2.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10630935/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43625878","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Exploratory Analysis of Decision-Making Biases of Professional Red Teamers in a Cyber-Attack Dataset 网络攻击数据集中专业红队人员决策偏差的探索性分析

IF 2

Journal of Cognitive Engineering and Decision Making Pub Date : 2023-11-28 DOI: 10.1177/15553434231217787

Robert S. Gutzwiller, Hansol Rheem, Kimberly J. Ferguson-Walter, Christina M. Lewis, Chelsea K. Johnson, M. Major

引用次数: 0

The Context of Care: Abstraction Hierarchy Modeling of Therapeutic Foster Care Programs 护理情境:治疗性寄养项目的抽象层次模型

Journal of Cognitive Engineering and Decision Making Pub Date : 2023-11-03 DOI: 10.1177/15553434231211060

Connor Wurst, Huei-Yen Winnie Chen, Ann M. Bisantz, Seventy F. Hall, Laura Maggiulli, Kenneth Joseph, Melanie Sage

引用次数: 0

In the Rough: Evaluation of Convergence Across Trust Assessment Techniques Using an Autonomous Golf Cart 粗糙:使用自主高尔夫球车的信任评估技术的收敛性评估

Journal of Cognitive Engineering and Decision Making Pub Date : 2023-10-17 DOI: 10.1177/15553434231206422

Nathan L. Tenhundfeld, Jason Forsyth, Nathan R. Sprague, Samy El-Tawab, Jenna E. Cotter, Lisa Vangsness

{"title":"In the Rough: Evaluation of Convergence Across Trust Assessment Techniques Using an Autonomous Golf Cart","authors":"Nathan L. Tenhundfeld, Jason Forsyth, Nathan R. Sprague, Samy El-Tawab, Jenna E. Cotter, Lisa Vangsness","doi":"10.1177/15553434231206422","DOIUrl":"https://doi.org/10.1177/15553434231206422","url":null,"abstract":"As automated and autonomous systems become more widely available, the ability to integrate them into environments seamlessly becomes more important. One cognitive construct that can predict the use, misuse, and disuse of automated and autonomous systems is trust that a user has in the system. The literature has explored not only the predictive nature of trust but also the ways in which it can be evaluated. As a result, various measures, such as physiological and behavioral measures, have been proposed as ways to evaluate trust in real-time. However, inherent differences in the measurement approaches (e.g., task dependencies and timescales) raise questions about whether the use of these approaches will converge upon each other. If they do, then the selection of any given proven approach to trust assessment may not matter. However, if they do not converge, it raises questions about the ability of these measures to assess trust equally and whether discrepancies are attributable to discriminant validity or other factors. The present study used various trust assessment techniques for passengers in a self-driving golf-cart. We find little to no convergence across measures, raising questions that need to be addressed in future research.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"219 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136032736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Framing Security Under Time Pressure: Brand Familiarity Matters for Mobile Application Choices 在时间压力下构建安全性:品牌熟悉度对移动应用选择的影响

Journal of Cognitive Engineering and Decision Making Pub Date : 2023-09-22 DOI: 10.1177/15553434231200119

Jing Chen, Cody Parker

{"title":"Framing Security Under Time Pressure: Brand Familiarity Matters for Mobile Application Choices","authors":"Jing Chen, Cody Parker","doi":"10.1177/15553434231200119","DOIUrl":"https://doi.org/10.1177/15553434231200119","url":null,"abstract":"The current study examined the effects of security score framing, time pressure, and brand familiarity on mobile application choices. Past research has found the framing of safety versus risk scores affects how potential risks for mobile apps are communicated to users. Both time pressure and brand familiarity have been shown to affect consumers’ purchase behaviors but not yet for app-selection decisions. The current study examined the effects of time pressure and brand familiarity on the effectiveness of risk displays (framed as safety or risk) for mobile apps. Participants were shown screenshots of various apps with these factors manipulated, and they were to choose one out of six apps. Our findings indicate that users rely heavily on brand familiarity when choosing apps, which could lead to insecure decisions. Additionally, security scores guided app choices toward more secure apps when framed as safety than when framed as risk, although this advantage was only evident without time pressure and disappeared under time pressure. The design implications call for more careful screening and user education about the potential risks associated familiar apps, as well as the need of new security design solutions to help users under time pressure.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136060132","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Dynamical Measurement of Team Resilience 团队弹性的动态测量

Journal of Cognitive Engineering and Decision Making Pub Date : 2023-09-20 DOI: 10.1177/15553434231199729

David A.P. Grimm, Jamie C. Gorman, Nancy J. Cooke, Mustafa Demir, Nathan J. McNeese

{"title":"Dynamical Measurement of Team Resilience","authors":"David A.P. Grimm, Jamie C. Gorman, Nancy J. Cooke, Mustafa Demir, Nathan J. McNeese","doi":"10.1177/15553434231199729","DOIUrl":"https://doi.org/10.1177/15553434231199729","url":null,"abstract":"Resilient teams overcome sudden, dynamic changes by enacting rapid, adaptive responses that maintain system effectiveness. We analyzed two experiments on human-autonomy teams (HATs) operating a simulated remotely piloted aircraft system (RPAS) and correlated dynamical measures of resilience with measures of team performance. Across both experiments, HATs experienced automation and autonomy failures, using a Wizard of Oz paradigm. Team performance was measured in multiple ways, using a mission-level performance score, a target processing efficiency score, a failure overcome score, and a ground truth resilience score. Novel dynamical systems metrics of resilience measured the timing of system reorganization in response to failures across RPAS layers, including vehicle, controls, communications layers, and the system overall. Time to achieve extreme values of reorganization and novelty of reorganization were consistently correlated with target processing efficiency and ground truth resilience across both studies. Correlations with mission-level performance and the overcome score were apparent but less consistent. Across both studies, teams displayed greater system reorganization during failures compared to routine task conditions. The second experiment revealed differential effects of team training focused on coordination coaching and trust calibration. These results inform the measurement and training of resilience in HATs using objective, real-time resilience analysis.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"183 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136314688","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0