Huao Li, Maximilian Chis, Keyang Zheng, Michael Lewis, Dana Hughes, Katia Sycara
{"title":"Sentiment analysis of Artificial Advisors in Search and Rescue Tasks","authors":"Huao Li, Maximilian Chis, Keyang Zheng, Michael Lewis, Dana Hughes, Katia Sycara","doi":"10.1177/21695067231205569","DOIUrl":"https://doi.org/10.1177/21695067231205569","url":null,"abstract":"The potential of Artificial Intelligence in assisting human teamwork has yet to be fully realized, despite its success in other domains. To ensure AI’s effectiveness and credibility as a team advisor, it must be able to effectively infer team dynamics and issue appropriate interventions. This study focuses on AI-mediated human teamwork in an simulated search and rescue (SAR) task, where a team of humans is monitored and guided by an artifical social intelligence (ASI). Six different ASIs are compared against a human baseline investigating the characteristics and effectiveness of their interventions. When adjusted for initial player competence ASIs performed on par with the human advisor although the human advisor was rated as more trustworthy and useful. Additionally, sentiment analysis of the interventions reveals that participants were more likely to accept interventions with negative emotions and resulted in improved team performance.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"22 1","pages":"2564 - 2570"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139343946","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Understanding the Impact of Team Cognitive Load and Advice Compliance in Urban Search and Rescue Task","authors":"Matthew M. Willett, Mustafa Demir","doi":"10.1177/21695067231192293","DOIUrl":"https://doi.org/10.1177/21695067231192293","url":null,"abstract":"This research concentrates on the impact of Artificial Social Intelligence (ASI)'s advice intervention text messages and the compliance of three human team members, who communicate via voice to carry out victim rescue operations, on the team's performance. This experiment takes place in a simulated Urban Search and Rescue (USAR) task environment built using Minecraft. The ASI agent, utilizing its analytical components designed around interactive real-time measurements, oversees the team's behavior in the USAR task environment. The agent discerns and forecasts the human team members' actions, offering interventions via text messages to foster and sustain team efficacy. The study examines (1) the influence of the team's cognitive load on message compliance from the advisor, and (2) how these elements collectively affect team performance. The results show a positive association between cognitive load, compliance, and enhanced task performance, despite the lack of a significant correlation between cognitive load and compliance.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"17 1","pages":"2484 - 2489"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139345310","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Anna Hall, Ronald L. Boring, Thomas A. Ulrich, Roger T. Lew, Michelle Velazquez, Jinding Xing, Tim A. Whiting, Georgios Michail Makrakis
{"title":"A Comparison of Three Types of Computer-Based Procedures: An Experiment Using the Rancor Microworld Simulator","authors":"Anna Hall, Ronald L. Boring, Thomas A. Ulrich, Roger T. Lew, Michelle Velazquez, Jinding Xing, Tim A. Whiting, Georgios Michail Makrakis","doi":"10.1177/21695067231205507","DOIUrl":"https://doi.org/10.1177/21695067231205507","url":null,"abstract":"The nuclear power industry has historically used paper-based procedures, but a shift towards computer-based procedures (CBPs) has the potential to reduce human errors, alleviate mental workload, and improve work performance. Twenty-seven participants were randomly assigned to one of three CBP types using the Rancor Microworld Simulator, and each performed two different types of operational scenarios (startup and loss of feedwater). The three CBP types varied in levels of digitalization. It was hypothesized that there would be less favorable impressions of the most basic procedures, and that these would demonstrate lower usability than types with greater digitalization. Overall, our predictions were partially supported with some interesting caveats, specifically with some performance benefits for CBPs that provided indicators but not embedded controls. We discuss our findings in terms of optimal levels of digitalization/automation within nuclear operations and suggest pathways for future directions.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"19 1","pages":"2552 - 2557"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139345762","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mansoor Nasir, Kalyani Sonawane, Nikhitha Bekkanti, Walter Talamonti
{"title":"Perspective on Emotion Detection for Automotive Applications: Performance Evaluation of Two Emotion AI SDKs","authors":"Mansoor Nasir, Kalyani Sonawane, Nikhitha Bekkanti, Walter Talamonti","doi":"10.1177/21695067231192630","DOIUrl":"https://doi.org/10.1177/21695067231192630","url":null,"abstract":"The work presented herein quantifies the limitations of the technology provided by two prominent suppliers in Emotion AI. Each Software Development Kit (SDK) performance was measured for accuracy using image and video databases. The results indicate that while the SDKs show high accuracy in detecting positive emotions (e.g., Happy), the performance suffered for negative emotions (e.g., Angry) due to missed and false detections. The results were worse for structured video datasets and degraded further when subjects were in naturalistic settings. Although Emotion AI have improved greatly in recent years, the current versions are not reliable enough for automotive applications. The paper provides perspectives on the reasons for subpar performance and guidance for improvement for future emotion estimation software.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"217 1","pages":"2366 - 2371"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139346913","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Feasibility of a Circadian Lighting Intervention to Promote Sleep in College Students","authors":"Martha Sanders","doi":"10.1177/21695067231192196","DOIUrl":"https://doi.org/10.1177/21695067231192196","url":null,"abstract":"College students report poor sleep quality that impacts class attendance, productivity, and overall success in college. Circadian lighting has helped to regulate sleep patterns and improve sleep quality in populations who traditionally experience poor sleep. A feasibility study was conducted to determine the practicality of conducting a study in which a circadian lighting intervention would be implemented in college students’ dorms to study the effect on sleep, mood, and productivity. This study examined the process, resources, data management, and preliminary efficacy of a 4-wk, daily, one-hour lightbox exposure. Results indicated the lightbox was well-received by students. Recommendations to facilitate the study include improved recruitment efforts, data management, use of a research-grade activity tracker, modification of data collection days, and utilization of research associates to assist in data collection. Preliminary outcomes showed improved sleep quality and productivity for schoolwork in this sample of college students.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"79 1","pages":"2228 - 2232"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139346010","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
John Hayes, Shivangi Dwivedi, Isabella Pedron, Joe Gabbard, Ranjana K. Mehta
{"title":"Learning across Diverse Training Modalities is Different across Gender: Insights from a Neuroergonomics Approach","authors":"John Hayes, Shivangi Dwivedi, Isabella Pedron, Joe Gabbard, Ranjana K. Mehta","doi":"10.1177/21695067231205572","DOIUrl":"https://doi.org/10.1177/21695067231205572","url":null,"abstract":"Recent challenges such as COVID-19 call for innovative methods of delivering training. In this study, we compare the effectiveness of augmented reality (AR) based psychomotor learning compared to videobased training. Participants completed either AR or video training to learn four basic AR interactions, before completing an AR evaluation. The AR group reported greater workload during training but demonstrated better performance during evaluation. We used functional near infrared spectroscopy (fNIRS) to compare brain activation and functional connectivity across groups during evaluation. We found that participants in the AR group displayed smaller brain networks during the evaluation, suggesting more efficient utilization of neural resources. Sex differences in activation and connectivity suggest that men and women potentially employ different neural strategies while learning motor skills in AR. Future studies should examine how these differences could impact performance and user experience in future AR-based training programs.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"1 1","pages":"2558 - 2559"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139346025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"I thought we tested that!: Lessons learned from a team communications field study","authors":"Jacquelyn A. Schreck, Eric Sikorski, Michael King","doi":"10.1177/21695067231194321","DOIUrl":"https://doi.org/10.1177/21695067231194321","url":null,"abstract":"This paper presents practical lessons learned for conducting field research based on challenges faced during a complex field study. Communication between soldiers was captured via audio recorders as Army squads conducted simulated battle drills. The communication data provided critical information regarding squad performance in a realistic context that would not have been obtainable in a lab environment. The field study, despite intensive preparation, presented unforeseen issues requiring both short-term and long-term solutions. Issues were encountered with the environment, data collection, and data handling, which were able to be dealt with in real-time because we were adequately prepared. Preparations, challenges with specific examples, and universal lessons learned that can be applied to other field studies are discussed.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"7 1","pages":"86 - 90"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139346532","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
K. Tabattanon, Emily Nakisher, Ekim Koca, Bernard J.
{"title":"Environmental Intervention Evaluation to Support Motor Planning of Wheelchair Movements: A Pilot Study","authors":"K. Tabattanon, Emily Nakisher, Ekim Koca, Bernard J.","doi":"10.1177/21695067231192877","DOIUrl":"https://doi.org/10.1177/21695067231192877","url":null,"abstract":"Environmental interventions provide a promising opportunity to support inclusive mobility in our rapidly changing society and workforce. Concurrently, the trends for aging into mobility disability, working into older age, and health and economic burdens of unpaid caregiving continue to rise. Hence, providing equitable mobility for all is an urgent need. In the context of manual wheelchair control, a novel method investigating the impact of environmental interventions on individual’s internal representation of motor actions is proposed. In addition to measuring objective and subjective performance metrics, we propose that an understanding of how internal representations of tasks are influenced by user perception of the environment has promising potential towards informing effective and inclusive task-environment interactions. The application explored in this pilot study aims to facilitate mobility.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"30 1","pages":"321 - 326"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139344303","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Who Hacked My Car? Designing Autonomous Vehicles to Support Driver Response to Security Threats","authors":"Cherin Lim, Prashanth Rajivan","doi":"10.1177/21695067231192217","DOIUrl":"https://doi.org/10.1177/21695067231192217","url":null,"abstract":"Modern vehicles have evolved into intelligent and autonomous transportation systems, yet such computer-driven developments also create opportunities for unforeseen cyber-security attacks on self-driving cars. These threats may pose critical risks to human lives but there is a considerable lack of understanding in designing vehicle systems to support driver response during rare and hazardous security events. We conducted an interview with autonomous vehicle drivers to understand their perception of automotive threats and design needs for effective response during security events. Results show that drivers expect information relating to malfunction detection, trouble-shooting instructions, and log data from the vehicle. Moreover, drivers were more likely to act based on instincts the more the driver perceives the threat to be urgent, rather than process the situation during the initial stages of an attack. We thus propose a ‘Driver Response Phase’ and corresponding design implications for future vehicles that support user response to security risks.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"93 1","pages":"247 - 252"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139344952","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Alesawy N., Halim P., Nadai M., Son J., Davis S., Teixeira C., Nelson T., Wang A., Holliman-Lopez G., Alesawy S., Stirling L.
{"title":"Illuminating the augmented reality stage: Assessment of lighting conditions for space exploration","authors":"Alesawy N., Halim P., Nadai M., Son J., Davis S., Teixeira C., Nelson T., Wang A., Holliman-Lopez G., Alesawy S., Stirling L.","doi":"10.1177/21695067231210845","DOIUrl":"https://doi.org/10.1177/21695067231210845","url":null,"abstract":"Augmented reality (AR) technology faces a prevailing challenge when dealing with harsh lighting environments, which are common in space. The study aims to evaluate the lighting compatibility for successful hand gestures using HoloLens 2, a device that utilizes AR technology for heads-up displays (HUDs), as a potential way to provide critical information to astronauts during extravehicular activities (EVAs). The study modulated luminance (dim, neutral, bright) and hand coverings (bare hand, white glove, black glove) to determine the HoloLens functionality. The results will inform design changes to support the astronaut experience by enhancing hand gesture recognition and reducing time wasted re-gesturing. By understanding the lighting requirements for HoloLens, we can improve the AR experience for future space missions. This study highlights the importance of considering lighting conditions in the development of AR technology, especially in challenging environments like space.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"442 1","pages":"2571 - 2576"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139345932","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}