{"title":"The Influence of Performance Feedback on Trust and Self-Confidence in Dynamically Reliable Automation.","authors":"Christopher Holland, Heather F Neyedli","doi":"10.1177/10711813251367370","DOIUrl":"https://doi.org/10.1177/10711813251367370","url":null,"abstract":"<p><p>This study examines how performance feedback influences trust and self-confidence during interactions with dynamically reliable automation. Trust and self-confidence are crucial components of human-automation collaboration, governing reliance decisions and decision-making processes. In this experiment, 80 participants engaged with an automated assistant whose reliability fluctuated across tasks, receiving performance feedback throughout. Contrary to expectations, trust and self-confidence remained stable, showing little sensitivity to changes in reliability or feedback. This suggests that performance feedback may moderate variability in trust, stabilizing perceptions of automation over time. However, this stabilization could lead to complacency and overconfidence. To develop systems that promote calibrated trust and optimize team performance, future research should investigate individual differences in trust calibration, situational awareness, and prior experience with automation. Understanding the complex interplay between feedback, trust, and self-confidence is essential for effective human-automation collaboration in dynamic environments.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"69 1","pages":"403-407"},"PeriodicalIF":0.0,"publicationDate":"2025-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12646391/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145643563","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Isra K Elsaadany, Sanaz Motamedi, Jason Z Moore, Scarlett R Miller
{"title":"Polyp Detection in Colonoscopy Training: A Qualitative Analysis of Resident Challenges and Expert Strategies.","authors":"Isra K Elsaadany, Sanaz Motamedi, Jason Z Moore, Scarlett R Miller","doi":"10.1177/10711813251374166","DOIUrl":"10.1177/10711813251374166","url":null,"abstract":"<p><p>Colorectal cancer (CRC) is a leading cause of mortality, with early detection through colonoscopy being crucial for reducing death rates. However, up to 26% of precancerous polyps are missed during procedures, largely due to variability in physician skill. Simulation-based training (SBT) has the potential to improve patient outcomes in colonoscopy by reducing cecal intubation time. Particularly through physical simulator (PS) which offer more realistic experiences than virtual simulators. Despite their realism, PS often lack integrated feedback, limiting their effectiveness in improving polyp detection (PD). This study demonstrated that experts achieved higher polyp detection (PD) and cecal intubation rates compared to residents, identified some of the challenges residents face during colonoscopy particularly in navigation, scope manipulation, and fold inspection-and contrasts them with expert strategies. Experts employ techniques such as thorough fold inspection, lumen centering, re-advancement, and slow withdrawal to enhance PD. These insights emphasize the need for targeted feedback within PS-based training to bridge the skill gap and reduce polyp miss rates. Developing feedback-driven training strategies during PS-based training using these expert strategies may potentially reduce polyp miss rates and improve CRC screening outcomes.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"69 1","pages":"1716-1722"},"PeriodicalIF":0.0,"publicationDate":"2025-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13007603/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147517303","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Technological Interventions in the Emergency Departments to Enhance Safety and Care Experiences of Mental and Behavioral Health Patients and Staff.","authors":"Mitali Bhosekar, Monica Gripko, Emma Arnold, Anjali Joseph, Kapil Chalil Madathil","doi":"10.1177/10711813251370727","DOIUrl":"10.1177/10711813251370727","url":null,"abstract":"<p><p>In the United States, post-COVID-19, Mental and Behavioral Health (MBH) related Emergency Department (ED) visits, specifically for young adults, have increased. This article presents a review of 29 peer-reviewed articles on technological ED interventions to improve the safety and care experiences of patients with MBH conditions. The key findings indicate improved MBH identification for patients, improved access to care with telepsychiatry, enhanced communication through standardized documentation and alerts, and high acceptability of crisis management interventions. Further research needs to be conducted to enhance intervention design, acceptability, and adoption of screening, remote consultation, and crisis management interventions, and reduce staff documentation workload.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"69 1","pages":"1195-1197"},"PeriodicalIF":0.0,"publicationDate":"2025-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13124013/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147791589","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Léandre Lavoie-Hudon, Coralie Bureau, Daniel Lafond, Sébastien Tremblay
{"title":"Less can be More: Effects of a Forgetting Function on an AI-based Policy Capturing Tool Performance.","authors":"Léandre Lavoie-Hudon, Coralie Bureau, Daniel Lafond, Sébastien Tremblay","doi":"10.1177/10711813251358264","DOIUrl":"https://doi.org/10.1177/10711813251358264","url":null,"abstract":"<p><p>Artificial intelligence (AI) systems need to adapt to changing circumstances to maintain relevance in dynamic environments. Inspired by the adaptive advantages of human forgetting, this study investigates the integration of a forgetting function into an AI system. We implemented this mechanism as a training window within the Cognitive Shadow (CS) system, an AI designed to learn and emulate human decision models. This training window hyperparameter-applicable to supervised machine learning algorithms-aims to address the issue of concept drift by prioritizing recent information. The effectiveness of this addition was tested with a simple strategy game similar in dynamics to rock-paper-scissors. Participants played individually against an AI opponent for three 60-round sessions. CS was trained during Session 1 to learn the decision patterns of the player and actively predicted and countered human decisions in Sessions 2 and 3. Analyses showed that including the training window significantly improved prediction accuracy in both Sessions 2 and 3 by emphasizing recent, relevant data. These findings highlight the potential of incorporating human-inspired forgetting mechanisms to enhance AI performance in interactive and dynamic environments, with implications for future decision support systems.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"69 1","pages":"1601-1607"},"PeriodicalIF":0.0,"publicationDate":"2025-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12646389/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145643512","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Chatbot Memory: Uncovering How Mental Effort and Chabot Interactions Affect Short-Term Learning.","authors":"Alexandre Marois, Isabelle Lavallée, Gabrielle Boily, Jonay Ramon Alaman, Bérénice Desrosiers, Noémie Lavoie","doi":"10.1177/10711813251358242","DOIUrl":"https://doi.org/10.1177/10711813251358242","url":null,"abstract":"<p><p>Developments in artificial intelligence (AI) are transforming everyday tasks, including accessing information, learning, and decision making. Generative AI is representative of these changes as it can generate content traditionally reserved for humans with increased efficiency and reduced effort. This includes technologies like ChatGPT and other tools that exploit large language models, typically taking the form of conversational agents (chatbots). These technologies can be useful for self-regulated learning as is the case for Web browsing. It is, however, unclear whether learning with chatbots may be efficient as opposed to other Web-based approaches given the reduced effort related to chatbot interactions. This study assessed how interacting with a chatbot may affect short-term learning and the role of mental effort. Memory performance was equivalent across participants who either interacted with a chatbot or browsed the Internet to find information for answering essay questions. Differences in self-reported workload were, however, found across conditions.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"69 1","pages":"2120-2126"},"PeriodicalIF":0.0,"publicationDate":"2025-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12646388/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145643062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Patricia R DeLucia, Daniel Oberfeld, Joseph K Kearney, Melissa Cloutier, Anna M Jilla, Avery Zhou, Stephanie Trejo Corona, Jessica Cormier, Audrey Taylor, Charles C Wykoff, Robin Baurès
{"title":"Time-to-Collision Estimation With Age-Related Macular Degeneration Using Visual and Auditory Cues: Which Cues are Most Important?","authors":"Patricia R DeLucia, Daniel Oberfeld, Joseph K Kearney, Melissa Cloutier, Anna M Jilla, Avery Zhou, Stephanie Trejo Corona, Jessica Cormier, Audrey Taylor, Charles C Wykoff, Robin Baurès","doi":"10.1177/10711813251357943","DOIUrl":"10.1177/10711813251357943","url":null,"abstract":"<p><p>We measured time-to-collision (TTC) judgments from participants with age-related macular degeneration (AMD), and normal vision (NV) controls, with an audiovisual virtual reality system that simulated vehicles approaching in a 3D traffic environment. The vehicle was presented visually only, aurally only, or both simultaneously, allowing us to determine the relative importance of visual and auditory cues with psychophysical reverse correlation. Results indicated that TTC judgments were based on both auditory and visual cues in the AMD and NV groups; the AMD group relied, at least in part, on their residual vision. A multimodal advantage was not observed in either group. TTC estimation in the AMD group was surprisingly similar to that in the NV group. However, the AMD group showed a higher relative importance of \"heuristic\" cues compared to more reliably accurate cues favored by the NV group, suggesting that similar performance may be achieved through different cue-weighting strategies.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12320946/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144790995","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evaluating Active Learning Strategies for Automated Classification of Patient Safety Event Reports in Hospitals.","authors":"Shehnaz Islam, Myrtede Alfred, Dulaney Wilson, Eldan Cohen","doi":"10.1177/10711813241260676","DOIUrl":"10.1177/10711813241260676","url":null,"abstract":"<p><p>Patient safety event (PSE) reports, which document incidents that compromise patient safety, are fundamental for improving healthcare quality. Accurate classification of these reports is crucial for analyzing trends, guiding interventions, and supporting organizational learning. However, this process is labor-intensive due to the high volume and complex taxonomy of reports. Previous work has shown that machine learning (ML) can automate PSE report classification; however, its success depends on large manually-labeled datasets. This study leverages Active Learning (AL) strategies with human expertise to streamline PSE-report labeling. We utilize pool-based AL sampling to selectively query reports for human annotation, developing a robust dataset for training ML classifiers. Our experiments demonstrate that AL significantly outperforms random sampling in accuracy across various text representations, reducing the need for labeled samples by 24% to 69%. Based on these findings, we suggest that incorporating AL strategies into PSE-report labeling can effectively reduce manual workload while maintaining high classification accuracy.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"465-472"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11655274/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142878921","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Christopher Holland, Grace Perry, Heather F Neyedli
{"title":"Calibrating Trust, Reliance and Dependence in Variable-Reliability Automation.","authors":"Christopher Holland, Grace Perry, Heather F Neyedli","doi":"10.1177/10711813241277531","DOIUrl":"10.1177/10711813241277531","url":null,"abstract":"<p><p>Trust and system reliability can influence a user's dependence on automated systems. This study aimed to investigate how increases and decreases in automation reliability affect users' trust in these systems and how these changes in trust are associated with users' dependence on the system. Participants completed a color identification task with the help of an automated aid, where the reliability of this aid either increased from 50% to 100% or decreased from 100% to 50% as the task progressed, depending on which group the participants were assigned to. Participants' trust, self-confidence, and dependence on the system were measured throughout the experiment. There were no differences in trust between the two groups throughout the experiment; however, participants' dependence behavior did follow system reliability. These findings highlight that trust is not always correlated with system reliability, and that although trust can often influence dependence, it does not always determine it.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"604-610"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11655268/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142878920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploring Collaborative Patterns in Neurodiverse Teams: A Hidden Markov Model Approach Using Physiological Signals.","authors":"Sunwook Kim, Manhua Wang, Megan Fok, Caroline Byrd Hornburg, Myounghoon Jeon, Angela Scarpa","doi":"10.1177/10711813241260680","DOIUrl":"10.1177/10711813241260680","url":null,"abstract":"<p><p>Autistic individuals face challenges in successful employment, emphasizing the need for targeted workplace support. This study explored collaborative dynamics within neurodiverse teams during a simulated remote work task by applying Hidden Markov Models (HMMs) to heart rate data. Eighteen participants formed nine dyads: six nonautistic (NA-NA) pairs and three autistic-non-autistic (ASD-NA) pairs. Dyads completed two trials of a collaborative programming task over Zoom, alternating roles between trials. Heart rate data were collected, segmented, and transformed to extract features reflecting participants' interactions. The final HMM was fitted with seven hidden states, and transition probabilities were derived for each dyad type. Results showed that NA-NA dyads exhibited more frequent transitions among states compared to ASD-NA dyads, potentially suggesting more varied interaction patterns. These findings demonstrate the utility of HMMs in capturing collaborative behaviors through physiological signals and highlight their potential in helping develop effective support strategies for neurodiverse teams.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"137-138"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12273867/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144676802","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hanna J Barton, Apoorva Maru, Olivia Lin, Margaret A Leaf, Daniel J Hekman, Douglas A Wiegmann, Manish N Shah, Brian W Patterson
{"title":"Considerations for Developing Patient-centered Clinical Decision Support: Preventing Older Adult Falls after Emergency Department Visits.","authors":"Hanna J Barton, Apoorva Maru, Olivia Lin, Margaret A Leaf, Daniel J Hekman, Douglas A Wiegmann, Manish N Shah, Brian W Patterson","doi":"10.1177/10711813241275504","DOIUrl":"10.1177/10711813241275504","url":null,"abstract":"<p><p>To support the ongoing adaptation and implementation of an Emergency Department (ED)-based clinical decision support (CDS) tool to prevent future falls, we interviewed older adults (n=15) during their ED stay. We elicited their feedback on the written and verbal content of the existing CDS, feelings about the automated risk-screening aspect of the CDS and asked them to identify barriers that would prevent them from following up with the Falls Clinic to which the CDS supports referral placements. Our findings suggest that the older adults interviewed saw the CDS simply as another tool that they trusted their ED physician/APP to interact with. The identified barriers to follow-up reflect common access barriers such as transportation availability and clinic distance. For CDS tools to impact real-life patient outcomes, we must consider patient's needs and limitations and appropriately match interventions.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"553-556"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12212639/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144546512","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}