{"title":"Evaluating Active Learning Strategies for Automated Classification of Patient Safety Event Reports in Hospitals.","authors":"Shehnaz Islam, Myrtede Alfred, Dulaney Wilson, Eldan Cohen","doi":"10.1177/10711813241260676","DOIUrl":"10.1177/10711813241260676","url":null,"abstract":"<p><p>Patient safety event (PSE) reports, which document incidents that compromise patient safety, are fundamental for improving healthcare quality. Accurate classification of these reports is crucial for analyzing trends, guiding interventions, and supporting organizational learning. However, this process is labor-intensive due to the high volume and complex taxonomy of reports. Previous work has shown that machine learning (ML) can automate PSE report classification; however, its success depends on large manually-labeled datasets. This study leverages Active Learning (AL) strategies with human expertise to streamline PSE-report labeling. We utilize pool-based AL sampling to selectively query reports for human annotation, developing a robust dataset for training ML classifiers. Our experiments demonstrate that AL significantly outperforms random sampling in accuracy across various text representations, reducing the need for labeled samples by 24% to 69%. Based on these findings, we suggest that incorporating AL strategies into PSE-report labeling can effectively reduce manual workload while maintaining high classification accuracy.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"465-472"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11655274/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142878921","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Christopher Holland, Grace Perry, Heather F Neyedli
{"title":"Calibrating Trust, Reliance and Dependence in Variable-Reliability Automation.","authors":"Christopher Holland, Grace Perry, Heather F Neyedli","doi":"10.1177/10711813241277531","DOIUrl":"10.1177/10711813241277531","url":null,"abstract":"<p><p>Trust and system reliability can influence a user's dependence on automated systems. This study aimed to investigate how increases and decreases in automation reliability affect users' trust in these systems and how these changes in trust are associated with users' dependence on the system. Participants completed a color identification task with the help of an automated aid, where the reliability of this aid either increased from 50% to 100% or decreased from 100% to 50% as the task progressed, depending on which group the participants were assigned to. Participants' trust, self-confidence, and dependence on the system were measured throughout the experiment. There were no differences in trust between the two groups throughout the experiment; however, participants' dependence behavior did follow system reliability. These findings highlight that trust is not always correlated with system reliability, and that although trust can often influence dependence, it does not always determine it.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"604-610"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11655268/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142878920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploring Collaborative Patterns in Neurodiverse Teams: A Hidden Markov Model Approach Using Physiological Signals.","authors":"Sunwook Kim, Manhua Wang, Megan Fok, Caroline Byrd Hornburg, Myounghoon Jeon, Angela Scarpa","doi":"10.1177/10711813241260680","DOIUrl":"10.1177/10711813241260680","url":null,"abstract":"<p><p>Autistic individuals face challenges in successful employment, emphasizing the need for targeted workplace support. This study explored collaborative dynamics within neurodiverse teams during a simulated remote work task by applying Hidden Markov Models (HMMs) to heart rate data. Eighteen participants formed nine dyads: six nonautistic (NA-NA) pairs and three autistic-non-autistic (ASD-NA) pairs. Dyads completed two trials of a collaborative programming task over Zoom, alternating roles between trials. Heart rate data were collected, segmented, and transformed to extract features reflecting participants' interactions. The final HMM was fitted with seven hidden states, and transition probabilities were derived for each dyad type. Results showed that NA-NA dyads exhibited more frequent transitions among states compared to ASD-NA dyads, potentially suggesting more varied interaction patterns. These findings demonstrate the utility of HMMs in capturing collaborative behaviors through physiological signals and highlight their potential in helping develop effective support strategies for neurodiverse teams.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"137-138"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12273867/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144676802","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hanna J Barton, Apoorva Maru, Olivia Lin, Margaret A Leaf, Daniel J Hekman, Douglas A Wiegmann, Manish N Shah, Brian W Patterson
{"title":"Considerations for Developing Patient-centered Clinical Decision Support: Preventing Older Adult Falls after Emergency Department Visits.","authors":"Hanna J Barton, Apoorva Maru, Olivia Lin, Margaret A Leaf, Daniel J Hekman, Douglas A Wiegmann, Manish N Shah, Brian W Patterson","doi":"10.1177/10711813241275504","DOIUrl":"10.1177/10711813241275504","url":null,"abstract":"<p><p>To support the ongoing adaptation and implementation of an Emergency Department (ED)-based clinical decision support (CDS) tool to prevent future falls, we interviewed older adults (n=15) during their ED stay. We elicited their feedback on the written and verbal content of the existing CDS, feelings about the automated risk-screening aspect of the CDS and asked them to identify barriers that would prevent them from following up with the Falls Clinic to which the CDS supports referral placements. Our findings suggest that the older adults interviewed saw the CDS simply as another tool that they trusted their ED physician/APP to interact with. The identified barriers to follow-up reflect common access barriers such as transportation availability and clinic distance. For CDS tools to impact real-life patient outcomes, we must consider patient's needs and limitations and appropriately match interventions.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"553-556"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12212639/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144546512","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploring the Relationship Between Drivers' Stationary Gaze Entropy and Situation Awareness in a Level-3 Automation Driving Simulation.","authors":"Wen Ding, Yovela Murzello, Shi Cao, Siby Samuel","doi":"10.1177/10711813241275910","DOIUrl":"10.1177/10711813241275910","url":null,"abstract":"<p><p>The transition period from automation to manual, known as the takeover process, presents challenges for drivers due to the deficiency in collecting requisite contextual information. The current study collected drivers' eye movement in a simulated takeover experiment, and their Situation Awareness (SA) was assessed using the Situation Awareness Global Assessment Technique (SAGAT) method. The drivers' Stationary Gaze Entropy (SGE) was calculated based on the percentages of time they spent on six pre-defined Areas of Interests (AOIs). Three critical time windows were extracted by using the takeover alert time spot and the hazard perceived time spot. The result indicated that drivers with higher SAGAT scores would spread their attention among multiple AOIs. Also, drivers' SGE and SA have a linear relationship only at the last time window (hazard perceived to the end) wherein SGE potentially functions as an evaluative metric for assessing SA in the future.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"879-884"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11655270/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142879000","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Manhua Wang, Megan Fok, Jisun Kim, Victoria Izaac, Caroline Byrd Hornburg, Angela Scarpa, Myounghoon Jeon, Sunwook Kim
{"title":"Exploring Neurodiverse Collaboration Between Autistic and Non-autistic Adults in an Online Setting: A Pilot Study.","authors":"Manhua Wang, Megan Fok, Jisun Kim, Victoria Izaac, Caroline Byrd Hornburg, Angela Scarpa, Myounghoon Jeon, Sunwook Kim","doi":"10.1177/10711813241260310","DOIUrl":"10.1177/10711813241260310","url":null,"abstract":"<p><p>Employment is an important aspect of independent adulthood, yet autistic adults typically face substantial barriers in the labor market, including high rates of un- and under-employment. To promote an inclusive workplace, the present study explored collaboration dynamics between autistic and non-autistic adults as they worked toward shared team goals in an online setting. We recruited nine dyads, including three dyads of non-autistic adults with an autistic adult (NA-AA), and six dyads of non-autistic adults (NA-NA). Our findings demonstrated that neurodiverse collaboration (autistic and non-autistic adults together) could lead to improved task efficiency at the group level and higher perceived team performance in individuals. However, in these collaborative settings, autistic adults reported higher levels of depression, anxiety, and stress compared to their non-autistic partners. Our findings demonstrate the unique contributions that autistic adults may bring into the workplace and highlight the need to develop workplace technologies supporting their collaborative experiences.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"611-612"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12273868/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144676803","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yining Elena Zhang, Jing Chen, Liang Sun, Bin Hu, Michael S Politowicz, Eric T Chancey
{"title":"Task-Allocation Decisions of Human-UAS Collaboration: Effects of Workload, Trust, and Self-confidence.","authors":"Yining Elena Zhang, Jing Chen, Liang Sun, Bin Hu, Michael S Politowicz, Eric T Chancey","doi":"10.1177/10711813241274652","DOIUrl":"10.1177/10711813241274652","url":null,"abstract":"<p><p>Uncrewed Aerial Systems (UAS) show promise in urban air transport, package delivery, and emergency services. UAS efficiency can be significantly improved by having multiple operators (<i>m</i>) managing a greater number of vehicles (<i>N</i>), or the <i>m:N</i> architecture of operation. The current study investigates how workload affects operators' task-allocation decision-making and the potential mediating effects of two crucial human factors, trust and self-confidence. In the context of a simulated UAS package-delivery task under the <i>m:N</i> architecture, two groups of participants with different levels of expertise in UAS operation will be recruited: UAS pilots and university students. Each participant will watch two sets of videos with different work-load manipulations and report their preferred task-allocation strategy for various subtasks. Measures of perceived workload, trust, and self-confidence will be conducted after each video session. Findings will inform optimizing task-allocation designs for UAS missions, considering operators' decision-making needs and expertise disparities.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"841-842"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11655267/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142879007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Torsten Bohn, Volker Böhm, Joanna Dulińska-Litewka, Jean-Francois Landrier, Diána Bánáti, Omer Kucuk, Patrick Borel, Jose A Canas, Ralph Rühl
{"title":"Is vitamin A an antioxidant?","authors":"Torsten Bohn, Volker Böhm, Joanna Dulińska-Litewka, Jean-Francois Landrier, Diána Bánáti, Omer Kucuk, Patrick Borel, Jose A Canas, Ralph Rühl","doi":"10.1024/0300-9831/a000752","DOIUrl":"10.1024/0300-9831/a000752","url":null,"abstract":"","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"56 1","pages":"481-482"},"PeriodicalIF":0.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87331446","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Investigating Human Physiological Responses to Work-Related Stress","authors":"Jimmy Uba, Joseph Nuamah","doi":"10.1177/21695067231192596","DOIUrl":"https://doi.org/10.1177/21695067231192596","url":null,"abstract":"Studies have shown that work-related stress is one of the causes of employee burnout, fatigue, and cognitive dysfunction, among other negative effects. Physiological features have been used to investigate stress, but more knowledge is needed in understanding physiological indicators of work-related stress. Moreover, to the best of our knowledge, no study is available that integrates both pupillometry and heart rate in investigating work-related stress. We, therefore, utilized task-evoked pupillary response (TEPR) from pupillometry and heart rate (HR), in the assessment of physiological responses of 32 subjects during the performance of Multi-Attribute Task Battery-II consisting of working baseline and stress conditions. A comparison of results of both conditions showed that TEPR and mean HR significantly increased during stress condition, as compared to working baseline condition. These results are attributed to the work related-stressors integrated in our study, thereby bolstering the applicability of heart rate and pupillometry in studies of work-related stress.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"56 8","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135539558","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Katherine R. Garcia, Jeremiah Ammons, Xiangrui Xu, Jing Chen
{"title":"Phishing in Social Media: Investigating Training Techniques on Instagram Shop","authors":"Katherine R. Garcia, Jeremiah Ammons, Xiangrui Xu, Jing Chen","doi":"10.1177/21695067231192588","DOIUrl":"https://doi.org/10.1177/21695067231192588","url":null,"abstract":"As new communication technologies emerge, social media continues to grow rapidly and falls into users' hands. However, social media also brings new forms of phishing attacks compared to conventional email phishing and desires new forms of anti-phishing intervention including user training. To tackle this problem, we investigated the efficacy of current email training techniques for phishing scams on Instagram Shop advertisements. Participants were tasked to rate how likely they would recommend an office product in Instagram Shop to their boss based on how legitimate the advertisement (ad) appeared. Our results indicated that shoppers’ experience with Instagram influenced their ability to distinguish between phishing and legitimate ads. However, more-frequent Instagram users did not have a decreased susceptibility to phishing than less-frequent users, and the current training techniques had no effect on participants’ ratings of phishing and legitimate ads. Future studies may explore other training methods, such as including feedback to participants.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"74 9","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135539698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}