{"title":"Evaluating Active Learning Strategies for Automated Classification of Patient Safety Event Reports in Hospitals.","authors":"Shehnaz Islam, Myrtede Alfred, Dulaney Wilson, Eldan Cohen","doi":"10.1177/10711813241260676","DOIUrl":"10.1177/10711813241260676","url":null,"abstract":"<p><p>Patient safety event (PSE) reports, which document incidents that compromise patient safety, are fundamental for improving healthcare quality. Accurate classification of these reports is crucial for analyzing trends, guiding interventions, and supporting organizational learning. However, this process is labor-intensive due to the high volume and complex taxonomy of reports. Previous work has shown that machine learning (ML) can automate PSE report classification; however, its success depends on large manually-labeled datasets. This study leverages Active Learning (AL) strategies with human expertise to streamline PSE-report labeling. We utilize pool-based AL sampling to selectively query reports for human annotation, developing a robust dataset for training ML classifiers. Our experiments demonstrate that AL significantly outperforms random sampling in accuracy across various text representations, reducing the need for labeled samples by 24% to 69%. Based on these findings, we suggest that incorporating AL strategies into PSE-report labeling can effectively reduce manual workload while maintaining high classification accuracy.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"465-472"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11655274/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142878921","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Christopher Holland, Grace Perry, Heather F Neyedli
{"title":"Calibrating Trust, Reliance and Dependence in Variable-Reliability Automation.","authors":"Christopher Holland, Grace Perry, Heather F Neyedli","doi":"10.1177/10711813241277531","DOIUrl":"10.1177/10711813241277531","url":null,"abstract":"<p><p>Trust and system reliability can influence a user's dependence on automated systems. This study aimed to investigate how increases and decreases in automation reliability affect users' trust in these systems and how these changes in trust are associated with users' dependence on the system. Participants completed a color identification task with the help of an automated aid, where the reliability of this aid either increased from 50% to 100% or decreased from 100% to 50% as the task progressed, depending on which group the participants were assigned to. Participants' trust, self-confidence, and dependence on the system were measured throughout the experiment. There were no differences in trust between the two groups throughout the experiment; however, participants' dependence behavior did follow system reliability. These findings highlight that trust is not always correlated with system reliability, and that although trust can often influence dependence, it does not always determine it.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"604-610"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11655268/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142878920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploring the Relationship Between Drivers' Stationary Gaze Entropy and Situation Awareness in a Level-3 Automation Driving Simulation.","authors":"Wen Ding, Yovela Murzello, Shi Cao, Siby Samuel","doi":"10.1177/10711813241275910","DOIUrl":"10.1177/10711813241275910","url":null,"abstract":"<p><p>The transition period from automation to manual, known as the takeover process, presents challenges for drivers due to the deficiency in collecting requisite contextual information. The current study collected drivers' eye movement in a simulated takeover experiment, and their Situation Awareness (SA) was assessed using the Situation Awareness Global Assessment Technique (SAGAT) method. The drivers' Stationary Gaze Entropy (SGE) was calculated based on the percentages of time they spent on six pre-defined Areas of Interests (AOIs). Three critical time windows were extracted by using the takeover alert time spot and the hazard perceived time spot. The result indicated that drivers with higher SAGAT scores would spread their attention among multiple AOIs. Also, drivers' SGE and SA have a linear relationship only at the last time window (hazard perceived to the end) wherein SGE potentially functions as an evaluative metric for assessing SA in the future.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"879-884"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11655270/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142879000","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yining Elena Zhang, Jing Chen, Liang Sun, Bin Hu, Michael S Politowicz, Eric T Chancey
{"title":"Task-Allocation Decisions of Human-UAS Collaboration: Effects of Workload, Trust, and Self-confidence.","authors":"Yining Elena Zhang, Jing Chen, Liang Sun, Bin Hu, Michael S Politowicz, Eric T Chancey","doi":"10.1177/10711813241274652","DOIUrl":"10.1177/10711813241274652","url":null,"abstract":"<p><p>Uncrewed Aerial Systems (UAS) show promise in urban air transport, package delivery, and emergency services. UAS efficiency can be significantly improved by having multiple operators (<i>m</i>) managing a greater number of vehicles (<i>N</i>), or the <i>m:N</i> architecture of operation. The current study investigates how workload affects operators' task-allocation decision-making and the potential mediating effects of two crucial human factors, trust and self-confidence. In the context of a simulated UAS package-delivery task under the <i>m:N</i> architecture, two groups of participants with different levels of expertise in UAS operation will be recruited: UAS pilots and university students. Each participant will watch two sets of videos with different work-load manipulations and report their preferred task-allocation strategy for various subtasks. Measures of perceived workload, trust, and self-confidence will be conducted after each video session. Findings will inform optimizing task-allocation designs for UAS missions, considering operators' decision-making needs and expertise disparities.</p>","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"68 1","pages":"841-842"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11655267/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142879007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Torsten Bohn, Volker Böhm, Joanna Dulińska-Litewka, Jean-Francois Landrier, Diána Bánáti, Omer Kucuk, Patrick Borel, Jose A Canas, Ralph Rühl
{"title":"Is vitamin A an antioxidant?","authors":"Torsten Bohn, Volker Böhm, Joanna Dulińska-Litewka, Jean-Francois Landrier, Diána Bánáti, Omer Kucuk, Patrick Borel, Jose A Canas, Ralph Rühl","doi":"10.1024/0300-9831/a000752","DOIUrl":"10.1024/0300-9831/a000752","url":null,"abstract":"","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"56 1","pages":"481-482"},"PeriodicalIF":2.3,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87331446","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Investigating Human Physiological Responses to Work-Related Stress","authors":"Jimmy Uba, Joseph Nuamah","doi":"10.1177/21695067231192596","DOIUrl":"https://doi.org/10.1177/21695067231192596","url":null,"abstract":"Studies have shown that work-related stress is one of the causes of employee burnout, fatigue, and cognitive dysfunction, among other negative effects. Physiological features have been used to investigate stress, but more knowledge is needed in understanding physiological indicators of work-related stress. Moreover, to the best of our knowledge, no study is available that integrates both pupillometry and heart rate in investigating work-related stress. We, therefore, utilized task-evoked pupillary response (TEPR) from pupillometry and heart rate (HR), in the assessment of physiological responses of 32 subjects during the performance of Multi-Attribute Task Battery-II consisting of working baseline and stress conditions. A comparison of results of both conditions showed that TEPR and mean HR significantly increased during stress condition, as compared to working baseline condition. These results are attributed to the work related-stressors integrated in our study, thereby bolstering the applicability of heart rate and pupillometry in studies of work-related stress.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"56 8","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135539558","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Katherine R. Garcia, Jeremiah Ammons, Xiangrui Xu, Jing Chen
{"title":"Phishing in Social Media: Investigating Training Techniques on Instagram Shop","authors":"Katherine R. Garcia, Jeremiah Ammons, Xiangrui Xu, Jing Chen","doi":"10.1177/21695067231192588","DOIUrl":"https://doi.org/10.1177/21695067231192588","url":null,"abstract":"As new communication technologies emerge, social media continues to grow rapidly and falls into users' hands. However, social media also brings new forms of phishing attacks compared to conventional email phishing and desires new forms of anti-phishing intervention including user training. To tackle this problem, we investigated the efficacy of current email training techniques for phishing scams on Instagram Shop advertisements. Participants were tasked to rate how likely they would recommend an office product in Instagram Shop to their boss based on how legitimate the advertisement (ad) appeared. Our results indicated that shoppers’ experience with Instagram influenced their ability to distinguish between phishing and legitimate ads. However, more-frequent Instagram users did not have a decreased susceptibility to phishing than less-frequent users, and the current training techniques had no effect on participants’ ratings of phishing and legitimate ads. Future studies may explore other training methods, such as including feedback to participants.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"74 9","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135539698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jessica Williams, Rhyse Bendell, Stephen M. Fiore, Florian Jentsch
{"title":"Factor Analysis of a Generalized Video Game Experience Measure","authors":"Jessica Williams, Rhyse Bendell, Stephen M. Fiore, Florian Jentsch","doi":"10.1177/21695067231192224","DOIUrl":"https://doi.org/10.1177/21695067231192224","url":null,"abstract":"Video gaming experience has been found to impact behavior and performance on experimental tasks, can influence cognitive processes, and may even transfer to proficiency in novel tasks. There is a growing need for an empirically validated generalizable tool that can capture differences in participants gaming experience due to the growing representation of regular video gamers, and the proliferation of gamified, simulated task environments. The analyses reported here examine the factor loadings of a general Video Game Experience Measure (VGEM) designed to tap facets of gaming experience that can distinguish non-gamers from gamers and is also sensitive to varying levels of proficiency. Results from exploratory and confirmatory factor analyses find support for a five-factor model capturing: Game-skill Confidence, Gaming Lifespan, Gaming Intensity, Gaming Frequency, and Gamer Self-efficacy. These findings are discussed in the context of how the VGEM can support research using gamified task environments requiring the study of cognition and collaboration.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"60 7","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135539856","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Completion Rate Conundrum: Reducing bias in the Single Usability Metric","authors":"Carl J. Pearson","doi":"10.1177/21695067231194328","DOIUrl":"https://doi.org/10.1177/21695067231194328","url":null,"abstract":"In the Single Usability Metric benchmarking method, the calculation of completion rates creates a bias for completion rates by ignoring the z-score transform that is conducted for satisfaction and time-on-task measures. This artificially inflates all ‘good’ scores and marks some ‘poor’ scores as ‘good’. This paper discusses two methods to augment the SUM so that it will accurately calculate completion rates into the final SUM score.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"26 3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135272706","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Caterina B Azzarello, Dave B Miller, Ben D Sawyer, Joanna E Lewis
{"title":"Format Readability Enhancing In Basic Mathematical Operations","authors":"Caterina B Azzarello, Dave B Miller, Ben D Sawyer, Joanna E Lewis","doi":"10.1177/21695067231199682","DOIUrl":"https://doi.org/10.1177/21695067231199682","url":null,"abstract":"Individuated font selection, which can increase text reading speed, may be able to increase mathematical expression reading speed and influence reasoning accuracy. To investigate whether the same font that increases a participant’s reading speed enhances mathematical reading, we compared their speed in evaluating mathematical expressions as true or false presented in their fastest reading font as determined by empirical test and with a control font, Times Roman. Participants were faster in completing mathematical problems when using typography selected for individual readability, but no difference occurred in task accuracy, matching patterns previously seen in interlude reading. Future research should assess the impact of elements of time pressure, math complexity, numeric versus text-based questions, and associated math anxiety.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"26 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135272707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}