Human FactorsPub Date : 2024-07-01Epub Date: 2023-07-17DOI: 10.1177/00187208231189000
Gene M Alarcon, August Capiola, Michael A Lee, Sasha Willis, Izz Aldin Hamdan, Sarah A Jessup, Krista N Harris
{"title":"Development and Validation of the System Trustworthiness Scale.","authors":"Gene M Alarcon, August Capiola, Michael A Lee, Sasha Willis, Izz Aldin Hamdan, Sarah A Jessup, Krista N Harris","doi":"10.1177/00187208231189000","DOIUrl":"10.1177/00187208231189000","url":null,"abstract":"<p><strong>Objective: </strong>We created and validated a scale to measure perceptions of system trustworthiness.</p><p><strong>Background: </strong>Several scales exist in the literature that attempt to assess trustworthiness of system referents. However, existing measures suffer from limitations in their development and validation. The current study sought to develop a scale based on theory and methodological rigor.</p><p><strong>Method: </strong>We conducted exploratory and confirmatory factor analyses on data from two online studies to develop the System Trustworthiness Scale (STS). Additional analyses explored the manipulation of the factors and assessed convergent and divergent validity.</p><p><strong>Results: </strong>The exploratory factor analyses resulted in a three-factor solution that represented the theoretical constructs of trustworthiness: performance, purpose, and process. Confirmatory factor analyses confirmed the three-factor solution. In addition, correlation and regression analyses demonstrated the scale's divergent and predictive validity.</p><p><strong>Conclusion: </strong>The STS is a psychometrically valid and predictive scale for assessing trustworthiness perceptions of system referents.</p><p><strong>Applications: </strong>The STS assesses trustworthiness perceptions of systems. Importantly, the scale differentiates performance, purpose, and process constructs and is adaptable to a variety of system referents.</p>","PeriodicalId":56333,"journal":{"name":"Human Factors","volume":" ","pages":"1893-1913"},"PeriodicalIF":2.9,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10185290","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Human FactorsPub Date : 2024-06-01Epub Date: 2023-05-22DOI: 10.1177/00187208231177574
Ziyang Xie, Lu Lu, Hanwen Wang, Bingyi Su, Yunan Liu, Xu Xu
{"title":"Improving Workers' Musculoskeletal Health During Human-Robot Collaboration Through Reinforcement Learning.","authors":"Ziyang Xie, Lu Lu, Hanwen Wang, Bingyi Su, Yunan Liu, Xu Xu","doi":"10.1177/00187208231177574","DOIUrl":"10.1177/00187208231177574","url":null,"abstract":"<p><strong>Objective: </strong>This study aims to improve workers' postures and thus reduce the risk of musculoskeletal disorders in human-robot collaboration by developing a novel model-free reinforcement learning method.</p><p><strong>Background: </strong>Human-robot collaboration has been a flourishing work configuration in recent years. Yet, it could lead to work-related musculoskeletal disorders if the collaborative tasks result in awkward postures for workers.</p><p><strong>Methods: </strong>The proposed approach follows two steps: first, a 3D human skeleton reconstruction method was adopted to calculate workers' continuous awkward posture (CAP) score; second, an online gradient-based reinforcement learning algorithm was designed to dynamically improve workers' CAP score by adjusting the positions and orientations of the robot end effector.</p><p><strong>Results: </strong>In an empirical experiment, the proposed approach can significantly improve the CAP scores of the participants during a human-robot collaboration task when compared with the scenarios where robot and participants worked together at a fixed position or at the individual elbow height. The questionnaire outcomes also showed that the working posture resulted from the proposed approach was preferred by the participants.</p><p><strong>Conclusion: </strong>The proposed model-free reinforcement learning method can learn the optimal worker postures without the need for specific biomechanical models. The data-driven nature of this method can make it adaptive to provide personalized optimal work posture.</p><p><strong>Application: </strong>The proposed method can be applied to improve the occupational safety in robot-implemented factories. Specifically, the personalized robot working positions and orientations can proactively reduce exposure to awkward postures that increase the risk of musculoskeletal disorders. The algorithm can also reactively protect workers by reducing the workload in specific joints.</p>","PeriodicalId":56333,"journal":{"name":"Human Factors","volume":" ","pages":"1754-1769"},"PeriodicalIF":2.9,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9509662","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Human FactorsPub Date : 2024-06-01Epub Date: 2023-03-22DOI: 10.1177/00187208231162449
Nancy J Cooke, Myke C Cohen, Walter C Fazio, Laura H Inderberg, Craig J Johnson, Glenn J Lematta, Matthew Peel, Aaron Teo
{"title":"From Teams to Teamness: Future Directions in the Science of Team Cognition.","authors":"Nancy J Cooke, Myke C Cohen, Walter C Fazio, Laura H Inderberg, Craig J Johnson, Glenn J Lematta, Matthew Peel, Aaron Teo","doi":"10.1177/00187208231162449","DOIUrl":"10.1177/00187208231162449","url":null,"abstract":"<p><strong>Objective: </strong>We review the current state-of-the-art in team cognition research, but more importantly describe the limitations of existing theories, laboratory paradigms, and measures considering the increasing complexities of modern teams and the study of team cognition.</p><p><strong>Background: </strong>Research on, and applications of, team cognition has led to theories, data, and measures over the last several decades.</p><p><strong>Method: </strong>This article is based on research questions generated in a spring 2022 seminar on team cognition at Arizona State University led by the first author.</p><p><strong>Results: </strong>Future research directions are proposed for extending the conceptualization of teams and team cognition by examining dimensions of teamness; extending laboratory paradigms to attain more realistic teaming, including nonhuman teammates; and advancing measures of team cognition in a direction such that data can be collected unobtrusively, in real time, and automatically.</p><p><strong>Conclusion: </strong>The future of team cognition is one of the new discoveries, new research paradigms, and new measures.</p><p><strong>Application: </strong>Extending the concepts of teams and team cognition can also extend the potential applications of these concepts.</p>","PeriodicalId":56333,"journal":{"name":"Human Factors","volume":" ","pages":"1669-1680"},"PeriodicalIF":2.9,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11044519/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9265442","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Human FactorsPub Date : 2024-06-01Epub Date: 2023-05-01DOI: 10.1177/00187208231167641
Curtis M Craig, Disi Tian, Nichole L Morris
{"title":"Task-Relevant Smartphone Messages Within Work Zones: A Driving Simulation Study.","authors":"Curtis M Craig, Disi Tian, Nichole L Morris","doi":"10.1177/00187208231167641","DOIUrl":"10.1177/00187208231167641","url":null,"abstract":"<p><strong>Objective: </strong>This study explored the impact of in-vehicle messages relative to roadside messages to alert drivers to events within a simulated work zone, in order to determine if these messages can improve driving performance within the work zone.</p><p><strong>Background: </strong>Safety risks in work zones are usually mitigated by design standards and clear signage to communicate work zone information to drivers. Due to distraction and other driving task demands, these signs are not always noticed by motorists, nor are they always followed when they are noticed.</p><p><strong>Method: </strong>The driving simulation tested drivers in two different types of work zones, shoulder work, and lane closure. Participants drove through these work zones three times, each with different messaging interfaces to communicate hazardous events to the driver. The interfaces included a roadside, portable changeable message sign, a smartphone presenting only auditory messages, and a smartphone presenting audio-visual messages.</p><p><strong>Results: </strong>There was significantly better driving performance on key metrics including lane deviation for the in-vehicle message conditions relative to the roadside signs. Furthermore, drivers directed visual attention toward the roadway for the in-vehicle message conditions relative to the roadside sign condition.</p><p><strong>Conclusion: </strong>The results indicate that in-vehicle messaging could provide benefits to primary task performance in driving if the message content is appropriately designed.</p><p><strong>Application: </strong>The findings provide support for a design framework to support in-vehicle communication to drivers approaching work zones and other environments to safely alert them to hazards.</p>","PeriodicalId":56333,"journal":{"name":"Human Factors","volume":" ","pages":"1786-1797"},"PeriodicalIF":2.9,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9747631","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Human FactorsPub Date : 2024-06-01Epub Date: 2023-03-14DOI: 10.1177/00187208231162453
Liam Kettle, Yi-Ching Lee
{"title":"User Experiences of Well-Being Chatbots.","authors":"Liam Kettle, Yi-Ching Lee","doi":"10.1177/00187208231162453","DOIUrl":"10.1177/00187208231162453","url":null,"abstract":"<p><strong>Objective: </strong>The current paper conducted two parallel studies to explore user experiences of well-being conversational agents (CAs) and identify important features for engagement.</p><p><strong>Background: </strong>Students transitioning into university life take on greater responsibility, yet tend to sacrifice healthy behaviors to strive for academic and financial gain. Additionally, students faced an unprecedented pandemic, leading to remote courses and reduced access to healthcare services. One tool designed to improve healthcare accessibility is well-being CAs. CAs have addressed mental health support in the general population but have yet to address physical well-being support and accessibility to those in disadvantaged socio-economic backgrounds where healthcare access is further limited.</p><p><strong>Method: </strong>Study One comprised a thematic analysis of mental health applications featuring CAs from the public forum, Reddit. Study Two explored emerging usability themes of an SMS-based CA designed to improve accessibility to well-being services alongside a commercially available CA, Woebot.</p><p><strong>Results: </strong>Study One identified several themes, including accessibility and availability, communication style, and anthropomorphism as important features. Study Two identified themes such as user response modality, perceived CA role, question specificity, and conversation flow control as critical for user engagement.</p><p><strong>Conclusion: </strong>Various themes emerged from individuals' experiences regarding CA features, functionality, and responses. The mixed experiences relevant to the communication and conversational styles between the CA and the user suggest varied motivations for using CAs for mental and physical well-being.</p><p><strong>Application: </strong>Practical recommendations to encourage continued use include providing dynamic response modalities, anthropomorphizing the chatbot, and calibrating expectations early.</p>","PeriodicalId":56333,"journal":{"name":"Human Factors","volume":" ","pages":"1703-1723"},"PeriodicalIF":2.9,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9456374","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Human FactorsPub Date : 2024-06-01Epub Date: 2023-03-28DOI: 10.1177/00187208231162448
P A Hancock
{"title":"Quintessential Solutions to Existential Problems: How Human Factors and Ergonomics Can and Should Address the Imminent Challenges of Our Times.","authors":"P A Hancock","doi":"10.1177/00187208231162448","DOIUrl":"10.1177/00187208231162448","url":null,"abstract":"<p><strong>Objective: </strong>To examine and evaluate ways in which an understanding of the quintessential element of Human Factors/Ergonomics can address the spectrum of existential threats that confront contemporary civilization.</p><p><strong>Background: </strong>HF/E is dedicated to improving quality of life. Paradoxically, many processes which sustain contemporary civilization act to reduce that overall quality. Some technological developments themselves now even present existential threats to the fragile skein of civilization itself. Many disciplines address these diverse threats, and each may be advised and facilitated by HF/E knowledge and methods. It is a moral imperative of our science to contribute what we can to proposed resolutions.</p><p><strong>Method: </strong>A primary conduit, by the established strengths of HF/E can contribute to potential solutions is identified. The present work advocates for specific, practical interventions using a direct-perception mediated, <i>panopticon principle,</i> that derives from the corpus of our science.</p><p><strong>Result: </strong>Limitations upon a general, social understanding of imminent global concerns, which are largely ignorable when not actually present, are brought to immediate consciousness via an HF/E principle emphasizing the direct-perception of threat. It is argued that this, and allied HF/E insights can generate practical steps toward problem resolution at both macroscopic and localized levels of implementation.</p><p><strong>Applications: </strong>The primary, practical application of the proposed panopticon principle is to use our science to save global civilization. It is postulated that this represents useful employment of the knowledge we have adduced and accumulated across our discipline's existence.</p>","PeriodicalId":56333,"journal":{"name":"Human Factors","volume":" ","pages":"1657-1668"},"PeriodicalIF":2.9,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9193096","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Predicting Fatigue-Associated Aberrant Driving Behaviors Using a Dynamic Weighted Moving Average Model With a Long Short-Term Memory Network Based on Heart Rate Variability.","authors":"Cheng-Yu Tsai, He-In Cheong, Robert Houghton, Wen-Hua Hsu, Kang-Yun Lee, Jiunn-Horng Kang, Yi-Chun Kuan, Hsin-Chien Lee, Cheng-Jung Wu, Lok-Yee Joyce Li, Yin-Tzu Lin, Shang-Yang Lin, Iulia Manole, Arnab Majumdar, Wen-Te Liu","doi":"10.1177/00187208231183874","DOIUrl":"10.1177/00187208231183874","url":null,"abstract":"<p><strong>Objective: </strong>This study proposed a moving average (MA) approach to dynamically process heart rate variability (HRV) and developed aberrant driving behavior (ADB) prediction models by using long short-term memory (LSTM) networks.</p><p><strong>Background: </strong>Fatigue-associated ADBs have traffic safety implications. Numerous models to predict such acts based on physiological responses have been developed but are still in embryonic stages.</p><p><strong>Method: </strong>This study recorded the data of 20 commercial bus drivers during their routine tasks on four consecutive days and subsequently asked them to complete questionnaires, including subjective sleep quality, driver behavior questionnaire and the Karolinska Sleepiness Scale. Driving behaviors and corresponding HRV were determined using a navigational mobile application and a wristwatch. The dynamic-weighted MA (DWMA) and exponential-weighted MA were used to process HRV in 5-min intervals. The data were independently separated for training and testing. Models were trained with 10-fold cross-validation strategy, their accuracies were evaluated, and Shapley additive explanation (SHAP) values were used to determine feature importance.</p><p><strong>Results: </strong>Significant increases in the standard deviation of NN intervals (SDNN), root mean square of successive heartbeat interval differences (RMSSD), and normalized spectrum of high frequency (nHF) were observed in the pre-event stage. The DWMA-based model exhibited the highest accuracy for both driver types (urban: 84.41%; highway: 80.56%). The SDNN, RMSSD, and nHF demonstrated relatively high SHAP values.</p><p><strong>Conclusion: </strong>HRV metrics can serve as indicators of mental fatigue. DWMA-based LSTM could predict the occurrence of the level of fatigue associated with ADBs.</p><p><strong>Application: </strong>The established models can be used in realistic driving scenarios.</p>","PeriodicalId":56333,"journal":{"name":"Human Factors","volume":" ","pages":"1681-1702"},"PeriodicalIF":2.9,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9690190","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Human FactorsPub Date : 2024-06-01Epub Date: 2023-05-01DOI: 10.1177/00187208231173263
Dawn M Sarno, Jeffrey Black
{"title":"Who Gets Caught in the Web of Lies?: Understanding Susceptibility to Phishing Emails, Fake News Headlines, and Scam Text Messages.","authors":"Dawn M Sarno, Jeffrey Black","doi":"10.1177/00187208231173263","DOIUrl":"10.1177/00187208231173263","url":null,"abstract":"<p><strong>Objective: </strong>The present study investigated if the same users are vulnerable to phishing emails, scam text messages, and fake news headlines and if there are universal predictors of susceptibility for all three tasks.</p><p><strong>Background: </strong>Theoretical research provides support for the notion that the same users likely fall for multiple forms of online deception. However, no research has directly compared susceptibility for various online deceptions (eg phishing, disinformation, scam text messages) within the same group of users.</p><p><strong>Method: </strong>Participants completed an online survey consisting of demographic questions, the Cognitive Reflection Test (ie impulsivity), and the Digital Literacy Scale, and classified 90 legitimate and deceptive emails, text messages, and news headlines.</p><p><strong>Results: </strong>Results suggest that individuals who struggle to discriminate between deceptive and legitimate stimuli on one task experience similar difficulties on the other two tasks. Additionally, while lower levels of digital literacy and cognitive reflectiveness predicted poorer discrimination abilities across all three tasks, age did not predict performance. Interestingly, participants appeared to be the most susceptible to phishing emails.</p><p><strong>Conclusion: </strong>Overall, individuals who fall for one form of online deception appear to be more likely to fall for other forms of deception, and digital literacy and cognitive reflectiveness can predict widespread vulnerability to online deception.</p><p><strong>Application: </strong>Organizations may be able to identify potential vulnerabilities for a variety of online attacks by measuring digital literacy, cognitive reflectiveness, and performance in one online deception task. Additionally, training interventions may be the most needed for phishing emails.</p>","PeriodicalId":56333,"journal":{"name":"Human Factors","volume":" ","pages":"1742-1753"},"PeriodicalIF":2.9,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9747630","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Human FactorsPub Date : 2024-06-01Epub Date: 2023-05-15DOI: 10.1177/00187208231168697
Scott Mishler, Jing Chen
{"title":"Boring But Demanding: Using Secondary Tasks to Counter the Driver Vigilance Decrement for Partially Automated Driving.","authors":"Scott Mishler, Jing Chen","doi":"10.1177/00187208231168697","DOIUrl":"10.1177/00187208231168697","url":null,"abstract":"<p><strong>Objective: </strong>We investigated secondary-task-based countermeasures to the vigilance decrement during a simulated partially automated driving (PAD) task, with the goal of understanding the underlying mechanism of the vigilance decrement and maintaining driver vigilance in PAD.</p><p><strong>Background: </strong>Partial driving automation requires a human driver to monitor the roadway, but humans are notoriously bad at monitoring tasks over long periods of time, demonstrating the vigilance decrement in such tasks. The overload explanations of the vigilance decrement predict the decrement to be worse with added secondary tasks due to increased task demands and depleted attentional resources, whereas the underload explanations predict the vigilance decrement to be alleviated with secondary tasks due to increased task engagement.</p><p><strong>Method: </strong>Participants watched a driving video simulating PAD and were required to identify hazardous vehicles throughout the 45-min drive. A total of 117 participants were assigned to three different vigilance-intervention conditions including a driving-related secondary task (DR) condition, a non-driving-related secondary task (NDR) condition, and a control condition with no secondary tasks.</p><p><strong>Results: </strong>Overall, the vigilance decrement was shown over time, reflected in increased response times, reduced hazard detection rates, reduced response sensitivity, shifted response criterion, and subjective reports on task-induced stress. Compared to the DR and the control conditions, the NDR displayed a mitigated vigilance decrement.</p><p><strong>Conclusion: </strong>This study provided convergent evidence for both resource depletion and disengagement as sources of the vigilance decrement.</p><p><strong>Application: </strong>The practical implication is that infrequent and intermittent breaks using a non-driving related task may help alleviate the vigilance decrement in PAD systems.</p>","PeriodicalId":56333,"journal":{"name":"Human Factors","volume":" ","pages":"1798-1811"},"PeriodicalIF":2.9,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11044522/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9856829","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Human FactorsPub Date : 2024-06-01Epub Date: 2023-04-28DOI: 10.1177/00187208231166624
Mengyao Li, Isabel M Erickson, Ernest V Cross, John D Lee
{"title":"It's Not Only What You Say, But Also How You Say It: Machine Learning Approach to Estimate Trust from Conversation.","authors":"Mengyao Li, Isabel M Erickson, Ernest V Cross, John D Lee","doi":"10.1177/00187208231166624","DOIUrl":"10.1177/00187208231166624","url":null,"abstract":"<p><strong>Objective: </strong>The objective of this study was to estimate trust from conversations using both lexical and acoustic data.</p><p><strong>Background: </strong>As NASA moves to long-duration space exploration operations, the increasing need for cooperation between humans and virtual agents requires real-time trust estimation by virtual agents. Measuring trust through conversation is a novel and unintrusive approach.</p><p><strong>Method: </strong>A 2 (reliability) × 2 (cycles) × 3 (events) within-subject study with habitat system maintenance was designed to elicit various levels of trust in a conversational agent. Participants had trust-related conversations with the conversational agent at the end of each decision-making task. To estimate trust, subjective trust ratings were predicted using machine learning models trained on three types of conversational features (i.e., lexical, acoustic, and combined). After training, model explanation was performed using variable importance and partial dependence plots.</p><p><strong>Results: </strong>Results showed that a random forest algorithm, trained using the combined lexical and acoustic features, predicted trust in the conversational agent most accurately <math><mrow><mo>(</mo><mrow><msubsup><mi>R</mi><mrow><mi>a</mi><mi>d</mi><mi>j</mi></mrow><mn>2</mn></msubsup><mo>=</mo><mn>0.71</mn></mrow><mo>)</mo></mrow></math>. The most important predictors were a combination of lexical and acoustic cues: average sentiment considering valence shifters, the mean of formants, and Mel-frequency cepstral coefficients (MFCC). These conversational features were identified as partial mediators predicting people's trust.</p><p><strong>Conclusion: </strong>Precise trust estimation from conversation requires lexical cues and acoustic cues.</p><p><strong>Application: </strong>These results showed the possibility of using conversational data to measure trust, and potentially other dynamic mental states, unobtrusively and dynamically.</p>","PeriodicalId":56333,"journal":{"name":"Human Factors","volume":" ","pages":"1724-1741"},"PeriodicalIF":2.9,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11044523/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9714812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}