Christer Ahlström, K. Kircher, M. Nyström, Benjamin Wolfe
{"title":"Eye Tracking in Driver Attention Research—How Gaze Data Interpretations Influence What We Learn","authors":"Christer Ahlström, K. Kircher, M. Nyström, Benjamin Wolfe","doi":"10.3389/fnrgo.2021.778043","DOIUrl":"https://doi.org/10.3389/fnrgo.2021.778043","url":null,"abstract":"Eye tracking (ET) has been used extensively in driver attention research. Amongst other findings, ET data have increased our knowledge about what drivers look at in different traffic environments and how they distribute their glances when interacting with non-driving related tasks. Eye tracking is also the go-to method when determining driver distraction via glance target classification. At the same time, eye trackers are limited in the sense that they can only objectively measure the gaze direction. To learn more about why drivers look where they do, what information they acquire foveally and peripherally, how the road environment and traffic situation affect their behavior, and how their own expertise influences their actions, it is necessary to go beyond counting the targets that the driver foveates. In this perspective paper, we suggest a glance analysis approach that classifies glances based on their purpose. The main idea is to consider not only the intention behind each glance, but to also account for what is relevant in the surrounding scene, regardless of whether the driver has looked there or not. In essence, the old approaches, unaware as they are of the larger context or motivation behind eye movements, have taken us as far as they can. We propose this more integrative approach to gain a better understanding of the complexity of drivers' informational needs and how they satisfy them in the moment.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130447935","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Hybrid Systems to Boost EEG-Based Real-Time Action Decoding in Car Driving Scenarios","authors":"G. Vecchiato","doi":"10.3389/fnrgo.2021.784827","DOIUrl":"https://doi.org/10.3389/fnrgo.2021.784827","url":null,"abstract":"The complexity of concurrent cerebral processes underlying driving makes such human behavior one of the most studied real-world activities in neuroergonomics. Several attempts have been made to decode, both offline and online, cerebral activity during car driving with the ultimate goal to develop brain-based systems for assistive devices. Electroencephalography (EEG) is the cornerstone of these studies providing the highest temporal resolution to track those cerebral processes underlying overt behavior. Particularly when investigating real-world scenarios as driving, EEG is constrained by factors such as robustness, comfortability, and high data variability affecting the decoding performance. Hence, additional peripheral signals can be combined with EEG for increasing replicability and the overall performance of the brain-based action decoder. In this regard, hybrid systems have been proposed for the detection of braking and steering actions in driving scenarios to improve the predictive power of the single neurophysiological measurement. These recent results represent a proof of concept of the level of technological maturity. They may pave the way for increasing the predictive power of peripheral signals, such as electroculogram (EOG) and electromyography (EMG), collected in real-world scenarios when informed by EEG measurements, even if collected only offline in standard laboratory settings. The promising usability of such hybrid systems should be further investigated in other domains of neuroergonomics.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127616263","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kazue Hirabayashi, Tatsuya Tokuda, Tomomi Nishinuma, Keith Kawabata Duncan, K. Tagai, I. Dan
{"title":"A Willingness-to-Pay Associated Right Prefrontal Activation During a Single, Real Use of Lipsticks as Assessed Using Functional Near-Infrared Spectroscopy","authors":"Kazue Hirabayashi, Tatsuya Tokuda, Tomomi Nishinuma, Keith Kawabata Duncan, K. Tagai, I. Dan","doi":"10.3389/fnrgo.2021.731160","DOIUrl":"https://doi.org/10.3389/fnrgo.2021.731160","url":null,"abstract":"Understanding consumer preferences and behavior is a major goal of consumer-oriented companies. The application of neuroscience to this goal is a promising avenue for companies. Previously, we observed a positive correlation during actual cosmetic use between the right dorsolateral prefrontal cortex (dlPFC) activity, measured by functional near-infrared spectroscopy (fNIRS), and the associated willingness-to-pay (WTP) values. However, we were unable to find any consistent group differences in the right dlPFC between different powdery foundations. Thus, the main objective of this study was to replicate the previous study and in addition, we aimed to refine the method of the previous study to increase the chance that a difference in valuation between different products can be detected. Twenty-five frequent lipstick using females were asked to apply six different lipsticks to their lips and to record how much they were willing to pay. To maximize the variation of the subjective experience of the products and the associated brain activity, the most preferred color lipstick and a less preferred color lipstick were chosen for each participant, and each color of lipstick had three different textures (Lo, Mid, and Hi). The time series was analyzed with the general linear model (GLM) and the correlation between the right dlPFC beta scores for the lipsticks and their respective WTP values conducted for each participant. This revealed a significant positive correlation and replicated our previous study. Surprisingly, the lipstick color and the texture manipulations did not result in any consistent differences in WTP and similarly no consistent group differences in brain activations. This study replicates our previous study extending it to a different type of cosmetic. The right dlPFC activity during the use of cosmetics may be a potential brain-based personalization or product selection process biomarker.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"231 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122390008","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Risk Assessment by a Passenger of an Autonomous Vehicle Among Pedestrians: Relationship Between Subjective and Physiological Measures","authors":"Jeffery Petit, Camilo Charron, F. Mars","doi":"10.3389/fnrgo.2021.682119","DOIUrl":"https://doi.org/10.3389/fnrgo.2021.682119","url":null,"abstract":"Autonomous navigation becomes complex when it is performed in an environment that lacks road signs and includes a variety of users, including vulnerable pedestrians. This article deals with the perception of collision risk from the viewpoint of a passenger sitting in the driver's seat who has delegated the total control of their vehicle to an autonomous system. The proposed study is based on an experiment that used a fixed-base driving simulator. The study was conducted using a group of 20 volunteer participants. Scenarios were developed to simulate avoidance manoeuvres that involved pedestrians walking at 4.5 kph and an autonomous vehicle that was otherwise driving in a straight line at 30 kph. The main objective was to compare two systems of risk perception: These included subjective risk assessments obtained with an analogue handset provided to the participants and electrodermal activity (EDA) that was measured using skin conductance sensors. The relationship between these two types of measures, which possibly relates to the two systems of risk perception, is not unequivocally described in the literature. This experiment addresses this relationship by manipulating two factors: The time-to-collision (TTC) at the initiation of a pedestrian avoidance manoeuvre and the lateral offset left between a vehicle and a pedestrian. These manipulations of vehicle dynamics made it possible to simulate different safety margins regarding pedestrians during avoidance manoeuvres. The conditional dependencies between the two systems and the manipulated factors were studied using hybrid Bayesian networks. This relationship was inferred by selecting the best Bayesian network structure based on the Bayesian information criterion. The results demonstrate that the reduction of safety margins increases risk perception according to both types of indicators. However, the increase in subjective risk is more pronounced than the physiological response. While the indicators cannot be considered redundant, data modeling suggests that the two risk perception systems are not independent.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"96 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126071479","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
R. Fredriksson, M. Lenné, Sjef van Montfort, C. Grover
{"title":"European NCAP Program Developments to Address Driver Distraction, Drowsiness and Sudden Sickness","authors":"R. Fredriksson, M. Lenné, Sjef van Montfort, C. Grover","doi":"10.3389/fnrgo.2021.786674","DOIUrl":"https://doi.org/10.3389/fnrgo.2021.786674","url":null,"abstract":"Driver distraction and drowsiness remain significant contributors to death and serious injury on our roads and are long standing issues in road safety strategies around the world. With developments in automotive technology, including driver monitoring, there are now more options available for automotive manufactures to mitigate risks associated with driver state. Such developments in Occupant Status Monitoring (OSM) are being incorporated into the European New Car Assessment Programme (Euro NCAP) Safety Assist protocols. The requirements for OSM technologies are discussed along two dimensions: detection difficulty and behavioral complexity. More capable solutions will be able to provide higher levels of system availability, being the proportion of time a system could provide protection to the driver, and will be able to capture a greater proportion of complex real-word driver behavior. The testing approach could initially propose testing using both a dossier of evidence provided by the Original Equipment Manufacturer (OEM) alongside selected use of track testing. More capable systems will not rely only on warning strategies but will also include intervention strategies when a driver is not attentive. The roadmap for future OSM protocol development could consider a range of known and emerging safety risks including driving while intoxicated by alcohol or drugs, cognitive distraction, and the driver engagement requirements for supervision and take-over performance with assisted and automated driving features.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"46 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131688569","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Yusupova, D. Shved, V. Gushin, A. Chekalina, N. Supolkina
{"title":"Style Features in Communication of the Crews With Mission Control","authors":"A. Yusupova, D. Shved, V. Gushin, A. Chekalina, N. Supolkina","doi":"10.3389/fnrgo.2021.768386","DOIUrl":"https://doi.org/10.3389/fnrgo.2021.768386","url":null,"abstract":"In “Content,” an International Space Station (ISS) Russian segment space experiment, features of communication between the cosmonauts and the Mission Control Center (MCC) were studied using content analysis. The method is based on the concept of stress copings by Lazarus and Folkman. Differences found in the communication of cosmonauts led to assumptions about the existence of individual communication styles in routine communication between the cosmonauts and the MCC. The differences found were defined using V. Satir's classical model of communication types. The pre-dominance of three main communication styles (“computing,” “blaming,” and “placating,” as per Satir) was found. Manifestations and features of styles are discussed, considering the effectiveness of the “computing” style for ISS-MCC communication. Cosmonauts with a pre-dominance of this communication style, mostly are stable and with good self-control. An increase of the “blaming” and the “placating” style features in the communication of cosmonauts may require adaptation of the MCC communication and additional psychological support for the cosmonauts.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130912579","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ioana Susnoschi Luca, F. Putri, Hao Ding, A. Vučković
{"title":"Brain Synchrony in Competition and Collaboration During Multiuser Neurofeedback-Based Gaming","authors":"Ioana Susnoschi Luca, F. Putri, Hao Ding, A. Vučković","doi":"10.3389/fnrgo.2021.749009","DOIUrl":"https://doi.org/10.3389/fnrgo.2021.749009","url":null,"abstract":"EEG hyperscanning during multiuser gaming offers opportunities to study brain characteristics of social interaction under various paradigms. In this study, we aimed to characterize neural signatures and phase-based functional connectivity patterns of gaming strategies during collaborative and competitive alpha neurofeedback games. Twenty pairs of participants with no close relationship took part in three sessions of collaborative or competitive multiuser neurofeedback (NF), with identical graphical user interface, using Relative Alpha (RA) power as a control signal. Collaborating dyads had to keep their RA within 5% of each other for the team to be awarded a point, while members of competitive dyads scored points if their RA was 10% above their opponent's. Interbrain synchrony existed only during gaming but not during baseline in either collaborative or competitive gaming. Spectral analysis and interbrain connectivity showed that in collaborative gaming, players with higher resting state alpha content were more active in regulating their RA to match those of their partner. Moreover, interconnectivity was the strongest between homologous brain structures of the dyad in theta and alpha bands, indicating a similar degree of planning and social exchange. Competitive gaming emphasized the difference between participants who were able to relax and, in this way, maintain RA, and those who had an unsuccessful approach. Analysis of interbrain connections shows engagement of frontal areas in losers, but not in winners, indicating the formers' attempt to mentalise and apply strategies that might be suitable for conventional gaming, but inappropriate for the alpha neurofeedback-based game. We show that in gaming based on multiplayer non-verbalized NF, the winning strategy is dependent on the rules of the game and on the behavior of the opponent. Mental strategies that characterize successful gaming in the physical world might not be adequate for NF-based gaming.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"192 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129253824","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Benchmarking cEEGrid and Solid Gel-Based Electrodes to Classify Inattentional Deafness in a Flight Simulator","authors":"B. Somon, Yasmina Giebeler, L. Darmet, F. Dehais","doi":"10.3389/fnrgo.2021.802486","DOIUrl":"https://doi.org/10.3389/fnrgo.2021.802486","url":null,"abstract":"Transfer from experiments in the laboratory to real-life tasks is challenging due notably to the inability to reproduce the complexity of multitasking dynamic everyday life situations in a standardized lab condition and to the bulkiness and invasiveness of recording systems preventing participants from moving freely and disturbing the environment. In this study, we used a motion flight simulator to induce inattentional deafness to auditory alarms, a cognitive difficulty arising in complex environments. In addition, we assessed the possibility of two low-density EEG systems a solid gel-based electrode Enobio (Neuroelectrics, Barcelona, Spain) and a gel-based cEEGrid (TMSi, Oldenzaal, Netherlands) to record and classify brain activity associated with inattentional deafness (misses vs. hits to odd sounds) with a small pool of expert participants. In addition to inducing inattentional deafness (missing auditory alarms) at much higher rates than with usual lab tasks (34.7% compared to the usual 5%), we observed typical inattentional deafness-related activity in the time domain but also in the frequency and time-frequency domains with both systems. Finally, a classifier based on Riemannian Geometry principles allowed us to obtain more than 70% of single-trial classification accuracy for both mobile EEG, and up to 71.5% for the cEEGrid (TMSi, Oldenzaal, Netherlands). These results open promising avenues toward detecting cognitive failures in real-life situations, such as real flight.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127605986","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Inattention and Uncertainty in the Predictive Brain","authors":"T. Kujala, O. Lappi","doi":"10.3389/fnrgo.2021.718699","DOIUrl":"https://doi.org/10.3389/fnrgo.2021.718699","url":null,"abstract":"Negative effects of inattention on task performance can be seen in many contexts of society and human behavior, such as traffic, work, and sports. In traffic, inattention is one of the most frequently cited causal factors in accidents. In order to identify inattention and mitigate its negative effects, there is a need for quantifying attentional demands of dynamic tasks, with a credible basis in cognitive modeling and neuroscience. Recent developments in cognitive science have led to theories of cognition suggesting that brains are an advanced prediction engine. The function of this prediction engine is to support perception and action by continuously matching incoming sensory input with top-down predictions of the input, generated by hierarchical models of the statistical regularities and causal relationships in the world. Based on the capacity of this predictive processing framework to explain various mental phenomena and neural data, we suggest it also provides a plausible theoretical and neural basis for modeling attentional demand and attentional capacity “in the wild” in terms of uncertainty and prediction error. We outline a predictive processing approach to the study of attentional demand and inattention in driving, based on neurologically-inspired theories of uncertainty processing and experimental research combining brain imaging, visual occlusion and computational modeling. A proper understanding of uncertainty processing would enable comparison of driver's uncertainty to a normative level of appropriate uncertainty, and thereby improve definition and detection of inattentive driving. This is the necessary first step toward applications such as attention monitoring systems for conventional and semi-automated driving.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129122904","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Stephan Getzmann, J. Reiser, Melanie Karthaus, G. Rudinger, E. Wascher
{"title":"Measuring Correlates of Mental Workload During Simulated Driving Using cEEGrid Electrodes: A Test–Retest Reliability Analysis","authors":"Stephan Getzmann, J. Reiser, Melanie Karthaus, G. Rudinger, E. Wascher","doi":"10.3389/fnrgo.2021.729197","DOIUrl":"https://doi.org/10.3389/fnrgo.2021.729197","url":null,"abstract":"The EEG reflects mental processes, especially modulations in the alpha and theta frequency bands are associated with attention and the allocation of mental resources. EEG has also been used to study mental processes while driving, both in real environments and in virtual reality. However, conventional EEG methods are of limited use outside of controlled laboratory settings. While modern EEG technologies offer hardly any restrictions for the user, they often still have limitations in measurement reliability. We recently showed that low-density EEG methods using film-based round the ear electrodes (cEEGrids) are well-suited to map mental processes while driving a car in a driving simulator. In the present follow-up study, we explored aspects of ecological and internal validity of the cEEGrid measurements. We analyzed longitudinal data of 127 adults, who drove the same driving course in a virtual environment twice at intervals of 12–15 months while the EEG was recorded. Modulations in the alpha and theta frequency bands as well as within behavioral parameters (driving speed and steering wheel angular velocity) which were highly consistent over the two measurement time points were found to reflect the complexity of the driving task. At the intraindividual level, small to moderate (albeit significant) correlations were observed in about 2/3 of the participants, while other participants showed significant deviations between the two measurements. Thus, the test-retest reliability at the intra-individual level was rather low and challenges the value of the application for diagnostic purposes. However, across all participants the reliability and ecological validity of cEEGrid electrodes were satisfactory in the context of driving-related parameters.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"192 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129269949","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}