Nicolas J. Bourguignon, S. Bue, C. Guerrero-Mosquera, Guillermo Borragán
{"title":"Bimodal EEG-fNIRS in Neuroergonomics. Current Evidence and Prospects for Future Research","authors":"Nicolas J. Bourguignon, S. Bue, C. Guerrero-Mosquera, Guillermo Borragán","doi":"10.3389/fnrgo.2022.934234","DOIUrl":"https://doi.org/10.3389/fnrgo.2022.934234","url":null,"abstract":"Neuroergonomics focuses on the brain signatures and associated mental states underlying behavior to design human-machine interfaces enhancing performance in the cognitive and physical domains. Brain imaging techniques such as functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) have been considered key methods for achieving this goal. Recent research stresses the value of combining EEG and fNIRS in improving these interface systems' mental state decoding abilities, but little is known about whether these improvements generalize over different paradigms and methodologies, nor about the potentialities for using these systems in the real world. We review 33 studies comparing mental state decoding accuracy between bimodal EEG-fNIRS and unimodal EEG and fNIRS in several subdomains of neuroergonomics. In light of these studies, we also consider the challenges of exploiting wearable versions of these systems in real-world contexts. Overall the studies reviewed suggest that bimodal EEG-fNIRS outperforms unimodal EEG or fNIRS despite major differences in their conceptual and methodological aspects. Much work however remains to be done to reach practical applications of bimodal EEG-fNIRS in naturalistic conditions. We consider these points to identify aspects of bimodal EEG-fNIRS research in which progress is expected or desired.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"63 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114814465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Thomas A. Swain, Scott W. Snyder, Jr Gerald McGwin, C. Owsley
{"title":"Associations of visual functions with attitudes about motor vehicle dashboards among older drivers","authors":"Thomas A. Swain, Scott W. Snyder, Jr Gerald McGwin, C. Owsley","doi":"10.3389/fnrgo.2022.918781","DOIUrl":"https://doi.org/10.3389/fnrgo.2022.918781","url":null,"abstract":"Purpose Proper understanding and interaction with the dashboard is an essential aspect of safely operating a motor vehicle. A portion of this task is dependent on vision, yet no published information exists regarding dashboard ergonomics and visual function. This study sought to associate visual functions and person abilities of dashboard ergonomic dimensions relevant to older driver design preferences and attitudes. Methods In this population-based study of drivers, participants completed functional testing for habitual distance visual acuity, contrast sensitivity, visual field sensitivity, visual processing speed, and spatial ability. A questionnaire assessed attitudes and understanding of dashboard design, with questionnaire items generated from the content of focus groups of older drivers. Dashboard design domains identified in Rasch analysis of questionnaire responses were quantified using person ability measures for the cognitive processing, lighting, obstructions, and pattern recognition domains. Visual functions and person abilities were correlated using Spearman partial correlations, adjusting for age and sex. Results A total of 997 participants completed functional testing and the dashboard questionnaire. The mean age was 77.4 ± 4.6 years, and the majority were male (55%) and white (81%). The sample had a range of person abilities and visual functions. Contrast and visual field sensitivities were significantly associated with the cognitive processing, lighting, and pattern recognition dashboard design dimensions (p ≤ 0.0052). For all significant associations, increased visual function was indicative of better person ability. Visual processing speed, as measured by Trails B and UFOV2, was significantly associated with the lighting domain (p = 0.0008 and p = 0.0007, respectively). The UFOV2 measure was correlated with pattern recognition (p = 0.0165). Spatial ability was the only visual function associated with the visual obstruction dimension (p = 0.0347). Conclusions Person ability for dashboard design domains are related to visual function in older drivers. Results show person ability for domains increased with improved visual function. Future automotive engineering and design initiatives should consider these associations in improving dashboard designs to increase vehicle utility and accessibility.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125525044","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Sensorimotor impairments during spaceflight: Trigger mechanisms and haptic assistance","authors":"Bernhard M. Weber, Martin Stelzer","doi":"10.3389/fnrgo.2022.959894","DOIUrl":"https://doi.org/10.3389/fnrgo.2022.959894","url":null,"abstract":"In a few years, manned space missions are planned in which the sensorimotor performance of humans will be of outstanding importance. However, research has repeatedly shown that human sensorimotor function can be impaired under conditions of microgravity. One way to compensate for these impairments is haptic feedback provided by the human-machine interface. In the current series of studies, sensorimotor performance was measured in basic aiming and tracking tasks. These tasks had to be performed using a force feedback joystick with different haptic settings (three spring stiffnesses, two dampings, two virtual masses, and no haptics). In two terrestrial studies, we investigated (1) the effects of cognitive load on performance in a dual-task paradigm (N = 10) and (2) which learning effects can be expected in these tasks in a longitudinal study design (N = 20). In the subsequent space study (N = 3 astronauts), the influence of microgravity and haptic settings of the joystick were investigated. For this purpose, three mission sessions after 2, 4, and 6 weeks on board the International Space Station (ISS), as well as terrestrial pre- and post-flight sessions, were conducted. The results of the studies indicated that (1) additional cognitive load led to longer reaction times during aiming and increased tracking error while aiming precision was not affected. (2) Significant learning effects were evident for most measures in the study on time effects. (3) Contrary to the expected learning trend, microgravity impaired the aiming precision performance of all astronauts in the initial phase of adaptation (2 weeks in space). No other significant effects were found. Intriguingly, these performance decrements could be compensated for with low to medium spring stiffness and virtual mass. The general result pattern provides further evidence that distorted proprioception during early adaptation to microgravity conditions is one main mechanism underlying sensorimotor impairment.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115765157","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Systematic Review of Visualization Techniques and Analysis Tools for Eye-Tracking in 3D Environments","authors":"V. Sundstedt, V. Garro","doi":"10.3389/fnrgo.2022.910019","DOIUrl":"https://doi.org/10.3389/fnrgo.2022.910019","url":null,"abstract":"This systematic literature review presents an update on developments in 3D visualization techniques and analysis tools for eye movement data in 3D environments. With the introduction of affordable and non-intrusive eye-tracking solutions to the mass market, access to users' gaze is now increasingly possible. As a result, the adoption of eye-tracking in virtual environments using head-mounted displays is expected to increase since the trend is to incorporate gaze tracking as part of new technical solutions. The systematic literature review presented in this paper was conducted using the Scopus database (using the period 2017 to 17th of May 2022), which after analysis, resulted in the inclusion of 15 recent publications with relevance in eye-tracking visualization techniques for 3D virtual scenes. First, this paper briefly describes the foundations of eye-tracking and traditional 2D visualization techniques. As background, we also list earlier 3D eye-tracking visualization techniques identified in a previous review. Next, the systematic literature review presents the method used to acquire the included papers and a description of these in terms of eye-tracking technology, observed stimuli, application context, and type of 3D gaze visualization techniques. We then discuss the overall findings, including opportunities, challenges, trends, and present ideas for future directions. Overall the results show that eye-tracking in immersive virtual environments is on the rise and that more research and developments are needed to create novel and improved technical solutions for 3D gaze analysis.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116466767","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Abubshait, L. Parenti, J. Pérez-Osorio, A. Wykowska
{"title":"Misleading Robot Signals in a Classification Task Induce Cognitive Load as Measured by Theta Synchronization Between Frontal and Temporo-parietal Brain Regions","authors":"A. Abubshait, L. Parenti, J. Pérez-Osorio, A. Wykowska","doi":"10.3389/fnrgo.2022.838136","DOIUrl":"https://doi.org/10.3389/fnrgo.2022.838136","url":null,"abstract":"As technological advances progress, we find ourselves in situations where we need to collaborate with artificial agents (e.g., robots, autonomous machines and virtual agents). For example, autonomous machines will be part of search and rescue missions, space exploration and decision aids during monitoring tasks (e.g., baggage-screening at the airport). Efficient communication in these scenarios would be crucial to interact fluently. While studies examined the positive and engaging effect of social signals (i.e., gaze communication) on human-robot interaction, little is known about the effects of conflicting robot signals on the human actor's cognitive load. Moreover, it is unclear from a social neuroergonomics perspective how different brain regions synchronize or communicate with one another to deal with the cognitive load induced by conflicting signals in social situations with robots. The present study asked if neural oscillations that correlate with conflict processing are observed between brain regions when participants view conflicting robot signals. Participants classified different objects based on their color after a robot (i.e., iCub), presented on a screen, simulated handing over the object to them. The robot proceeded to cue participants (with a head shift) to the correct or incorrect target location. Since prior work has shown that unexpected cues can interfere with oculomotor planning and induces conflict, we expected that conflicting robot social signals which would interfere with the execution of actions. Indeed, we found that conflicting social signals elicited neural correlates of cognitive conflict as measured by mid-brain theta oscillations. More importantly, we found higher coherence values between mid-frontal electrode locations and posterior occipital electrode locations in the theta-frequency band for incongruent vs. congruent cues, which suggests that theta-band synchronization between these two regions allows for communication between cognitive control systems and gaze-related attentional mechanisms. We also find correlations between coherence values and behavioral performance (Reaction Times), which are moderated by the congruency of the robot signal. In sum, the influence of irrelevant social signals during goal-oriented tasks can be indexed by behavioral, neural oscillation and brain connectivity patterns. These data provide insights about a new measure for cognitive load, which can also be used in predicting human interaction with autonomous machines.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129964488","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bianca Biebl, Elena Arcidiacono, Severin Kacianka, J. Rieger, K. Bengler
{"title":"Opportunities and Limitations of a Gaze-Contingent Display to Simulate Visual Field Loss in Driving Simulator Studies","authors":"Bianca Biebl, Elena Arcidiacono, Severin Kacianka, J. Rieger, K. Bengler","doi":"10.3389/fnrgo.2022.916169","DOIUrl":"https://doi.org/10.3389/fnrgo.2022.916169","url":null,"abstract":"Background Research on task performance under visual field loss is often limited due to small and heterogenous samples. Simulations of visual impairments hold the potential to account for many of those challenges. Digitally altered pictures, glasses, and contact lenses with partial occlusions have been used in the past. One of the most promising methods is the use of a gaze-contingent display that occludes parts of the visual field according to the current gaze position. In this study, the gaze-contingent paradigm was implemented in a static driving simulator to simulate visual field loss and to evaluate parallels in the resulting driving and gaze behavior in comparison to patients. Methods The sample comprised 15 participants without visual impairment. All the subjects performed three drives: with full vision, simulated left-sided homonymous hemianopia, and simulated right-sided homonymous hemianopia, respectively. During each drive, the participants drove through an urban environment where they had to maneuver through intersections by crossing straight ahead, turning left, and turning right. Results The subjects reported reduced safety and increased workload levels during simulated visual field loss, which was reflected in reduced lane position stability and greater absence of large gaze movements. Initial compensatory strategies could be found concerning a dislocated gaze position and a distorted fixation ratio toward the blind side, which was more pronounced for right-sided visual field loss. During left-sided visual field loss, the participants showed a smaller horizontal range of gaze positions, longer fixation durations, and smaller saccadic amplitudes compared to right-sided homonymous hemianopia and, more distinctively, compared to normal vision. Conclusion The results largely mirror reports from driving and visual search tasks under simulated and pathological homonymous hemianopia concerning driving and scanning challenges, initially adopted compensatory strategies, and driving safety. This supports the notion that gaze-contingent displays can be a useful addendum to driving simulator research with visual impairments if the results are interpreted considering methodological limitations and inherent differences to the pathological impairment.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"446 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132553898","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Crum, F. Ronca, George Herbert, S. Funk, E. Carmona, Uzair Hakim, Isla Jones, M. Hamer, J. Hirsch, Antonia Hamilton, I. Tachtsidis, P. Burgess
{"title":"Decreased Exercise-Induced Changes in Prefrontal Cortex Hemodynamics Are Associated With Depressive Symptoms","authors":"J. Crum, F. Ronca, George Herbert, S. Funk, E. Carmona, Uzair Hakim, Isla Jones, M. Hamer, J. Hirsch, Antonia Hamilton, I. Tachtsidis, P. Burgess","doi":"10.3389/fnrgo.2022.806485","DOIUrl":"https://doi.org/10.3389/fnrgo.2022.806485","url":null,"abstract":"People with a depressed mood tend to perform poorly on executive function tasks, which require much of the prefrontal cortex (PFC), an area of the brain which has also been shown to be hypo-active in this population. Recent research has suggested that these aspects of cognition might be improved through physical activity and cognitive training. However, whether the acute effects of exercise on PFC activation during executive function tasks vary with depressive symptoms remains unclear. To investigate these effects, 106 participants were given a cardiopulmonary exercise test (CPET) and were administered a set of executive function tests directly before and after the CPET assessment. The composite effects of exercise on the PFC (all experimental blocks) showed bilateral activation changes in dorsolateral (BA46/9) and ventrolateral (BA44/45) PFC, with the greatest changes occurring in rostral PFC (BA10). The effects observed in right ventrolateral PFC varied depending on level of depressive symptoms (13% variance explained); the changes in activation were less for higher levels. There was also a positive relationship between CPET scores (VO2peak) and right rostral PFC, in that greater activation changes in right BA10 were predictive of higher levels of aerobic fitness (9% variance explained). Since acute exercise ipsilaterally affected this PFC subregion and the inferior frontal gyrus during executive function tasks, this suggests physical activity might benefit the executive functions these subregions support. And because physical fitness and depressive symptoms explained some degree of cerebral upregulation to these subregions, physical activity might more specifically facilitate the engagement of executive functions that are typically associated with hypoactivation in depressed populations. Future research might investigate this possibility in clinical populations, particularly the neural effects of physical activity used in combination with mental health interventions.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131434738","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Causal Analysis of Activity in Social Brain Areas During Human-Agent Conversation","authors":"Caio De Castro Martins, T. Chaminade, M. Cavazza","doi":"10.3389/fnrgo.2022.843005","DOIUrl":"https://doi.org/10.3389/fnrgo.2022.843005","url":null,"abstract":"This article investigates the differences in cognitive and neural mechanisms between human-human and human-virtual agent interaction using a dataset recorded in an ecologically realistic environment. We use Convergent Cross Mapping (CCM) to investigate functional connectivity between pairs of regions involved in the framework of social cognitive neuroscience, namely the fusiform gyrus, superior temporal sulcus (STS), temporoparietal junction (TPJ), and the dorsolateral prefrontal cortex (DLPFC)—taken as prefrontal asymmetry. Our approach is a compromise between investigating local activation in specific regions and investigating connectivity networks that may form part of larger networks. In addition to concording with previous studies, our results suggest that the right TPJ is one of the most reliable areas for assessing processes occurring during human-virtual agent interactions, both in a static and dynamic sense.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126638198","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Mental Workload in Neuropsychology: An Example With the NASA-TLX in Adults With HIV","authors":"D. Hardy, C. Hinkin","doi":"10.3389/fnrgo.2022.881653","DOIUrl":"https://doi.org/10.3389/fnrgo.2022.881653","url":null,"abstract":"A preliminary set of analyses are presented, where workload was examined in 32 adults infected with the human immunodeficiency virus (HIV). Like the current COVID-19 pandemic (caused by the SARS-CoV-2 virus), HIV can produce a wide variety of symptoms, including various levels of cognitive dysfunction. In fact, a recent meta-analysis estimates that of the 39 million adults infected globally with HIV, 42.6% exhibit some form of HIV-associated neurocognitive disorder. A common cognitive symptom in HIV is decline in attention and executive functioning. Though typically examined by clinicians with less precise traditional paper-and-pencil neuropsychological tests, we examined this aspect of cognitive functioning using a more psychometrically sophisticated task as we had HIV-positive adults perform a computerized tracking task in single, dual, and tri-task conditions via the Multi-Attribute Task (MAT) Battery. Also assessed was mental workload, with the NASA-Task Load Index (NASA-TLX), rarely used in neuropsychology but a standard tool in human factors and neuroergonomics research. As expected, tracking performance declined with task condition difficulty (p < 0.001). Although no direct statistical comparisons were made, MAT performance here appeared worse than the MAT performance of various other groups reported in the research literature and in our laboratory. Ratings of workload also tended to increase as a function of task condition difficulty (p < 0.001). Plotting MAT tracking performance against the Mental Demand subscale scores, large individual differences in this aspect of workload were evident in both optimal and sub-optimal tracking performance. To examine likely variables with a potential impact on Mental Demand, a variety of variables (nadir CD4 count, viral load, depression symptoms, diagnosis of AIDS, presence of opportunistic infection, general cognitive status, etc.) were examined in relation to the Mental Demand scale, with age showing a significant association (r = 0.41, p = 0.022) and a diagnosis of AIDS showing trend associations (ps ≥ 0.066). Findings suggesting a deficit in metacognition or insight are also discussed. It is argued that assessment of workload (and its various aspects or components) can provide valuable additional information in neuropsychology.","PeriodicalId":207447,"journal":{"name":"Frontiers in Neuroergonomics","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125745659","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}