Siwei Ma , Yingnan Yan , Jianqiang Wang , Deqi Chen , Jingsi Yang , Xiaobing Liu
{"title":"通过功能性脑网络和深度学习方法,预测司机在闪灯控制的平交路口做出的停/走决策","authors":"Siwei Ma , Yingnan Yan , Jianqiang Wang , Deqi Chen , Jingsi Yang , Xiaobing Liu","doi":"10.1016/j.trf.2024.08.031","DOIUrl":null,"url":null,"abstract":"<div><p>Detecting and predicting the stop/go decisions of drivers at grade crossings is crucial for enhancing road safety. Electroencephalography (EEG) data, which provides direct and effective physiological indicators for recognizing driver states, combined with associated machine-learning techniques, can be used to monitor driver decisions. However, the ability of EEG to predict a driver’s stop/go decisions remains unclear. To investigate this, we collected both EEG and behavioral data from drivers at a flashing-light-controlled grade crossing, where stop/go decisions are critical, using a driving simulator. Herein, we propose an EEG-based prediction framework that combines functional brain network analysis with conventional neural networks (FBN-CNNs) to predict drivers’ stop/go decisions. The functional brain network was measured using phase-lag index matrices and minimum-spanning tree techniques. We subsequently compared the obtained results of the FBN-CNN with those from traditional machine learning methods, specifically random forest (RF) and Support Vector Machines (SVM). The results indicate that when facing a flashing red light, drivers who decide to stop exhibit stronger alpha band connectivity and weaker delta and theta activity than those who run the red-light. Furthermore, the FBN-CNN model outperformed the machine learning methods (RF and SVM) in both extracting EEG features and achieving high prediction accuracy. Interestingly, the EEGs of drivers during normal driving stages could help to predict their stop-or-go behavior at the onset of a flashing red light. In the typical dilemma zone, combining EEG data from the normal driving stage with those from the pre-decision stage improved the accuracy from 76% to 90%. These findings demonstrate the efficacy of EEG and deep learning methods in driver decision monitoring.</p></div>","PeriodicalId":48355,"journal":{"name":"Transportation Research Part F-Traffic Psychology and Behaviour","volume":"107 ","pages":"Pages 115-132"},"PeriodicalIF":3.5000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Predictability of driver’s stop/go decisions at flashing-light-controlled grade crossings by coupling functional brain network and deep learning methods\",\"authors\":\"Siwei Ma , Yingnan Yan , Jianqiang Wang , Deqi Chen , Jingsi Yang , Xiaobing Liu\",\"doi\":\"10.1016/j.trf.2024.08.031\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Detecting and predicting the stop/go decisions of drivers at grade crossings is crucial for enhancing road safety. Electroencephalography (EEG) data, which provides direct and effective physiological indicators for recognizing driver states, combined with associated machine-learning techniques, can be used to monitor driver decisions. However, the ability of EEG to predict a driver’s stop/go decisions remains unclear. To investigate this, we collected both EEG and behavioral data from drivers at a flashing-light-controlled grade crossing, where stop/go decisions are critical, using a driving simulator. Herein, we propose an EEG-based prediction framework that combines functional brain network analysis with conventional neural networks (FBN-CNNs) to predict drivers’ stop/go decisions. The functional brain network was measured using phase-lag index matrices and minimum-spanning tree techniques. We subsequently compared the obtained results of the FBN-CNN with those from traditional machine learning methods, specifically random forest (RF) and Support Vector Machines (SVM). The results indicate that when facing a flashing red light, drivers who decide to stop exhibit stronger alpha band connectivity and weaker delta and theta activity than those who run the red-light. Furthermore, the FBN-CNN model outperformed the machine learning methods (RF and SVM) in both extracting EEG features and achieving high prediction accuracy. Interestingly, the EEGs of drivers during normal driving stages could help to predict their stop-or-go behavior at the onset of a flashing red light. In the typical dilemma zone, combining EEG data from the normal driving stage with those from the pre-decision stage improved the accuracy from 76% to 90%. These findings demonstrate the efficacy of EEG and deep learning methods in driver decision monitoring.</p></div>\",\"PeriodicalId\":48355,\"journal\":{\"name\":\"Transportation Research Part F-Traffic Psychology and Behaviour\",\"volume\":\"107 \",\"pages\":\"Pages 115-132\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2024-09-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Transportation Research Part F-Traffic Psychology and Behaviour\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1369847824002389\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY, APPLIED\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Transportation Research Part F-Traffic Psychology and Behaviour","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1369847824002389","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, APPLIED","Score":null,"Total":0}
Predictability of driver’s stop/go decisions at flashing-light-controlled grade crossings by coupling functional brain network and deep learning methods
Detecting and predicting the stop/go decisions of drivers at grade crossings is crucial for enhancing road safety. Electroencephalography (EEG) data, which provides direct and effective physiological indicators for recognizing driver states, combined with associated machine-learning techniques, can be used to monitor driver decisions. However, the ability of EEG to predict a driver’s stop/go decisions remains unclear. To investigate this, we collected both EEG and behavioral data from drivers at a flashing-light-controlled grade crossing, where stop/go decisions are critical, using a driving simulator. Herein, we propose an EEG-based prediction framework that combines functional brain network analysis with conventional neural networks (FBN-CNNs) to predict drivers’ stop/go decisions. The functional brain network was measured using phase-lag index matrices and minimum-spanning tree techniques. We subsequently compared the obtained results of the FBN-CNN with those from traditional machine learning methods, specifically random forest (RF) and Support Vector Machines (SVM). The results indicate that when facing a flashing red light, drivers who decide to stop exhibit stronger alpha band connectivity and weaker delta and theta activity than those who run the red-light. Furthermore, the FBN-CNN model outperformed the machine learning methods (RF and SVM) in both extracting EEG features and achieving high prediction accuracy. Interestingly, the EEGs of drivers during normal driving stages could help to predict their stop-or-go behavior at the onset of a flashing red light. In the typical dilemma zone, combining EEG data from the normal driving stage with those from the pre-decision stage improved the accuracy from 76% to 90%. These findings demonstrate the efficacy of EEG and deep learning methods in driver decision monitoring.
期刊介绍:
Transportation Research Part F: Traffic Psychology and Behaviour focuses on the behavioural and psychological aspects of traffic and transport. The aim of the journal is to enhance theory development, improve the quality of empirical studies and to stimulate the application of research findings in practice. TRF provides a focus and a means of communication for the considerable amount of research activities that are now being carried out in this field. The journal provides a forum for transportation researchers, psychologists, ergonomists, engineers and policy-makers with an interest in traffic and transport psychology.