{"title":"基于深度学习的新型驾驶员嗜睡检测技术","authors":"Prithwijit Mukherjee, Anisha Halder Roy","doi":"10.1002/hfm.21056","DOIUrl":null,"url":null,"abstract":"<p>Every year, many people lose their lives because of road accidents. It is evident from statistics that drowsiness is one of the main causes of a large number of car accidents. In our research, we wish to solve this major problem by measuring the drowsiness level of the human brain while driving. The study aims to develop a novel technique to detect different alertness levels (i.e., awake, moderately drowsy, and maximally drowsy) of a person while driving. A hybrid model using a stacked autoencoder and hyperbolic tangent Long Short-Term Memory (TLSTM) network with attention mechanism is designed for this purpose. The designed model uses different biopotential signals, such as electroencephalography (EEG), facial electromyography (EMG), and different biomarkers, such as pulse rate, respiration rate galvanic skin response, and head movement to detect a person's alertness level. Here, the stacked autoencoder model is used for automated feature extraction. TLSTM is used to predict a person's alertness level using stacked autoencoder network-extracted features. The proposed model can classify awake, moderately drowsy, and maximally drowsy states of a person with accuracies of 99%, 98.3%, and 98.6%, respectively. The novel contributions of the paper includes (i) incorporation of an attention mechanism into the TLSTM network of the proposed hybrid model to focus on the emphatic states to enhance classification accuracy, and (ii) utilization of EEG, facial EMG, pulse rate, respiration rate, galvanic skin reaction, and head movement pattern to assess a person's alertness level.</p>","PeriodicalId":55048,"journal":{"name":"Human Factors and Ergonomics in Manufacturing & Service Industries","volume":"34 6","pages":"667-684"},"PeriodicalIF":2.2000,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A novel deep learning-based technique for driver drowsiness detection\",\"authors\":\"Prithwijit Mukherjee, Anisha Halder Roy\",\"doi\":\"10.1002/hfm.21056\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Every year, many people lose their lives because of road accidents. It is evident from statistics that drowsiness is one of the main causes of a large number of car accidents. In our research, we wish to solve this major problem by measuring the drowsiness level of the human brain while driving. The study aims to develop a novel technique to detect different alertness levels (i.e., awake, moderately drowsy, and maximally drowsy) of a person while driving. A hybrid model using a stacked autoencoder and hyperbolic tangent Long Short-Term Memory (TLSTM) network with attention mechanism is designed for this purpose. The designed model uses different biopotential signals, such as electroencephalography (EEG), facial electromyography (EMG), and different biomarkers, such as pulse rate, respiration rate galvanic skin response, and head movement to detect a person's alertness level. Here, the stacked autoencoder model is used for automated feature extraction. TLSTM is used to predict a person's alertness level using stacked autoencoder network-extracted features. The proposed model can classify awake, moderately drowsy, and maximally drowsy states of a person with accuracies of 99%, 98.3%, and 98.6%, respectively. The novel contributions of the paper includes (i) incorporation of an attention mechanism into the TLSTM network of the proposed hybrid model to focus on the emphatic states to enhance classification accuracy, and (ii) utilization of EEG, facial EMG, pulse rate, respiration rate, galvanic skin reaction, and head movement pattern to assess a person's alertness level.</p>\",\"PeriodicalId\":55048,\"journal\":{\"name\":\"Human Factors and Ergonomics in Manufacturing & Service Industries\",\"volume\":\"34 6\",\"pages\":\"667-684\"},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2024-09-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Human Factors and Ergonomics in Manufacturing & Service Industries\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/hfm.21056\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, MANUFACTURING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Human Factors and Ergonomics in Manufacturing & Service Industries","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/hfm.21056","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
A novel deep learning-based technique for driver drowsiness detection
Every year, many people lose their lives because of road accidents. It is evident from statistics that drowsiness is one of the main causes of a large number of car accidents. In our research, we wish to solve this major problem by measuring the drowsiness level of the human brain while driving. The study aims to develop a novel technique to detect different alertness levels (i.e., awake, moderately drowsy, and maximally drowsy) of a person while driving. A hybrid model using a stacked autoencoder and hyperbolic tangent Long Short-Term Memory (TLSTM) network with attention mechanism is designed for this purpose. The designed model uses different biopotential signals, such as electroencephalography (EEG), facial electromyography (EMG), and different biomarkers, such as pulse rate, respiration rate galvanic skin response, and head movement to detect a person's alertness level. Here, the stacked autoencoder model is used for automated feature extraction. TLSTM is used to predict a person's alertness level using stacked autoencoder network-extracted features. The proposed model can classify awake, moderately drowsy, and maximally drowsy states of a person with accuracies of 99%, 98.3%, and 98.6%, respectively. The novel contributions of the paper includes (i) incorporation of an attention mechanism into the TLSTM network of the proposed hybrid model to focus on the emphatic states to enhance classification accuracy, and (ii) utilization of EEG, facial EMG, pulse rate, respiration rate, galvanic skin reaction, and head movement pattern to assess a person's alertness level.
期刊介绍:
The purpose of Human Factors and Ergonomics in Manufacturing & Service Industries is to facilitate discovery, integration, and application of scientific knowledge about human aspects of manufacturing, and to provide a forum for worldwide dissemination of such knowledge for its application and benefit to manufacturing industries. The journal covers a broad spectrum of ergonomics and human factors issues with a focus on the design, operation and management of contemporary manufacturing systems, both in the shop floor and office environments, in the quest for manufacturing agility, i.e. enhancement and integration of human skills with hardware performance for improved market competitiveness, management of change, product and process quality, and human-system reliability. The inter- and cross-disciplinary nature of the journal allows for a wide scope of issues relevant to manufacturing system design and engineering, human resource management, social, organizational, safety, and health issues. Examples of specific subject areas of interest include: implementation of advanced manufacturing technology, human aspects of computer-aided design and engineering, work design, compensation and appraisal, selection training and education, labor-management relations, agile manufacturing and virtual companies, human factors in total quality management, prevention of work-related musculoskeletal disorders, ergonomics of workplace, equipment and tool design, ergonomics programs, guides and standards for industry, automation safety and robot systems, human skills development and knowledge enhancing technologies, reliability, and safety and worker health issues.