从空中交通管制员的语音和目光数据中分析多模式疲劳信息

IF 2.1 3区工程技术 Q2 ENGINEERING, AEROSPACE

Aerospace Pub Date : 2023-12-24 DOI:10.3390/aerospace11010015

Lin Xu, Shanxiu Ma, Zhiyuan Shen, Shiyu Huang, Ying Nan

{"title":"从空中交通管制员的语音和目光数据中分析多模式疲劳信息","authors":"Lin Xu, Shanxiu Ma, Zhiyuan Shen, Shiyu Huang, Ying Nan","doi":"10.3390/aerospace11010015","DOIUrl":null,"url":null,"abstract":"In order to determine the fatigue state of air traffic controllers from air talk, an algorithm is proposed for discriminating the fatigue state of controllers based on applying multi-speech feature fusion to voice data using a Fuzzy Support Vector Machine (FSVM). To supplement the basis for discrimination, we also extracted eye-fatigue-state discrimination features based on Percentage of Eyelid Closure Duration (PERCLOS) eye data. To merge the two classes of discrimination results, a new controller fatigue-state evaluation index based on the entropy weight method is proposed, based on a decision-level fusion of fatigue discrimination results for speech and the eyes. The experimental results show that the fatigue-state recognition accuracy rate was 86.0% for the fatigue state evaluation index, which was 3.5% and 2.2%higher than those for speech and eye assessments, respectively. The comprehensive fatigue evaluation index provides important reference values for controller scheduling and mental-state evaluations.","PeriodicalId":48525,"journal":{"name":"Aerospace","volume":"331 3","pages":""},"PeriodicalIF":2.1000,"publicationDate":"2023-12-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Analyzing Multi-Mode Fatigue Information from Speech and Gaze Data from Air Traffic Controllers\",\"authors\":\"Lin Xu, Shanxiu Ma, Zhiyuan Shen, Shiyu Huang, Ying Nan\",\"doi\":\"10.3390/aerospace11010015\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In order to determine the fatigue state of air traffic controllers from air talk, an algorithm is proposed for discriminating the fatigue state of controllers based on applying multi-speech feature fusion to voice data using a Fuzzy Support Vector Machine (FSVM). To supplement the basis for discrimination, we also extracted eye-fatigue-state discrimination features based on Percentage of Eyelid Closure Duration (PERCLOS) eye data. To merge the two classes of discrimination results, a new controller fatigue-state evaluation index based on the entropy weight method is proposed, based on a decision-level fusion of fatigue discrimination results for speech and the eyes. The experimental results show that the fatigue-state recognition accuracy rate was 86.0% for the fatigue state evaluation index, which was 3.5% and 2.2%higher than those for speech and eye assessments, respectively. The comprehensive fatigue evaluation index provides important reference values for controller scheduling and mental-state evaluations.\",\"PeriodicalId\":48525,\"journal\":{\"name\":\"Aerospace\",\"volume\":\"331 3\",\"pages\":\"\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2023-12-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Aerospace\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.3390/aerospace11010015\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, AEROSPACE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Aerospace","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.3390/aerospace11010015","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, AEROSPACE","Score":null,"Total":0}

引用次数: 0

摘要

为了从空中通话中判断空中交通管制员的疲劳状态，我们提出了一种基于模糊支持向量机（FSVM）对语音数据进行多语音特征融合的管制员疲劳状态判别算法。为了补充判别基础，我们还根据眼睑闭合持续时间百分比（PERCLOS）眼部数据提取了眼部疲劳状态判别特征。为了合并两类判别结果，我们在决策层融合语音和眼睛疲劳判别结果的基础上，提出了一种基于熵权法的新控制器疲劳状态评价指标。实验结果表明，疲劳状态评价指数的疲劳状态识别准确率为 86.0%，分别比语音和眼睛的评估结果高出 3.5%和 2.2%。综合疲劳评估指数为控制器调度和精神状态评估提供了重要的参考值。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Analyzing Multi-Mode Fatigue Information from Speech and Gaze Data from Air Traffic Controllers

In order to determine the fatigue state of air traffic controllers from air talk, an algorithm is proposed for discriminating the fatigue state of controllers based on applying multi-speech feature fusion to voice data using a Fuzzy Support Vector Machine (FSVM). To supplement the basis for discrimination, we also extracted eye-fatigue-state discrimination features based on Percentage of Eyelid Closure Duration (PERCLOS) eye data. To merge the two classes of discrimination results, a new controller fatigue-state evaluation index based on the entropy weight method is proposed, based on a decision-level fusion of fatigue discrimination results for speech and the eyes. The experimental results show that the fatigue-state recognition accuracy rate was 86.0% for the fatigue state evaluation index, which was 3.5% and 2.2%higher than those for speech and eye assessments, respectively. The comprehensive fatigue evaluation index provides important reference values for controller scheduling and mental-state evaluations.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Aerospace ENGINEERING, AEROSPACE-

CiteScore

3.40

自引率

23.10%

发文量

661

审稿时长

6 weeks

期刊介绍： Aerospace is a multidisciplinary science inviting submissions on, but not limited to, the following subject areas: aerodynamics computational fluid dynamics fluid-structure interaction flight mechanics plasmas research instrumentation test facilities environment material science structural analysis thermophysics and heat transfer thermal-structure interaction aeroacoustics optics electromagnetism and radar propulsion power generation and conversion fuels and propellants combustion multidisciplinary design optimization software engineering data analysis signal and image processing artificial intelligence aerospace vehicles'' operation, control and maintenance risk and reliability human factors human-automation interaction airline operations and management air traffic management airport design meteorology space exploration multi-physics interaction.