T. Flores, Marianne Silva, Mariana Azevedo, Thaís Medeiros, Morsinaldo Medeiros, I. Silva, Max Mauro Dias Santos, Dan Costa
{"title":"TinyML安全驾驶:使用嵌入式机器学习检测驾驶员分心","authors":"T. Flores, Marianne Silva, Mariana Azevedo, Thaís Medeiros, Morsinaldo Medeiros, I. Silva, Max Mauro Dias Santos, Dan Costa","doi":"10.1109/MetroAutomotive57488.2023.10219132","DOIUrl":null,"url":null,"abstract":"Among the main causes of road accidents, one of the most significant is related to driver distraction while driving, which is responsible for 18% of car accidents worldwide. This situation has demanded the development of mechanisms to automatically detect this dangerous behavior while driving. One of the computational solutions that has been considered viable to detect situations like this is the use of Convolutional Neural Networks (CNN), but some complex issues arise when deploying CNN models in microcontroller-based embedded devices with constrained processing and memory capabilities. In this context, this paper proposes a driver distraction detection system that achieves high accuracy (99.3%) and low latency (72ms) while requiring minimal computational resources (Peak- RAM of 164 KB and Flash of 52.7 KB). This solution exploiting Tiny Machine Learning (TinyML) algorithms was developed with the support of the Edge Impulse platform, used to perform the entire ML pipeline, from data pre-processing and ML model creation to deployment into an Arduino Portenta H7 board. By designing a driver assistance system that can be integrated into vehicles, it is expected that an affordable solution based on embedded machine learning is provided, tackling a real-world problem by potentially reducing accidents caused by driver distractions.","PeriodicalId":115847,"journal":{"name":"2023 IEEE International Workshop on Metrology for Automotive (MetroAutomotive)","volume":"80 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"TinyML for Safe Driving: The Use of Embedded Machine Learning for Detecting Driver Distraction\",\"authors\":\"T. Flores, Marianne Silva, Mariana Azevedo, Thaís Medeiros, Morsinaldo Medeiros, I. Silva, Max Mauro Dias Santos, Dan Costa\",\"doi\":\"10.1109/MetroAutomotive57488.2023.10219132\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Among the main causes of road accidents, one of the most significant is related to driver distraction while driving, which is responsible for 18% of car accidents worldwide. This situation has demanded the development of mechanisms to automatically detect this dangerous behavior while driving. One of the computational solutions that has been considered viable to detect situations like this is the use of Convolutional Neural Networks (CNN), but some complex issues arise when deploying CNN models in microcontroller-based embedded devices with constrained processing and memory capabilities. In this context, this paper proposes a driver distraction detection system that achieves high accuracy (99.3%) and low latency (72ms) while requiring minimal computational resources (Peak- RAM of 164 KB and Flash of 52.7 KB). This solution exploiting Tiny Machine Learning (TinyML) algorithms was developed with the support of the Edge Impulse platform, used to perform the entire ML pipeline, from data pre-processing and ML model creation to deployment into an Arduino Portenta H7 board. By designing a driver assistance system that can be integrated into vehicles, it is expected that an affordable solution based on embedded machine learning is provided, tackling a real-world problem by potentially reducing accidents caused by driver distractions.\",\"PeriodicalId\":115847,\"journal\":{\"name\":\"2023 IEEE International Workshop on Metrology for Automotive (MetroAutomotive)\",\"volume\":\"80 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE International Workshop on Metrology for Automotive (MetroAutomotive)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/MetroAutomotive57488.2023.10219132\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE International Workshop on Metrology for Automotive (MetroAutomotive)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/MetroAutomotive57488.2023.10219132","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
TinyML for Safe Driving: The Use of Embedded Machine Learning for Detecting Driver Distraction
Among the main causes of road accidents, one of the most significant is related to driver distraction while driving, which is responsible for 18% of car accidents worldwide. This situation has demanded the development of mechanisms to automatically detect this dangerous behavior while driving. One of the computational solutions that has been considered viable to detect situations like this is the use of Convolutional Neural Networks (CNN), but some complex issues arise when deploying CNN models in microcontroller-based embedded devices with constrained processing and memory capabilities. In this context, this paper proposes a driver distraction detection system that achieves high accuracy (99.3%) and low latency (72ms) while requiring minimal computational resources (Peak- RAM of 164 KB and Flash of 52.7 KB). This solution exploiting Tiny Machine Learning (TinyML) algorithms was developed with the support of the Edge Impulse platform, used to perform the entire ML pipeline, from data pre-processing and ML model creation to deployment into an Arduino Portenta H7 board. By designing a driver assistance system that can be integrated into vehicles, it is expected that an affordable solution based on embedded machine learning is provided, tackling a real-world problem by potentially reducing accidents caused by driver distractions.