Celso Pereira;Ricardo P. M. Cruz;João N. D. Fernandes;João Ribeiro Pinto;Jaime S. Cardoso
{"title":"用于自动驾驶的天气和气象光学距离分类","authors":"Celso Pereira;Ricardo P. M. Cruz;João N. D. Fernandes;João Ribeiro Pinto;Jaime S. Cardoso","doi":"10.1109/TIV.2024.3387113","DOIUrl":null,"url":null,"abstract":"Weather and meteorological optical range (MOR) perception is crucial for smooth and safe autonomous driving (AD). This article introduces two deep learning-based architectures, employing early and intermediate sensor fusion and multi-task strategies, designed for concurrent weather and MOR classification in AD. Extensive experiments employing the publicly available FogChamber dataset demonstrate that the proposed early fusion architecture, characterized by its lightweight design and simplicity, achieves an accuracy of 98.88% in weather classification and 89.77% in MOR classification, with a competitive memory allocation of 5.33 megabytes (MB) and an inference time of 2.50 milliseconds (ms). In contrast, the proposed intermediate fusion architecture prioritizes performance, achieving higher accuracies of 99.38% in weather classification and 91.88% in MOR classification. However, it requires a more substantial memory allocation of 54.06 MB and exhibits a longer inference time of 15.55 ms. Compared to other state-of-the-art architectures, the proposed methods present a competitive balance between accuracy performance, inference time, and memory allocation, which are crucial parameters for enabling autonomous driving.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 10","pages":"6637-6647"},"PeriodicalIF":14.3000,"publicationDate":"2024-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10496236","citationCount":"0","resultStr":"{\"title\":\"Weather and Meteorological Optical Range Classification for Autonomous Driving\",\"authors\":\"Celso Pereira;Ricardo P. M. Cruz;João N. D. Fernandes;João Ribeiro Pinto;Jaime S. Cardoso\",\"doi\":\"10.1109/TIV.2024.3387113\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Weather and meteorological optical range (MOR) perception is crucial for smooth and safe autonomous driving (AD). This article introduces two deep learning-based architectures, employing early and intermediate sensor fusion and multi-task strategies, designed for concurrent weather and MOR classification in AD. Extensive experiments employing the publicly available FogChamber dataset demonstrate that the proposed early fusion architecture, characterized by its lightweight design and simplicity, achieves an accuracy of 98.88% in weather classification and 89.77% in MOR classification, with a competitive memory allocation of 5.33 megabytes (MB) and an inference time of 2.50 milliseconds (ms). In contrast, the proposed intermediate fusion architecture prioritizes performance, achieving higher accuracies of 99.38% in weather classification and 91.88% in MOR classification. However, it requires a more substantial memory allocation of 54.06 MB and exhibits a longer inference time of 15.55 ms. Compared to other state-of-the-art architectures, the proposed methods present a competitive balance between accuracy performance, inference time, and memory allocation, which are crucial parameters for enabling autonomous driving.\",\"PeriodicalId\":36532,\"journal\":{\"name\":\"IEEE Transactions on Intelligent Vehicles\",\"volume\":\"9 10\",\"pages\":\"6637-6647\"},\"PeriodicalIF\":14.3000,\"publicationDate\":\"2024-04-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10496236\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Intelligent Vehicles\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10496236/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Intelligent Vehicles","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10496236/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Weather and Meteorological Optical Range Classification for Autonomous Driving
Weather and meteorological optical range (MOR) perception is crucial for smooth and safe autonomous driving (AD). This article introduces two deep learning-based architectures, employing early and intermediate sensor fusion and multi-task strategies, designed for concurrent weather and MOR classification in AD. Extensive experiments employing the publicly available FogChamber dataset demonstrate that the proposed early fusion architecture, characterized by its lightweight design and simplicity, achieves an accuracy of 98.88% in weather classification and 89.77% in MOR classification, with a competitive memory allocation of 5.33 megabytes (MB) and an inference time of 2.50 milliseconds (ms). In contrast, the proposed intermediate fusion architecture prioritizes performance, achieving higher accuracies of 99.38% in weather classification and 91.88% in MOR classification. However, it requires a more substantial memory allocation of 54.06 MB and exhibits a longer inference time of 15.55 ms. Compared to other state-of-the-art architectures, the proposed methods present a competitive balance between accuracy performance, inference time, and memory allocation, which are crucial parameters for enabling autonomous driving.
期刊介绍:
The IEEE Transactions on Intelligent Vehicles (T-IV) is a premier platform for publishing peer-reviewed articles that present innovative research concepts, application results, significant theoretical findings, and application case studies in the field of intelligent vehicles. With a particular emphasis on automated vehicles within roadway environments, T-IV aims to raise awareness of pressing research and application challenges.
Our focus is on providing critical information to the intelligent vehicle community, serving as a dissemination vehicle for IEEE ITS Society members and others interested in learning about the state-of-the-art developments and progress in research and applications related to intelligent vehicles. Join us in advancing knowledge and innovation in this dynamic field.