{"title":"Extending Operational Design Domain for Perception Systems Through Robust Learning","authors":"Chen Sun;Yaodong Cui;Minghao Ning;Yukun Lu;Dongpu Cao;Amir Khajepour","doi":"10.1109/TIV.2024.3386915","DOIUrl":null,"url":null,"abstract":"Perception modules in Autonomous Driving Systems (ADS) provide excellent performance in simple, constrained environments but generally have precarious performance in real driving situations with various weather and lighting conditions. Therefore, robust perception performance in new and unanticipated domains is a crucial factor for the large-scale application of autonomous driving, especially when considering unexpected scenarios outside the predefined Operational Design Domain (ODD). This paper proposes a novel approach to extending the ODD for perception modules in ADS through robust learning. The model's robustness is characterized by the anchor data and corresponding perturbation model. The robust learning task is then formulated as a min-max optimization problem conjugated to the perturbation model and a semantically parameter-defined constrained exploration space. The proposed robustify procedures solve the optimization problem in terms of robustness-related batch loss and worst-case loss, which improves the model resilience in multiple domain shift experiments, including virtual-real and weather changes. This paper presents experimental results that demonstrate the efficacy of robust learning approaches in extending the ODD for perception modules and provides insights into future research directions in this field.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 10","pages":"6599-6609"},"PeriodicalIF":14.0000,"publicationDate":"2024-04-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Intelligent Vehicles","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10497901/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Perception modules in Autonomous Driving Systems (ADS) provide excellent performance in simple, constrained environments but generally have precarious performance in real driving situations with various weather and lighting conditions. Therefore, robust perception performance in new and unanticipated domains is a crucial factor for the large-scale application of autonomous driving, especially when considering unexpected scenarios outside the predefined Operational Design Domain (ODD). This paper proposes a novel approach to extending the ODD for perception modules in ADS through robust learning. The model's robustness is characterized by the anchor data and corresponding perturbation model. The robust learning task is then formulated as a min-max optimization problem conjugated to the perturbation model and a semantically parameter-defined constrained exploration space. The proposed robustify procedures solve the optimization problem in terms of robustness-related batch loss and worst-case loss, which improves the model resilience in multiple domain shift experiments, including virtual-real and weather changes. This paper presents experimental results that demonstrate the efficacy of robust learning approaches in extending the ODD for perception modules and provides insights into future research directions in this field.
期刊介绍:
The IEEE Transactions on Intelligent Vehicles (T-IV) is a premier platform for publishing peer-reviewed articles that present innovative research concepts, application results, significant theoretical findings, and application case studies in the field of intelligent vehicles. With a particular emphasis on automated vehicles within roadway environments, T-IV aims to raise awareness of pressing research and application challenges.
Our focus is on providing critical information to the intelligent vehicle community, serving as a dissemination vehicle for IEEE ITS Society members and others interested in learning about the state-of-the-art developments and progress in research and applications related to intelligent vehicles. Join us in advancing knowledge and innovation in this dynamic field.