Extending Operational Design Domain for Perception Systems Through Robust Learning

IF 14 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Chen Sun;Yaodong Cui;Minghao Ning;Yukun Lu;Dongpu Cao;Amir Khajepour
{"title":"Extending Operational Design Domain for Perception Systems Through Robust Learning","authors":"Chen Sun;Yaodong Cui;Minghao Ning;Yukun Lu;Dongpu Cao;Amir Khajepour","doi":"10.1109/TIV.2024.3386915","DOIUrl":null,"url":null,"abstract":"Perception modules in Autonomous Driving Systems (ADS) provide excellent performance in simple, constrained environments but generally have precarious performance in real driving situations with various weather and lighting conditions. Therefore, robust perception performance in new and unanticipated domains is a crucial factor for the large-scale application of autonomous driving, especially when considering unexpected scenarios outside the predefined Operational Design Domain (ODD). This paper proposes a novel approach to extending the ODD for perception modules in ADS through robust learning. The model's robustness is characterized by the anchor data and corresponding perturbation model. The robust learning task is then formulated as a min-max optimization problem conjugated to the perturbation model and a semantically parameter-defined constrained exploration space. The proposed robustify procedures solve the optimization problem in terms of robustness-related batch loss and worst-case loss, which improves the model resilience in multiple domain shift experiments, including virtual-real and weather changes. This paper presents experimental results that demonstrate the efficacy of robust learning approaches in extending the ODD for perception modules and provides insights into future research directions in this field.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 10","pages":"6599-6609"},"PeriodicalIF":14.0000,"publicationDate":"2024-04-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Intelligent Vehicles","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10497901/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Perception modules in Autonomous Driving Systems (ADS) provide excellent performance in simple, constrained environments but generally have precarious performance in real driving situations with various weather and lighting conditions. Therefore, robust perception performance in new and unanticipated domains is a crucial factor for the large-scale application of autonomous driving, especially when considering unexpected scenarios outside the predefined Operational Design Domain (ODD). This paper proposes a novel approach to extending the ODD for perception modules in ADS through robust learning. The model's robustness is characterized by the anchor data and corresponding perturbation model. The robust learning task is then formulated as a min-max optimization problem conjugated to the perturbation model and a semantically parameter-defined constrained exploration space. The proposed robustify procedures solve the optimization problem in terms of robustness-related batch loss and worst-case loss, which improves the model resilience in multiple domain shift experiments, including virtual-real and weather changes. This paper presents experimental results that demonstrate the efficacy of robust learning approaches in extending the ODD for perception modules and provides insights into future research directions in this field.
通过鲁棒学习扩展感知系统的操作设计域
自动驾驶系统(ADS)中的感知模块在简单、受限的环境中提供出色的性能,但在各种天气和光照条件下的真实驾驶情况下,通常表现不稳定。因此,对于自动驾驶的大规模应用来说,在新的和未预料到的领域中稳健的感知性能是一个至关重要的因素,尤其是在考虑预定义的操作设计领域(ODD)之外的意外场景时。本文提出了一种通过鲁棒学习扩展ADS中感知模块的ODD的新方法。模型的鲁棒性由锚点数据和相应的扰动模型来表征。然后将鲁棒学习任务表述为与扰动模型和语义参数定义的约束探索空间共轭的最小-最大优化问题。所提出的鲁棒性方法解决了鲁棒性相关的批损失和最坏情况损失的优化问题,提高了模型在包括虚实和天气变化在内的多域漂移实验中的弹性。本文提出了实验结果,证明了鲁棒学习方法在扩展感知模块ODD方面的有效性,并为该领域的未来研究方向提供了见解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Intelligent Vehicles
IEEE Transactions on Intelligent Vehicles Mathematics-Control and Optimization
CiteScore
12.10
自引率
13.40%
发文量
177
期刊介绍: The IEEE Transactions on Intelligent Vehicles (T-IV) is a premier platform for publishing peer-reviewed articles that present innovative research concepts, application results, significant theoretical findings, and application case studies in the field of intelligent vehicles. With a particular emphasis on automated vehicles within roadway environments, T-IV aims to raise awareness of pressing research and application challenges. Our focus is on providing critical information to the intelligent vehicle community, serving as a dissemination vehicle for IEEE ITS Society members and others interested in learning about the state-of-the-art developments and progress in research and applications related to intelligent vehicles. Join us in advancing knowledge and innovation in this dynamic field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信