ArXiv.org最新文献

筛选

英文中文

Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failures 不确定性感知的潜在安全滤波器用于避免分布外故障

ArXiv.org Pub Date : 2025-05-01 DOI: 10.48550/arxiv.2505.00779

Junwon Seo, Kensuke Nakamura, Andrea Bajcsy

{"title":"Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failures","authors":"Junwon Seo, Kensuke Nakamura, Andrea Bajcsy","doi":"10.48550/arxiv.2505.00779","DOIUrl":"https://doi.org/10.48550/arxiv.2505.00779","url":null,"abstract":"Recent advances in generative world models have enabled classical safe control methods, such as Hamilton-Jacobi (HJ) reachability, to generalize to complex robotic systems operating directly from high-dimensional sensor observations. However, obtaining comprehensive coverage of all safety-critical scenarios during world model training is extremely challenging. As a result, latent safety filters built on top of these models may miss novel hazards and even fail to prevent known ones, overconfidently misclassifying risky out-of-distribution (OOD) situations as safe. To address this, we introduce an uncertainty-aware latent safety filter that proactively steers robots away from both known and unseen failures. Our key idea is to use the world model's epistemic uncertainty as a proxy for identifying unseen potential hazards. We propose a principled method to detect OOD world model predictions by calibrating an uncertainty threshold via conformal prediction. By performing reachability analysis in an augmented state space-spanning both the latent representation and the epistemic uncertainty-we synthesize a latent safety filter that can reliably safeguard arbitrary policies from both known and unseen safety hazards. In simulation and hardware experiments on vision-based control tasks with a Franka manipulator, we show that our uncertainty-aware safety filter preemptively detects potential unsafe scenarios and reliably proposes safe, in-distribution actions. Video results can be found on the project website at https://cmu-intentlab.github.io/UNISafe","PeriodicalId":522166,"journal":{"name":"ArXiv.org","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://arxiv.org/pdf/2505.00779","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147892780","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0