{"title":"Lighting-Robust Behavioral Cloning via Bayesian Visual Encoding for Robot Manipulation","authors":"Zhenyuan Dong;Dongxu Han;Zhi Wang;Zhiyi Yan;Qian Lin;Ziyi Zhang;Peng Zhang","doi":"10.1109/LRA.2026.3692063","DOIUrl":null,"url":null,"abstract":"Behavioral cloning (BC) has demonstrated strong performance in robot manipulation by learning visuomotor policies directly from expert demonstrations. However, under illumination-induced distribution shifts, vision-based BC policies often become sensitive to spurious visual variations, leading to degraded reliability and generalization. To address this issue, we propose a lighting-robust BC framework that incorporates Bayesian deep learning into the visual encoder. Specifically, we model a posterior distribution over convolutional weights and optimize the evidence lower bound, where a Kullback–Leibler regularization term constrains feature learning under illumination variability. In simulation, the proposed method achieves higher success rates and shorter rollout lengths than deterministic baselines, while maintaining strong sample efficiency with a single Monte Carlo sample. In real-world experiments across seven illumination regimes, including distribution-shifted conditions, our method consistently outperforms BC baselines and remains stable under severe lighting changes. These results indicate that Bayesian regularization provides an effective inductive bias for learning visual representations that improve robustness and generalization in vision-based robot manipulation.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"11 7","pages":"8236-8243"},"PeriodicalIF":5.3000,"publicationDate":"2026-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Robotics and Automation Letters","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11513768/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/3/11 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0
Abstract
Behavioral cloning (BC) has demonstrated strong performance in robot manipulation by learning visuomotor policies directly from expert demonstrations. However, under illumination-induced distribution shifts, vision-based BC policies often become sensitive to spurious visual variations, leading to degraded reliability and generalization. To address this issue, we propose a lighting-robust BC framework that incorporates Bayesian deep learning into the visual encoder. Specifically, we model a posterior distribution over convolutional weights and optimize the evidence lower bound, where a Kullback–Leibler regularization term constrains feature learning under illumination variability. In simulation, the proposed method achieves higher success rates and shorter rollout lengths than deterministic baselines, while maintaining strong sample efficiency with a single Monte Carlo sample. In real-world experiments across seven illumination regimes, including distribution-shifted conditions, our method consistently outperforms BC baselines and remains stable under severe lighting changes. These results indicate that Bayesian regularization provides an effective inductive bias for learning visual representations that improve robustness and generalization in vision-based robot manipulation.
期刊介绍:
The scope of this journal is to publish peer-reviewed articles that provide a timely and concise account of innovative research ideas and application results, reporting significant theoretical findings and application case studies in areas of robotics and automation.