Lighting-Robust Behavioral Cloning via Bayesian Visual Encoding for Robot Manipulation

IF 5.3 2区 计算机科学 Q2 ROBOTICS
IEEE Robotics and Automation Letters Pub Date : 2026-07-01 Epub Date: 2026-03-11 DOI:10.1109/LRA.2026.3692063
Zhenyuan Dong;Dongxu Han;Zhi Wang;Zhiyi Yan;Qian Lin;Ziyi Zhang;Peng Zhang
{"title":"Lighting-Robust Behavioral Cloning via Bayesian Visual Encoding for Robot Manipulation","authors":"Zhenyuan Dong;Dongxu Han;Zhi Wang;Zhiyi Yan;Qian Lin;Ziyi Zhang;Peng Zhang","doi":"10.1109/LRA.2026.3692063","DOIUrl":null,"url":null,"abstract":"Behavioral cloning (BC) has demonstrated strong performance in robot manipulation by learning visuomotor policies directly from expert demonstrations. However, under illumination-induced distribution shifts, vision-based BC policies often become sensitive to spurious visual variations, leading to degraded reliability and generalization. To address this issue, we propose a lighting-robust BC framework that incorporates Bayesian deep learning into the visual encoder. Specifically, we model a posterior distribution over convolutional weights and optimize the evidence lower bound, where a Kullback–Leibler regularization term constrains feature learning under illumination variability. In simulation, the proposed method achieves higher success rates and shorter rollout lengths than deterministic baselines, while maintaining strong sample efficiency with a single Monte Carlo sample. In real-world experiments across seven illumination regimes, including distribution-shifted conditions, our method consistently outperforms BC baselines and remains stable under severe lighting changes. These results indicate that Bayesian regularization provides an effective inductive bias for learning visual representations that improve robustness and generalization in vision-based robot manipulation.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"11 7","pages":"8236-8243"},"PeriodicalIF":5.3000,"publicationDate":"2026-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Robotics and Automation Letters","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11513768/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/3/11 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Behavioral cloning (BC) has demonstrated strong performance in robot manipulation by learning visuomotor policies directly from expert demonstrations. However, under illumination-induced distribution shifts, vision-based BC policies often become sensitive to spurious visual variations, leading to degraded reliability and generalization. To address this issue, we propose a lighting-robust BC framework that incorporates Bayesian deep learning into the visual encoder. Specifically, we model a posterior distribution over convolutional weights and optimize the evidence lower bound, where a Kullback–Leibler regularization term constrains feature learning under illumination variability. In simulation, the proposed method achieves higher success rates and shorter rollout lengths than deterministic baselines, while maintaining strong sample efficiency with a single Monte Carlo sample. In real-world experiments across seven illumination regimes, including distribution-shifted conditions, our method consistently outperforms BC baselines and remains stable under severe lighting changes. These results indicate that Bayesian regularization provides an effective inductive bias for learning visual representations that improve robustness and generalization in vision-based robot manipulation.
基于贝叶斯视觉编码的机器人操作光照鲁棒行为克隆
行为克隆(BC)通过直接从专家演示中学习视觉运动策略,在机器人操作中表现出强大的性能。然而,在光照引起的分布变化下,基于视觉的BC策略往往对虚假的视觉变化很敏感,导致可靠性和泛化能力下降。为了解决这个问题,我们提出了一个将贝叶斯深度学习集成到视觉编码器中的光照鲁棒BC框架。具体来说,我们在卷积权重上建立了一个后验分布模型,并优化了证据下界,其中Kullback-Leibler正则化项约束了光照变化下的特征学习。在仿真中,与确定性基线相比,该方法获得了更高的成功率和更短的滚动长度,同时在单个蒙特卡罗样本中保持了很强的样本效率。在包括分布移位条件在内的七种照明制度的实际实验中,我们的方法始终优于BC基线,并在严重的照明变化下保持稳定。这些结果表明,贝叶斯正则化为学习视觉表征提供了有效的归纳偏差,从而提高了基于视觉的机器人操作的鲁棒性和泛化。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Robotics and Automation Letters
IEEE Robotics and Automation Letters Computer Science-Computer Science Applications
CiteScore
9.60
自引率
15.40%
发文量
1428
期刊介绍: The scope of this journal is to publish peer-reviewed articles that provide a timely and concise account of innovative research ideas and application results, reporting significant theoretical findings and application case studies in areas of robotics and automation.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书