RLRC: Reinforcement Learning-Based Recovery for Compressed Vision-Language-Action Models

IF 5.3 2区 计算机科学 Q2 ROBOTICS
IEEE Robotics and Automation Letters Pub Date : 2026-07-01 Epub Date: 2026-06-04 DOI:10.1109/LRA.2026.3700379
Yuxuan Chen;Yixin Han;Yize Huang;Xiao Li
{"title":"RLRC: Reinforcement Learning-Based Recovery for Compressed Vision-Language-Action Models","authors":"Yuxuan Chen;Yixin Han;Yize Huang;Xiao Li","doi":"10.1109/LRA.2026.3700379","DOIUrl":null,"url":null,"abstract":"Vision-Language-Action models (VLA) have demonstrated remarkable capabilities and strong potential in complex robotic manipulation. However, their large parameter sizes and high inference latency hinder real-world deployment, especially on resource-constrained platforms. To address this, we conduct a systematic empirical study of model compression for VLAs. Building on these insights, we present <italic>RLRC</i>, a three-stage compression and recovery pipeline consisting of structured pruning, performance recovery via SFT and RL, and subsequent quantization. The RL stage incorporates a critic warm-up strategy and BC loss regularization to stabilize training and preserve policy behavior. RLRC achieves up to an 8× memory reduction and 2.3× inference speedup while maintaining the original task success rate. Extensive experiments across multiple VLA backbones show that RLRC consistently outperforms existing compression baselines, highlighting its effectiveness for on-device deployment.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"11 7","pages":"8864-8871"},"PeriodicalIF":5.3000,"publicationDate":"2026-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Robotics and Automation Letters","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11551322/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/6/4 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Vision-Language-Action models (VLA) have demonstrated remarkable capabilities and strong potential in complex robotic manipulation. However, their large parameter sizes and high inference latency hinder real-world deployment, especially on resource-constrained platforms. To address this, we conduct a systematic empirical study of model compression for VLAs. Building on these insights, we present RLRC, a three-stage compression and recovery pipeline consisting of structured pruning, performance recovery via SFT and RL, and subsequent quantization. The RL stage incorporates a critic warm-up strategy and BC loss regularization to stabilize training and preserve policy behavior. RLRC achieves up to an 8× memory reduction and 2.3× inference speedup while maintaining the original task success rate. Extensive experiments across multiple VLA backbones show that RLRC consistently outperforms existing compression baselines, highlighting its effectiveness for on-device deployment.
RLRC:基于强化学习的压缩视觉-语言-动作模型恢复
视觉-语言-动作模型(VLA)在复杂的机器人操作中表现出了显著的能力和巨大的潜力。然而,它们的大参数大小和高推断延迟阻碍了实际部署,特别是在资源受限的平台上。为了解决这个问题,我们对VLAs的模型压缩进行了系统的实证研究。基于这些见解,我们提出了RLRC,这是一种三级压缩和恢复管道,包括结构化修剪,通过SFT和RL恢复性能,以及随后的量化。RL阶段包括一个临界热身策略和BC损失正则化,以稳定训练和保持策略行为。在保持原始任务成功率的同时,RLRC实现了高达8倍的内存减少和2.3倍的推理加速。在多个VLA主干网上进行的大量实验表明,RLRC始终优于现有的压缩基线,突出了其在设备上部署的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Robotics and Automation Letters
IEEE Robotics and Automation Letters Computer Science-Computer Science Applications
CiteScore
9.60
自引率
15.40%
发文量
1428
期刊介绍: The scope of this journal is to publish peer-reviewed articles that provide a timely and concise account of innovative research ideas and application results, reporting significant theoretical findings and application case studies in areas of robotics and automation.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书