Shijing Hu , Zhihui Lu , Xin Xu , Ruijun Deng , Xin Du , Qiang Duan
{"title":"LAECIPS:基于物联网的具体智能系统的大视觉模型辅助自适应边缘云协作","authors":"Shijing Hu , Zhihui Lu , Xin Xu , Ruijun Deng , Xin Du , Qiang Duan","doi":"10.1016/j.jii.2025.100955","DOIUrl":null,"url":null,"abstract":"<div><div>Embodied intelligence (EI) enables manufacturing systems to flexibly perceive, reason, adapt, and operate within dynamic shop floor environments. In smart manufacturing, a representative EI scenario is <strong>robotic visual inspection</strong>, where industrial robots must accurately inspect components on rapidly changing, heterogeneous production lines. This task requires both high inference accuracy — especially for uncommon defects — and low latency to match production speeds, despite evolving lighting, part geometries, and surface conditions. To meet these needs, we propose <strong>LAECIPS</strong>, a large vision model-assisted adaptive edge–cloud collaboration framework for IoT-based embodied intelligence systems. LAECIPS decouples large vision models in the cloud from lightweight models on the edge, enabling flexible model deployment and continual learning (automated model updates). Through identifying complex inspection cases, LAECIPS routes complex and uncertain inspection cases to the cloud while handling routine tasks at the edge, achieving both high accuracy and low latency. Experiments conducted on a real-world robotic semantic segmentation system for visual inspection demonstrate significant improvements in accuracy, processing latency, and communication overhead compared to state-of-the-art methods. From an industrial information integration perspective, LAECiPS operationalizes a complete edge–cloud information loop for smart manufacturing: integrating multi-source perception data at the edge, adaptively routing information to the cloud for large model assistance, and feeding back distilled knowledge to the edge for continual adaptation. This layered integration improves both accuracy and task-time-constrained latency, aligning with the focus on interoperable and scalable industrial information integration.</div></div>","PeriodicalId":55975,"journal":{"name":"Journal of Industrial Information Integration","volume":"48 ","pages":"Article 100955"},"PeriodicalIF":10.4000,"publicationDate":"2025-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"LAECIPS: Large vision model assisted adaptive edge–cloud collaboration for IoT-based embodied intelligence system\",\"authors\":\"Shijing Hu , Zhihui Lu , Xin Xu , Ruijun Deng , Xin Du , Qiang Duan\",\"doi\":\"10.1016/j.jii.2025.100955\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Embodied intelligence (EI) enables manufacturing systems to flexibly perceive, reason, adapt, and operate within dynamic shop floor environments. In smart manufacturing, a representative EI scenario is <strong>robotic visual inspection</strong>, where industrial robots must accurately inspect components on rapidly changing, heterogeneous production lines. This task requires both high inference accuracy — especially for uncommon defects — and low latency to match production speeds, despite evolving lighting, part geometries, and surface conditions. To meet these needs, we propose <strong>LAECIPS</strong>, a large vision model-assisted adaptive edge–cloud collaboration framework for IoT-based embodied intelligence systems. LAECIPS decouples large vision models in the cloud from lightweight models on the edge, enabling flexible model deployment and continual learning (automated model updates). Through identifying complex inspection cases, LAECIPS routes complex and uncertain inspection cases to the cloud while handling routine tasks at the edge, achieving both high accuracy and low latency. Experiments conducted on a real-world robotic semantic segmentation system for visual inspection demonstrate significant improvements in accuracy, processing latency, and communication overhead compared to state-of-the-art methods. From an industrial information integration perspective, LAECiPS operationalizes a complete edge–cloud information loop for smart manufacturing: integrating multi-source perception data at the edge, adaptively routing information to the cloud for large model assistance, and feeding back distilled knowledge to the edge for continual adaptation. This layered integration improves both accuracy and task-time-constrained latency, aligning with the focus on interoperable and scalable industrial information integration.</div></div>\",\"PeriodicalId\":55975,\"journal\":{\"name\":\"Journal of Industrial Information Integration\",\"volume\":\"48 \",\"pages\":\"Article 100955\"},\"PeriodicalIF\":10.4000,\"publicationDate\":\"2025-09-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Industrial Information Integration\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2452414X25001785\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Industrial Information Integration","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2452414X25001785","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
LAECIPS: Large vision model assisted adaptive edge–cloud collaboration for IoT-based embodied intelligence system
Embodied intelligence (EI) enables manufacturing systems to flexibly perceive, reason, adapt, and operate within dynamic shop floor environments. In smart manufacturing, a representative EI scenario is robotic visual inspection, where industrial robots must accurately inspect components on rapidly changing, heterogeneous production lines. This task requires both high inference accuracy — especially for uncommon defects — and low latency to match production speeds, despite evolving lighting, part geometries, and surface conditions. To meet these needs, we propose LAECIPS, a large vision model-assisted adaptive edge–cloud collaboration framework for IoT-based embodied intelligence systems. LAECIPS decouples large vision models in the cloud from lightweight models on the edge, enabling flexible model deployment and continual learning (automated model updates). Through identifying complex inspection cases, LAECIPS routes complex and uncertain inspection cases to the cloud while handling routine tasks at the edge, achieving both high accuracy and low latency. Experiments conducted on a real-world robotic semantic segmentation system for visual inspection demonstrate significant improvements in accuracy, processing latency, and communication overhead compared to state-of-the-art methods. From an industrial information integration perspective, LAECiPS operationalizes a complete edge–cloud information loop for smart manufacturing: integrating multi-source perception data at the edge, adaptively routing information to the cloud for large model assistance, and feeding back distilled knowledge to the edge for continual adaptation. This layered integration improves both accuracy and task-time-constrained latency, aligning with the focus on interoperable and scalable industrial information integration.
期刊介绍:
The Journal of Industrial Information Integration focuses on the industry's transition towards industrial integration and informatization, covering not only hardware and software but also information integration. It serves as a platform for promoting advances in industrial information integration, addressing challenges, issues, and solutions in an interdisciplinary forum for researchers, practitioners, and policy makers.
The Journal of Industrial Information Integration welcomes papers on foundational, technical, and practical aspects of industrial information integration, emphasizing the complex and cross-disciplinary topics that arise in industrial integration. Techniques from mathematical science, computer science, computer engineering, electrical and electronic engineering, manufacturing engineering, and engineering management are crucial in this context.