Design of modified model of intelligent assembly digital twins based on optical fiber sensor network

IF 7.5 2区 计算机科学 Q1 TELECOMMUNICATIONS
Zhichao Liu , Jinhua Yang , Juan Wang , Lin Yue
{"title":"Design of modified model of intelligent assembly digital twins based on optical fiber sensor network","authors":"Zhichao Liu ,&nbsp;Jinhua Yang ,&nbsp;Juan Wang ,&nbsp;Lin Yue","doi":"10.1016/j.dcan.2022.06.013","DOIUrl":null,"url":null,"abstract":"<div><div>Intelligent assembly of large-scale, complex structures using an intelligent manufacturing platform represents the future development direction for industrial manufacturing. During large-scale structural assembly processes, several bottleneck problems occur in the existing auxiliary assembly technology. First, the traditional LiDAR-based assembly technology is often limited by the openness of the manufacturing environment, in which there are blind spots, and continuous online assembly adjustment thus cannot be realized. Second, for assembly of large structures, a single-station LiDAR system cannot achieve complete coverage, which means that a multi-station combination method must be used to acquire the complete three-dimensional data; many more data errors are caused by the transfer between stations than by the measurement accuracy of a single station, which means that the overall system's measurement and adjustment errors are increased greatly. Third, because of the large numbers of structural components contained in a large assembly, the accumulated errors may lead to assembly interference, but the LiDAR-assisted assembly process does not have a feedback perception capability, and thus assembly component loss can easily be caused when assembly interference occurs. Therefore, this paper proposes to combine an optical fiber sensor network with digital twin technology, which will allow the test data from the assembly entity state in the real world to be applied to the “twin” model in the virtual world and thus solve the problems with test openness and data transfer. The problem of station and perception feedback is also addressed and represents the main innovation of this work. The system uses an optical fiber sensor network as a flexible sensing medium to monitor the strain field distribution within a complex area in real time, and then completes real-time parameter adjustment of the virtual assembly based on the distributed data. Complex areas include areas that are laser-unreachable, areas with complex contact surfaces, and areas with large-scale bending deformations. An assembly condition monitoring system is designed based on the optical fiber sensor network, and an assembly condition monitoring algorithm based on multiple physical quantities is proposed. The feasibility of use of the optical fiber sensor network as the real-state parameter acquisition module for the digital twin intelligent assembly system is discussed. The offset of any position in the test area is calculated using the convolutional neural network of a residual module to provide the compensation parameters required for the virtual model of the assembly structure. In the model optimization parameter module, a correction data table is obtained through iterative learning of the algorithm to realize state prediction from the test data. The experiment simulates a large-scale structure assembly process, and performs virtual and real mapping for a variety of situations with different assembly errors to enable correction of the digital twin data stream for the assembly process through the optical fiber sensor network. In the plane strain field calibration experiment, the maximum error among the test values for this system is 0.032 ​mm, and the average error is 0.014 ​mm. The results show that use of visual calibration can correct the test error to within a very small range. This result is equally applicable to gradient curvature surfaces and freeform surfaces. Statistics show that the average measurement accuracy error for regular surfaces is better than 11.2%, and the average measurement accuracy error for irregular surfaces is better than 14.8%. During simulation of large-scale structure assembly experiments, the average position deviation accuracy is 0.043 ​mm, which is in line with the designed accuracy.</div></div>","PeriodicalId":48631,"journal":{"name":"Digital Communications and Networks","volume":"10 5","pages":"Pages 1542-1552"},"PeriodicalIF":7.5000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Communications and Networks","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2352864822001353","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

Intelligent assembly of large-scale, complex structures using an intelligent manufacturing platform represents the future development direction for industrial manufacturing. During large-scale structural assembly processes, several bottleneck problems occur in the existing auxiliary assembly technology. First, the traditional LiDAR-based assembly technology is often limited by the openness of the manufacturing environment, in which there are blind spots, and continuous online assembly adjustment thus cannot be realized. Second, for assembly of large structures, a single-station LiDAR system cannot achieve complete coverage, which means that a multi-station combination method must be used to acquire the complete three-dimensional data; many more data errors are caused by the transfer between stations than by the measurement accuracy of a single station, which means that the overall system's measurement and adjustment errors are increased greatly. Third, because of the large numbers of structural components contained in a large assembly, the accumulated errors may lead to assembly interference, but the LiDAR-assisted assembly process does not have a feedback perception capability, and thus assembly component loss can easily be caused when assembly interference occurs. Therefore, this paper proposes to combine an optical fiber sensor network with digital twin technology, which will allow the test data from the assembly entity state in the real world to be applied to the “twin” model in the virtual world and thus solve the problems with test openness and data transfer. The problem of station and perception feedback is also addressed and represents the main innovation of this work. The system uses an optical fiber sensor network as a flexible sensing medium to monitor the strain field distribution within a complex area in real time, and then completes real-time parameter adjustment of the virtual assembly based on the distributed data. Complex areas include areas that are laser-unreachable, areas with complex contact surfaces, and areas with large-scale bending deformations. An assembly condition monitoring system is designed based on the optical fiber sensor network, and an assembly condition monitoring algorithm based on multiple physical quantities is proposed. The feasibility of use of the optical fiber sensor network as the real-state parameter acquisition module for the digital twin intelligent assembly system is discussed. The offset of any position in the test area is calculated using the convolutional neural network of a residual module to provide the compensation parameters required for the virtual model of the assembly structure. In the model optimization parameter module, a correction data table is obtained through iterative learning of the algorithm to realize state prediction from the test data. The experiment simulates a large-scale structure assembly process, and performs virtual and real mapping for a variety of situations with different assembly errors to enable correction of the digital twin data stream for the assembly process through the optical fiber sensor network. In the plane strain field calibration experiment, the maximum error among the test values for this system is 0.032 ​mm, and the average error is 0.014 ​mm. The results show that use of visual calibration can correct the test error to within a very small range. This result is equally applicable to gradient curvature surfaces and freeform surfaces. Statistics show that the average measurement accuracy error for regular surfaces is better than 11.2%, and the average measurement accuracy error for irregular surfaces is better than 14.8%. During simulation of large-scale structure assembly experiments, the average position deviation accuracy is 0.043 ​mm, which is in line with the designed accuracy.
基于光纤传感器网络的智能装配数字孪生改进模型设计
利用智能制造平台实现大型复杂结构的智能装配是未来工业制造的发展方向。在大型结构装配过程中,现有的辅助装配技术存在几个瓶颈问题。首先,传统的基于激光雷达的装配技术往往受限于制造环境的开放性,存在盲区,无法实现连续的在线装配调整。其次,对于大型结构的装配,单站的激光雷达系统无法实现完全覆盖,这就意味着必须采用多站组合的方法来获取完整的三维数据;与单站的测量精度相比,多站之间的传输所造成的数据误差要大得多,这就意味着整个系统的测量和调整误差会大大增加。第三,由于大型装配体中包含大量结构部件,累积误差可能导致装配干扰,但激光雷达辅助装配过程不具备反馈感知能力,因此装配干扰发生时很容易造成装配体部件丢失。因此,本文提出将光纤传感网络与数字孪生技术相结合,将现实世界中装配实体状态的测试数据应用于虚拟世界中的 "孪生 "模型,从而解决测试开放性和数据传输的问题。此外,还解决了工位和感知反馈问题,这也是这项工作的主要创新点。该系统利用光纤传感器网络作为灵活的传感媒介,实时监测复杂区域内的应变场分布,然后根据分布的数据完成虚拟装配的实时参数调整。复杂区域包括激光无法触及的区域、接触面复杂的区域以及存在大规模弯曲变形的区域。设计了基于光纤传感器网络的装配状态监测系统,并提出了基于多个物理量的装配状态监测算法。讨论了将光纤传感网络作为数字孪生智能装配系统的实态参数采集模块的可行性。利用残差模块的卷积神经网络计算测试区域内任意位置的偏移量,为装配结构的虚拟模型提供所需的补偿参数。在模型优化参数模块中,通过算法迭代学习获得修正数据表,从而实现测试数据的状态预测。实验模拟大型结构装配过程,对不同装配误差的各种情况进行虚实映射,通过光纤传感网络实现装配过程数字孪生数据流的校正。在平面应变场校准实验中,该系统测试值之间的最大误差为 0.032 毫米,平均误差为 0.014 毫米。结果表明,使用视觉校准可以将测试误差修正到很小的范围内。这一结果同样适用于梯度曲率表面和自由曲面。统计数据显示,规则表面的平均测量精度误差优于 11.2%,不规则表面的平均测量精度误差优于 14.8%。在大型结构装配实验模拟中,平均位置偏差精度为 0.043 毫米,与设计精度相符。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Digital Communications and Networks
Digital Communications and Networks Computer Science-Hardware and Architecture
CiteScore
12.80
自引率
5.10%
发文量
915
审稿时长
30 weeks
期刊介绍: Digital Communications and Networks is a prestigious journal that emphasizes on communication systems and networks. We publish only top-notch original articles and authoritative reviews, which undergo rigorous peer-review. We are proud to announce that all our articles are fully Open Access and can be accessed on ScienceDirect. Our journal is recognized and indexed by eminent databases such as the Science Citation Index Expanded (SCIE) and Scopus. In addition to regular articles, we may also consider exceptional conference papers that have been significantly expanded. Furthermore, we periodically release special issues that focus on specific aspects of the field. In conclusion, Digital Communications and Networks is a leading journal that guarantees exceptional quality and accessibility for researchers and scholars in the field of communication systems and networks.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信