Application of image recognition technology in digital twinning technology: Taking tangram splicing as an example

Abstract

Background: With the rapid development of digital twinning technology, the compatibility of digital twinning technology to other technologies is continuously enhanced. It is because of this that the application of image recognition technology in digital twinning technology becomes a reality. However, the key technology of digital twin, the virtual-actual mutual control technology, is not mature enough, and the image recognition technology applied in digital twin technology also has the problem of coordinate system transformation, which becomes an important link of image recognition technology in digital twin. Methods: Based on the above two problems, we take the tangram splicing project as an example to realize a virtual-actual mutual control method, so that the digital twinning technology can be well presented. Furthermore, we implement an image recognition applied to the conversion of digital twinning technology, so that digital twinning technology and image recognition have a seamless connection, allowing the application range of digital twinning technology to be further expanded. Results: In this paper, image recognition technology is successfully applied to digital twin technology by adopting the conversion between different coordinate systems and the real and virtual real time control, which makes the applicability of digital twin technology in high-tech fields such as smart factories and smart manufacturing to a higher level. Conclusions: Finally, through the tangram splicing project, the motion trajectories of the robotic arm and the tangram are consistent with the virtual robotic arm and the tangram in the computer. It is proved that our method can well combine digital twinning technology and image recognition technology.