{"title":"利用任务优化神经网络进行与用户无关、精确且像素化的 DIC 测量","authors":"B. Pan, Y. Liu","doi":"10.1007/s11340-024-01088-4","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>Being an image-based optical technique for full-field deformation measurements, the ultimate purpose of digital image correlation (DIC) is to realize accurate, precise and pixel-wise displacement/strain measurements in a full-automatic manner without users’ inputs.</p><h3>Objective</h3><p>In this work, we propose a task-optimized neural network, called RAFT-DIC, to achieve user-independent, accurate and pixel-wise displacement field measurements.</p><h3>Methods</h3><p>RAFT-DIC is based on the state-of-the-art optical flow architecture: Recurrent All-Pairs Field Transforms (RAFT). We make two targeted improvements that fundamentally enhanced its measurement accuracy and generalization performance. Firstly, we remove all the down-sampling operations in the encode module to improve the perception of spatial information, and reduce the number of pyramid levels of the correlation layer to increase the small displacement accuracy. By building the correlation layer to compute the similarity of pixel pairs, and iteratively updating the displacement field through a recurrent unit, RAFT-DIC introduces the prior information of DIC measurement to guide the displacement estimation with high accuracy. Secondly, we develop a novel dataset generation method to synthesize customized speckle patterns and diverse displacement fields, which facilitate the construction of a robust and adaptable dataset to improve the network generalization.</p><h3>Results</h3><p>Both simulated and real experimental results demonstrate that the accuracy of the proposed method is approximately an order of magnitude higher than pervious deep learning-based DIC (DL-DIC).</p><h3>Conclusions</h3><p>The proposed RAFT-DIC shows higher accuracy as well as stronger practicality and cross-dataset generalization performance over existing DL-DIC methods, and is expected to be a new standard architecture for DL-DIC.</p></div>","PeriodicalId":552,"journal":{"name":"Experimental Mechanics","volume":"64 8","pages":"1199 - 1213"},"PeriodicalIF":2.0000,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"User-Independent, Accurate and Pixel-Wise DIC Measurements with a Task-Optimized Neural Network\",\"authors\":\"B. Pan, Y. Liu\",\"doi\":\"10.1007/s11340-024-01088-4\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Background</h3><p>Being an image-based optical technique for full-field deformation measurements, the ultimate purpose of digital image correlation (DIC) is to realize accurate, precise and pixel-wise displacement/strain measurements in a full-automatic manner without users’ inputs.</p><h3>Objective</h3><p>In this work, we propose a task-optimized neural network, called RAFT-DIC, to achieve user-independent, accurate and pixel-wise displacement field measurements.</p><h3>Methods</h3><p>RAFT-DIC is based on the state-of-the-art optical flow architecture: Recurrent All-Pairs Field Transforms (RAFT). We make two targeted improvements that fundamentally enhanced its measurement accuracy and generalization performance. Firstly, we remove all the down-sampling operations in the encode module to improve the perception of spatial information, and reduce the number of pyramid levels of the correlation layer to increase the small displacement accuracy. By building the correlation layer to compute the similarity of pixel pairs, and iteratively updating the displacement field through a recurrent unit, RAFT-DIC introduces the prior information of DIC measurement to guide the displacement estimation with high accuracy. Secondly, we develop a novel dataset generation method to synthesize customized speckle patterns and diverse displacement fields, which facilitate the construction of a robust and adaptable dataset to improve the network generalization.</p><h3>Results</h3><p>Both simulated and real experimental results demonstrate that the accuracy of the proposed method is approximately an order of magnitude higher than pervious deep learning-based DIC (DL-DIC).</p><h3>Conclusions</h3><p>The proposed RAFT-DIC shows higher accuracy as well as stronger practicality and cross-dataset generalization performance over existing DL-DIC methods, and is expected to be a new standard architecture for DL-DIC.</p></div>\",\"PeriodicalId\":552,\"journal\":{\"name\":\"Experimental Mechanics\",\"volume\":\"64 8\",\"pages\":\"1199 - 1213\"},\"PeriodicalIF\":2.0000,\"publicationDate\":\"2024-06-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Experimental Mechanics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s11340-024-01088-4\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MATERIALS SCIENCE, CHARACTERIZATION & TESTING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Experimental Mechanics","FirstCategoryId":"5","ListUrlMain":"https://link.springer.com/article/10.1007/s11340-024-01088-4","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, CHARACTERIZATION & TESTING","Score":null,"Total":0}
User-Independent, Accurate and Pixel-Wise DIC Measurements with a Task-Optimized Neural Network
Background
Being an image-based optical technique for full-field deformation measurements, the ultimate purpose of digital image correlation (DIC) is to realize accurate, precise and pixel-wise displacement/strain measurements in a full-automatic manner without users’ inputs.
Objective
In this work, we propose a task-optimized neural network, called RAFT-DIC, to achieve user-independent, accurate and pixel-wise displacement field measurements.
Methods
RAFT-DIC is based on the state-of-the-art optical flow architecture: Recurrent All-Pairs Field Transforms (RAFT). We make two targeted improvements that fundamentally enhanced its measurement accuracy and generalization performance. Firstly, we remove all the down-sampling operations in the encode module to improve the perception of spatial information, and reduce the number of pyramid levels of the correlation layer to increase the small displacement accuracy. By building the correlation layer to compute the similarity of pixel pairs, and iteratively updating the displacement field through a recurrent unit, RAFT-DIC introduces the prior information of DIC measurement to guide the displacement estimation with high accuracy. Secondly, we develop a novel dataset generation method to synthesize customized speckle patterns and diverse displacement fields, which facilitate the construction of a robust and adaptable dataset to improve the network generalization.
Results
Both simulated and real experimental results demonstrate that the accuracy of the proposed method is approximately an order of magnitude higher than pervious deep learning-based DIC (DL-DIC).
Conclusions
The proposed RAFT-DIC shows higher accuracy as well as stronger practicality and cross-dataset generalization performance over existing DL-DIC methods, and is expected to be a new standard architecture for DL-DIC.
期刊介绍:
Experimental Mechanics is the official journal of the Society for Experimental Mechanics that publishes papers in all areas of experimentation including its theoretical and computational analysis. The journal covers research in design and implementation of novel or improved experiments to characterize materials, structures and systems. Articles extending the frontiers of experimental mechanics at large and small scales are particularly welcome.
Coverage extends from research in solid and fluids mechanics to fields at the intersection of disciplines including physics, chemistry and biology. Development of new devices and technologies for metrology applications in a wide range of industrial sectors (e.g., manufacturing, high-performance materials, aerospace, information technology, medicine, energy and environmental technologies) is also covered.