{"title":"基于人工智能的无标记DIC大型结构位移测量","authors":"Sneha Prasad;David Kumar;Chih-Hung Chiang;Sumit Kalra;Arpit Khandelwal","doi":"10.1109/JSEN.2024.3519460","DOIUrl":null,"url":null,"abstract":"Digital image correlation (DIC) technique provides an accurate and efficient solution for measuring both 2-D and 3-D displacements of large structures. However, a successful DIC implementation requires unique patterns or markers on the target surface. Creating artificial markers on large structures is a time-consuming and challenging task. Any error while developing or identifying unique markers could lead to unreliable and inaccurate DIC results. This study introduces a novel artificial intelligence (AI)-based approach to identify and generate distinctive feature-rich natural markers for DIC. The proposed technique includes a crucial preprocessing step, which comprises an instance segmentation model built with the you only look once (YOLOv8) and the segment anything model (SAM) deep learning algorithms. This model ensures that the markers are integral to the structure rather than a part of the background. Further, the developed methodology employs the KAZE feature-based clustering (FBC) approach to identify poly-shaped non-intersecting regions as a DIC marker for achieving strong correlation. This study incorporates a wind turbine tower dataset to validate and demonstrate the proposed methodology. The performance of the developed technique is evaluated with respect to the conventional manual marker selection approach and recently developed marker generation methodologies. It is observed that the proposed methodology is 11 times faster and reduces memory consumption by 63%. Moreover, it excludes feature-less regions and can successfully determine the optimal feature-rich DIC marker (in the form of a non-intersecting poly-shaped marker) for achieving strong correlations.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 3","pages":"5221-5230"},"PeriodicalIF":4.3000,"publicationDate":"2024-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"AI-Based Marker-Free DIC for Measuring Displacements of Large Structures\",\"authors\":\"Sneha Prasad;David Kumar;Chih-Hung Chiang;Sumit Kalra;Arpit Khandelwal\",\"doi\":\"10.1109/JSEN.2024.3519460\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Digital image correlation (DIC) technique provides an accurate and efficient solution for measuring both 2-D and 3-D displacements of large structures. However, a successful DIC implementation requires unique patterns or markers on the target surface. Creating artificial markers on large structures is a time-consuming and challenging task. Any error while developing or identifying unique markers could lead to unreliable and inaccurate DIC results. This study introduces a novel artificial intelligence (AI)-based approach to identify and generate distinctive feature-rich natural markers for DIC. The proposed technique includes a crucial preprocessing step, which comprises an instance segmentation model built with the you only look once (YOLOv8) and the segment anything model (SAM) deep learning algorithms. This model ensures that the markers are integral to the structure rather than a part of the background. Further, the developed methodology employs the KAZE feature-based clustering (FBC) approach to identify poly-shaped non-intersecting regions as a DIC marker for achieving strong correlation. This study incorporates a wind turbine tower dataset to validate and demonstrate the proposed methodology. The performance of the developed technique is evaluated with respect to the conventional manual marker selection approach and recently developed marker generation methodologies. It is observed that the proposed methodology is 11 times faster and reduces memory consumption by 63%. Moreover, it excludes feature-less regions and can successfully determine the optimal feature-rich DIC marker (in the form of a non-intersecting poly-shaped marker) for achieving strong correlations.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 3\",\"pages\":\"5221-5230\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-12-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10812706/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10812706/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
AI-Based Marker-Free DIC for Measuring Displacements of Large Structures
Digital image correlation (DIC) technique provides an accurate and efficient solution for measuring both 2-D and 3-D displacements of large structures. However, a successful DIC implementation requires unique patterns or markers on the target surface. Creating artificial markers on large structures is a time-consuming and challenging task. Any error while developing or identifying unique markers could lead to unreliable and inaccurate DIC results. This study introduces a novel artificial intelligence (AI)-based approach to identify and generate distinctive feature-rich natural markers for DIC. The proposed technique includes a crucial preprocessing step, which comprises an instance segmentation model built with the you only look once (YOLOv8) and the segment anything model (SAM) deep learning algorithms. This model ensures that the markers are integral to the structure rather than a part of the background. Further, the developed methodology employs the KAZE feature-based clustering (FBC) approach to identify poly-shaped non-intersecting regions as a DIC marker for achieving strong correlation. This study incorporates a wind turbine tower dataset to validate and demonstrate the proposed methodology. The performance of the developed technique is evaluated with respect to the conventional manual marker selection approach and recently developed marker generation methodologies. It is observed that the proposed methodology is 11 times faster and reduces memory consumption by 63%. Moreover, it excludes feature-less regions and can successfully determine the optimal feature-rich DIC marker (in the form of a non-intersecting poly-shaped marker) for achieving strong correlations.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice