CrackMDM: Masked Modeling on DCT Domain for Efficient Pavement Crack Segmentation

IF 5.9 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Huajun Liu;Yuan Jiang;Cailing Wang;Suting Chen;Hui Kong
{"title":"CrackMDM: Masked Modeling on DCT Domain for Efficient Pavement Crack Segmentation","authors":"Huajun Liu;Yuan Jiang;Cailing Wang;Suting Chen;Hui Kong","doi":"10.1109/TIM.2025.3604145","DOIUrl":null,"url":null,"abstract":"Existing pavement crack inspection methods heavily rely on a large amount of annotated samples and require overburdened computational power, which is not affordable on edge devices. Recent methods mostly focus on spatial features, which cannot effectively capture the long, continuous, tender, and thin road features. The masked image modeling (MIM) is an effective way to rebuild the crack primitive features by masking strategy on unlabeled data to reduce the dependence on annotated data, and the convolution on the frequency domain provides a flexible and efficient path to capture continuous and tender road features. Inspired by the thoughts of masked frequency modeling (MFM), we proposed a masked discrete cosine transform (DCT)-domain modeling strategy, named crack masked DCT-domain modeling (CrackMDM), for efficient pavement crack segmentation. Specifically, we propose a DCT-domain masked modeling method in the CrackMDM model, which combines the advantages of separable convolutions and spectral convolutions (SP-Convs) in the DCT domain to extract continuous and tender crack structures. Additionally, we introduce the self-supervised pretraining with a masking strategy in the DCT domain using unlabeled crack samples to build crack primitives and to fine-tune the encoder and decoder parameters on labeled crack data to refine crack features in the fine-tuning phase. The CrackMDM model is evaluated on three public benchmarks: CFD, YCD, and GAPs, and achieves state-of-the-art (SOTA) performance with superior inference speed. Codes are available at <uri>https://github.com/Jyuan357/CrackMDM</uri>","PeriodicalId":13341,"journal":{"name":"IEEE Transactions on Instrumentation and Measurement","volume":"74 ","pages":"1-15"},"PeriodicalIF":5.9000,"publicationDate":"2025-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Instrumentation and Measurement","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/11145882/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Existing pavement crack inspection methods heavily rely on a large amount of annotated samples and require overburdened computational power, which is not affordable on edge devices. Recent methods mostly focus on spatial features, which cannot effectively capture the long, continuous, tender, and thin road features. The masked image modeling (MIM) is an effective way to rebuild the crack primitive features by masking strategy on unlabeled data to reduce the dependence on annotated data, and the convolution on the frequency domain provides a flexible and efficient path to capture continuous and tender road features. Inspired by the thoughts of masked frequency modeling (MFM), we proposed a masked discrete cosine transform (DCT)-domain modeling strategy, named crack masked DCT-domain modeling (CrackMDM), for efficient pavement crack segmentation. Specifically, we propose a DCT-domain masked modeling method in the CrackMDM model, which combines the advantages of separable convolutions and spectral convolutions (SP-Convs) in the DCT domain to extract continuous and tender crack structures. Additionally, we introduce the self-supervised pretraining with a masking strategy in the DCT domain using unlabeled crack samples to build crack primitives and to fine-tune the encoder and decoder parameters on labeled crack data to refine crack features in the fine-tuning phase. The CrackMDM model is evaluated on three public benchmarks: CFD, YCD, and GAPs, and achieves state-of-the-art (SOTA) performance with superior inference speed. Codes are available at https://github.com/Jyuan357/CrackMDM
裂缝mdm:基于DCT域的掩模路面裂缝有效分割
现有的路面裂缝检测方法严重依赖于大量带注释的样本,并且需要负担过重的计算能力,这在边缘设备上是无法承受的。目前的方法主要集中在空间特征上,不能有效地捕捉长、连续、柔软、细的道路特征。掩蔽图像建模(MIM)是一种有效的方法,通过对未标记数据的掩蔽策略来重建裂缝原语特征,以减少对标注数据的依赖,而在频域上的卷积为捕获连续和柔软的道路特征提供了灵活有效的途径。受掩模频率建模(MFM)思想的启发,提出了一种有效分割路面裂缝的掩模离散余弦变换(DCT)域建模策略——裂缝掩模DCT域建模(CrackMDM)。具体而言,我们在裂纹mdm模型中提出了一种DCT域掩模建模方法,该方法结合了DCT域中可分卷积和频谱卷积(SP-Convs)的优点,提取连续和柔软的裂纹结构。此外,我们在DCT域中引入了一种带有掩蔽策略的自监督预训练,使用未标记的裂纹样本构建裂纹原语,并在标记的裂纹数据上微调编码器和解码器参数,以在微调阶段细化裂纹特征。CrackMDM模型在三个公共基准上进行了评估:CFD、YCD和GAPs,并以卓越的推理速度实现了最先进(SOTA)的性能。代码可在https://github.com/Jyuan357/CrackMDM上获得
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Instrumentation and Measurement
IEEE Transactions on Instrumentation and Measurement 工程技术-工程:电子与电气
CiteScore
9.00
自引率
23.20%
发文量
1294
审稿时长
3.9 months
期刊介绍: Papers are sought that address innovative solutions to the development and use of electrical and electronic instruments and equipment to measure, monitor and/or record physical phenomena for the purpose of advancing measurement science, methods, functionality and applications. The scope of these papers may encompass: (1) theory, methodology, and practice of measurement; (2) design, development and evaluation of instrumentation and measurement systems and components used in generating, acquiring, conditioning and processing signals; (3) analysis, representation, display, and preservation of the information obtained from a set of measurements; and (4) scientific and technical support to establishment and maintenance of technical standards in the field of Instrumentation and Measurement.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信