Liang Zhu , Kuan Shen , Guangwen Wang , Yujie Hao , Lijun Zheng , Yanping Lu
{"title":"DUWS Net: Wavelet-based dual U-shaped spatial-frequency fusion transformer network for medical image segmentation","authors":"Liang Zhu , Kuan Shen , Guangwen Wang , Yujie Hao , Lijun Zheng , Yanping Lu","doi":"10.1016/j.jvcir.2025.104428","DOIUrl":null,"url":null,"abstract":"<div><div>Medical image segmentation is crucial for disease monitoring, diagnosis, and treatment planning. However, due to the complexity of medical images and their rich frequency information, networks face challenges in segmenting regions of interest using single-domain information. This study proposes a wavelet-transform-based dual U-Net fusion Transformer network for medical image segmentation, aiming to address the shortcomings of current methods. The network supplements spatial information through an external U-Net encoder-decoder structure, enabling deeper extraction of spatial features from the images. The internal U-shaped structure utilizes wavelet transform to capture low-frequency and high-frequency components of feature maps, performing linear self-attention interactions between these frequencies. This allows the network to learn global structures from low frequencies while capturing detailed features from high frequencies. Finally, spatial and frequency domain features are fused through alternating weighting based on spatial and channel dimensions. Experimental results show that the proposed method outperforms traditional single-domain segmentation models.</div></div>","PeriodicalId":54755,"journal":{"name":"Journal of Visual Communication and Image Representation","volume":"108 ","pages":"Article 104428"},"PeriodicalIF":2.6000,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Visual Communication and Image Representation","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1047320325000422","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Medical image segmentation is crucial for disease monitoring, diagnosis, and treatment planning. However, due to the complexity of medical images and their rich frequency information, networks face challenges in segmenting regions of interest using single-domain information. This study proposes a wavelet-transform-based dual U-Net fusion Transformer network for medical image segmentation, aiming to address the shortcomings of current methods. The network supplements spatial information through an external U-Net encoder-decoder structure, enabling deeper extraction of spatial features from the images. The internal U-shaped structure utilizes wavelet transform to capture low-frequency and high-frequency components of feature maps, performing linear self-attention interactions between these frequencies. This allows the network to learn global structures from low frequencies while capturing detailed features from high frequencies. Finally, spatial and frequency domain features are fused through alternating weighting based on spatial and channel dimensions. Experimental results show that the proposed method outperforms traditional single-domain segmentation models.
期刊介绍:
The Journal of Visual Communication and Image Representation publishes papers on state-of-the-art visual communication and image representation, with emphasis on novel technologies and theoretical work in this multidisciplinary area of pure and applied research. The field of visual communication and image representation is considered in its broadest sense and covers both digital and analog aspects as well as processing and communication in biological visual systems.