IEEE transactions on image processing : a publication of the IEEE Signal Processing Society最新文献

筛选
英文 中文
Spatial-Frequency-Aware Implicit Neural Representation of Multidimensional Signals via MLP-KAN Fusion. 基于MLP-KAN融合的空间频率感知的多维信号隐式神经表示。
IF 13.7
Wen Yan, Ligen Shi, Jun Qiu, Haimiao Zhang, Lina Wu, Chang Liu
{"title":"Spatial-Frequency-Aware Implicit Neural Representation of Multidimensional Signals via MLP-KAN Fusion.","authors":"Wen Yan, Ligen Shi, Jun Qiu, Haimiao Zhang, Lina Wu, Chang Liu","doi":"10.1109/TIP.2026.3750876","DOIUrl":"10.1109/TIP.2026.3750876","url":null,"abstract":"<p><p>Implicit Neural Representations (INRs) have emerged as a compelling paradigm for modeling multidimensional signals by mapping continuous coordinates to signal values. However, Multi-Layer Perceptrons (MLP)-based INRs inherently suffer from spectral bias, which favors low-frequency components and suppresses the reconstruction of essential high-frequency details. While existing techniques, such as Fourier feature mappings, mitigate this issue, they often rely on sensitive manual tuning and are prone to spectral artifacts. In this paper, we propose a spatial-frequency-aware INR framework that combines an MLP branch with a Kolmogorov-Arnold network (KAN) branch for complementary frequency-oriented modeling. The MLP branch provides a low-frequency-oriented representation of smooth structures, whereas the KAN branch complements localized variations and fine details. To coordinate the two branches, we integrate the discrete wavelet transform (DWT) and inverse discrete wavelet transform (IDWT) into the output fusion stage. The outputs of the two branches are decomposed into wavelet coefficients, and the corresponding coefficients are additively fused before inverse wavelet reconstruction. A wavelet-domain band-separation regularization further penalizes high-frequency responses in the MLP branch and low-frequency responses in the KAN branch, thereby encouraging complementary frequency-oriented behavior. Experiments on 1D signals, 2D images, 3D volumes and signed distance functions, videos, and 4D light-fields demonstrate the applicability of the proposed representation across the evaluated signal modalities. Results demonstrate improved reconstruction fidelity across the evaluated signal modalities.</p>","PeriodicalId":94032,"journal":{"name":"IEEE transactions on image processing : a publication of the IEEE Signal Processing Society","volume":"PP ","pages":""},"PeriodicalIF":13.7,"publicationDate":"2026-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149396654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Preserving Structural Irreplaceability in Token Pruning through Local Representation Complexity. 利用局部表示复杂度保持令牌剪枝中的结构不可替代性。
IF 13.7
Chongxin Li, Shiyu Lu, Hanzhang Wang
{"title":"Preserving Structural Irreplaceability in Token Pruning through Local Representation Complexity.","authors":"Chongxin Li, Shiyu Lu, Hanzhang Wang","doi":"10.1109/TIP.2026.3744689","DOIUrl":"10.1109/TIP.2026.3744689","url":null,"abstract":"<p><p>The effectiveness of vision token pruning critically depends on the criterion used to define token redundancy. Existing approaches, which primarily rely on global saliency scores or similarity heuristics, often fail to account for a token's essential contribution to the model's internal representations. This oversight results in retaining visually prominent but redundant tokens or merging semantically distinct features, severely degrading performance under tight compression budgets. To address this, we propose a novel token pruning strategy aligned with representation complexity. We first introduce Local Representation Complexity (LRC), a token-level measure that estimates the intrinsic dimension of each token's embedding. Tokens exhibiting high LRC are considered locally unpredictable and are therefore prioritized for preservation. To ensure selection diversity and mitigate over-concentration in the selected set, we frame the pruning process as a budget allocation problem and introduce a Greedy Selection algorithm with Penalized Diversity to actively suppress redundancy. We evaluate the proposed method across five vision-language model backbones from three model families, including LLaVA-1.5/LLaVA-NeXT, Qwen2.5-VL/Qwen3-VL, and InternVL3, covering a wide range of capacities and tasks. The results demonstrate competitive performance across different backbones, with particularly notable gains at aggressive compression ratios.</p>","PeriodicalId":94032,"journal":{"name":"IEEE transactions on image processing : a publication of the IEEE Signal Processing Society","volume":"PP ","pages":""},"PeriodicalIF":13.7,"publicationDate":"2026-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149396652","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Progressive Style Transfer for Exemplar-based Open-world Sketch Colorization. 基于范例的开放世界素描着色的渐进式风格转移。
IF 13.7
Xi Yang, Hanyu Xing, Fei Gao, Maoying Qiao, Nannan Wang
{"title":"Progressive Style Transfer for Exemplar-based Open-world Sketch Colorization.","authors":"Xi Yang, Hanyu Xing, Fei Gao, Maoying Qiao, Nannan Wang","doi":"10.1109/TIP.2026.3751118","DOIUrl":"https://doi.org/10.1109/TIP.2026.3751118","url":null,"abstract":"<p><p>Sketch colorization in open-world scenarios presents unique challenges due to diverse, unpaired datasets and the variety in user-generated sketch styles. Traditional exemplar-based methods, which typically rely on dense feature matching and style normalization, struggle to generalize effectively in these conditions, as they require structured paired data and exhibit limited flexibility. We introduce Progressive Style Transfer (PROST), a completely unsupervised framework that addresses these limitations by progressively injecting style features into sketches without rigid content-style alignment. PROST comprises two key modules: Progressive Style Injection (PSI), which transfers style features adaptively across scales, and Progressive Style Enhancement (PSE), which refines style coherence through multi-layer style-adaptive attention. Together, these modules enable flexible style transfer that preserves content fidelity while achieving high stylistic coherence. Our approach also integrates a Dual Cycle-Consistency (DCC) framework to ensure both style and content consistency in generated outputs. Extensive evaluations demonstrate that PROST effectively generalizes to unseen styles, achieving robust performance across varied datasets and setting a new benchmark for open-world sketch colorization. The source code is publicly available at https://github.com/Vincotto/ProST.</p>","PeriodicalId":94032,"journal":{"name":"IEEE transactions on image processing : a publication of the IEEE Signal Processing Society","volume":"PP ","pages":""},"PeriodicalIF":13.7,"publicationDate":"2026-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149396653","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Rethinking Language Bias in Referring Image Segmentation via Linguistically Enriched Data Reconstruction and Semantic Alignment. 基于语言丰富数据重构和语义对齐的参考图像分割中的语言偏差再思考
IF 13.7
Lu Zhang, Xiaoyu Guo, Yunzhi Zhuge, Wenbo Zhang, Ping Hu, Huchuan Lu, You He
{"title":"Rethinking Language Bias in Referring Image Segmentation via Linguistically Enriched Data Reconstruction and Semantic Alignment.","authors":"Lu Zhang, Xiaoyu Guo, Yunzhi Zhuge, Wenbo Zhang, Ping Hu, Huchuan Lu, You He","doi":"10.1109/TIP.2026.3748959","DOIUrl":"10.1109/TIP.2026.3748959","url":null,"abstract":"<p><p>Referring Image Segmentation (RIS) enables fine-grained interaction between vision and language by segmenting target objects based on natural language expressions. However, existing RIS models are fundamentally constrained by the linguistic bias of manually annotated benchmarks, whose captions exhibit limited lexical, syntactic, and contextual diversity. As a result, these methods often overfit to dataset-specific linguistic patterns and struggle with real-world expressions that deviate from these distributions. To address this issue, we propose a linguistically enriched RIS framework that improves robustness under diverse linguistic expressions. On the data side, we introduce a multi-stage MLLM-driven caption reconstruction pipeline that automatically expands linguistic richness of existing RIS datasets through instance-specific generation, relational context integration, location-aware semantic verification, and linguistic diversification enhancement. On the model side, we design two complementary enhancement strategies: (i) a Decoupled Text-Visual Interaction (DTVI) module that refines fine-grained cross-modal alignment through component-level textual decomposition, and (ii) a Semantic-Aware Mosaic Augmentation (SAMA) strategy that leverages dual-caption semantic cues to mine informative negative contexts and improves target-distractor discrimination under visually confusing contexts. Extensive experiments on three public RIS benchmarks and three representative architectures demonstrate that our framework achieves consistent performance improvement on both original and reconstructed datasets.</p>","PeriodicalId":94032,"journal":{"name":"IEEE transactions on image processing : a publication of the IEEE Signal Processing Society","volume":"PP ","pages":""},"PeriodicalIF":13.7,"publicationDate":"2026-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149358490","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
DeepMURE: Deep Self-Supervised Despeckling via Monte Carlo Multiplicative Unbiased Risk Estimation. 基于蒙特卡罗乘法无偏风险估计的深度自监督分解。
IF 13.7
Ashutosh Gupta, Chandra Sekhar Seelamantula, Thierry Blu, Tanish Yelgoe, Nitant Dube, Shanmuganathan Raman
{"title":"DeepMURE: Deep Self-Supervised Despeckling via Monte Carlo Multiplicative Unbiased Risk Estimation.","authors":"Ashutosh Gupta, Chandra Sekhar Seelamantula, Thierry Blu, Tanish Yelgoe, Nitant Dube, Shanmuganathan Raman","doi":"10.1109/TIP.2026.3746434","DOIUrl":"https://doi.org/10.1109/TIP.2026.3746434","url":null,"abstract":"<p><p>Synthetic Aperture Radars (SAR) are key to all-weather, day-and-night Earth observation. Yet, the direct use of SAR images is hindered by multiplicative speckle. While deep learning has significantly advanced SAR despeckling, the reliance on pristine, speckle-free ground truth for supervised training remains a critical bottleneck in real-world applications. To overcome this fundamental limitation, we propose DeepMURE, a novel and general-purpose self-supervised training framework that effectively bypasses the need for clean reference data. DeepMURE mathematically reconstructs the supervised Mean Squared Error (MSE) directly from noisy observations by leveraging multi-perturbation, higher-order Taylor approximations, explicitly incorporating Jacobian and Hessian corrections to guarantee stable and accurate loss convergence. To fully exploit the potential of this framework in SAR applications, we also introduce SpeckleFormer, a specialized joint spatial-frequency-domain transformer architecture. SpeckleFormer features a Frequency domain Token Block (FTB) to effectively handle Gamma-distributed speckle in homogeneous and heterogeneous regions, alongside a Target Preservation Module (TPM) that explicitly preserves the radiometric response of strong scatterers. Comprehensive evaluations on hybrid Sentinel-1 and high-resolution real ICEYE datasets demonstrate that DeepMURE enables networks to closely approach their fully supervised counterparts. Furthermore, the combined DeepMURE and SpeckleFormer pipeline achieves state-of-the-art performance, delivering superior despeckling with detail preservation as validated by both full-reference and blind quality metrics. Finally, validation on downstream remote sensing task as well ablations confirm that the proposed restoration pipeline effectively enhances the accuracy and reliability of subsequent semantic applications, highlighting its utility for operational Earth observation workflows.</p>","PeriodicalId":94032,"journal":{"name":"IEEE transactions on image processing : a publication of the IEEE Signal Processing Society","volume":"PP ","pages":""},"PeriodicalIF":13.7,"publicationDate":"2026-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149303004","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
AnchorSED: A Segmentation Enhanced Detection Framework Based on Sparse Anchor for Multi-View 3D Object Detection. 锚定:一种基于稀疏锚点的分割增强检测框架,用于多视图三维目标检测。
IF 13.7
Shuhui Cheng, Lei Zhang, Xiaolin Ding, Jizheng Liu
{"title":"AnchorSED: A Segmentation Enhanced Detection Framework Based on Sparse Anchor for Multi-View 3D Object Detection.","authors":"Shuhui Cheng, Lei Zhang, Xiaolin Ding, Jizheng Liu","doi":"10.1109/TIP.2026.3744684","DOIUrl":"https://doi.org/10.1109/TIP.2026.3744684","url":null,"abstract":"<p><p>Existing 3D detection methods typically exploit 2D image information through region-level feature extraction and auxiliary semantic supervision. However, these strategies do not explicitly establish a correspondence between 3D candidates and corresponding 2D instance-level representations, which limits the ability to handle objects with complex shapes or severe occlusions. To address this limitation, we propose an anchorbased framework that establishes an anchor-conditioned 2D-3D interaction for jointly exploiting 2D and 3D annotations. Specifically, each 3D anchor and its sampled points are projected onto multiple image planes to identify anchor-associated regions of interest (ROIs), from which view-specific instance segmentation masks are predicted. These 2D representations are subsequently mapped back to their corresponding 3D anchors and aggregated through geometry-aware cross-modal feature alignment. Our approach extends conventional sparse detectors by introducing three components: (1) multi-view ROIs prediction, which maps 3D anchors and sampled points onto multi-view image planes to predict regions of interest (ROIs); (2) multi-view instance segmentation, generating pixel-accurate masks corresponding to predicted ROIs; and (3) cross-modal feature alignment, which fuses geometrically consistent 2D segmentation features with their associated 3D anchors. Furthermore, to bridge the geometric discrepancy between 2D images and 3D objects, we distill multi-scale visual knowledge from a pretrained large-scale self-supervised vision model into our detector, enhancing geometric consistency. Evaluated on the nuScenes benchmark, our framework achieves state-of-the-art performance while maintaining computational efficiency. The code and auxiliary supervision data are available at https://github.com/HuiAuto/AnchorSED.</p>","PeriodicalId":94032,"journal":{"name":"IEEE transactions on image processing : a publication of the IEEE Signal Processing Society","volume":"PP ","pages":""},"PeriodicalIF":13.7,"publicationDate":"2026-10-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149279079","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Statistical Model-Driven Similarity Hashing for Unsupervised Multimedia Retrieval. 统计模型驱动的无监督多媒体检索相似性哈希。
IF 13.7
Binghong Chen, Yinan Li, Mingjin Kuai, Longzhi Sun, Zhan Yang
{"title":"Statistical Model-Driven Similarity Hashing for Unsupervised Multimedia Retrieval.","authors":"Binghong Chen, Yinan Li, Mingjin Kuai, Longzhi Sun, Zhan Yang","doi":"10.1109/TIP.2026.3730836","DOIUrl":"https://doi.org/10.1109/TIP.2026.3730836","url":null,"abstract":"<p><p>Unsupervised deep cross-modal hash retrieval aims to map multi-modal features into binary hash codes without labels, which is of interest due to the storage efficiency, query speed, and convenient applications. However, existing approaches suffer from two main limitations: (1) Insufficient consideration of text instance similarity, along with independent or redundant fusion to learn multi-modal similarity information. (2) Ignoring the noisy adjacent correlations between multi-modal instances leads to a lack of discriminative capacity in the generated hash codes. To address the challenges, we propose a novel approach called Statistical Model-driven Similarity Hashing. Specifically, Jaccard similarity is introduced to construct the text similarity matrix, which reduces the similarity error between text instances while better considering the asymmetry of elements in text features. After that, original similarity information between various modalities is integrated to construct a unified similarity matrix, where the modality gaps are effectively bridged while reducing the redundant information. In addition, we present a Statistical Model-driven Similarity Enhancement approach, which reduces the noise of similarity relations between multi-modal instances by utilizing Gaussian Mixture Models to keep instances with lower semantic similarity as far away from each other as possible. Moreover, we introduce an enhanced version, which integrates a structure-aware self-paced contrastive learning framework that progressively schedules reliable and fuzzy-positive pairs, jointly optimizing statistical reconstruction and discriminative alignment, and further extends to noisy environments. Extensive experiments on three benchmark datasets demonstrate the excellent performance of the proposed method.</p>","PeriodicalId":94032,"journal":{"name":"IEEE transactions on image processing : a publication of the IEEE Signal Processing Society","volume":"PP ","pages":""},"PeriodicalIF":13.7,"publicationDate":"2026-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148946316","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dual Retrieval Queries Fine-Tuning for Composed Image Retrieval. 组合图像检索的双检索查询微调。
IF 13.7
Wenyue Tang, Jianze Wei, Xingyu Gao
{"title":"Dual Retrieval Queries Fine-Tuning for Composed Image Retrieval.","authors":"Wenyue Tang, Jianze Wei, Xingyu Gao","doi":"10.1109/TIP.2025.3597043","DOIUrl":"10.1109/TIP.2025.3597043","url":null,"abstract":"<p><p>Composed Image Retrieval (CIR) is a popular multi-modal retrieval task that aims to retrieve a target image based on a query composed of a reference image and modification text. The challenge lies in how to effectively retrieve a target image that preserves the visual content of the reference image while incorporating the changes described by the modification text. Existing CIR methods primarily employ a fusion-based strategy or a textual-inversion strategy during training. Although these methods have achieved promising results, they are limited in fully leveraging multi-modal information. This results in modality redundancy, where the retrieval process is dominated by one modality while ignoring the other. To address this issue, we propose an asymmetric fusion mechanism to generate dual retrieval queries of different granularity, enabling the model to fully use multi-modal information. Specifically, we propose a novel method termed Dual Retrieval Queries Fine-Tuning for Composed Image Retrieval (DRQ-CIR), which consists of two key components: 1) a Bilateral Multi-Modal Fusion (BMMF) module based on pre-trained VLMs, which combines the reference image and modification text to generate an enriched retrieval query; and 2) a Dual Retrieval Queries Fine-Tuning (DRQ-FT) module, which employs latent prompts to generate an enhanced retrieval query. Dual retrieval queries are used for contrastive learning with the target image to fine-tune the model and improve retrieval performance. Additionally, we introduce a bi-directional training paradigm to ensure retrieval consistency and further exploit the triplets. Extensive experiments validate the effectiveness of our proposed method on four established benchmark datasets. (Code will be available at: https://github.com/Crystal-twy998/DRQ-CIR).</p>","PeriodicalId":94032,"journal":{"name":"IEEE transactions on image processing : a publication of the IEEE Signal Processing Society","volume":"PP ","pages":""},"PeriodicalIF":13.7,"publicationDate":"2026-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148671687","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Long-Tailed and Inter-Class Homogeneity Matters in Multi-Class Weakly Supervised Tissue Segmentation of Histopathology Images 组织病理学图像的多类弱监督组织分割中的长尾和类间同质性问题
IF 13.7
Siyang Feng;Xipeng Pan;Huadeng Wang;Zhenbing Liu;Weidong Zhang;Rushi Lan
{"title":"Long-Tailed and Inter-Class Homogeneity Matters in Multi-Class Weakly Supervised Tissue Segmentation of Histopathology Images","authors":"Siyang Feng;Xipeng Pan;Huadeng Wang;Zhenbing Liu;Weidong Zhang;Rushi Lan","doi":"10.1109/TIP.2026.3671622","DOIUrl":"10.1109/TIP.2026.3671622","url":null,"abstract":"Using image-level weakly supervised semantic segmentation (WSSS) techniques to segment tissue regions in giga-pixel histopathological whole slide images (WSI) has garnered widespread attention, as it can reduce many annotation workloads for pathologists. Most recent studies are based on class activation mapping (CAM) to generate pseudo masks, which are then used to train segmentation model in a fully supervised manner. However, it is still a challenge to accurately segment non-predominant tissue categories due to the existence of long-tailed and inter-class homogeneity matters. For these matters, we propose three designs to solve them: 1) Diffusion-based Data Generation to synthesis new images of tail class to expand data distribution; 2) Feature Recalibration to reassign the logits in CAM to narrow the feature-level prediction gap between predominant and non-predominant classes; 3) Grade-skip Learning to correct the under-fitting tendency of hard samples during the segmentation phase. Moreover, we also design a powerful pipeline LoHo for histopathology tissue segmentation. Extensive experiments demonstrate that our method not only achieves new state-of-the-art performances but also significantly improves segmentation of tail classes. In addition, our methods are plug-and-play, making it easily integrable into many mainstream WSSS frameworks.","PeriodicalId":94032,"journal":{"name":"IEEE transactions on image processing : a publication of the IEEE Signal Processing Society","volume":"35 ","pages":"2513-2528"},"PeriodicalIF":13.7,"publicationDate":"2026-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147439808","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
DiffLLFace: Learning Alternate Illumination-Diffusion Adaptation for Low-Light Face Super-Resolution and Beyond DiffLLFace:学习交替照明扩散适应低光面超分辨率和超越
IF 13.7
Runmin Cong;Kaisheng Pang;Feng Li;Hua Li;Huihui Bai;Sam Kwong;Wei Zhang
{"title":"DiffLLFace: Learning Alternate Illumination-Diffusion Adaptation for Low-Light Face Super-Resolution and Beyond","authors":"Runmin Cong;Kaisheng Pang;Feng Li;Hua Li;Huihui Bai;Sam Kwong;Wei Zhang","doi":"10.1109/TIP.2026.3671638","DOIUrl":"10.1109/TIP.2026.3671638","url":null,"abstract":"Facial image acquisition under constrained illumination and with limited-resolution imaging devices often results in coupled photometric and geometric degradations, manifesting as low-light and low-resolution (LLR) conditions. Prevailing research predominantly follows fragmented optimization paradigms that address low-light image enhancement (LLIE) and face super-resolution (FSR) as isolated tasks. This approach overlooks the compound nature of the degradations, thereby significantly limiting their applicability in practical scenarios. To bridge this gap, we present DiffLLFace, a unified framework that harnesses diffusive generative capabilities with illumination-aware trajectories to achieve robust FSR from LLR observations. The core of our method lies in its alternate illumination-diffusion adaptation, which operates throughout the generation process. This mechanism not only captures degradation patterns in both brightness and structure to harmonize latent representations but also dynamically calibrates the illumination prior with the generative knowledge inherent to diffusion models. As such, DiffLLFace attains precise control over conditional adaptation and illumination rectification. We further devise a simple yet effective non-parametric Fourier enhancement strategy, which provides structural appearance clues that work in concert with the alternate adaptation to ensure texture and color consistency. Extensive experiments demonstrate the superiority of DiffLLFace over existing methods and remarkable generalizability on complex natural scenes. Code is available at <uri>https://github.com/KaishengPang/DiffLLFace</uri>","PeriodicalId":94032,"journal":{"name":"IEEE transactions on image processing : a publication of the IEEE Signal Processing Society","volume":"35 ","pages":"2499-2512"},"PeriodicalIF":13.7,"publicationDate":"2026-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147439809","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书