Text-guided context learning for multi-source domain adaptation

IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Computer Vision and Image Understanding Pub Date : 2026-06-01 Epub Date: 2026-05-22 DOI:10.1016/j.cviu.2026.104818
Bo Zhou, Long Liu, Chenyue Fan, Zhipeng Zhao
{"title":"Text-guided context learning for multi-source domain adaptation","authors":"Bo Zhou,&nbsp;Long Liu,&nbsp;Chenyue Fan,&nbsp;Zhipeng Zhao","doi":"10.1016/j.cviu.2026.104818","DOIUrl":null,"url":null,"abstract":"<div><div>Multi-source Unsupervised Domain Adaptation (MUDA) aims to address the domain transfer challenge between multiple labeled source domains and an unlabeled target domain by reducing domain discrepancies. Existing methods typically learn domain-invariant features in a shared feature space between the source and target domains. However, during multi-source distribution alignment, cross-domain distribution adjustment may shift the model’s attention away from category-discriminative regions. Moreover, most approaches focus primarily on global distribution alignment while neglecting the applicability of source domain supervision to the target domain. To address these issues, we propose a multi-source domain adaptation method called Text-guided Context Learning (TCL), which reformulates multi-source transfer as a cross-domain textual context optimization problem within a pretrained vision–language model. Specifically, we first develop a target domain style context-guided feature augmentation strategy. This strategy utilizes textual modal features that incorporate the style of the target domain to optimize the source domain features, improving the applicability of the source domain supervisory information to the target domain while preserving the category-discriminative information of the source domain visual features. Furthermore, TCL proposes active boundary optimization to ensure the class distinguishability of cross-domain context. By designing a boundary loss and a boundary sampling strategy, we guide the model to focus on difficult samples near decision boundaries during learning, ensuring the learned cross-domain context is more sensitive to inter-class differences. Experimental results demonstrate that our method effectively mitigates the shortcomings of prompt-tuning approaches in domain shift tasks and achieves competitive performance across multiple benchmark datasets. Additionally, our method can be effectively generalized to semi-supervised and partial-set domain adaptation tasks, further validating its robustness and versatility.</div></div>","PeriodicalId":50633,"journal":{"name":"Computer Vision and Image Understanding","volume":"269 ","pages":"Article 104818"},"PeriodicalIF":3.6000,"publicationDate":"2026-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Vision and Image Understanding","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1077314226001852","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/5/22 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Multi-source Unsupervised Domain Adaptation (MUDA) aims to address the domain transfer challenge between multiple labeled source domains and an unlabeled target domain by reducing domain discrepancies. Existing methods typically learn domain-invariant features in a shared feature space between the source and target domains. However, during multi-source distribution alignment, cross-domain distribution adjustment may shift the model’s attention away from category-discriminative regions. Moreover, most approaches focus primarily on global distribution alignment while neglecting the applicability of source domain supervision to the target domain. To address these issues, we propose a multi-source domain adaptation method called Text-guided Context Learning (TCL), which reformulates multi-source transfer as a cross-domain textual context optimization problem within a pretrained vision–language model. Specifically, we first develop a target domain style context-guided feature augmentation strategy. This strategy utilizes textual modal features that incorporate the style of the target domain to optimize the source domain features, improving the applicability of the source domain supervisory information to the target domain while preserving the category-discriminative information of the source domain visual features. Furthermore, TCL proposes active boundary optimization to ensure the class distinguishability of cross-domain context. By designing a boundary loss and a boundary sampling strategy, we guide the model to focus on difficult samples near decision boundaries during learning, ensuring the learned cross-domain context is more sensitive to inter-class differences. Experimental results demonstrate that our method effectively mitigates the shortcomings of prompt-tuning approaches in domain shift tasks and achieves competitive performance across multiple benchmark datasets. Additionally, our method can be effectively generalized to semi-supervised and partial-set domain adaptation tasks, further validating its robustness and versatility.
多源领域适应的文本引导语境学习
多源无监督域自适应(Multi-source Unsupervised Domain Adaptation, MUDA)旨在通过减少域差异,解决多个标记源域与未标记目标域之间的域转移问题。现有的方法通常是在源域和目标域之间的共享特征空间中学习域不变特征。然而,在多源分布对齐过程中,跨域分布调整可能会使模型的注意力从类别区分区域转移。此外,大多数方法主要关注全局分布对齐,而忽略了源域监督对目标域的适用性。为了解决这些问题,我们提出了一种称为文本引导上下文学习(TCL)的多源域自适应方法,该方法将多源迁移重新定义为预训练的视觉语言模型中的跨域文本上下文优化问题。具体来说,我们首先开发了一个目标领域风格上下文引导的特征增强策略。该策略利用融合目标域风格的文本模态特征对源域特征进行优化,提高了源域监控信息对目标域的适用性,同时保留了源域视觉特征的分类判别信息。此外,TCL还提出了主动边界优化,以保证跨域上下文的类可区分性。通过设计边界损失和边界采样策略,我们引导模型在学习过程中关注决策边界附近的困难样本,确保学习到的跨域上下文对类间差异更加敏感。实验结果表明,我们的方法有效地缓解了快速调优方法在领域转移任务中的缺点,并在多个基准数据集上取得了具有竞争力的性能。此外,该方法可以有效地推广到半监督和部分集域自适应任务中,进一步验证了其鲁棒性和通用性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computer Vision and Image Understanding
Computer Vision and Image Understanding 工程技术-工程:电子与电气
CiteScore
7.80
自引率
4.40%
发文量
112
审稿时长
79 days
期刊介绍: The central focus of this journal is the computer analysis of pictorial information. Computer Vision and Image Understanding publishes papers covering all aspects of image analysis from the low-level, iconic processes of early vision to the high-level, symbolic processes of recognition and interpretation. A wide range of topics in the image understanding area is covered, including papers offering insights that differ from predominant views. Research Areas Include: • Theory • Early vision • Data structures and representations • Shape • Range • Motion • Matching and recognition • Architecture and languages • Vision systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书