{"title":"Unified Discriminant and Distribution Alignment for Visual Domain Adaptation","authors":"M. Samsudin, S. Abu-Bakar, M. Mokji","doi":"10.1109/ICSIPA52582.2021.9576812","DOIUrl":null,"url":null,"abstract":"In visual understandings, images taken from different cameras usually have different resolutions, illumination, poses, and background views that lead to domain shift. Besides labeling these data is an expensive operation. These problems lead to the need for unsupervised domain adaptation (UDA), in which training and testing data are not drawn from the same distribution, and labels are not available in the target domain. This paper presents an improvement for unsupervised domain adaptation in transfer learning using a unified discriminant and distribution alignment (UDDA). The existing method of UDA only utilized unsupervised PCA as the dimensionality reduction process before being added to the joint objective function consisting of distribution discrepancy minimization and regularization. However, the label in the source domain has been utilized by some works (i.e., joint geometrical and statistical (JGSA)) to use the supervised method LDA and show good improvement. Nevertheless, LDA has some drawbacks that is sensitive to noise and outlier in square operations and only take part in global information. The contribution of this paper is to add local discriminant information to the proposed UDA model by adopting locality-sensitive discriminant analysis (LSDA) that strengthens the between-class and within-class discriminant in the source domain. In this method, within-class and between-class graphs will be computed, and summed up with within-class and between-class scatter matrices before being embedded into the joint domain adaptation framework. Comparing the proposed method with the state-of-the-art techniques in objects and digital datasets, it shows our UDDA improved the average accuracy by 3.43% and 7.13% compare with the second and third highest results respectively.","PeriodicalId":326688,"journal":{"name":"2021 IEEE International Conference on Signal and Image Processing Applications (ICSIPA)","volume":"66 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Signal and Image Processing Applications (ICSIPA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSIPA52582.2021.9576812","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
In visual understandings, images taken from different cameras usually have different resolutions, illumination, poses, and background views that lead to domain shift. Besides labeling these data is an expensive operation. These problems lead to the need for unsupervised domain adaptation (UDA), in which training and testing data are not drawn from the same distribution, and labels are not available in the target domain. This paper presents an improvement for unsupervised domain adaptation in transfer learning using a unified discriminant and distribution alignment (UDDA). The existing method of UDA only utilized unsupervised PCA as the dimensionality reduction process before being added to the joint objective function consisting of distribution discrepancy minimization and regularization. However, the label in the source domain has been utilized by some works (i.e., joint geometrical and statistical (JGSA)) to use the supervised method LDA and show good improvement. Nevertheless, LDA has some drawbacks that is sensitive to noise and outlier in square operations and only take part in global information. The contribution of this paper is to add local discriminant information to the proposed UDA model by adopting locality-sensitive discriminant analysis (LSDA) that strengthens the between-class and within-class discriminant in the source domain. In this method, within-class and between-class graphs will be computed, and summed up with within-class and between-class scatter matrices before being embedded into the joint domain adaptation framework. Comparing the proposed method with the state-of-the-art techniques in objects and digital datasets, it shows our UDDA improved the average accuracy by 3.43% and 7.13% compare with the second and third highest results respectively.
在视觉理解中,从不同相机拍摄的图像通常具有不同的分辨率,照明,姿势和背景视图,从而导致域移位。此外,标记这些数据是一项昂贵的操作。这些问题导致了对无监督域自适应(UDA)的需求,其中训练和测试数据不是从相同的分布中提取的,并且目标域中没有可用的标签。提出了一种基于统一判别和分布对齐(UDDA)的迁移学习中无监督域自适应的改进方法。现有的UDA方法仅利用无监督PCA作为降维过程,然后加入由分布差异最小化和正则化组成的联合目标函数。然而,一些作品(即joint geometric and statistical (JGSA))利用源域中的标签来使用监督方法LDA,并取得了很好的改进。然而,LDA在平方运算中存在对噪声和离群值敏感、只参与全局信息等缺点。本文的贡献在于,通过采用增强源域类间和类内判别的位置敏感判别分析(LSDA),将局部判别信息添加到所提出的UDA模型中。该方法首先计算类内图和类间图,并与类内和类间散点矩阵进行汇总,然后嵌入到联合域自适应框架中。将本文提出的方法与最先进的物体和数字数据集技术进行比较,结果表明,与第二和第三高的结果相比,我们的UDDA分别提高了3.43%和7.13%的平均精度。