{"title":"Zero-shot image classification based on attribute","authors":"Wei Zhang, Wenbai Chen, Xiangfeng Chen, Hu Han","doi":"10.1109/SPAC.2017.8304245","DOIUrl":null,"url":null,"abstract":"In the image classification task, traditional model can only recognize annotated image samples, but class labels can't involve all the object categories. In order to reduce the dependence on the labels and recognize unannotated object samples, this paper proposes zero-shot image classification based on attribute. The binary attribute is used as the intermediate knowledge to migrate learned knowledge from training samples domain to test samples domain. Using the classification model of the multi-loss function based on ResNet-50 to predict the object attributes. Then, using an attribute matrix to represent the correspondence between the object class and the attribute. Finally, the result of attribute prediction is combined with the prior knowledge of the attribute matrix to get the category. Compared with the traditional image classification method, the attribute learning model is applied to the zero-shot image classification. The experimental data show that the method improves the recognition accuracy of the image and improves the flexibility of the image classification task, which lays the foundation for the multi-source domain adaptation induction problem.","PeriodicalId":161647,"journal":{"name":"2017 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2017 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SPAC.2017.8304245","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
In the image classification task, traditional model can only recognize annotated image samples, but class labels can't involve all the object categories. In order to reduce the dependence on the labels and recognize unannotated object samples, this paper proposes zero-shot image classification based on attribute. The binary attribute is used as the intermediate knowledge to migrate learned knowledge from training samples domain to test samples domain. Using the classification model of the multi-loss function based on ResNet-50 to predict the object attributes. Then, using an attribute matrix to represent the correspondence between the object class and the attribute. Finally, the result of attribute prediction is combined with the prior knowledge of the attribute matrix to get the category. Compared with the traditional image classification method, the attribute learning model is applied to the zero-shot image classification. The experimental data show that the method improves the recognition accuracy of the image and improves the flexibility of the image classification task, which lays the foundation for the multi-source domain adaptation induction problem.