Yusheng Pu, Ruonan Liu, Qian Chen, Dongyue Chen, Wenlong Yu, Di Cao
{"title":"开集分类的周期正交中心损失","authors":"Yusheng Pu, Ruonan Liu, Qian Chen, Dongyue Chen, Wenlong Yu, Di Cao","doi":"10.1109/acait53529.2021.9731132","DOIUrl":null,"url":null,"abstract":"When designing classification models, people usually do not assume that there will be unknown classes in the test set, which never appeared in the training set. However, this tricky situation is very common in practical applications. Such test conditions are called Open Set environments. Now, how to make models have the ability to identify unknown classes in the open environment has become a topic of great concern to researchers. In this paper, we follow up on previous research, which focusses on using orthogonal class centers to detect the unknown. We explain the reasons for the poor performance of the previous class center update strategy and propose using the orthogonal loss applied to the class centers to restrict the update direction. In addition, we use the multi-head attention layer for centers’ calculation to find suitable projection space adaptively. Experiments show that our method improves the performance of preceding orthogonal center methods.","PeriodicalId":173633,"journal":{"name":"2021 5th Asian Conference on Artificial Intelligence Technology (ACAIT)","volume":"28 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"POC: Periodical Orthogonal Center Loss For Open Set Classification\",\"authors\":\"Yusheng Pu, Ruonan Liu, Qian Chen, Dongyue Chen, Wenlong Yu, Di Cao\",\"doi\":\"10.1109/acait53529.2021.9731132\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"When designing classification models, people usually do not assume that there will be unknown classes in the test set, which never appeared in the training set. However, this tricky situation is very common in practical applications. Such test conditions are called Open Set environments. Now, how to make models have the ability to identify unknown classes in the open environment has become a topic of great concern to researchers. In this paper, we follow up on previous research, which focusses on using orthogonal class centers to detect the unknown. We explain the reasons for the poor performance of the previous class center update strategy and propose using the orthogonal loss applied to the class centers to restrict the update direction. In addition, we use the multi-head attention layer for centers’ calculation to find suitable projection space adaptively. Experiments show that our method improves the performance of preceding orthogonal center methods.\",\"PeriodicalId\":173633,\"journal\":{\"name\":\"2021 5th Asian Conference on Artificial Intelligence Technology (ACAIT)\",\"volume\":\"28 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-10-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 5th Asian Conference on Artificial Intelligence Technology (ACAIT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/acait53529.2021.9731132\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 5th Asian Conference on Artificial Intelligence Technology (ACAIT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/acait53529.2021.9731132","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
POC: Periodical Orthogonal Center Loss For Open Set Classification
When designing classification models, people usually do not assume that there will be unknown classes in the test set, which never appeared in the training set. However, this tricky situation is very common in practical applications. Such test conditions are called Open Set environments. Now, how to make models have the ability to identify unknown classes in the open environment has become a topic of great concern to researchers. In this paper, we follow up on previous research, which focusses on using orthogonal class centers to detect the unknown. We explain the reasons for the poor performance of the previous class center update strategy and propose using the orthogonal loss applied to the class centers to restrict the update direction. In addition, we use the multi-head attention layer for centers’ calculation to find suitable projection space adaptively. Experiments show that our method improves the performance of preceding orthogonal center methods.