Jiayue Wang, Ren Wang, Tae Sung Kim, Jin-Sung Kim, Hyuk-Jae Lee
{"title":"Diagnose Label Errors for 3D Object Classification","authors":"Jiayue Wang, Ren Wang, Tae Sung Kim, Jin-Sung Kim, Hyuk-Jae Lee","doi":"10.1109/ICEIC57457.2023.10049969","DOIUrl":null,"url":null,"abstract":"3D object classification is widely used in many real-life scenarios and has recently become a popular research area. Meanwhile, 3D datasets tend to be larger and more complex, increasing the difficulty of labeling. Since label errors in test data affect the accuracy of model evaluation and analysis, this study proposes a multi-view post-training label refinery protocol to clean the label errors in test data. Experimental results on ModelNet40 show that 4.58% of test samples are selected as label-error candidates and 29.2% of them are relabeled. On this basis, this study analyzes the weakness of ModelNet40 and provides suggestions for future dataset construction.","PeriodicalId":373752,"journal":{"name":"2023 International Conference on Electronics, Information, and Communication (ICEIC)","volume":"3 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 International Conference on Electronics, Information, and Communication (ICEIC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICEIC57457.2023.10049969","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
3D object classification is widely used in many real-life scenarios and has recently become a popular research area. Meanwhile, 3D datasets tend to be larger and more complex, increasing the difficulty of labeling. Since label errors in test data affect the accuracy of model evaluation and analysis, this study proposes a multi-view post-training label refinery protocol to clean the label errors in test data. Experimental results on ModelNet40 show that 4.58% of test samples are selected as label-error candidates and 29.2% of them are relabeled. On this basis, this study analyzes the weakness of ModelNet40 and provides suggestions for future dataset construction.