{"title":"一种卷积网络的数据增强方法","authors":"Diancheng Gong, Zhiling Wang, Hanqi Wang, Huawei Liang","doi":"10.1109/IAEAC54830.2022.9929974","DOIUrl":null,"url":null,"abstract":"Convolutional neural networks can learn a powerful feature space and play a great role on the promotion of autonomous driving. On limited datasets, deep neural networks often overfit. Properly adding noise and regularization during training can alleviate this. DropBlock randomly removes blocks on the feature map, however, such randomness may lead to complete removal of objects due to excessive removal of one or a few blocks, as well as contextual information. To solve this problem, we propose a regularization method (DropMask), which strikes a reasonable balance between deletion and retention in the block to be deleted on the feature map. That will avoid excessive removal of contiguous blocks so that improve the accuracy and robustness of model. After extensive experiments, it has been shown that the DropMask proposed in the paper outperforms DropBlock on neural networks. On CIFAR-I0 classification, ResNet-18 architecture with DropMask achieves 95.34% on accuracy, 1.88% improvement over the baseline. On KITTI 2D detection task, Yolov5s with DropMask improves mAP from 77.6% to 79.2%.","PeriodicalId":349113,"journal":{"name":"2022 IEEE 6th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC )","volume":"337 5","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DropMask: A data augmentation method for convolutional networks\",\"authors\":\"Diancheng Gong, Zhiling Wang, Hanqi Wang, Huawei Liang\",\"doi\":\"10.1109/IAEAC54830.2022.9929974\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Convolutional neural networks can learn a powerful feature space and play a great role on the promotion of autonomous driving. On limited datasets, deep neural networks often overfit. Properly adding noise and regularization during training can alleviate this. DropBlock randomly removes blocks on the feature map, however, such randomness may lead to complete removal of objects due to excessive removal of one or a few blocks, as well as contextual information. To solve this problem, we propose a regularization method (DropMask), which strikes a reasonable balance between deletion and retention in the block to be deleted on the feature map. That will avoid excessive removal of contiguous blocks so that improve the accuracy and robustness of model. After extensive experiments, it has been shown that the DropMask proposed in the paper outperforms DropBlock on neural networks. On CIFAR-I0 classification, ResNet-18 architecture with DropMask achieves 95.34% on accuracy, 1.88% improvement over the baseline. On KITTI 2D detection task, Yolov5s with DropMask improves mAP from 77.6% to 79.2%.\",\"PeriodicalId\":349113,\"journal\":{\"name\":\"2022 IEEE 6th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC )\",\"volume\":\"337 5\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE 6th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC )\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IAEAC54830.2022.9929974\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE 6th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC )","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IAEAC54830.2022.9929974","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
DropMask: A data augmentation method for convolutional networks
Convolutional neural networks can learn a powerful feature space and play a great role on the promotion of autonomous driving. On limited datasets, deep neural networks often overfit. Properly adding noise and regularization during training can alleviate this. DropBlock randomly removes blocks on the feature map, however, such randomness may lead to complete removal of objects due to excessive removal of one or a few blocks, as well as contextual information. To solve this problem, we propose a regularization method (DropMask), which strikes a reasonable balance between deletion and retention in the block to be deleted on the feature map. That will avoid excessive removal of contiguous blocks so that improve the accuracy and robustness of model. After extensive experiments, it has been shown that the DropMask proposed in the paper outperforms DropBlock on neural networks. On CIFAR-I0 classification, ResNet-18 architecture with DropMask achieves 95.34% on accuracy, 1.88% improvement over the baseline. On KITTI 2D detection task, Yolov5s with DropMask improves mAP from 77.6% to 79.2%.