{"title":"基于最优阈值的卷积神经网络剪枝算法","authors":"Jianjun Wang, Leshan Liu, Ximeng Pan","doi":"10.1145/3395260.3395300","DOIUrl":null,"url":null,"abstract":"In the process of pruning, in order to automatically obtain an optimal pruning threshold that can balance the maximum sparse rate and the minimum error. This paper proposes a convolutional neural network pruning algorithm based on the optimal threshold. The algorithm uses the optimization ability of the greedy algorithm to select an optimal threshold, and uses the sensitivity and correlation of the node as factors to determine whether the node is important. Then by deleting the nodes whose importance is below the optimal threshold, the purpose of pruning the network is achieved. Experiments show that under the premise of loss accuracy within 2%, the algorithm can test the Lenet-5 network pruning on the M-NIST data set, which can accelerate 36.62%. This algorithm tests the VggNet network pruning on the CIFAR-10 dataset, which can speed up 43.86%. Experiments show that the algorithm effectively reduces network parameters and reduces running time.","PeriodicalId":103490,"journal":{"name":"Proceedings of the 2020 5th International Conference on Mathematics and Artificial Intelligence","volume":"13 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Pruning algorithm of convolutional neural network based on optimal threshold\",\"authors\":\"Jianjun Wang, Leshan Liu, Ximeng Pan\",\"doi\":\"10.1145/3395260.3395300\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the process of pruning, in order to automatically obtain an optimal pruning threshold that can balance the maximum sparse rate and the minimum error. This paper proposes a convolutional neural network pruning algorithm based on the optimal threshold. The algorithm uses the optimization ability of the greedy algorithm to select an optimal threshold, and uses the sensitivity and correlation of the node as factors to determine whether the node is important. Then by deleting the nodes whose importance is below the optimal threshold, the purpose of pruning the network is achieved. Experiments show that under the premise of loss accuracy within 2%, the algorithm can test the Lenet-5 network pruning on the M-NIST data set, which can accelerate 36.62%. This algorithm tests the VggNet network pruning on the CIFAR-10 dataset, which can speed up 43.86%. Experiments show that the algorithm effectively reduces network parameters and reduces running time.\",\"PeriodicalId\":103490,\"journal\":{\"name\":\"Proceedings of the 2020 5th International Conference on Mathematics and Artificial Intelligence\",\"volume\":\"13 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-04-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2020 5th International Conference on Mathematics and Artificial Intelligence\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3395260.3395300\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2020 5th International Conference on Mathematics and Artificial Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3395260.3395300","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Pruning algorithm of convolutional neural network based on optimal threshold
In the process of pruning, in order to automatically obtain an optimal pruning threshold that can balance the maximum sparse rate and the minimum error. This paper proposes a convolutional neural network pruning algorithm based on the optimal threshold. The algorithm uses the optimization ability of the greedy algorithm to select an optimal threshold, and uses the sensitivity and correlation of the node as factors to determine whether the node is important. Then by deleting the nodes whose importance is below the optimal threshold, the purpose of pruning the network is achieved. Experiments show that under the premise of loss accuracy within 2%, the algorithm can test the Lenet-5 network pruning on the M-NIST data set, which can accelerate 36.62%. This algorithm tests the VggNet network pruning on the CIFAR-10 dataset, which can speed up 43.86%. Experiments show that the algorithm effectively reduces network parameters and reduces running time.