Yifeng Wang, Yang Wang, Hongyi Li, Zhuoxi Cai, Xiaohan Tang, Y. Yang
{"title":"CNN Hyperparameter Optimization Based on CNN Visualization and Perception Hash Algorithm","authors":"Yifeng Wang, Yang Wang, Hongyi Li, Zhuoxi Cai, Xiaohan Tang, Y. Yang","doi":"10.1109/DCABES50732.2020.00029","DOIUrl":null,"url":null,"abstract":"In this paper, the network structure and the optimal hyperparameter selection which affect the performance of the model are obtained through the analysis of the convolutional neural network model with mathematical interpretation and visualization. In the study, we used visual methods such as deconvolution and Guided Grad-CAM to display the network structure, parameter changes, and the learning process of the model convolutional layer. Simultaneously, we developed CNN hyperparameters optimization strategy based on the perceptual hash algorithm according to its training characteristics. This method significantly improves the accuracy of image classification of the model and the generalization ability of the model and also provides certain theoretical support for the optimization and understanding of deep learning models in practical application. In addition, the hyperparameter optimization method based on the deep learning model feature map reconstruction visualization proposed in this paper also provides a good idea for the formulation of model training strategies.","PeriodicalId":351404,"journal":{"name":"2020 19th International Symposium on Distributed Computing and Applications for Business Engineering and Science (DCABES)","volume":"141 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 19th International Symposium on Distributed Computing and Applications for Business Engineering and Science (DCABES)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DCABES50732.2020.00029","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 6
Abstract
In this paper, the network structure and the optimal hyperparameter selection which affect the performance of the model are obtained through the analysis of the convolutional neural network model with mathematical interpretation and visualization. In the study, we used visual methods such as deconvolution and Guided Grad-CAM to display the network structure, parameter changes, and the learning process of the model convolutional layer. Simultaneously, we developed CNN hyperparameters optimization strategy based on the perceptual hash algorithm according to its training characteristics. This method significantly improves the accuracy of image classification of the model and the generalization ability of the model and also provides certain theoretical support for the optimization and understanding of deep learning models in practical application. In addition, the hyperparameter optimization method based on the deep learning model feature map reconstruction visualization proposed in this paper also provides a good idea for the formulation of model training strategies.