Zhebin Feng, Chunhua Wang, Wenqian Shang, Weiguo Lin
{"title":"A Neural Network Feature Enhancement Method Based on Feedback Compensation Mechanism","authors":"Zhebin Feng, Chunhua Wang, Wenqian Shang, Weiguo Lin","doi":"10.1109/icisfall51598.2021.9627442","DOIUrl":null,"url":null,"abstract":"In traditional convolutional neural networks, the calculation process of input information is generally regarded as the process of feature extraction and representation. The effects of the models are closely related to the number of extracted features. In the research of this paper, the feature extraction process of neural network is regarded as a signal processing process. By using the feedback compensation mechanism of weak signal detection in the signal system, the output at the current time is fed back to the current input for information compensation, so as to achieve the effect of feature enhancement. This method is tested on MINIST data set and the experimental results show that the neural network with feedback compensation, without adding more parameters, can effectively improve the convergence speed of the model, reduce the fluctuation of loss function, and improve the accuracy. The comparison results show that the neural network with feedback compensation mechanism achieves the effect of feature enhancement.","PeriodicalId":240142,"journal":{"name":"2021 IEEE/ACIS 20th International Fall Conference on Computer and Information Science (ICIS Fall)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE/ACIS 20th International Fall Conference on Computer and Information Science (ICIS Fall)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/icisfall51598.2021.9627442","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
In traditional convolutional neural networks, the calculation process of input information is generally regarded as the process of feature extraction and representation. The effects of the models are closely related to the number of extracted features. In the research of this paper, the feature extraction process of neural network is regarded as a signal processing process. By using the feedback compensation mechanism of weak signal detection in the signal system, the output at the current time is fed back to the current input for information compensation, so as to achieve the effect of feature enhancement. This method is tested on MINIST data set and the experimental results show that the neural network with feedback compensation, without adding more parameters, can effectively improve the convergence speed of the model, reduce the fluctuation of loss function, and improve the accuracy. The comparison results show that the neural network with feedback compensation mechanism achieves the effect of feature enhancement.