Zhebin Feng, Chunhua Wang, Wenqian Shang, Weiguo Lin
{"title":"基于反馈补偿机制的神经网络特征增强方法","authors":"Zhebin Feng, Chunhua Wang, Wenqian Shang, Weiguo Lin","doi":"10.1109/icisfall51598.2021.9627442","DOIUrl":null,"url":null,"abstract":"In traditional convolutional neural networks, the calculation process of input information is generally regarded as the process of feature extraction and representation. The effects of the models are closely related to the number of extracted features. In the research of this paper, the feature extraction process of neural network is regarded as a signal processing process. By using the feedback compensation mechanism of weak signal detection in the signal system, the output at the current time is fed back to the current input for information compensation, so as to achieve the effect of feature enhancement. This method is tested on MINIST data set and the experimental results show that the neural network with feedback compensation, without adding more parameters, can effectively improve the convergence speed of the model, reduce the fluctuation of loss function, and improve the accuracy. The comparison results show that the neural network with feedback compensation mechanism achieves the effect of feature enhancement.","PeriodicalId":240142,"journal":{"name":"2021 IEEE/ACIS 20th International Fall Conference on Computer and Information Science (ICIS Fall)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Neural Network Feature Enhancement Method Based on Feedback Compensation Mechanism\",\"authors\":\"Zhebin Feng, Chunhua Wang, Wenqian Shang, Weiguo Lin\",\"doi\":\"10.1109/icisfall51598.2021.9627442\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In traditional convolutional neural networks, the calculation process of input information is generally regarded as the process of feature extraction and representation. The effects of the models are closely related to the number of extracted features. In the research of this paper, the feature extraction process of neural network is regarded as a signal processing process. By using the feedback compensation mechanism of weak signal detection in the signal system, the output at the current time is fed back to the current input for information compensation, so as to achieve the effect of feature enhancement. This method is tested on MINIST data set and the experimental results show that the neural network with feedback compensation, without adding more parameters, can effectively improve the convergence speed of the model, reduce the fluctuation of loss function, and improve the accuracy. The comparison results show that the neural network with feedback compensation mechanism achieves the effect of feature enhancement.\",\"PeriodicalId\":240142,\"journal\":{\"name\":\"2021 IEEE/ACIS 20th International Fall Conference on Computer and Information Science (ICIS Fall)\",\"volume\":\"33 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-10-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE/ACIS 20th International Fall Conference on Computer and Information Science (ICIS Fall)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/icisfall51598.2021.9627442\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE/ACIS 20th International Fall Conference on Computer and Information Science (ICIS Fall)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/icisfall51598.2021.9627442","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A Neural Network Feature Enhancement Method Based on Feedback Compensation Mechanism
In traditional convolutional neural networks, the calculation process of input information is generally regarded as the process of feature extraction and representation. The effects of the models are closely related to the number of extracted features. In the research of this paper, the feature extraction process of neural network is regarded as a signal processing process. By using the feedback compensation mechanism of weak signal detection in the signal system, the output at the current time is fed back to the current input for information compensation, so as to achieve the effect of feature enhancement. This method is tested on MINIST data set and the experimental results show that the neural network with feedback compensation, without adding more parameters, can effectively improve the convergence speed of the model, reduce the fluctuation of loss function, and improve the accuracy. The comparison results show that the neural network with feedback compensation mechanism achieves the effect of feature enhancement.