Xintao Xu, Zhelong Jiang, Gang Chen, Zhigang Li, Guoliang Gong, Huaxiang Lu
{"title":"基于CNN的一般非线性函数神经网络拟合算法","authors":"Xintao Xu, Zhelong Jiang, Gang Chen, Zhigang Li, Guoliang Gong, Huaxiang Lu","doi":"10.1109/cvidliccea56201.2022.9824846","DOIUrl":null,"url":null,"abstract":"This paper proposes a generic neural network fitting algorithm based on CNN for nonlinear functions that overcomes the challenges of a large number of nonlinear functions in terms of hardware deployment and computing circuit generality in diverse neural network models. The model takes advantage of the principle that functions have varying degrees of difficulty fitting in different spaces, mapping the input to high-dimensional space with 1x1 convolution, and utilizing CNN to extract features of nonlinear functions with its strong feature extraction ability in high-dimensional space. Furthermore, MaxPool and ReLU improve the ability of nonlinear fitting. When fitting Tanh, Sigmoid, and ELU activation functions with 16bit accuracy, the proposed algorithm has an average error of less than 0.0006, with a parameter size of 5.793 k.","PeriodicalId":23649,"journal":{"name":"Vision","volume":"65 1","pages":"1079-1082"},"PeriodicalIF":0.0000,"publicationDate":"2022-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"General nonlinear function neural network fitting algorithm based on CNN\",\"authors\":\"Xintao Xu, Zhelong Jiang, Gang Chen, Zhigang Li, Guoliang Gong, Huaxiang Lu\",\"doi\":\"10.1109/cvidliccea56201.2022.9824846\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper proposes a generic neural network fitting algorithm based on CNN for nonlinear functions that overcomes the challenges of a large number of nonlinear functions in terms of hardware deployment and computing circuit generality in diverse neural network models. The model takes advantage of the principle that functions have varying degrees of difficulty fitting in different spaces, mapping the input to high-dimensional space with 1x1 convolution, and utilizing CNN to extract features of nonlinear functions with its strong feature extraction ability in high-dimensional space. Furthermore, MaxPool and ReLU improve the ability of nonlinear fitting. When fitting Tanh, Sigmoid, and ELU activation functions with 16bit accuracy, the proposed algorithm has an average error of less than 0.0006, with a parameter size of 5.793 k.\",\"PeriodicalId\":23649,\"journal\":{\"name\":\"Vision\",\"volume\":\"65 1\",\"pages\":\"1079-1082\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-05-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Vision\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/cvidliccea56201.2022.9824846\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Vision","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/cvidliccea56201.2022.9824846","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
General nonlinear function neural network fitting algorithm based on CNN
This paper proposes a generic neural network fitting algorithm based on CNN for nonlinear functions that overcomes the challenges of a large number of nonlinear functions in terms of hardware deployment and computing circuit generality in diverse neural network models. The model takes advantage of the principle that functions have varying degrees of difficulty fitting in different spaces, mapping the input to high-dimensional space with 1x1 convolution, and utilizing CNN to extract features of nonlinear functions with its strong feature extraction ability in high-dimensional space. Furthermore, MaxPool and ReLU improve the ability of nonlinear fitting. When fitting Tanh, Sigmoid, and ELU activation functions with 16bit accuracy, the proposed algorithm has an average error of less than 0.0006, with a parameter size of 5.793 k.