{"title":"基于超像素级卷积神经网络的多尺度图像深度融合方法","authors":"Xiaojie Chai, Rongsheng Wang, Junming Wang, Riqiang Zhang","doi":"10.3233/jcm-226706","DOIUrl":null,"url":null,"abstract":"In order to improve the image quality, reduce the image noise and improve the image definition, the image depth fusion processing is realized by using the sp CNN network (Super pixel level convolution neural network, sp CNN). The improved non-local mean method is used to de-noise the image to highlight the role of the center pixel of the image block; the de-noised image is segmented by the improved CV model (Chan-Vese, CV), and the globally optimal multi-scale image segmentation result is obtained after optimization; From the perspective of regional features, the similarity measurement of image regions is carried out to realize image preprocessing. The sp-CNN network is constructed, and with the help of the idea of pyramid pooling, the average pooling is used to extract the features of each layer from the global and local levels of the convolutional features, and the training data set is generated for training, thereby realizing multi-scale image fusion. The experimental results show that the optimal value of the root mean square error index of the proposed method is 0.58. The optimal value of structural similarity index is 41.22. On the average slope index, the optimal value is 21.39. The optimal value of cross entropy index is 2.21. This shows that the proposed method has high image definition and good visual effect, which verifies the effectiveness of the method.","PeriodicalId":14668,"journal":{"name":"J. Comput. Methods Sci. Eng.","volume":"48 1","pages":"1237-1250"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Multi-scale image depth fusion method based on superpixel-level convolutional neural network\",\"authors\":\"Xiaojie Chai, Rongsheng Wang, Junming Wang, Riqiang Zhang\",\"doi\":\"10.3233/jcm-226706\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In order to improve the image quality, reduce the image noise and improve the image definition, the image depth fusion processing is realized by using the sp CNN network (Super pixel level convolution neural network, sp CNN). The improved non-local mean method is used to de-noise the image to highlight the role of the center pixel of the image block; the de-noised image is segmented by the improved CV model (Chan-Vese, CV), and the globally optimal multi-scale image segmentation result is obtained after optimization; From the perspective of regional features, the similarity measurement of image regions is carried out to realize image preprocessing. The sp-CNN network is constructed, and with the help of the idea of pyramid pooling, the average pooling is used to extract the features of each layer from the global and local levels of the convolutional features, and the training data set is generated for training, thereby realizing multi-scale image fusion. The experimental results show that the optimal value of the root mean square error index of the proposed method is 0.58. The optimal value of structural similarity index is 41.22. On the average slope index, the optimal value is 21.39. The optimal value of cross entropy index is 2.21. This shows that the proposed method has high image definition and good visual effect, which verifies the effectiveness of the method.\",\"PeriodicalId\":14668,\"journal\":{\"name\":\"J. Comput. Methods Sci. Eng.\",\"volume\":\"48 1\",\"pages\":\"1237-1250\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-01-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"J. Comput. Methods Sci. Eng.\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3233/jcm-226706\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"J. Comput. Methods Sci. Eng.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3233/jcm-226706","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Multi-scale image depth fusion method based on superpixel-level convolutional neural network
In order to improve the image quality, reduce the image noise and improve the image definition, the image depth fusion processing is realized by using the sp CNN network (Super pixel level convolution neural network, sp CNN). The improved non-local mean method is used to de-noise the image to highlight the role of the center pixel of the image block; the de-noised image is segmented by the improved CV model (Chan-Vese, CV), and the globally optimal multi-scale image segmentation result is obtained after optimization; From the perspective of regional features, the similarity measurement of image regions is carried out to realize image preprocessing. The sp-CNN network is constructed, and with the help of the idea of pyramid pooling, the average pooling is used to extract the features of each layer from the global and local levels of the convolutional features, and the training data set is generated for training, thereby realizing multi-scale image fusion. The experimental results show that the optimal value of the root mean square error index of the proposed method is 0.58. The optimal value of structural similarity index is 41.22. On the average slope index, the optimal value is 21.39. The optimal value of cross entropy index is 2.21. This shows that the proposed method has high image definition and good visual effect, which verifies the effectiveness of the method.