{"title":"Dual-Streams Global Guided Learning for High Dynamic Range Image Reconstruction","authors":"Junjie Lian, Yongfang Wang, Chuang Wang","doi":"10.1109/VCIP47243.2019.8965798","DOIUrl":"https://doi.org/10.1109/VCIP47243.2019.8965798","url":null,"abstract":"High dynamic range (HDR) images capture the luminance information of the real world and have more detailed information than low dynamic range (LDR) images. In this paper, we propose a dual-streams global guided end-to-end learning method to reconstruct HDR image from a single LDR input that combines both global information and local image features. In our framework, global features and local features are separately learned in dual-streams branches. In the reconstructed phase, we use a fusion layer to fuse them so that the global features can guide the local features to better reconstruct the HDR image. Furthermore, we design mixed loss function including multi-scale pixel-wise loss, color similarity loss and gradient loss to jointly train our network. Comparative experiments are carried out with other state-of-the-art methods and our method achieves superior performance.","PeriodicalId":388109,"journal":{"name":"2019 IEEE Visual Communications and Image Processing (VCIP)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117168127","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multi-path Convolutional Neural Network based on Rectangular Kernel with Path Signature Features for Gesture Recognition","authors":"Lufan Liao, Xin Zhang, Chenyang Li","doi":"10.1109/VCIP47243.2019.8965816","DOIUrl":"https://doi.org/10.1109/VCIP47243.2019.8965816","url":null,"abstract":"Skeleton based gesture recognition has gained more attention due to its wide application and large-scale databases availability. Recent methods designed for skeleton sequence data mainly pay attention to network architecture but ignore an essential characteristic of skeleton sequences that the temporal dimensionality of skeleton sequences is usually higher than its spatial dimensionality. Directly applying CNNs designed for image classification to skeleton-based data can not capture this unique property. Considering this fact, we propose the rectangular convolution and pooling to skeleton sequence data. Temporal features are crucial for gesture action recognition. Further, we introduce path signature features (PSF) to represent temporal variation characteristics of each joint. Moreover, there only exist a few minor distinctions between some gestures. To classify them more accurately, we add two sub-networks to extract discriminative features from two hands respectively. We evaluate our method on three major benchmark gesture datasets, i.e., ChaLearn 2013, ChaLearn 2016 and MSRC-12, and reach the state-of-the-art performance.","PeriodicalId":388109,"journal":{"name":"2019 IEEE Visual Communications and Image Processing (VCIP)","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116613228","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. Jaiswal, V. Jakhetiya, K. Gui, Sharath Chandra Guntuku, A. Singla
{"title":"Frequency-Domain Analysis Based Exploitation Of Color Channels For Color Image Demosaicking","authors":"S. Jaiswal, V. Jakhetiya, K. Gui, Sharath Chandra Guntuku, A. Singla","doi":"10.1109/VCIP47243.2019.8966070","DOIUrl":"https://doi.org/10.1109/VCIP47243.2019.8966070","url":null,"abstract":"Color-difference interpolation (CDI) has been a widely used technique for various color demosaicking methods. CDI-based methods perform interpolation in the color-difference domain assuming that the color-difference signal is a low-pass signal. Recently, a residual interpolation (RI) algorithm, which conducts interpolation in the residual domain, has been developed, and it assumes that the residual domain is flatter or smoother than the channel-difference domain. In this paper, we comprehensively show a frequency domain analysis of these assumptions and observe that it is image dependent and creates artifacts in the interpolated image. With this view, we propose an algorithm that uses the inter-color correlation as well as the residual smoothness among the different channel much better than the existing algorithms. Experimental results emphasize that the proposed algorithm atribute better performances the existing algorithms in terms of both visual and objective quality.","PeriodicalId":388109,"journal":{"name":"2019 IEEE Visual Communications and Image Processing (VCIP)","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123450620","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Depth Estimation with Multi-Resolution Stereo Matching","authors":"Qiuchen Du, Rongke Liu, Yu Pan, Shantong Sun, Shuqiao Sun, Zheng Zheng","doi":"10.1109/VCIP47243.2019.8965775","DOIUrl":"https://doi.org/10.1109/VCIP47243.2019.8965775","url":null,"abstract":"Depth estimation has widely demands in autopilot and scene reconstruction. Although depth estimation has been greatly improved by deep learning, there is still some room for improvement. Usually, stereo-matching-based depth estimation matches low-resolution features and then up-samples depth map to full-resolution. Such methods suffer from low accuracy because of information loss in low-resolution features. To solve this problem, a depth estimation method via multi-resolution gradual-refining stereo matching is proposed. As with classic methods, this method first extracts pyramid features by convolution network and estimates low-resolution depth maps. Then, as an innovation, stereo-matching at each pyramid feature is successively executed using the low-resolution maps as initial depth, which limits search range of stereo-matching for accuracy and efficiency. Results of stereo-matching are used as residuals to refine the depth maps. Experimental results demonstrate that accuracy of depth estimation by the proposed method is significantly improved, but computational complexity does not much increase compared with classic methods.","PeriodicalId":388109,"journal":{"name":"2019 IEEE Visual Communications and Image Processing (VCIP)","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123695016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Statistical Model for Disocclusions in Depth-based Novel View Synthesis","authors":"Jayant Thatte, B. Girod","doi":"10.1109/VCIP47243.2019.8966071","DOIUrl":"https://doi.org/10.1109/VCIP47243.2019.8966071","url":null,"abstract":"The occurrence of missing regions in output images is a critical issue when rendering a scene from novel vantage points using depth-based view synthesis. These regions typically have to be filled using inpainting algorithms, which are slow and might yield unconvincing results. Understanding the likelihood of the occurrence of these missing regions can help us design better, application-specific data representations and camera systems by knowing which vantage points should be captured and stored to minimize disocclusion holes in the synthesized novel views. In this paper, we propose a statistical model that predicts the likelihood of missing data in synthesized images as a function of the viewpoint translation. Scene-dependent model parameters are efficiently estimated using simple shift and scaling transformations on the source depth images without needing view synthesis.","PeriodicalId":388109,"journal":{"name":"2019 IEEE Visual Communications and Image Processing (VCIP)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125006750","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Progressive Background Updating Based Coding Scheme for Surveillance Videos","authors":"Meng Li, Yunhui Shi, Wenpeng Ding, Xiaojie Liu, Jiaying Liu, Baocai Yin","doi":"10.1109/VCIP47243.2019.8965904","DOIUrl":"https://doi.org/10.1109/VCIP47243.2019.8965904","url":null,"abstract":"Background based coding is an effective scheme to improve the coding efficiency of surveillance videos. However, it takes a long time to generate a high quality background picture (BG-picture). And the encoding of the high quality BG-picture will increase the bitrate abruptly. To solve these problems, a progressive background updating based coding scheme is proposed in this paper. In the proposed scheme, the BG-picture is updated block by block. To improve the overall coding efficiency, an importance map is designed to select the valid background blocks (B-blocks) progressively which will be encoded with high quality. It is worth noting that only the valid B-blocks is encoded instead of the entire BG-picture. Compared with the reference software of Versatile Video Coding (VVC), the proposed scheme achieves about 23.3 percent bit-rate saving on average.","PeriodicalId":388109,"journal":{"name":"2019 IEEE Visual Communications and Image Processing (VCIP)","volume":"18 4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131096206","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Spatial and Semantic Relations for Pedestrian Attribute Recognition","authors":"Lei Li, Yuan Dong, Fengye Xiong, Hongliang Bai","doi":"10.1109/VCIP47243.2019.8965877","DOIUrl":"https://doi.org/10.1109/VCIP47243.2019.8965877","url":null,"abstract":"This paper addresses the problem of pedestrian attribute recognition. Previous works typically treat the different attributes independently with each other, without considering possible dependencies between them, or just take semantic relations or spatial relations into consideration. In our work, we propose an end-to-end learning framework combining with a subnet for multi-task classification to take both spatial and semantic relations into account, which proves to be more accurate and effective. Our work can not only deal with binary attributes, but also multi-class attributes in a single network, overcoming the drawbacks in many methods that can only recognize the binary attributes in joint-training. Experiments have been carried out on several benchmarks and positively demonstrated the superiority of our method.","PeriodicalId":388109,"journal":{"name":"2019 IEEE Visual Communications and Image Processing (VCIP)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130508130","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Learn Image Object Co-segmentation with Multi-scale Feature Fusion","authors":"Lina Li, Zhi Liu, Jian Zhang, Xiaofei Zhou","doi":"10.1109/VCIP47243.2019.8965813","DOIUrl":"https://doi.org/10.1109/VCIP47243.2019.8965813","url":null,"abstract":"Image object co-segmentation aims to segment common objects in a group of images. This paper proposes a novel neural network, which extracts multi-scale convolutional features at multiple layers via a modified VGG network and fuses them both within and across images as the intra-image and the inter-image features. Then these two kinds of features are further fused at each scale as the multi-scale co-features of common objects, and finally the multi-scale co-features are summed up and upsampled to obtain the co-segmentation results. To simplify the network and reduce the rapidly rising resource cost along with the inputs, the reduced input size, less downsampling and dilation convolution are adopted in the proposed model. Experimental results on the public dataset demonstrate that the proposed model achieves a comparable performance to the state-of-the-art co-segmentation methods while the computation cost has been effectively reduced.","PeriodicalId":388109,"journal":{"name":"2019 IEEE Visual Communications and Image Processing (VCIP)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130974300","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Improving Person Search by Adaptive Feature Pyramid-based Multi-Scale Matching","authors":"Binbin Song, Xue Zhou, Wei Xiang, Hao Wen","doi":"10.1109/VCIP47243.2019.8965743","DOIUrl":"https://doi.org/10.1109/VCIP47243.2019.8965743","url":null,"abstract":"Within person search problem, existing pedestrian detectors usually generate person bounding boxes with different sizes, which will degrade the performance of person re-identification in matching process. The built-in feature pyramid hierarchy to address the multi-scale matching problem adopted in previous studies, is prone to be effective for reducing the semantic gaps among different level features. Therefore, in this paper we propose an Adaptive Feature Pyramid (AFP)-based multi-scale matching method for person search. The network adaptively learns a set of adjusting vectors to make the low-level feature distributions approximate the high-level. Moreover, we integrate the AFP structure into a ResNet-50 based person search framework to search a target person from a gallery of whole scene images. Extensive experimental results show that our approach performs superiority over the state-of-the-art person search methods on CUHK-SYSU dataset.","PeriodicalId":388109,"journal":{"name":"2019 IEEE Visual Communications and Image Processing (VCIP)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127605966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Toward Intelligent Visual Sensing and Low-cost Analysis: A Collaborative Computing Approach","authors":"Yan Bai, Ling-yu Duan, Yong Luo, Shiqi Wang, Yonggang Wen, Wen Gao","doi":"10.1109/VCIP47243.2019.8965808","DOIUrl":"https://doi.org/10.1109/VCIP47243.2019.8965808","url":null,"abstract":"In the big data era, there has been an increasing consensus that the label information, computational resources and communication bandwidth are particularly precious. State-of-the-art research is revolutionizing the vision systems of the smart city, which converts the visual signals from sensory input into feature representations and conveys the compact feature for analysis by using the computational resources of both front and back ends. To deploy a robust model, large amounts of labeled data are usually required, and thereby heavy computational and communication resources are incurred in model training as well as inference. However, the computational resources in front-end devices are usually constrained, and heavy transmission burden is imposed when leveraging multiple models amongst different ends. In this work, we propose a novel collaborative computing approach for intelligent sensing and low-cost analysis, which reduces the requirement of labeled data and communication cost, and balances the computational load in model training and inference. By incorporating the adversarial learning mechanism into collaborative model training, knowledge of different domains can be better exploited. Moreover, the learned models are deployed for inference in a collaborative manner, in which part of model is placed in front-ends for extracting intermediate feature maps, and part of the model remains in back ends for inference with received feature maps. The effectiveness of the proposed approach has been validated in the context of an emerging digital retina system for smart city intelligent applications.","PeriodicalId":388109,"journal":{"name":"2019 IEEE Visual Communications and Image Processing (VCIP)","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126003287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}