{"title":"Mining Regional Relation from Pixel-wise Annotation for Scene Parsing","authors":"Zichen Song, Hongliang Li, Heqian Qiu, Xiaoliang Zhang","doi":"10.1109/VCIP56404.2022.10008859","DOIUrl":"https://doi.org/10.1109/VCIP56404.2022.10008859","url":null,"abstract":"Scene parsing is an important and challenging task in computer vision, which assigns semantic labels to each pixel in the entire scene. Existing scene parsing methods only utilize pixel-wise annotation as the supervision of neural network, thus, some similar categories are easy to be misclassified in the complex scenes without the utilization of regional relation. To tackle these above challenging problems, a Regional Relation Network (RRNet) is proposed in this paper, which aims to boost the scene parsing performance by mining regional relation from pixel-wise annotation. Specifically, the pixel-wise annotation is divided into a lot of fixed regions, so that intra- and inter-regional relation are able to be extracted as the supervision of network. We firstly design an intra-regional relation module to predict category distribution in each fixed region, which is helpful for reducing the misclassification phenomenon in regions. Secondly, an inter-regional relation module is proposed to learn the relationships among each region in scene images. With the guideline of relation information extracted from the ground truth, the network is able to learn more discriminative relation representations. To validate our proposed model, we conduct experiments on three typical datasets, including NYU-depth-v2, PASCAL-Context and ADE20k. The achieved competitive results on all three datasets demonstrate the effectiveness of our method.","PeriodicalId":269379,"journal":{"name":"2022 IEEE International Conference on Visual Communications and Image Processing (VCIP)","volume":"728 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126948980","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sibo Wu, Mengqiu Xu, Ming Wu, Chuang Zhang, Hua Shen
{"title":"Identify, Guess and Reconstruct: Three Principles for Cloud Removal Task","authors":"Sibo Wu, Mengqiu Xu, Ming Wu, Chuang Zhang, Hua Shen","doi":"10.1109/VCIP56404.2022.10008852","DOIUrl":"https://doi.org/10.1109/VCIP56404.2022.10008852","url":null,"abstract":"Remote sensing images serve a significant role in earth observation to tackle climate change and post-disaster reconstruction concerns. However, optical images are obscured by clouds or haze, preventing precise earth observation; hence, cloud removal has been a hot topic among concerned scholars. The objective of this article is to make cloud removal more efficient and explicable by proposing three principles: identifying clouds, guessing objects beneath the clouds, and reconstructing the cloudy area. In addition, a modified dual contrastive learning Generative Adversarial Network is proposed based on these three principles by adding cloud detection and weight sharing strategy to obtain cloud semantics. In particular, we align two datasets by forming a quaternary sample pair that includes not only optical pictures and SAR images, but also region information for a more precise reconstruction. Our experiment results on the integrated dataset reveal the superiority of proposed method over previous cloud removal methods and the effectiveness of added modules through ablation experiments, with PSNR and SSIM values of 26.2 and 0.728, respectively.","PeriodicalId":269379,"journal":{"name":"2022 IEEE International Conference on Visual Communications and Image Processing (VCIP)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122562751","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Heming Sun, Qingyang Yi, Fangzheng Lin, Lu Yu, J. Katto, M. Fujita
{"title":"Real-time Learned Image Codec on FPGA","authors":"Heming Sun, Qingyang Yi, Fangzheng Lin, Lu Yu, J. Katto, M. Fujita","doi":"10.1109/VCIP56404.2022.10008876","DOIUrl":"https://doi.org/10.1109/VCIP56404.2022.10008876","url":null,"abstract":"This demo paper gives a real-time learned image codec on FPGA. By using Xilinx VCU128, the proposed system reaches 720P@30fps codec, which is 7.76x faster than prior work.","PeriodicalId":269379,"journal":{"name":"2022 IEEE International Conference on Visual Communications and Image Processing (VCIP)","volume":"106 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122706171","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Tire Pattern Image Classification using Variational Auto-Encoder with Contrastive Learning","authors":"Jianning Yang, Jiahao Xue, Xiao Feng, Chaoqi Song, Yu Hao","doi":"10.1109/VCIP56404.2022.10008835","DOIUrl":"https://doi.org/10.1109/VCIP56404.2022.10008835","url":null,"abstract":"Tire pattern image classification is an important computer vision problem in pubic security, which can guide policeman to detect criminal cases. It remains challenge due to the small diversity within different classes. Generally, a tire pattern image classification system may require two characteristics: high accuracy and low computation. In this paper, we first assume that capturing rich feature representation will benefits tire classification and learning through a lightweight network will improve computing efficiency. We then propose a simple yet efficient two-stage training mechanism: 1) We learn a feature extractor using a V ariational Auto-Encoder framework constrained by contrastive learning, projecting images to latent space owing rich feature representation. 2) We train a single-layer linear classification network depend on the features extracted by the previous trained encoder. The Top-1 and Top-5 accuracy on tire pattern dataset is 89.8% and 96.6% respectively, validating the effectiveness of our strategy.","PeriodicalId":269379,"journal":{"name":"2022 IEEE International Conference on Visual Communications and Image Processing (VCIP)","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121181660","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fenglei Zhang, Da Li, Shenghua Li, Weili Guan, Meng Liu
{"title":"A Lightweight Tire Tread Image Classification Network","authors":"Fenglei Zhang, Da Li, Shenghua Li, Weili Guan, Meng Liu","doi":"10.1109/VCIP56404.2022.10008894","DOIUrl":"https://doi.org/10.1109/VCIP56404.2022.10008894","url":null,"abstract":"VCIP 2022 “Tire pattern image classification based on lightweight network challenge” aims to design lightweight networks that correctly classify tire surface tread patterns and indentation images using less overhead. To this end, we present a novel lightweight tire tread classification network. Concretely, we adopt the ShuffleNet-V2-x0.5 network as our backbone. To reduce the computation complexity, we introduce the Space-To-Depth and Anti-Alias Downsampling modules to pre-process the input image. Moreover, to enhance the classification ability of our model, we adopt the knowledge distillation strategy by considering Vision Transformer as the teacher network. To ensure the robustness of our model, we pre-train it on ImageNet and fine-tune the training set of the challenge. Experiments on the challenge dataset demonstrate that our model achieves supe-rior performance, with 99.00% classification accuracy, 25.51M FLOPs, and 0.20M parameters.","PeriodicalId":269379,"journal":{"name":"2022 IEEE International Conference on Visual Communications and Image Processing (VCIP)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116678540","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"SparseARFM-SI: Rotary Point Cloud Place Recognition Based on Multi-Resolution and Attention Mechanism","authors":"Xiaohang Liu, Ruonan Zhang, Jie Wang, Ge Li","doi":"10.1109/VCIP56404.2022.10008851","DOIUrl":"https://doi.org/10.1109/VCIP56404.2022.10008851","url":null,"abstract":"Place recognition based on 3D point cloud can directly describe the scene of 3D world by acquiring 3D point clouds via LiDAR, which is robust with environmental changes. The core challenge locates at how to obtain compact and representative feature expression for positioning. In this paper, SparseARFM-SI framework is proposed to solve the problem of feature extraction caused by the large size difference of different objects and the difficulty of feature extraction based on the point cloud data collected by rotating LiDAR. SparseARFM-SI is mainly composed of four models: data representation model, sparse convolution model, ARFM model and NetVLAD model. Experiments show that SparseARFM-SI framework has good performance in USyd data set collected based on rotating Lidar.","PeriodicalId":269379,"journal":{"name":"2022 IEEE International Conference on Visual Communications and Image Processing (VCIP)","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117115334","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jack Enhorn, Christopher Hollmann, Rickard Sjöberg, Jacob Ström, Per Wennersten
{"title":"Block Importance Mapping for Video Encoding","authors":"Jack Enhorn, Christopher Hollmann, Rickard Sjöberg, Jacob Ström, Per Wennersten","doi":"10.1109/VCIP56404.2022.10008857","DOIUrl":"https://doi.org/10.1109/VCIP56404.2022.10008857","url":null,"abstract":"This paper presents a novel video encoding algorithm called Block Importance Mapping. In this method, blocks are assigned a quantization parameter, QP, offset based on how likely the block samples are to be used as references in encoding of nearby pictures. The reusability estimation is based on a motion search in pictures immediately before and after the current picture in output order. Blocks that are likely to be used as reference blocks are coded with a lower QP value, i.e., higher quality, whereas blocks that are deemed unlikely to be referenced are coded with a higher QP value. This method has been implemented in the VVC reference software VTM and tested on various configurations and contents. It is reported to provide BD-rate savings of 1.93% for PSNR and 3.69% for MS-SSIM in Random Access and 2.26% for PSNR and 4.29% for MS-SSIM in Low Delay coding. For HDR content, wPSNR BD-rate savings of 1.18% in Random Access configuration is reported.","PeriodicalId":269379,"journal":{"name":"2022 IEEE International Conference on Visual Communications and Image Processing (VCIP)","volume":"140 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115729781","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Saiping Zhang, Luge Wang, Xionghui Mao, Fuzheng Yang, Shuai Wan
{"title":"Rate Controllable Learned Image Compression Based on RFL Model","authors":"Saiping Zhang, Luge Wang, Xionghui Mao, Fuzheng Yang, Shuai Wan","doi":"10.1109/VCIP56404.2022.10008802","DOIUrl":"https://doi.org/10.1109/VCIP56404.2022.10008802","url":null,"abstract":"In this paper, we propose a rate controllable image compression framework, Rate Controllable Variational Autoencoder (RC-VAE), based on the Rate-Feature-Level (RFL) model established through our exploration on the correlation among target rates, image features and quantization levels. Considering that, when meeting the same target rate, different images should be quantized in different levels, we focus on jointly utilizing the target rate and the extracted features of the image to predict the corresponding quantization level and propose the RFL model. Combining the proposed RFL model with a Hyperprior Continuously Variable Rate (HCVR) image compression network, we further propose the RC-VAE. By controlling information loss in quantization process, the RC-VAE can work at the target rate. Experimental results have demonstrated that one single RC-VAE model can adapt to multiple target rates with higher rate control accuracy and better R-D performance compared with the state-of-the-art rate controllable Image compression networks.","PeriodicalId":269379,"journal":{"name":"2022 IEEE International Conference on Visual Communications and Image Processing (VCIP)","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114701320","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Refine-PU: A Graph Convolutional Point Cloud Upsampling Network using Spatial Refinement","authors":"Yilin Liu, Yumei Wang, Yu Liu","doi":"10.1109/VCIP56404.2022.10008811","DOIUrl":"https://doi.org/10.1109/VCIP56404.2022.10008811","url":null,"abstract":"Upsampling of 3D point clouds plays an important role in point cloud reconstruction, rendering, meshing and analysis. Most of the existing point cloud upsampling networks are three-tier cascaded networks that use a combination of feature extraction, feature expansion, and coordinate reconstruction. However, for the point clouds reconstructed by this network architecture, there is a non-negligible deviation between the point clouds after upsampling and the ground truth, especially in the details. In this paper, we propose a four-tier cascaded graph convolutional network architecture called Refine-PU, which di-vides the network into four parts, i.e., feature extraction, feature expansion, coordinate reconstruction, and spatial refinement. We first design a multi-scale graph convolutional feature extractor called Dense Edge Conv (DEC) to better capture the global and the local structural features of point clouds. In addition, the network appends a spatial refinement module on the basis of the traditional three-tier cascaded network, in order to further adjust the details of the coarse dense point clouds obtained after upsampling to make them more consistent with the ground truth. Extensive experiments implemented on both synthetic and real-scanned datasets demonstrate the superiority of our method over the state-of-the-art methods both quantitatively and qualitatively.","PeriodicalId":269379,"journal":{"name":"2022 IEEE International Conference on Visual Communications and Image Processing (VCIP)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127418121","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Global Homography Motion Compensation for Versatile Video Coding","authors":"Yao Li, Zhuoyuan Li, Li Li, Dong Liu, Houqiang Li","doi":"10.1109/VCIP56404.2022.10008901","DOIUrl":"https://doi.org/10.1109/VCIP56404.2022.10008901","url":null,"abstract":"In Versatile Video Coding (VVC), local affine motion compensation (LAMC) is adopted to handle complex motions, such as rotation and zooming. However, it is inefficient to use LAMC to handle the global motion due to the following two reasons. First, the use of LAMC may lead to some extra bit cost on the affine motion model parameters. Second, the precision of LAMC is restricted by the MV precision of the control points. Therefore, in this paper, we propose a global homography motion compensation (GHMC) framework to better characterize the global motion. For each coding block, an extra mode is added to perform motion compensation based on an 8-parameter global homography motion model. In addition, an extrapolation scheme is designed to derive the parameters from reference frames to save the bit cost for signaling them. The proposed framework is implemented into the VVC reference software VTM-6.0. Experimental results show that, on average, 0.69% and 0.66% BD-rate reduction is achieved under Low Delay P and Low Delay B configurations, respectively, for sequences with rich complex global motions.","PeriodicalId":269379,"journal":{"name":"2022 IEEE International Conference on Visual Communications and Image Processing (VCIP)","volume":"168 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126965221","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}