{"title":"Global Feature Fusion Attention Network For Single Image Dehazing","authors":"J. Luo, Qirong Bu, Lei Zhang, Jun Feng","doi":"10.1109/ICMEW53276.2021.9455955","DOIUrl":"https://doi.org/10.1109/ICMEW53276.2021.9455955","url":null,"abstract":"As a common low-level visual task, image dehazing is widely used in various multimedia fields. However, it faces great challenges due to its ill-posed property, especially the problem with dense haze removal. In this paper, we propose an efficient end-to-end global feature fusion attention network for single image dehazing based on an encoder-decoder structure. We design a Multi-scale Global Context Fusion (MGCF) block to capture the global context feature and integrates them into the network to assist in the recovery of the dense haze area. After the global feature is aggregated in the context modeling module, a two-stream structure is used to combine two feature transformation modes and two feature fusion modes to obtain more comprehensive and accurate features. We simplify the pixel attention block and combine it with the MGCF block to form a Global Feature Fusion Attention (GFFA) module. Based on the local residual learning and the GFFA module, the Feature Enhancement (FE) module is proposed as the basic module of the encoder-decoder, allowing the network to focus on enhancing more useful feature. Experimental results show that the proposed method surpasses state-of-the-art dehazing methods, both quantitatively and qualitatively.","PeriodicalId":228350,"journal":{"name":"2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116170411","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Phyu Phyu Htun, Marco Antonio Boschetti, Attaullah Buriro, R. Confalonieri, Boyuan Sun, A. N. Htwe, T. Tillo
{"title":"A Lightweight Approach For Wood Hyperspectral Images Classification","authors":"Phyu Phyu Htun, Marco Antonio Boschetti, Attaullah Buriro, R. Confalonieri, Boyuan Sun, A. N. Htwe, T. Tillo","doi":"10.1109/ICMEW53276.2021.9455943","DOIUrl":"https://doi.org/10.1109/ICMEW53276.2021.9455943","url":null,"abstract":"This paper presents a Convolutional Neural Network (CNN)based spatial classifier to classify hyperspectral images for wood recognition. The spatial classifier is built by adapting the input and output units of Cifar10Net, a conventional image classifier that accepts three-band images as input. Obtained results in terms of accuracy and training time show that the proposed classifier can be trained using few training data, and few computational resources.","PeriodicalId":228350,"journal":{"name":"2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)","volume":"224 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125946937","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Dahu Feng, Yan Huang, Yiwei Zhang, Jun Ling, Anni Tang, Li Song
{"title":"A Generative Compression Framework For Low Bandwidth Video Conference","authors":"Dahu Feng, Yan Huang, Yiwei Zhang, Jun Ling, Anni Tang, Li Song","doi":"10.1109/ICMEW53276.2021.9455985","DOIUrl":"https://doi.org/10.1109/ICMEW53276.2021.9455985","url":null,"abstract":"Video conferences introduce a new scenario for video transmission, which focuses on keeping the fidelity of faces even in the low bandwidth network environment. In this work, we propose VSBNet, one of the frameworks to utilize face landmarks in video compression. Our method utilizes the adversarial learning to reconstruct origin frames from the landmarks. To recover more details and keep the consistency of identity, we propose the concept of visual sensitivity to separate the contour of the face from the fast-moving parts, such as eyes and mouth. Experimental results demonstrate the superiority of our framework with a low bit rate of around 1KB/s.","PeriodicalId":228350,"journal":{"name":"2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132900123","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards Efficient Masked-Face Alignment Via Cascaded Regression","authors":"Tiancheng Wen, Zhonggan Ding, Yongqiang Yao, WeiZhang, Yanhao Ge, Xueming Qian","doi":"10.1109/ICMEW53276.2021.9455962","DOIUrl":"https://doi.org/10.1109/ICMEW53276.2021.9455962","url":null,"abstract":"Practical and efficient face alignment has been highly required and widely focused in recent years, especially under the trend of edge computation and real-time operation. And it is a critical need to deal with masked faces in the context of COVID-19 epidemic. In this paper, we propose a novel cascaded facial landmark detector towards efficient masked face alignment, which we call QCN (Quantized Cascaded Network). QCN consists of three stages: alignment, estimation and refinement. The alignment stage help to pre-align the faces to alleviate extreme poses. And the next two stages localize facial landmarks in a coarse-to-fine manner. Thanks to the Network Architecture Search and Quantization techniques, the networks of QCN are designed as efficient as possible. Specifically, QCN occupies 1.75 Mb storage and runs in 84.18 MFLOPs only. Despite costs little computations, the proposed method yields 62.62% AUC (@0.08) on test set of JD-landmark-mask, which achieves 2nd place in the Grand Challenge of 106-point Facial Landmark Localization in ICME2021.","PeriodicalId":228350,"journal":{"name":"2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114981556","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Visual Saliency Prediction on 360 Degree Images With CNN","authors":"Xinlang Chen, Pan Gao, Ran Wei","doi":"10.1109/ICMEW53276.2021.9456008","DOIUrl":"https://doi.org/10.1109/ICMEW53276.2021.9456008","url":null,"abstract":"With the rapid development of virtual reality techniques, understanding the visual attention in 360° images has attracted tremendous interest. Due to the lack of a sufficient large-scale 360° image saliency database, it is not straightforward to extend the existing saliency prediction methods from traditional 2D images to 360° images. In this paper, an end-to-end model based on Convolutional Neural Network (CNN) is proposed for 360° images saliency prediction. Firstly, we sample the omnidirectional image into equally-sized patches as the input, so as to reduce the error caused by stretching during equirectangular projection. Afterwards, a model containing two networks is proposed, i.e., basenet and refinenet. The basenet is designed to learn the saliency feature from the planar 2D patch, while the refinenet is to refine the saliency from the basenet by incorporating the observer bias towards the equator in spherical space. In addition, a new loss function is proposed, where both the distribution and location based evaluation metric are considered. Finally, we project each pixel of each patch back to the equirectangular image to generate the complete saliency map. Our experiments show that the proposed model outperforms the state-of-the-art method.","PeriodicalId":228350,"journal":{"name":"2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115040104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multi-View Image Feature Correlation Guided Cost Aggregation For Multi-View Stereo","authors":"Yawen Lai, Ke Qiu, Ronggang Wang","doi":"10.1109/ICMEW53276.2021.9455978","DOIUrl":"https://doi.org/10.1109/ICMEW53276.2021.9455978","url":null,"abstract":"In this paper, we propose a learning-based multi-view stereo network with the proposed feature correlation aggregation network (FCANet). We notice that the source views used to infer the depth of reference view are quite different, which are reflected in the images. Therefore, the contribution of source views should be different for building cost volume, which depends on the similarity between the source and reference views in our opinion. To this end, we propose FCANet infer the similarity to guide the cost aggregation. In addition, we adopt the strategy to build cost volume and infer depth in coarse to fine. We evaluate the proposed FCA-MVSNet and conduct ablation studies for the proposed FCANet on DTU dataset. The results show that we can significantly outperform the baseline and achieve state-of-the-art results, especially the reconstruction completeness has broken through 0.3mm of mean distance metric. Moreover, the proposed FCANet can significantly improve the reconstruction quality compared with the widely used variance metric.","PeriodicalId":228350,"journal":{"name":"2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128742161","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Correcting Perspective Distortion In Incremental Video Stitching","authors":"Yinqi Chen, Huicheng Zheng, Junyu Lin","doi":"10.1109/ICMEW53276.2021.9455966","DOIUrl":"https://doi.org/10.1109/ICMEW53276.2021.9455966","url":null,"abstract":"In video stitching, only incremental video stitching technology can typically be used due to the limitations of computer memory and processing speeds. However, if frames with perspective distortion are selected as reference planes, perspective distortion will accumulate continuously during incremental video stitching, making the resulting panorama image appear unnatural. Existing solutions to correct perspective distortion rely on the content of scenes or external hardware, which lack generalization and yield poor performance when stitching UAV (unmanned aerial vehicle) videos. This paper proposes a novel type of feature called “displacements of matching feature points” to correct perspective distortion. A displacement vector composed of matching feature points on two adjacent frames contains the information of perspective distortion, which allows us to correct any perspective distortion. We correct the displacements of matching feature points with perspective distortion in a reference plane to one without perspective distortion. Then, this plane is taken as a global reference plane in incremental video stitching to further correct the panorama. Using the proposed method, correction of perspective distortion is no longer dependent on image content or computational hardware. Experimentally, the proposed method performs better than other state-of-the-art methods, yielding more natural panoramas.","PeriodicalId":228350,"journal":{"name":"2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134544864","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Wieckowski, J. Brandenburg, Tobias Hinz, Christian Bartnik, Valeri George, G. Hege, Christian R. Helmrich, Anastasia Henkel, C. Lehmann, C. Stoffers, Ivan Zupancic, B. Bross, D. Marpe
{"title":"Vvenc: An Open And Optimized Vvc Encoder Implementation","authors":"A. Wieckowski, J. Brandenburg, Tobias Hinz, Christian Bartnik, Valeri George, G. Hege, Christian R. Helmrich, Anastasia Henkel, C. Lehmann, C. Stoffers, Ivan Zupancic, B. Bross, D. Marpe","doi":"10.1109/ICMEW53276.2021.9455944","DOIUrl":"https://doi.org/10.1109/ICMEW53276.2021.9455944","url":null,"abstract":"The recently finalized Versatile Video Coding (VVC) standard promises to reduce the video bitrate by 50% compared to its predecessor, High Efficiency Video Coding (HEVC). The increased efficiency comes at a cost of increased computational burden. The Fraunhofer Versatile Video Encoder VVenC is the first openly available optimized implementation providing access to VVC’s efficiency at only 46% of the runtime of the VVC test model VTM, when not using multi-threading. An alternative operating point allows $30 times$ faster encoding for the price of around 12% bitrate increase, while still providing around 38% bitrate reduction compared to HEVC test model HM. In the fastest configuration, VVenC runs over $140 times$ faster than VTM while still providing over 10% bitrate reduction compared to HM. Even faster encoding is possible with multi-threading. This paper provides an overview of VVenC’s main features and some evaluation results.","PeriodicalId":228350,"journal":{"name":"2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)","volume":"2014 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133228248","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Gbk360: A Game Among Tiles In 360 Video Based On Kalman Filter","authors":"Simou Shang, Yumei Wang, Yu Liu","doi":"10.1109/ICMEW53276.2021.9455996","DOIUrl":"https://doi.org/10.1109/ICMEW53276.2021.9455996","url":null,"abstract":"The tile-based method provides a feasible way for 360 video transmission. Viewpoint prediction and bitrate allocation are important modules in the tile-based method. In this paper, we propose GBK360 (a game based on Kalman filter), a transmission scheme of 360 videos, to improve the user’s quality of experience (QoE). Firstly, we achieve a viewpoint prediction method based on the Kalman filter, which can predict the viewpoint and the error distribution. Then, we regard the allocation of bandwidth to different tiles as a cooperative game and use the idea of game theory to improve the bandwidth utilization efficiency. Different categories of videos are used for experiments. The results showed that the proposed method based on the Kalman filter could increase the hit rate by 50.97% compared with the linear regression method. And the bitrate allocation method based on game theory can improve the bandwidth utilization efficiency and the user’s QoE compared with the other three schemes.","PeriodicalId":228350,"journal":{"name":"2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116086168","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Attention Based Facial Expression Manipulation","authors":"Feng Wang, Suncheng Xiang, Ting Liu, Yuzhuo Fu","doi":"10.1109/ICMEW53276.2021.9456007","DOIUrl":"https://doi.org/10.1109/ICMEW53276.2021.9456007","url":null,"abstract":"Facial expression manipulation has two objectives: 1) generating an image with target expression; 2) preserving the identity information of the original image as much as possible. Recently, Generative Adversarial Networks (GANs) have shown the abilities for fine-grained facial expression manipulation. However, current methods are still prone to generate images with poor quality. In this work, we propose a U-Net based generator with multi-attention gate for facial expression manipulation. The multi-level attention mechanism is helpful to manipulate relevant regions and preserve identity features, thus improving the editing ability. Furthermore, we adopt self-attention block to replace direct skip-connection to get long-range dependency in images. To suppress artifacts in generated images, we add a discriminator based loss function in the training process. Extensive experiments on both quantitative and qualitative evaluation show that our proposed method achieves better performance for facial expression manipulation.","PeriodicalId":228350,"journal":{"name":"2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122243282","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}