{"title":"Challenges in 3D video standardization","authors":"K. Müller, P. Merkle","doi":"10.1109/VCIP.2011.6116048","DOIUrl":"https://doi.org/10.1109/VCIP.2011.6116048","url":null,"abstract":"Stereoscopic video transmission systems have now evolved from 2D video systems and have been commercialized for a number of application areas, driven by developments in stereo capturing and display technology. With the new developments in autostereoscopic display technology, these stereo systems need to further advance towards 3D video systems. In contrast to all previous video coding technologies, 3D video data requires a number of new assumptions and novel technology developments. This paper discusses the evolution from 2D to stereo video and finally to 3D video systems and highlights some of the major new challenges for 3D Video. Finally, an evaluation framework for 3D video technology is shown, that addresses these challenges and is used by ISO-MPEG for standardizing the best 3D video coding solution.","PeriodicalId":149704,"journal":{"name":"2011 Visual Communications and Image Processing (VCIP)","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124441797","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An adaptive H.264 video protection scheme for video conferencing","authors":"Fang-xiao Wang, Wenjun Wu, Yihua Lou, Aixuan Yang","doi":"10.1109/VCIP.2011.6115954","DOIUrl":"https://doi.org/10.1109/VCIP.2011.6115954","url":null,"abstract":"Real-time video communication such as Internet video conferencing is often afflicted by packet loss over the network. To improve the quality of video, error protection schemes have been introduced based on FMO in H.264 whose encoding efficiency is unacceptable. This paper presents a novel region of interest (ROI) protection scheme that can accurately extract ROI area using facial recognition and greatly speedup video encoding based on feedback using x264 codec implementation. In this scheme, the video receiver uses a packet loss prediction model to predict whether to send feedback to the video sender that dynamically adjust the ROI protecting scheme. Experiments prove that the quality of the ROI area can be effectively improved by the scheme whose encoding performance increases by 50 times compared with FMO based algorithms.","PeriodicalId":149704,"journal":{"name":"2011 Visual Communications and Image Processing (VCIP)","volume":"471 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115325351","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multiple description video coding against both erasure and bit errors by compressive sensing","authors":"Liangjun Wang, Xiaolin Wu, Guangming Shi","doi":"10.1109/VCIP.2011.6116045","DOIUrl":"https://doi.org/10.1109/VCIP.2011.6116045","url":null,"abstract":"We propose a novel multiple description video coding (MDVC) technique for robust video transmission via lossy networks of both packet erasure and bit errors. The new MDVC technique is designed to meet two objectives: ultra fine description granularity and low encoder complexity, which allow resource-deprived video transmitters (e.g., smart phones) to operate in time-varying adverse network conditions. These design goals are met by the signal acquisition and coding strategy of compressive sensing, and by locally adaptive sparse representation of video signals.","PeriodicalId":149704,"journal":{"name":"2011 Visual Communications and Image Processing (VCIP)","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122321955","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Image retargeting based on the sensitivity-tuned visual significance map","authors":"Yuming Fang, Zhenzhong Chen, Weisi Lin, Chia-Wen Lin, Chia-Ming Tsai","doi":"10.1109/VCIP.2011.6116014","DOIUrl":"https://doi.org/10.1109/VCIP.2011.6116014","url":null,"abstract":"In this paper, we propose a novel image retargeting algorithm based on the sensitivity-tuned visual significance map which is composed of a saliency map and a gradient map. We develop a new saliency detection model based on the human visual sensitivity and amplitude spectrum of image patches. We use a coherent normalization based fusion method to combine the saliency map and the gradient map to generate the visual significance map. The seam carving technique is adopted for image retargeting, based on the sensitivity-tuned visual significance map. Experiment results show that the proposed algorithm outperforms the relevant state-of-the-arts image retargeting algorithms significantly.","PeriodicalId":149704,"journal":{"name":"2011 Visual Communications and Image Processing (VCIP)","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122615691","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Cross-view post-filtering for fidelity enhancement on asymmetric coding of 3D video","authors":"Yin Zhao, Lu Yu, Zhenzhong Chen","doi":"10.1109/VCIP.2011.6116017","DOIUrl":"https://doi.org/10.1109/VCIP.2011.6116017","url":null,"abstract":"3D video employing depth-image-based rendering (DIBR) typically contains a stereo pair plus two associated depth maps. The stereo pair may be compressed asymmetrically (e.g., using mixed resolution coding) to effectively reduce the bit rate while maintaining the stereoscopic visual quality at the same level as that from symmetric coding. With depth information, it is straightforward to locate high-fidelity (HF) inter-view correspondences of pixels in the low-fidelity (LF) view. However, we find that LF-view fidelity cannot be consistently improved by simply substituting LF pixels with their HF counterparts, due to inter-view color/geometric differences and depth errors. In this paper, we propose an effective post-filter which first checks the coherence between local LF and HF waveforms to distinguish unreliable correspondences. Then, the LF view is adaptively rectified by the reliable HF pixels to improve its fidelity. Experimental results show that the proposed cross-view fidelity enhancement scheme can promote Peak Signal-to-Noise Ratio (PSNR) of LF views by up to 1.1 dB, and can effectively suppress ringing and blocking artifacts in flat regions of LF views.","PeriodicalId":149704,"journal":{"name":"2011 Visual Communications and Image Processing (VCIP)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122639305","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Resource aware real-time stream adaptation of MPEG-4 video in constrained bandwidth networks","authors":"A. Kotra, G. Fohler","doi":"10.1109/VCIP.2011.6116008","DOIUrl":"https://doi.org/10.1109/VCIP.2011.6116008","url":null,"abstract":"In this paper, we propose a novel method for real-time stream adaptation of live MPEG-4 Visual advanced simple profile (ASP) and simple prole (SP) bit streams to limited and varying network bandwidth. The proposed method operates by dropping higher order AC DCT coefficients present in blocks. Unlike frame dropping, the proposed method delivers finer granularity during adaptation and therefore smaller resource under-utilization. Furthermore, to optimize the resource utilization and consequently the perceptive video quality, the method attempts to represent the adapted block with the least possible number of bits. The low computation requirements of the proposed method qualifies its application to adaptation of live streams. Additionally, the method can be applied for other constrained resources as well (e.g. CPU bandwidth). Implementation and case study of the proposed method show that, on an average, a bit rate reduction of up to 50% and a decoding time speedup up to 20% are achieved when compared with that of the original bitstream. Results also affirm the efficiency in resource usage.","PeriodicalId":149704,"journal":{"name":"2011 Visual Communications and Image Processing (VCIP)","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124003337","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Chia-Ping Chen, Yu-Ting Chen, Ping-Han Lee, Yu-Pao Tsai, S. Lei
{"title":"Real-time hand tracking on depth images","authors":"Chia-Ping Chen, Yu-Ting Chen, Ping-Han Lee, Yu-Pao Tsai, S. Lei","doi":"10.1109/VCIP.2011.6115983","DOIUrl":"https://doi.org/10.1109/VCIP.2011.6115983","url":null,"abstract":"Hand tracking is a fundamental task in a gesture recognition system. Most previous works tracked the hand position on color images and relied heavily on skin color information. However, color information is very vulnerable to lighting variations and skin color varies across difference human races. Furthermore, one can not effectively discriminate faces or other skin-color-like objects from hands when using skin color detection. In this paper, we propose a hand tracking algorithm that uses depth images only, and also a hand click detection method to initialize the hand tracking automatically. We show that depth images suffice and are advantageous to real-time hand tracking. A region growing technique is applied to segment the hand region on depth images. Then a mean-shift based algorithm accurately locates the hand center in the segmented hand region. The experimental results show that the proposed tracking algorithm runs at 300+ FPS, and the average error of the tracked 3D hand positions is less than 1 centimeter. The proposed method enables a plethora of potential applications to natural Human-Computer Interaction (HCI), and is adequate for embedded systems of consumer electronics because of its low complexity and low bandwidth requirement.","PeriodicalId":149704,"journal":{"name":"2011 Visual Communications and Image Processing (VCIP)","volume":"361 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116322629","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Content-based image quality assessment of natural scene image distorted by quantization","authors":"Tao Luo, Chao Wang, X. Mou","doi":"10.1109/VCIP.2011.6115992","DOIUrl":"https://doi.org/10.1109/VCIP.2011.6115992","url":null,"abstract":"In this paper, the subjective image quality for different image content is investigated by psychophysical experiments. The experimental images are the parts from natural scenes distorted by integer transform and quantization in H.264 frame. These images are divided into two types based on the scene content, type I and type II. The perceived thresholds and subjective graded scores for different quantization are obtained using forced choice staircase experiments and graded response experiments, respectively. The subjective assessment results showed that the image quality of type I degrades much more than the type II when quantization steps increase, and the preliminary experiment showed that the existed IQA metric, i.e. SSIM, could not predict it well. We also present a content-based image classifier to predict the two image types. The results show good accordance between the classifier and the subjective assessment.","PeriodicalId":149704,"journal":{"name":"2011 Visual Communications and Image Processing (VCIP)","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121482867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Visual system using ray-based image sensors and electronic holography display toward ultra-realistic communication","authors":"K. Yamamoto","doi":"10.1109/VCIP.2011.6116011","DOIUrl":"https://doi.org/10.1109/VCIP.2011.6116011","url":null,"abstract":"This paper introduces two 3D visual systems using ray-based image sensors and electronic holography display toward ultra-realistic communication. The first system uses integral photography for the capture of ray information at slightly separated locations. The second system uses camera array that includes 300 cameras to capture ray information at more sparse locations than integral photography. Both systems use electronic holography as an ideal 3D display. Since spatial light modulators are currently inadequate specifications for electronic holography, the setup to remove disturbing light is necessary, which we implemented in both systems.","PeriodicalId":149704,"journal":{"name":"2011 Visual Communications and Image Processing (VCIP)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126414343","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yongsheng Zhang, H. Xiong, Hao Wang, Chang Wen Chen
{"title":"Conditional random field based side-information fusion for distributed multi-view video coding","authors":"Yongsheng Zhang, H. Xiong, Hao Wang, Chang Wen Chen","doi":"10.1109/VCIP.2011.6116053","DOIUrl":"https://doi.org/10.1109/VCIP.2011.6116053","url":null,"abstract":"This paper presents a new temporal and inter-view side-information fusion algorithm for distributed multi-view video coding (DMVC). Unlike existing fusion algorithms in DMVC schemes that produce the fusion mask by finding the motion vector outliers, it introduces conditional random fields (CRF) to exploit the intrinsic geometric regularity and temporal consistency constraint in multi-view video sequences. Specifically, Wyner-Ziv (WZ) frames are modeled by CRF with the temporal and the inter-view side-information as two observations. The observation distribution models the local accuracy of the temporal and the inter-view side-information. The transition distribution of the CRF model represents the local geometric regularity, e.g., the edge directions and the local smoothness of the WZ frame. Its parameters are trained from previously decoded WZ frames, and the inference is made on trained weights to generate fused side-information. The accurate modeling is validated to show a significant performance gain over the existing fusion algorithms by experiments.","PeriodicalId":149704,"journal":{"name":"2011 Visual Communications and Image Processing (VCIP)","volume":"60 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126535870","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}