Chenguang Ma, J. Suo, Qionghai Dai, R. Raskar, Gordon Wetzstein
{"title":"High-rank coded aperture projection for extended depth of field","authors":"Chenguang Ma, J. Suo, Qionghai Dai, R. Raskar, Gordon Wetzstein","doi":"10.1109/ICCPhot.2013.6528303","DOIUrl":"https://doi.org/10.1109/ICCPhot.2013.6528303","url":null,"abstract":"Projectors require large apertures to maximize light throughput. Unfortunately, this leads to shallow depths of field (DOF), hence blurry images, when projecting on non-planar surfaces, such as cultural heritage sites, curved screens, or when sharing visual information in everyday environments. We introduce high-rank coded aperture projectors - a new computational display technology that combines optical designs with computational processing to overcome depth of field limitations of conventional devices. In particular, we employ high-speed spatial light modulators (SLMs) on the image plane and in the aperture of modified projectors. The patterns displayed on these SLMs are computed with a new mathematical framework that uses high-rank light field factorizations and directly exploits the limited temporal resolution and contrast sensitivity of the human visual system. With an experimental prototype projector, we demonstrate significantly increased DOF as compared to conventional technology.","PeriodicalId":289563,"journal":{"name":"IEEE International Conference on Computational Photography (ICCP)","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123572800","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
B. Sajadi, Duy-Quoc Lai, A. Ihler, M. Gopi, A. Majumder
{"title":"Image enhancement in projectors via optical pixel shift and overlay","authors":"B. Sajadi, Duy-Quoc Lai, A. Ihler, M. Gopi, A. Majumder","doi":"10.1109/ICCPhot.2013.6528304","DOIUrl":"https://doi.org/10.1109/ICCPhot.2013.6528304","url":null,"abstract":"Earlier work has explored enhancing the perceived resolution of a display by shifting multiple different low-resolution images by fractions of a pixel and overlaying them in a temporally multiplexed fashion. This increases the manufacturing cost and also sacrifices the temporal resolution that can compromise other capabilities like 3D active stereo. In this paper we propose a method to achieve the same goal in projectors by performing the pixel shift and superposition optically by introducing a simple and inexpensive optical ensemble of a set of lenses on the projector light path. This does not sacrifice the temporal resolution and is extremely easy to implement in practice. However, instead of overlaying different images, we overlay an image with one or more sub-pixel shifted copies of itself. Therefore, we seek a single n×n image which when shifted and overlaid with itself creates a perceptually closer to a higher resolution 2n × 2n target image. This changes the optimization formulation significantly and requires solving a system of sparse linear equations. We take advantage of this sparsity and design a parallel implementation of this optimization in GPUs for real-time computation of the input image critical for its practical implementation. But, since this system is more constrained that using multiple overlaid images, the enhancement of resolution is compromised. However, since the optical design is very simple and inexpensive, it can be deployed on a variety of low-cost projectors and still offer a significant image quality benefit.","PeriodicalId":289563,"journal":{"name":"IEEE International Conference on Computational Photography (ICCP)","volume":"99 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130097387","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Super-resolution with randomly shaped pixels and sparse regularization","authors":"Tomoki Sasao, S. Hiura, Kosuke Sato","doi":"10.1109/ICCPhot.2013.6528310","DOIUrl":"https://doi.org/10.1109/ICCPhot.2013.6528310","url":null,"abstract":"This paper shows a random and distinct shape of each pixel improves the performance of super-resolution using multiple input images. Since the spatial light sensitivity distribution in each pixel of an image sensor is rectangular and identical, the process of imaging is equivalent to the point sampling of blurred image which is a result of convolution of a rectangle with the original image. The convolution results in a loss of the high spatial frequency component of the original image, which limits the performance of super-resolution. Thus, we sprayed a fine-grained black powder on an image sensor to give a random code to the spatial light sensitivity distribution in each pixel. This approach was combined with a reconstruction technique based on sparse regularization, which is commonly used in compressed sensing, in an experiment with an actual setup. A high-resolution image was reconstructed from a limited number of input images and the performance of super-resolution was significantly improved.","PeriodicalId":289563,"journal":{"name":"IEEE International Conference on Computational Photography (ICCP)","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114429721","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Triangulation in random refractive distortions","authors":"Marina Alterman, Y. Schechner, Y. Swirski","doi":"10.1109/ICCPhot.2013.6528314","DOIUrl":"https://doi.org/10.1109/ICCPhot.2013.6528314","url":null,"abstract":"Random refraction occurs in turbulence and through a wavy water-air interface. It creates distortion that changes in space, time and with viewpoint. Localizing objects in three dimensions (3D) despite this random distortion is important to some predators and also to submariners avoiding the salient use of periscopes. We take a multiview approach to this task. Refracted distortion statistics induce a probabilistic relation between any pixel location and a line of sight in space. Measurements of an object's random projection from multiple views and times lead to a likelihood function of the object's 3D location. The likelihood leads to estimates of the 3D location and its uncertainty. Furthermore, multiview images acquired simultaneously in a wide stereo baseline have uncorrelated distortions. This helps reduce the acquisition time needed for localization. The method is demonstrated in stereoscopic video sequences, both in a lab and a swimming pool.","PeriodicalId":289563,"journal":{"name":"IEEE International Conference on Computational Photography (ICCP)","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129988546","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Edge-based blur kernel estimation using patch priors","authors":"Libin Sun, Sunghyun Cho, Jue Wang, James Hays","doi":"10.1109/ICCPhot.2013.6528301","DOIUrl":"https://doi.org/10.1109/ICCPhot.2013.6528301","url":null,"abstract":"Blind image deconvolution, i.e., estimating a blur kernel k and a latent image x from an input blurred image y, is a severely ill-posed problem. In this paper we introduce a new patch-based strategy for kernel estimation in blind deconvolution. Our approach estimates a “trusted” subset of x by imposing a patch prior specifically tailored towards modeling the appearance of image edge and corner primitives. To choose proper patch priors we examine both statistical priors learned from a natural image dataset and a simple patch prior from synthetic structures. Based on the patch priors, we iteratively recover the partial latent image x and the blur kernel k. A comprehensive evaluation shows that our approach achieves state-of-the-art results for uniformly blurred images.","PeriodicalId":289563,"journal":{"name":"IEEE International Conference on Computational Photography (ICCP)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115256309","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"3Deflicker from motion","authors":"Y. Swirski, Y. Schechner","doi":"10.1109/ICCPhot.2013.6528294","DOIUrl":"https://doi.org/10.1109/ICCPhot.2013.6528294","url":null,"abstract":"Spatio-temporal irradiance variations are created by some structured light setups. They also occur naturally underwater, where they are termed flicker. Underwater, visibility is also affected by water scattering. Methods for overcoming or exploiting flicker or scatter exist, when the imaging geometry is static or quasi-static. This work removes the need for quasi-static scene-object geometry under flickering illumination. A scene is observed from a free moving platform that carries standard frame-rate stereo cameras. The 3D scene structure is illumination invariant. Thus, as a reference for motion estimation, we use projections of stereoscopic range maps, rather than object radiance. Consequently, each object point can be tracked and then filtered in time, yielding deflickered videos. Moreover, since objects are viewed from different distances as the stereo rig moves, scattering effects on the images are modulated. This modulation, the recovered camera poses, 3D structure and de-flickered images yield inversion of scattering and recovery of the water attenuation coefficient. Thus, coupled difficult problems are solved in a single framework. This is demonstrated in underwater field experiments and in a lab.","PeriodicalId":289563,"journal":{"name":"IEEE International Conference on Computational Photography (ICCP)","volume":"94 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117201478","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Random coded sampling for high-speed HDR video","authors":"Travis Portz, Li Zhang, Hongrui Jiang","doi":"10.1109/ICCPhot.2013.6528308","DOIUrl":"https://doi.org/10.1109/ICCPhot.2013.6528308","url":null,"abstract":"We propose a novel method for capturing high-speed, high dynamic range video with a single low-speed camera using a coded sampling technique. Traditional video cameras use a constant full-frame exposure time, which makes temporal super-resolution difficult due to the ill-posed nature of inverting the sampling operation. Our method samples at the same rate as the traditional low-speed camera but uses random per-pixel exposure times and offsets. By exploiting temporal and spatial redundancy in the video, we can reconstruct a high-speed video from the coded input. Furthermore, the different exposure times used in our sampling scheme enable us to obtain a higher dynamic range than a traditional camera or other temporal superresolution methods. We validate our approach using simulation and provide a detailed discussion on how to make a hardware implementation. In particular, we believe that our approach can maintain a 100% light throughput similarly to existing cameras and can be implemented on a single chip, making it suitable for small form factors.","PeriodicalId":289563,"journal":{"name":"IEEE International Conference on Computational Photography (ICCP)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114357817","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Matthias Grundmann, C. McClanahan, S. B. Kang, Irfan Essa
{"title":"Post-processing approach for radiometric self-calibration of video","authors":"Matthias Grundmann, C. McClanahan, S. B. Kang, Irfan Essa","doi":"10.1109/ICCPhot.2013.6528307","DOIUrl":"https://doi.org/10.1109/ICCPhot.2013.6528307","url":null,"abstract":"We present a novel data-driven technique for radiometric self-calibration of video from an unknown camera. Our approach self-calibrates radiometric variations in video, and is applied as a post-process; there is no need to access the camera, and in particular it is applicable to internet videos. This technique builds on empirical evidence that in video the camera response function (CRF) should be regarded time variant, as it changes with scene content and exposure, instead of relying on a single camera response function. We show that a time-varying mixture of responses produces better accuracy and consistently reduces the error in mapping intensity to irradiance when compared to a single response model. Furthermore, our mixture model counteracts the effects of possible nonlinear exposure-dependent intensity perturbations and white-balance changes caused by proprietary camera firmware. We further show how radiometrically calibrated video improves the performance of other video analysis algorithms, enabling a video segmentation algorithm to be invariant to exposure and gain variations over the sequence. We validate our data-driven technique on videos from a variety of cameras and demonstrate the generality of our approach by applying it to internet video.","PeriodicalId":289563,"journal":{"name":"IEEE International Conference on Computational Photography (ICCP)","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133434173","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multi-modality depth map fusion using primal-dual optimization","authors":"David Ferstl, René Ranftl, M. Rüther, H. Bischof","doi":"10.1109/ICCPhot.2013.6528305","DOIUrl":"https://doi.org/10.1109/ICCPhot.2013.6528305","url":null,"abstract":"We present a novel fusion method that combines complementary 3D and 2D imaging techniques. Consider a Time-of-Flight sensor that acquires a dense depth map on a wide depth range but with a comparably small resolution. Complementary, a stereo sensor generates a disparity map in high resolution but with occlusions and outliers. In our method, we fuse depth data, and optionally also intensity data using a primal-dual optimization, with an energy functional that is designed to compensate for missing parts, filter strong outliers and reduce the acquisition noise. The numerical algorithm is efficiently implemented on a GPU to achieve a processing speed of 10 to 15 frames per second. Experiments on synthetic, real and benchmark datasets show that the results are superior compared to each sensor alone and to competing optimization techniques. In a practical example, we are able to fuse a Kinect triangulation sensor and a small size Time-of-Flight camera to create a gaming sensor with superior resolution, acquisition range and accuracy.","PeriodicalId":289563,"journal":{"name":"IEEE International Conference on Computational Photography (ICCP)","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126089274","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xing Lin, J. Suo, Gordon Wetzstein, Qionghai Dai, R. Raskar
{"title":"Coded focal stack photography","authors":"Xing Lin, J. Suo, Gordon Wetzstein, Qionghai Dai, R. Raskar","doi":"10.1109/ICCPhot.2013.6528297","DOIUrl":"https://doi.org/10.1109/ICCPhot.2013.6528297","url":null,"abstract":"We present coded focal stack photography as a computational photography paradigm that combines a focal sweep and a coded sensor readout with novel computational algorithms. We demonstrate various applications of coded focal stacks, including photography with programmable non-planar focal surfaces and multiplexed focal stack acquisition. By leveraging sparse coding techniques, coded focal stacks can also be used to recover a full-resolution depth and all-in-focus (AIF) image from a single photograph. Coded focal stack photography is a significant step towards a computational camera architecture that facilitates high-resolution post-capture refocusing, flexible depth of field, and 3D imaging.","PeriodicalId":289563,"journal":{"name":"IEEE International Conference on Computational Photography (ICCP)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124972243","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}