{"title":"Tracking from a moving platform with the Dynamic Vision Sensor","authors":"Joseph Cox, Nicholas J. Morley","doi":"10.1117/12.2518761","DOIUrl":"https://doi.org/10.1117/12.2518761","url":null,"abstract":"The Dynamic Vision Sensor (DVS) is an imaging sensor that processes the incident irradiance image and outputs temporal log irradiance changes in the image, such as those generated by moving target(s) and/or the moving sensor platform. From a static platform, this enables the DVS to cancel out background clutter and greatly decrease the sensor bandwidth required to track temporal changes in a scene. However, the sensor bandwidth advantage is lost when imaging a scene from a moving platform due to platform motion causing optical flow in the background. Imaging from a moving platform has been utilized in many recently reported applications of this sensor. However, this approach inherently outputs background clutter generated from optical flow, and as such this approach has limited spatio-temporal resolution and is of limited utility for target tracking applications. In this work we present a new approach to moving target tracking applications with the DVS. Essentially, we propose modifying the incident image to cancel out optical flow due to platform motion, thereby removing background clutter and recovering the bandwidth performance advantage of the DVS. We propose that such improved performance can be accomplished by integrating a hardware tracking and stabilization subsystem with the DVS. Representative simulation scenarios are used to quantify the performance of the proposed approach to clutter cancellation and improved sensor bandwidth.","PeriodicalId":127697,"journal":{"name":"Computational Imaging IV","volume":"729 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133631968","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Grover A. Swartzlander, Jacob H. Wirth, A. Watnik, K. Novak
{"title":"Imaging reconstruction with engineered point spread functions (Conference Presentation)","authors":"Grover A. Swartzlander, Jacob H. Wirth, A. Watnik, K. Novak","doi":"10.1117/12.2521317","DOIUrl":"https://doi.org/10.1117/12.2521317","url":null,"abstract":"A Point Spread Function (PSF) engineered imaging system provides functionality at the expense of image distortion. Deconvolution and other post-processing techniques may partially restore the image if the PSF is known. We compare how various phase mask functions (e.g., vortex, axicon, cubic, and circular harmonic) may functionally protect a sensor from a coherent beam, and we discuss the subsequent trade-off between peak irradiance and the integrated modulation transfer function (Strehl ratio). Both experimental and numerical examples demonstrate that the peak irradiance may be suppressed by orders of magnitude without intolerable loss of image fidelity. The design of an optimal phase mask that accomplishes this task is made difficult by the nonlinear relationship between peak irradiance and Strehl. Results from experimental and numerical optimization schemes like simulated annealing, differential evolution, and Nelder-Mead will be compared.","PeriodicalId":127697,"journal":{"name":"Computational Imaging IV","volume":"69 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115951730","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Learning speckle correlations for imaging through scattering \u0000 (Conference Presentation)","authors":"Yunzhe Li, Yujia Xue, L. Tian","doi":"10.1117/12.2520081","DOIUrl":"https://doi.org/10.1117/12.2520081","url":null,"abstract":"Light scattering in complex media is a pervasive problem across many areas, such as deep tissue imaging, and imaging in degraded environment. Major progress has been made by using the transmission matrix (TM) framework that characterizes the “one-for-one” input-output relation of a fixed scattering medium as a linear shift-variant matrix. A major limitation of these existing approaches is their high susceptibility to model errors. The phase-sensitive TM is inherently intolerant to speckle decorrelations. Our goal here is to develop a highly scalable imaging through scattering framework by overcoming the existing limitations in susceptibility to speckle decorrelation and SBP. The proposed model is built on a deep learning (DL) frame- work. To satisfy the desired statistical properties, we do not train a convolutional neural network (CNN) to learn the TM of a single scattering medium. Instead, we build a CNN to learn a “one-for-all” mapping by training on several scattering media with different microstructures while having the same macroscopic parameter. Specifically, we show that our CNN model trained on a few diffusers can sufficiently support the statistical information of all diffusers having the same mean characteristics (e.g. ‘grits’). We then experimentally demonstrate that the CNN is able to “invert” speckles captured from entirely different diffusers to make high-quality object predictions. Our method significantly improves the system’s information throughput and adaptability as compared to existing approaches, by improving both the SBP and the robustness to speckle decorrelations.","PeriodicalId":127697,"journal":{"name":"Computational Imaging IV","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115339400","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}