[WIP] Unlocking Static Images for Training Event-driven Neural Networks

Abstract

Event driven cameras have the potential to revolutionise the real-time visual sensory processing paradigm. These asynchronous sensors detect change in the environment with low latency and high dynamic range, allowing for orders of magnitude faster systems than the state of the art using intensity cameras. On the other hand, deep artificial neural networks have refashioned machine vision in the last decade, greatly expanding the reach of viable tasks, supported by the creation of many large scale image datasets. In this work, we present a modality to leverage these large scale datasets for the purpose of training off-the-shelf deep learning architectures and re-appropriating them for event-based tasks. To this end, we describe an event representation, EROS, and a method to convert images to an EROS-like representation such that image datasets can train neural networks for event driven applications.