Xavier Lesage, Rosalie Tran, Stéphane Mancini, L. Fesquet
{"title":"An improved event-by-event clustering algorithm for noisy acquisition","authors":"Xavier Lesage, Rosalie Tran, Stéphane Mancini, L. Fesquet","doi":"10.1109/EBCCSP56922.2022.9845512","DOIUrl":"https://doi.org/10.1109/EBCCSP56922.2022.9845512","url":null,"abstract":"Event-based image sensors are a new class of sensors developed thanks to non-uniform sampling and asynchronous technology, which overcomes many image sensor limitations such as a high throughput or a huge power consumption. As their behavior and outputs are really different from traditional image sensors, the produced data stream imposes to completely rethink image processing. Indeed, dedicated algorithms are mandatory to take advantage of this specific data stream, known as Address Event Representation (AER). This paper presents an improved and dedicated event-by-event clustering algorithm allowing the object detection in a noisy environment which is still performant with a SNR of 1/4. We measure high recall and precision for different simulated scenarios with multiple objects and show an improvement compared to the previous algorithm. The approach especially demonstrates a low computational complexity and a reduced memory footprint, which is perfectly suited for low-cost and low-power embedded image sensing applications.","PeriodicalId":383039,"journal":{"name":"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)","volume":"67 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121797824","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Maciej Ordowski, M. Pawlak, D. Rzepka, M. Miśkowicz
{"title":"Signal Estimation from Level Crossings using Conditional Minimum Mean Square Error Predictor","authors":"Maciej Ordowski, M. Pawlak, D. Rzepka, M. Miśkowicz","doi":"10.1109/EBCCSP56922.2022.9845541","DOIUrl":"https://doi.org/10.1109/EBCCSP56922.2022.9845541","url":null,"abstract":"This paper is focused on the interpolation of a signal modeled by a random process from a set of discrete-time measurements. The process of signal sampling is studied as a conditioning of a random process at instants of its discrete-time observations. The analysis shows that even if an input is modeled by a stationary Gaussian process, the conditional random process with a set of observations at sampling instants, is still Gaussian but non-stationary. By the adoption of standard properties of the multivariate normal distribution, we derive the mean of the conditional process, which is at the same time the minimum mean-square error (MMSE) predictor for signal reconstruction based on the given information represented by the observations. It is shown that for Gaussian signals, the MMSE predictor is a linear function of the observed data. For bandlimited signals, the conditional MMSE predictor coincides to the well-known MMSE reconstruction derived by Yen based on the deterministic approach. Although the approach covers any measurement scheme, possibly non-uniform in time, the study is narrowed down to the interpolation of the signal from its level-crossing samples. The accuracy of the MMSE reconstruction has been verified by simulations.","PeriodicalId":383039,"journal":{"name":"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)","volume":"56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129470236","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
L. Rosa, Aiko Dinale, Simeon A. Bamford, C. Bartolozzi, Arren J. Glover
{"title":"High-Throughput Asynchronous Convolutions for High-Resolution Event-Cameras","authors":"L. Rosa, Aiko Dinale, Simeon A. Bamford, C. Bartolozzi, Arren J. Glover","doi":"10.1109/EBCCSP56922.2022.9845500","DOIUrl":"https://doi.org/10.1109/EBCCSP56922.2022.9845500","url":null,"abstract":"Event cameras are promising sensors for on-line and real-time vision tasks due to their high temporal resolution, low latency, and redundant static data elimination. Many vision algorithms use some form of spatial convolution (i.e. spatial pattern detection) as a fundamental component. However, additional consideration must be taken for event cameras, as the visual signal is asynchronous and sparse. While elegant methods have been proposed for event-based convolutions, they are unsuitable for real scenarios due to their inefficient processing pipeline and subsequent low event-throughput. This paper presents an efficient implementation based on decoupling the event-based computations from the computationally heavy convolutions, increasing the maximum event processing rate by 15. 92 × to over 10 million events/second, while still maintaining the event-based paradigm of asynchronous input and output. Results on public datasets with modern 640 × 480 event-camera recordings show that the proposed implementation achieves real-time processing with minimal impact on the convolution result, while the prior state-of-the-art results in a latency of over 1 second.","PeriodicalId":383039,"journal":{"name":"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)","volume":"103 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131055111","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Luna Gava, Marco Monforte, C. Bartolozzi, Arren J. Glover
{"title":"How Late is too Late? A Preliminary Event-based Latency Evaluation","authors":"Luna Gava, Marco Monforte, C. Bartolozzi, Arren J. Glover","doi":"10.1109/EBCCSP56922.2022.9845622","DOIUrl":"https://doi.org/10.1109/EBCCSP56922.2022.9845622","url":null,"abstract":"For a robot to compete at the game of air-hockey requires the ability to track the fast-moving puck, and fast reaction of its control system. Event-cameras can be used to solve the visual tracking task in order to overcome problems of motion blur and/or high processing requirements that come from when using traditional RGB cameras. Each pixel of an event-camera responds independently to change in light, resulting in a high frequency, low-latency update of the puck position. A vision-in-the-loop robot control can then maintain stability with much faster movements. In this paper, we introduce the control loop for an iCub robot to follow the position of the puck with its head motion. We evaluate the accuracy and stability of the iCub motion as the latency of the tracked position is varied from 1 ms to 30 ms, achievable in real-time with the event-camera, eventually resulting in control failure. We conclude that the event-driven tracking paradigm is an enabling technology for unlocking smooth dynamic robot motions from vision, also for tasks beyond air-hockey.","PeriodicalId":383039,"journal":{"name":"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122675506","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fully Event-Driven Control Architecture, Application to Visual Servoing of a Ball-on-Beam System","authors":"J. Soudier, Sacha De Sousa, S. Durand","doi":"10.1109/EBCCSP56922.2022.9845596","DOIUrl":"https://doi.org/10.1109/EBCCSP56922.2022.9845596","url":null,"abstract":"Nowadays, controlled systems with constant time sampling are widely spread. Conversely, the event-triggered paradigm is highly appealing since it promises to reduce computation and data flow when the dynamics of the system requires little or no control update, while allowing more intense refresh during transition phases. The objective here is to extend this opportunity and to design a fully event-based control architecture by considering not only the controller but the whole sensorimotor chain from perception to action, with the hope of even better gains in resource utilization. The targeted application is the visual servoing of a ball-on-beam system. The proposal includes a visual sensor, perception and control algorithms, as well as an actuator, all of which being event driven. Moreover, the proposed strategy is implemented on an embedded CPU-based platform. Beyond the innovative design, experimental results highlight savings in computational cost and bandwidth, with even slightly better performances.","PeriodicalId":383039,"journal":{"name":"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130977784","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Detailed EBCCSP/NeuroEng 2022 Program","authors":"","doi":"10.1109/ebccsp56922.2022.9845542","DOIUrl":"https://doi.org/10.1109/ebccsp56922.2022.9845542","url":null,"abstract":"","PeriodicalId":383039,"journal":{"name":"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130949012","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"EBCCSP 2022 Blank Page","authors":"","doi":"10.1109/ebccsp56922.2022.9845653","DOIUrl":"https://doi.org/10.1109/ebccsp56922.2022.9845653","url":null,"abstract":"","PeriodicalId":383039,"journal":{"name":"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)","volume":"103 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124624468","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"EBCCSP 2022 Cover Page","authors":"","doi":"10.1109/ebccsp56922.2022.9845673","DOIUrl":"https://doi.org/10.1109/ebccsp56922.2022.9845673","url":null,"abstract":"","PeriodicalId":383039,"journal":{"name":"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115803378","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ziyao Zhang, Maria Sabrina Ma, J. K. Eshraghian, D. Vigolo, Ken-Tye Yong, O. Kavehei
{"title":"Work in Progress: Neuromorphic Cytometry, High-throughput Event-based flow Flow-Imaging","authors":"Ziyao Zhang, Maria Sabrina Ma, J. K. Eshraghian, D. Vigolo, Ken-Tye Yong, O. Kavehei","doi":"10.1109/EBCCSP56922.2022.9845595","DOIUrl":"https://doi.org/10.1109/EBCCSP56922.2022.9845595","url":null,"abstract":"Cell sorting and counting technology has been broadly adopted for medical diagnosis, cell-based therapy, and biological research. Microscopy operates with image capture that is subject to an extremely constrained field-of-view, and even slow-moving targets may undergo motion blur, ghosting, and other movement-induced artifacts, which will ultimately degrade performance in developing machine learning models to perform cell sorting, detection, and tracking. Frame-based sensors are especially susceptible to these issues, and it is highly costly to overcome them with modern but conventional CMOS sensing technologies. We provide an early demonstration of a proof-of-concept system, with the overarching goals of curating a neuromorphic imaging cytometry (NIC) dataset, multimodal analysis techniques, and associated deep-learning models. We are working towards this goal by utilising an event-based camera to perform flow-imaging cytometry to capture cells in motion and train neural networks capable of identifying their morphology (size and shape) and identities. We propose that implementing a neuromorphic sensory system or developing a new class of event-based cameras customised for this purpose with our sorting strategy will unbind the applications from the constraints of framerate and provide a cost-efficient, reproducible and high-throughput imaging mechanism. While we target this early work for cell sorting, this novel idea is the first stepping-stone towards a new type of high-throughput and automated high-content image analysis system and screening instrument.","PeriodicalId":383039,"journal":{"name":"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128688886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shouyu Xie, E. Jones, Edward Marsden, I. Baistow, S. Furber, S. Mitra, A. Hamilton
{"title":"Unsupervised STDP-based Radioisotope Identification Using Spiking Neural Networks Implemented on SpiNNaker","authors":"Shouyu Xie, E. Jones, Edward Marsden, I. Baistow, S. Furber, S. Mitra, A. Hamilton","doi":"10.1109/EBCCSP56922.2022.9845586","DOIUrl":"https://doi.org/10.1109/EBCCSP56922.2022.9845586","url":null,"abstract":"This paper presents a spiking neural network (SNN) implementation which employs unsupervised feature extraction using spike timing dependent plasticity (STDP) to classify 8 different radioisotopes. With the implementation, the accuracy could reach 80% during training and overall testing accuracy of 72%. The whole network was implemented on SpiNNaker, a spiking neural network emulation platform. This work shows that unsupervised STDP, an SNN native training method, can be applied to the classification task of RIID to provide event-based training as well as inference.","PeriodicalId":383039,"journal":{"name":"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116991436","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}