{"title":"Accelerating Event-based Deep Neural Networks via Flexible Data Encoding","authors":"Yuanli Zhong, Yongqi Xu, Bosheng Liu, Yibing Tang, Jigang Wu","doi":"10.1587/elex.20.20230379","DOIUrl":null,"url":null,"abstract":"Event-based deep neural networks (DNNs) have shown great promise in computer vision under difficult lighting conditions. However, existing hardware solutions cannot provide efficient event-based DNN accelerations owing to the characteristic of event streams, which are typically in low datarate and high-dynamic range. In this letter, we present a novel hardware design that can handle event-based DNNs according to the data characteristic of event streams. Furthermore, we provide a dataflow that enables flexible DNN data encodings (including both bitmask and compressed sparse row (CSR)) based on the event data characteristic for energy saving. Comprehensive evaluations based on four famous event-based benchmarks show that the proposed design can achieve higher performance and better energy efficiency compared with representative accelerator baselines.","PeriodicalId":50387,"journal":{"name":"Ieice Electronics Express","volume":null,"pages":null},"PeriodicalIF":0.8000,"publicationDate":"2023-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ieice Electronics Express","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1587/elex.20.20230379","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Event-based deep neural networks (DNNs) have shown great promise in computer vision under difficult lighting conditions. However, existing hardware solutions cannot provide efficient event-based DNN accelerations owing to the characteristic of event streams, which are typically in low datarate and high-dynamic range. In this letter, we present a novel hardware design that can handle event-based DNNs according to the data characteristic of event streams. Furthermore, we provide a dataflow that enables flexible DNN data encodings (including both bitmask and compressed sparse row (CSR)) based on the event data characteristic for energy saving. Comprehensive evaluations based on four famous event-based benchmarks show that the proposed design can achieve higher performance and better energy efficiency compared with representative accelerator baselines.
期刊介绍:
An aim of ELEX is rapid publication of original, peer-reviewed short papers that treat the field of modern electronics and electrical engineering. The boundaries of acceptable fields are not strictly delimited and they are flexibly varied to reflect trends of the fields. The scope of ELEX has mainly been focused on device and circuit technologies. Current appropriate topics include:
- Integrated optoelectronics (lasers and optoelectronic devices, silicon photonics, planar lightwave circuits, polymer optical circuits, etc.)
- Optical hardware (fiber optics, microwave photonics, optical interconnects, photonic signal processing, photonic integration and modules, optical sensing, etc.)
- Electromagnetic theory
- Microwave and millimeter-wave devices, circuits, and modules
- THz devices, circuits and modules
- Electron devices, circuits and modules (silicon, compound semiconductor, organic and novel materials)
- Integrated circuits (memory, logic, analog, RF, sensor)
- Power devices and circuits
- Micro- or nano-electromechanical systems
- Circuits and modules for storage
- Superconducting electronics
- Energy harvesting devices, circuits and modules
- Circuits and modules for electronic displays
- Circuits and modules for electronic instrumentation
- Devices, circuits and modules for IoT and biomedical applications