Accelerating Event-based Deep Neural Networks via Flexible Data Encoding

IF 0.8 4区 工程技术 Q4 ENGINEERING, ELECTRICAL & ELECTRONIC
Yuanli Zhong, Yongqi Xu, Bosheng Liu, Yibing Tang, Jigang Wu
{"title":"Accelerating Event-based Deep Neural Networks via Flexible Data Encoding","authors":"Yuanli Zhong, Yongqi Xu, Bosheng Liu, Yibing Tang, Jigang Wu","doi":"10.1587/elex.20.20230379","DOIUrl":null,"url":null,"abstract":"Event-based deep neural networks (DNNs) have shown great promise in computer vision under difficult lighting conditions. However, existing hardware solutions cannot provide efficient event-based DNN accelerations owing to the characteristic of event streams, which are typically in low datarate and high-dynamic range. In this letter, we present a novel hardware design that can handle event-based DNNs according to the data characteristic of event streams. Furthermore, we provide a dataflow that enables flexible DNN data encodings (including both bitmask and compressed sparse row (CSR)) based on the event data characteristic for energy saving. Comprehensive evaluations based on four famous event-based benchmarks show that the proposed design can achieve higher performance and better energy efficiency compared with representative accelerator baselines.","PeriodicalId":50387,"journal":{"name":"Ieice Electronics Express","volume":null,"pages":null},"PeriodicalIF":0.8000,"publicationDate":"2023-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ieice Electronics Express","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1587/elex.20.20230379","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Event-based deep neural networks (DNNs) have shown great promise in computer vision under difficult lighting conditions. However, existing hardware solutions cannot provide efficient event-based DNN accelerations owing to the characteristic of event streams, which are typically in low datarate and high-dynamic range. In this letter, we present a novel hardware design that can handle event-based DNNs according to the data characteristic of event streams. Furthermore, we provide a dataflow that enables flexible DNN data encodings (including both bitmask and compressed sparse row (CSR)) based on the event data characteristic for energy saving. Comprehensive evaluations based on four famous event-based benchmarks show that the proposed design can achieve higher performance and better energy efficiency compared with representative accelerator baselines.
通过灵活的数据编码加速基于事件的深度神经网络
基于事件的深度神经网络(dnn)在困难光照条件下的计算机视觉中显示出巨大的前景。然而,由于事件流的特性,现有的硬件解决方案无法提供有效的基于事件的DNN加速,事件流通常处于低数据量和高动态范围内。在这封信中,我们提出了一种新的硬件设计,可以根据事件流的数据特征处理基于事件的dnn。此外,我们提供了一个基于事件数据特征的数据流,该数据流支持灵活的DNN数据编码(包括位掩码和压缩稀疏行(CSR)),以节省能源。基于四个著名事件基准的综合评估表明,与代表性加速器基准相比,所提出的设计可以实现更高的性能和更好的能源效率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Ieice Electronics Express
Ieice Electronics Express 工程技术-工程:电子与电气
CiteScore
1.50
自引率
37.50%
发文量
119
审稿时长
1.1 months
期刊介绍: An aim of ELEX is rapid publication of original, peer-reviewed short papers that treat the field of modern electronics and electrical engineering. The boundaries of acceptable fields are not strictly delimited and they are flexibly varied to reflect trends of the fields. The scope of ELEX has mainly been focused on device and circuit technologies. Current appropriate topics include: - Integrated optoelectronics (lasers and optoelectronic devices, silicon photonics, planar lightwave circuits, polymer optical circuits, etc.) - Optical hardware (fiber optics, microwave photonics, optical interconnects, photonic signal processing, photonic integration and modules, optical sensing, etc.) - Electromagnetic theory - Microwave and millimeter-wave devices, circuits, and modules - THz devices, circuits and modules - Electron devices, circuits and modules (silicon, compound semiconductor, organic and novel materials) - Integrated circuits (memory, logic, analog, RF, sensor) - Power devices and circuits - Micro- or nano-electromechanical systems - Circuits and modules for storage - Superconducting electronics - Energy harvesting devices, circuits and modules - Circuits and modules for electronic displays - Circuits and modules for electronic instrumentation - Devices, circuits and modules for IoT and biomedical applications
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信