Parallel GEMM-based convolutions for deep learning on multicore ARM and RISC-V architectures

IF 3.7 2区计算机科学 Q1 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE

Journal of Systems Architecture Pub Date : 2024-05-24 DOI:10.1016/j.sysarc.2024.103186

Héctor Martínez , Sandra Catalán , Adrián Castelló , Enrique S. Quintana-Ortí

引用次数: 0

Abstract

We present high performance, multi-threaded implementations of three GEMM-based convolution algorithms for multicore processors with ARM and RISC-V architectures. The codes are integrated into CONVLIB, a library that has the following unique features: (1) scripts to automatically generate a key component of GEMM, known as the micro-kernel, which is typically written in assembly language; (2) a modified analytical model to automatically tune the algorithms to the underlying cache architecture; (3) the ability to select four hyper-parameters: micro-kernel, cache parameters, parallel loop, and GEMM algorithm dynamically between calls to the library, without recompiling it; and (4) a driver to identify the best hyper-parameters. In addition, we provide a detailed performance evaluation of the convolution algorithms, on five ARM and RISC-V processors, and we publicly release the codes.

查看原文本刊更多论文

在多核 ARM 和 RISC-V 架构上基于 GEMM 的并行卷积进行深度学习

我们介绍了针对 ARM 和 RISC-V 架构多核处理器的三种基于 GEMM 的卷积算法的高性能多线程实现。这些代码被集成到 CONVLIB 库中，该库具有以下独特功能：(1) 自动生成 GEMM 关键组件（即通常用汇编语言编写的微内核）的脚本；(2) 根据底层高速缓存架构自动调整算法的改进分析模型；(3) 在调用库之间动态选择微内核、高速缓存参数、并行循环和 GEMM 算法这四个超参数的能力，而无需重新编译；(4) 识别最佳超参数的驱动程序。此外，我们还在五种 ARM 和 RISC-V 处理器上对卷积算法进行了详细的性能评估，并公开发布了代码。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Journal of Systems Architecture 工程技术-计算机：硬件

CiteScore

8.70

自引率

15.60%

发文量

226

审稿时长

46 days

期刊介绍： The Journal of Systems Architecture: Embedded Software Design (JSA) is a journal covering all design and architectural aspects related to embedded systems and software. It ranges from the microarchitecture level via the system software level up to the application-specific architecture level. Aspects such as real-time systems, operating systems, FPGA programming, programming languages, communications (limited to analysis and the software stack), mobile systems, parallel and distributed architectures as well as additional subjects in the computer and system architecture area will fall within the scope of this journal. Technology will not be a main focus, but its use and relevance to particular designs will be. Case studies are welcome but must contribute more than just a design for a particular piece of software. Design automation of such systems including methodologies, techniques and tools for their design as well as novel designs of software components fall within the scope of this journal. Novel applications that use embedded systems are also central in this journal. While hardware is not a part of this journal hardware/software co-design methods that consider interplay between software and hardware components with and emphasis on software are also relevant here.