WPIA: accelerating DNN warm-up in Web browsers by precompiling WebGL programs

IF 3.4 3区计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS

Frontiers of Computer Science Pub Date : 2024-06-25 DOI:10.1007/s11704-024-40066-w

Deyu Tian, Yun Ma, Yudong Han, Qi Yang, Haochen Yang, Gang Huang

引用次数: 0

Abstract

In this paper, we study the long warm-up time of GPU acceleration of DNN inference in Web browsers. We analyzed the reason behind the long warm-up time through a measurement study and revealed that compiling WebGL programs takes most of the warm-up time. Inspired by this finding, we proposed WPIA, an approach that suggests precompiling WebGL programs on the server side to avoid compiling them in Web browsers. WPIA tackles the challenges of precompiling by merging WebGL programs and using a record-and-replay technique. Evaluation experiment results show that WPIA can accelerate the DNN warm-up time to an order of magnitude.

查看原文本刊更多论文

WPIA：通过预编译 WebGL 程序加速 DNN 在网络浏览器中的预热

本文研究了网络浏览器中 DNN 推理的 GPU 加速预热时间过长的问题。我们通过测量研究分析了预热时间长的原因，发现编译 WebGL 程序占用了大部分预热时间。受这一发现的启发，我们提出了 WPIA，一种建议在服务器端预编译 WebGL 程序以避免在 Web 浏览器中编译它们的方法。WPIA 通过合并 WebGL 程序和使用记录与重放技术来应对预编译的挑战。评估实验结果表明，WPIA 可以将 DNN 预热时间加快一个数量级。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Frontiers of Computer Science COMPUTER SCIENCE, INFORMATION SYSTEMS-COMPUTER SCIENCE, SOFTWARE ENGINEERING

CiteScore

8.60

自引率

2.40%

发文量

799

审稿时长

6-12 weeks

期刊介绍： Frontiers of Computer Science aims to provide a forum for the publication of peer-reviewed papers to promote rapid communication and exchange between computer scientists. The journal publishes research papers and review articles in a wide range of topics, including: architecture, software, artificial intelligence, theoretical computer science, networks and communication, information systems, multimedia and graphics, information security, interdisciplinary, etc. The journal especially encourages papers from new emerging and multidisciplinary areas, as well as papers reflecting the international trends of research and development and on special topics reporting progress made by Chinese computer scientists.