Proceedings of the 2nd Workshop on High Performance Serverless Computing最新文献

PONCHO: Dynamic Package Synthesis for Distributed and Serverless Python Applications PONCHO:分布式和无服务器Python应用程序的动态包合成

Proceedings of the 2nd Workshop on High Performance Serverless Computing Pub Date : 2022-06-30 DOI: 10.1145/3526060.3535459

Barry Sly-Delgado, Nick Locascio, David Simonetti, B. Wiseman, Benjamín Tovar, D. Thain

{"title":"PONCHO: Dynamic Package Synthesis for Distributed and Serverless Python Applications","authors":"Barry Sly-Delgado, Nick Locascio, David Simonetti, B. Wiseman, Benjamín Tovar, D. Thain","doi":"10.1145/3526060.3535459","DOIUrl":"https://doi.org/10.1145/3526060.3535459","url":null,"abstract":"An increasing number of distributed applications operate by dispatching function invocations across the nodes of a distributed system. To operate correctly, the code and data dependencies of the function must be distributed along with the invocations in some way. When translating applications to work on large scale distributed systems, managing these dependencies becomes challenging: delivery must be scalable to thousands of nodes; the dependencies must be consistent across the system; and the method must be usable by an unprivileged developer. As a solution, in this paper we present PONCHO, which is a lightweight Python based toolkit which allows users to discover, package, and deploy dependencies as an integral part of distributed applications. PONCHO encapsulates a set of commands to be executed within an environment. PONCHO offers a lightweight solution to create and manage environments increasing the portability of scientific applications as well as reproducibility. In this paper, we evaluate PONCHO with real-world applications in the fields of physics, computational chemistry, and hyperparameter optimization, We observe the challenges that arise when creating and distributing an environment and measure the overheads that emerge as a result.","PeriodicalId":223581,"journal":{"name":"Proceedings of the 2nd Workshop on High Performance Serverless Computing","volume":"148 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123433240","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Session details: Keynote Talk 会议详情:主题演讲

Proceedings of the 2nd Workshop on High Performance Serverless Computing Pub Date : 2022-06-30 DOI: 10.1145/3545163

I. Foster

引用次数: 0

Scalable and Cost-effective Serverless Architecture for Information Extraction Workflows 用于信息提取工作流的可扩展且经济高效的无服务器架构

Proceedings of the 2nd Workshop on High Performance Serverless Computing Pub Date : 2022-06-30 DOI: 10.1145/3526060.3535458

Dheeraj Chahal, S. Palepu, Rekha Singhal

{"title":"Scalable and Cost-effective Serverless Architecture for Information Extraction Workflows","authors":"Dheeraj Chahal, S. Palepu, Rekha Singhal","doi":"10.1145/3526060.3535458","DOIUrl":"https://doi.org/10.1145/3526060.3535458","url":null,"abstract":"Information extraction from an image or scanned document is a complex and challenging process since it involves recognizing various visual structures such as tables, boxes, logos, text, charts, etc. Hence, the content extraction applications contain a pipeline of multiple computer vision algorithms, APIs, and models. Deploying such applications for document processing requires a resilient system to deliver high performance. Such applications can be deployed on cloud to leverage the flexible infrastructure and multiple supporting services available there. In this paper, we discuss a scalable and high performance architecture using a serverless platform for deploying information extraction workflows consisting of multiple APIs and computer vision models. Our experiments show that the use of a serverless platform results in a scalable, cost-effective, and low latency deployment of such workflows. Moreover, we discuss the performance and cost trade-offs while choosing cloud services and their configuration. We also show that the use of workload characterization-based performance and cost models to find the optimal serverless instance configuration results in a significant deployment cost reduction.","PeriodicalId":223581,"journal":{"name":"Proceedings of the 2nd Workshop on High Performance Serverless Computing","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127645604","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Session details: Workshop Presentations 会议详情:研讨会演讲

Proceedings of the 2nd Workshop on High Performance Serverless Computing Pub Date : 2022-06-30 DOI: 10.1145/3545164

K. Chard

引用次数: 0

Enabling Stateful Functions for Stream Processing in the Programmable Data Plane 开启可编程数据平面流处理的有状态功能

Proceedings of the 2nd Workshop on High Performance Serverless Computing Pub Date : 2022-06-30 DOI: 10.1145/3526060.3535461

Sabra Ossen, Lucas R. B. Brasilino, Luke Dalessandro, D. M. Swany

引用次数: 2

Benchmarking the Data Layer Across Serverless Platforms 跨无服务器平台的数据层基准测试

Proceedings of the 2nd Workshop on High Performance Serverless Computing Pub Date : 2022-06-30 DOI: 10.1145/3526060.3535460

S. Palepu, Dheeraj Chahal, M. Ramesh, Rekha Singhal

引用次数: 1

Bringing Serverless Computing to the HPC Community 将无服务器计算带入高性能计算社区

Proceedings of the 2nd Workshop on High Performance Serverless Computing Pub Date : 2022-06-30 DOI: 10.1145/3526060.3536352

Devesh Tiwari

{"title":"Bringing Serverless Computing to the HPC Community","authors":"Devesh Tiwari","doi":"10.1145/3526060.3536352","DOIUrl":"https://doi.org/10.1145/3526060.3536352","url":null,"abstract":"The next wave of cloud computing - the serverless computing model - is enjoying adoption at scale by different cloud computing vendors. The serverless computing model is already rapidly accelerating the development and deployment of enterprise applications. Unfortunately, the HPC community appears to be left behind in the revolution. The widespread assumption or opinion is that the serverless computing model is not beneficial for the HPC community because the serverless computing model was not primarily designed for scientific computing and users. In this talk, I promise to do three things. First, I'll show why existing popular opinion about HPC and serverless is pre-mature and inaccurate. Second, I'll demonstrate how HPC users and programmers can leverage the serverless computing model for mitigating some of the long-standing challenges and causes of frustration in HPC resource management. In the spirit of transparency, I admit that the path to effectively leveraging serverless for traditional HPC is challenging and has long stretches of darkness. I will identify and discuss some lamp posts on this not-so-well-lit path. Finally, I'll share my perspective on what new lampposts we should build as a community and where we should put them.","PeriodicalId":223581,"journal":{"name":"Proceedings of the 2nd Workshop on High Performance Serverless Computing","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124711823","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0