Proceedings of the 11th Workshop on Scientific Cloud Computing最新文献

筛选

英文中文

A Layered Approach for Modular Container Construction and Orchestration in HPC Environments HPC环境中模块化容器构建和编排的分层方法

Proceedings of the 11th Workshop on Scientific Cloud Computing Pub Date : 2020-06-21 DOI: 10.1145/3452370.3466001

Quincy Wofford, P. Bridges, Patrick M. Widener

{"title":"A Layered Approach for Modular Container Construction and Orchestration in HPC Environments","authors":"Quincy Wofford, P. Bridges, Patrick M. Widener","doi":"10.1145/3452370.3466001","DOIUrl":"https://doi.org/10.1145/3452370.3466001","url":null,"abstract":"Large-scale, high-throughput computational science faces an accelerating convergence of software and hardware. Software container-based solutions have become common in cloud-based datacenter environments, and are considered promising tools for addressing heterogeneity and portability concerns. However, container solutions reflect a set of assumptions which complicate their adoption by developers and users of scientific workflow applications. Nor are containers a universal solution for deployment in high-performance computing (HPC) environments which have specialized and vertically integrated scheduling and runtime software stacks. In this paper, we present a container design and deployment approach which uses modular layering to ease the deployment of containers into existing HPC environments. This layered approach allows operating system integrations, support for different communication and performance monitoring libraries, and application code to be defined and interchanged in isolation. We describe in this paper the details of our approach, including specifics about container deployment and orchestration for different HPC scheduling systems. We also describe how this layering method can be used to build containers for two separate applications, each deployed on clusters with different batch schedulers, MPI networking support, and performance monitoring requirements. Our experience indicates that the layered approach is a viable strategy for building applications intended to provide similar behavior across widely varying deployment targets.","PeriodicalId":224355,"journal":{"name":"Proceedings of the 11th Workshop on Scientific Cloud Computing","volume":"100 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128756876","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Proceedings of the 11th Workshop on Scientific Cloud Computing 第11届科学云计算研讨会论文集

Proceedings of the 11th Workshop on Scientific Cloud Computing Pub Date : 1900-01-01 DOI: 10.1145/3452370

引用次数: 0