Anton Tesliuk, S. Bobkov, V. Ilyin, A. Novikov, A. Poyda, V. Velikhov
{"title":"Kubernetes容器编排作为灵活有效的科学数据分析框架","authors":"Anton Tesliuk, S. Bobkov, V. Ilyin, A. Novikov, A. Poyda, V. Velikhov","doi":"10.1109/ISPRAS47671.2019.00016","DOIUrl":null,"url":null,"abstract":"In this paper we present the design and deployment details for Single Particle Imaging (SPI) experiments data analysis pipeline in Kubernetes infrastructure. We have analyzed various software usage patterns for different payloads. Components of the pipeline software include traditional HPC (MPI-based) applications, applications which require GPU computations, GUI-based software and the software which can be parallelized naturally by dividing the data into several independent parts (Data parallelism). For every payload type individual deployment approach was proposed.","PeriodicalId":154688,"journal":{"name":"2019 Ivannikov Ispras Open Conference (ISPRAS)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"7","resultStr":"{\"title\":\"Kubernetes Container Orchestration as a Framework for Flexible and Effective Scientific Data Analysis\",\"authors\":\"Anton Tesliuk, S. Bobkov, V. Ilyin, A. Novikov, A. Poyda, V. Velikhov\",\"doi\":\"10.1109/ISPRAS47671.2019.00016\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper we present the design and deployment details for Single Particle Imaging (SPI) experiments data analysis pipeline in Kubernetes infrastructure. We have analyzed various software usage patterns for different payloads. Components of the pipeline software include traditional HPC (MPI-based) applications, applications which require GPU computations, GUI-based software and the software which can be parallelized naturally by dividing the data into several independent parts (Data parallelism). For every payload type individual deployment approach was proposed.\",\"PeriodicalId\":154688,\"journal\":{\"name\":\"2019 Ivannikov Ispras Open Conference (ISPRAS)\",\"volume\":\"37 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"7\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 Ivannikov Ispras Open Conference (ISPRAS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISPRAS47671.2019.00016\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 Ivannikov Ispras Open Conference (ISPRAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISPRAS47671.2019.00016","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Kubernetes Container Orchestration as a Framework for Flexible and Effective Scientific Data Analysis
In this paper we present the design and deployment details for Single Particle Imaging (SPI) experiments data analysis pipeline in Kubernetes infrastructure. We have analyzed various software usage patterns for different payloads. Components of the pipeline software include traditional HPC (MPI-based) applications, applications which require GPU computations, GUI-based software and the software which can be parallelized naturally by dividing the data into several independent parts (Data parallelism). For every payload type individual deployment approach was proposed.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
