{"title":"多核作业提交LHCb作业的可塑性评价","authors":"N. Rauschmayr, A. Streit","doi":"10.1109/SYNASC.2013.74","DOIUrl":null,"url":null,"abstract":"The LHCb experiment at CERN processes its datasets over hundred different grid sites within the Worldwide LHC Computing Grid (WLCG). All those grid sites consist of multicore CPUs nowadays. However, the number of cores per worker node will increase in the near future. Using such worker nodes more efficiently requires parallelization of software as well as modifications at the level of scheduling. This paper will evaluate a moldable job model for LHCb grid jobs where the main challenge is the definition of the best degree of parallelism. Choosing an appropriate degree of parallelism depends on the parameters, on which optimization shall be applied. Commonly used features are for example scalability, workload and turnaround time. Prediction of run time is another major problem and it will be discussed how it can be handled using historical information. Furthermore, the advantages and disadvantages of a moldable job model will be discussed as well on how it must be extended to meet the requirements of LHCb jobs.","PeriodicalId":293085,"journal":{"name":"2013 15th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing","volume":"54 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2013-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Evaluating Moldability of LHCb Jobs for Multicore Job Submission\",\"authors\":\"N. Rauschmayr, A. Streit\",\"doi\":\"10.1109/SYNASC.2013.74\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The LHCb experiment at CERN processes its datasets over hundred different grid sites within the Worldwide LHC Computing Grid (WLCG). All those grid sites consist of multicore CPUs nowadays. However, the number of cores per worker node will increase in the near future. Using such worker nodes more efficiently requires parallelization of software as well as modifications at the level of scheduling. This paper will evaluate a moldable job model for LHCb grid jobs where the main challenge is the definition of the best degree of parallelism. Choosing an appropriate degree of parallelism depends on the parameters, on which optimization shall be applied. Commonly used features are for example scalability, workload and turnaround time. Prediction of run time is another major problem and it will be discussed how it can be handled using historical information. Furthermore, the advantages and disadvantages of a moldable job model will be discussed as well on how it must be extended to meet the requirements of LHCb jobs.\",\"PeriodicalId\":293085,\"journal\":{\"name\":\"2013 15th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing\",\"volume\":\"54 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2013-09-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2013 15th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SYNASC.2013.74\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2013 15th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SYNASC.2013.74","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Evaluating Moldability of LHCb Jobs for Multicore Job Submission
The LHCb experiment at CERN processes its datasets over hundred different grid sites within the Worldwide LHC Computing Grid (WLCG). All those grid sites consist of multicore CPUs nowadays. However, the number of cores per worker node will increase in the near future. Using such worker nodes more efficiently requires parallelization of software as well as modifications at the level of scheduling. This paper will evaluate a moldable job model for LHCb grid jobs where the main challenge is the definition of the best degree of parallelism. Choosing an appropriate degree of parallelism depends on the parameters, on which optimization shall be applied. Commonly used features are for example scalability, workload and turnaround time. Prediction of run time is another major problem and it will be discussed how it can be handled using historical information. Furthermore, the advantages and disadvantages of a moldable job model will be discussed as well on how it must be extended to meet the requirements of LHCb jobs.