Companion of the 2023 ACM/SPEC International Conference on Performance Engineering最新文献

筛选
英文 中文
How Do ML Jobs Fail in Datacenters? Analysis of a Long-Term Dataset from an HPC Cluster 数据中心的机器学习作业是如何失败的?高性能计算集群长期数据集分析
Xiaoyu Chu, Sacheendra Talluri, L. Versluis, A. Iosup
{"title":"How Do ML Jobs Fail in Datacenters? Analysis of a Long-Term Dataset from an HPC Cluster","authors":"Xiaoyu Chu, Sacheendra Talluri, L. Versluis, A. Iosup","doi":"10.1145/3578245.3584726","DOIUrl":"https://doi.org/10.1145/3578245.3584726","url":null,"abstract":"Reliable job execution is important in High Performance Computing clusters. Understanding the failure distribution and failure pattern of jobs helps HPC cluster managers design better systems, and users design fault tolerant systems. Machine learning is an increasingly popular workload for HPC clusters are used for. But, there is little information on machine learning job failure characteristics on HPC clusters, and how they differ from the previous workload such clusters were used for. The goal of our work is to improve the understanding of machine learning job failures in HPC clusters. We collect and analyze job data spanning the whole of 2022, and over 2~million jobs. We analyze basic statistical characteristics, the time pattern of failures, resource waste caused by failures, and their autocorrelation. Some of our findings are that machine learning jobs fail at a higher rate than non-ML jobs, and waste much more CPU-time per job when they fail.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124589674","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
GraalVM Compiler Benchmark Results Dataset (Data Artifact) GraalVM编译器基准结果数据集(数据工件)
L. Bulej, Vojtech Horký, Michele Tucci, P. Tůma, François Farquet, David Leopoldseder, Aleksandar Prokopec
{"title":"GraalVM Compiler Benchmark Results Dataset (Data Artifact)","authors":"L. Bulej, Vojtech Horký, Michele Tucci, P. Tůma, François Farquet, David Leopoldseder, Aleksandar Prokopec","doi":"10.1145/3578245.3585025","DOIUrl":"https://doi.org/10.1145/3578245.3585025","url":null,"abstract":"Systematic testing of software performance during development is a persistent challenge, made increasingly important by the magnifying effect of mass software deployment on any savings. In practice, such systematic performance evaluation requires a combination of an efficient and reliable measurement procedure integrated into the development environment, coupled with an automated evaluation of the measurement results and compact reporting of detected performance anomalies. A realistic evaluation of research contributions to systematic software performance testing can benefit from the availability of measurement data that comes from long term development activities in a well documented context. This paper presents a data artifact that aggregates more than 70 machine time years of performance measurements over 7 years of development of the GraalVM Compiler Project, aiming to reduce the costs of evaluating research contributions in this and similar contexts.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117217110","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Transparent Trace Annotation for Performance Debugging in Microservice-oriented Systems (Work In Progress Paper) 面向微服务系统性能调试的透明跟踪注释(工作进展文件)
Adel Belkhiri, Ahmad Shahnejat Bushehri, Felipe Gohring de Magalhaes, G. Nicolescu
{"title":"Transparent Trace Annotation for Performance Debugging in Microservice-oriented Systems (Work In Progress Paper)","authors":"Adel Belkhiri, Ahmad Shahnejat Bushehri, Felipe Gohring de Magalhaes, G. Nicolescu","doi":"10.1145/3578245.3585030","DOIUrl":"https://doi.org/10.1145/3578245.3585030","url":null,"abstract":"Microservices is a cloud-native architecture in which a single application is implemented as a collection of small, independent, and loosely-coupled services. This architecture is gaining popularity in the industry as it promises to make applications more scalable and easier to develop and deploy. Nonetheless, adopting this architecture in practice has raised many concerns, particularly regarding the difficulty of diagnosing performance bugs and explaining abnormal software behaviour. Fortunately, many tools based on distributed tracing were proposed to achieve observability in microservice-oriented systems and address these concerns (e.g., Jaeger). Distributed tracing is a method for tracking user requests as they flow between services. While these tools can identify slow services and detect latency-related problems, they mostly fail to pinpoint the root causes of these issues. This paper presents a new approach for enacting cross-layer tracing of microservice-based applications. It also proposes a framework for annotating traces generated by most distributed tracing tools with relevant tracing data and metrics collected from the kernel. The information added to the traces aims at helping the practitioner get a clear insight into the operations of the application executing user requests. The framework we present is notably efficient in diagnosing the causes of long tail latencies. Unlike other solutions, our approach for annotating traces is completely transparent as it does not require the modification of the application, the tracer, or the operating system. Furthermore, our evaluation shows that this approach incurs low overhead costs.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122936556","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
ICPE'23 AIPerf Workshop Chairs' Welcome ICPE第23届AIPerf研讨会主席欢迎
Emilio Incerto, Marin Litoiu, Riccardo Pinciroli
{"title":"ICPE'23 AIPerf Workshop Chairs' Welcome","authors":"Emilio Incerto, Marin Litoiu, Riccardo Pinciroli","doi":"10.1145/3578245.3584940","DOIUrl":"https://doi.org/10.1145/3578245.3584940","url":null,"abstract":"We are pleased to welcome you to the 2023 ACM Workshop on Artificial Intelligence for Performance Modeling, Prediction, and Control - AIPerf'23. In its first edition, AIPerf intends to foster the usage of AI (such as probabilistic methods, machine learning, and deep learning) to control, model, and predict the performance of computer systems. The relevance of these topics reflects current and future trends toward exploiting AI-based approaches to deal with complex, large, and interconnected systems. Despite AI and ML being widely adopted techniques to investigate several mainstream domains, their usage for performance modeling and evaluation is still limited, and their benefit to the performance engineering field remains unclear. AIPerf proposes a meeting venue to promote the dissemination of research works that use or study AI techniques for quantitative analysis of modern ICT systems and to engage academics and practitioners of this field. The workshop focuses on presenting experiences and results of applying AI/ML-based techniques to performance-related problems, as well as sharing performance datasets and benchmarks with the community to facilitate the development of new and more accurate learning procedures. Putting together AIPerf'23 was a team effort. We first thank the authors for providing the content of the program. We are grateful to the program committee and the senior program committee, who worked very hard to review papers and provide authors' feedback. Finally, We thank the ICPE23 organizers for sponsoring AIPerf in its community. We hope that you will find this program interesting and thought-provoking and that the symposium will provide you with a valuable opportunity to share ideas with other researchers and practitioners from institutions around the world.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"426 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116716835","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Large-scale Graph Processing and Simulation with Serverless Workflows in Federated FaaS 联邦FaaS中无服务器工作流的大规模图形处理与仿真
S. Ristov, Reza Farahani, R.-C. Prodan
{"title":"Large-scale Graph Processing and Simulation with Serverless Workflows in Federated FaaS","authors":"S. Ristov, Reza Farahani, R.-C. Prodan","doi":"10.1145/3578245.3585333","DOIUrl":"https://doi.org/10.1145/3578245.3585333","url":null,"abstract":"Serverless computing offers an affordable and easy way to code lightweight functions that can be invoked based on some events to perform simple tasks. For more complicated processing, multiple serverless functions can be orchestrated as a directed acyclic graph to form a serverless workflow, so-called function choreography (FC). Although most famous cloud providers offer FC management systems such as AWS Step Functions, and there are also several open-source FC management systems (e.g., Apache OpenWhisk), their primary focus is on describing the control flow and data flow between serverless functions in the FC. Moreover, the existing FC management systems rarely consider the processed data, which is commonly represented in a graph format. In this paper, we review the capabilities of the existing FC management systems in supporting graph processing applications. We also raise two key research questions related to large-scale graph processing using serverless computing in federated Function-as-a-Service (FaaS). As part of the Graph-Massivizer project, funded by the Horizon Europe research and innovation program, we will research and develop (prototype) solutions that will address these challenges.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126985225","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Pattern-based Function and Workflow Visual Environment for FaaS Development across the Continuum 跨连续体的FaaS开发的基于模式的功能和工作流可视化环境
George Kousiouris, Szymon Ambroziak, Blazej Zarzycki, D. Costantino, Stylianos Tsarsitalidis, Vasileios Katevas, Alessandro Mamelli, Teta Stamati
{"title":"A Pattern-based Function and Workflow Visual Environment for FaaS Development across the Continuum","authors":"George Kousiouris, Szymon Ambroziak, Blazej Zarzycki, D. Costantino, Stylianos Tsarsitalidis, Vasileios Katevas, Alessandro Mamelli, Teta Stamati","doi":"10.1145/3578245.3584934","DOIUrl":"https://doi.org/10.1145/3578245.3584934","url":null,"abstract":"The ability to split applications across different locations in the continuum (edge/cloud) creates needs for application break down into smaller and more distributed chunks. In this realm the Function as a Service approach appears as a significant enabler in this process. The paper presents a visual function and workflow development environment for complex FaaS (Apache OpenwhisK) applications. The environment offers a library of pattern based and reusable nodes and flows while mitigating function orchestration limitations in the domain. Generation of the deployable artefacts, i.e. the functions, is performed through embedded DevOps pipelines. A range of annotations are available for dictating diverse options including QoS needs, function or data locality requirements, function affinity considerations etc. These are propagated to the deployment and operation stacks for supporting the cloud/edge interplay. The mechanism is evaluated functionally through creating, registering and executing functions and orchestrating workflows, adapting typical parallelization patterns and an edge data collection process.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"115 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134408574","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
AI, What Does the Future Hold for Us? Automating Strategic Foresight 人工智能,未来会给我们带来什么?自动化战略预见
Jože M. Rožanec, P. Nemec, Gregor Leban, M. Grobelnik
{"title":"AI, What Does the Future Hold for Us? Automating Strategic Foresight","authors":"Jože M. Rožanec, P. Nemec, Gregor Leban, M. Grobelnik","doi":"10.1145/3578245.3585336","DOIUrl":"https://doi.org/10.1145/3578245.3585336","url":null,"abstract":"There is an increasing awareness that strategic foresight is much needed to guide efficient policy-making. The growing digitalization implies a rising amount of digital evidence of many aspects of society (e.g., science, economy, and politics). Artificial intelligence can process massive amounts of data and extract meaningful information. Furthermore, a knowledge graph can be developed to capture significant aspects of reality, and machine learning models can be used to identify patterns and derive insights. This paper describes how we envision artificial intelligence could be used to create and deliver strategic foresight automatically.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133504350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Identification and Classification of JMH Microbenchmark States using Time Series Analysis JMH微基准状态的时间序列识别与分类
T. Wallace, B. Ombuki-Berman, Naser Ezzati-Jivan
{"title":"Identification and Classification of JMH Microbenchmark States using Time Series Analysis","authors":"T. Wallace, B. Ombuki-Berman, Naser Ezzati-Jivan","doi":"10.1145/3578245.3584694","DOIUrl":"https://doi.org/10.1145/3578245.3584694","url":null,"abstract":"The practice of microbenchmarking is very important for observing the performance of code. As such, observing the states and anomalies experienced by the program during a benchmark is equally important. This paper attempts to evaluate the effectiveness of the matrix profile method when applied to analyse JMH benchmarks in time series format, to determine if it is a viable alternative to proven methods. We observe that, when using the matrix profile method, there is a statistically significant difference between the results of the analysis on steady state and non-steady state benchmarks. By comparing results of the matrix profile method and the proven changepoint analysis method, we are able to prove a stronger correlation between the two when the benchmark tested is non-steady state versus that of steady state.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"26 7","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131686891","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automatic FAIR Provenance Collection and Visualization for Time Series 时间序列的自动公平来源收集和可视化
Fadoua Rafii, H. González-Vélez, Adriana E. Chis
{"title":"Automatic FAIR Provenance Collection and Visualization for Time Series","authors":"Fadoua Rafii, H. González-Vélez, Adriana E. Chis","doi":"10.1145/3578245.3585026","DOIUrl":"https://doi.org/10.1145/3578245.3585026","url":null,"abstract":"Provenance provides data lineage and history of different transformations applied to a dataset. A complete trace of data provenance can enable the reanalysis, reproducibility, and reusability of features, which are essential for validating results and extending them in many projects. Open time series datasets are readily accessible and discoverable, but their full reproducibility and reusability require clear metadata provenance. This paper introduces an assessment of provenance variables using an algorithm for collecting FAIR (Findable, Accessible, Interoperable, Reusable) characteristics in open time series and generating an associated provenance graph. We have evaluated the FAIRness of provenance traces by automatically mapping their properties to a provenance data model graph for a case study employing open time series from weather stations. Our approach arguably enables researchers to analyse time series datasets with similar characteristics, prompting new research questions, insights, and investigations. As a result, this approach has the potential to promote reusability and reproducibility, which are critical factors in scientific research.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129529972","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Views From the Trenches: Current Trends in Performance Engineering 来自战壕的观点:性能工程的当前趋势
A. Podelko
{"title":"Views From the Trenches: Current Trends in Performance Engineering","authors":"A. Podelko","doi":"10.1145/3578245.3584355","DOIUrl":"https://doi.org/10.1145/3578245.3584355","url":null,"abstract":"Performance engineering is changing before our eyes adjusting to current industry trends - such as cloud computing, agile development, and DevOps. As systems scale and sophistication skyrocket, performance gets more attention. While it looks like some performance concepts like algorithm complexity became a must for anybody working in the industry, it still doesn't result in a consistent view of performance. So it remains an open question what computer professionals should learn about performance - and, even more challenging, what is needed to prepare performance professionals (that actually have never been clearly answered - and now it is even less defined than it was before).","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128790535","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书