Companion of the 2023 ACM/SPEC International Conference on Performance Engineering最新文献

Performance Engineering Practices for Modern Industrial Applications at ABB Research ABB研究院现代工业应用的性能工程实践

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584350

H. Koziolek

引用次数: 0

Performance Analysis Tools for MPI Applications and their Use in Programming Education MPI应用程序的性能分析工具及其在编程教育中的应用

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584358

Anna-Lena Roth, Tim Süß

{"title":"Performance Analysis Tools for MPI Applications and their Use in Programming Education","authors":"Anna-Lena Roth, Tim Süß","doi":"10.1145/3578245.3584358","DOIUrl":"https://doi.org/10.1145/3578245.3584358","url":null,"abstract":"Performance analysis tools are frequently used to support the development of parallel MPI applications. They facilitate the detection of errors, bottlenecks, or inefficiencies but differ substantially in their instrumentation, measurement, and type of feedback. Especially, tools that provide visual feedback are helpful for educational purposes. They provide a visual abstraction of program behavior, supporting learners to identify and understand performance issues and write more efficient code. However, existing professional tools for performance analysis are very complex, and their use in beginner courses can be very demanding. Foremost, their instrumentation and measurement require deep knowledge and take a long time. Immediate, as well as straightforward feedback, is essential to motivate learners. This paper provides an extensive overview of performance analysis tools for parallel MPI applications, which experienced developers broadly use today. It also gives an overview of existing educational tools for parallel programming with MPI and shows their shortcomings compared to professional tools. Using tools for performance analysis of MPI programs in educational scenarios can promote the understanding of program behavior in large HPC systems and support learning parallel programming. At the same time, the complexity of the programs and the lack of infrastructure in educational institutions are barriers. These aspects will be considered and discussed in detail.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127175535","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A Study of Java Microbenchmark Tail Latencies Java微基准测试尾部延迟的研究

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584690

Sen He, I. Kim, Wei Wang

{"title":"A Study of Java Microbenchmark Tail Latencies","authors":"Sen He, I. Kim, Wei Wang","doi":"10.1145/3578245.3584690","DOIUrl":"https://doi.org/10.1145/3578245.3584690","url":null,"abstract":"As Java microbenchmarks are great at profiling the performance of essential code elements, they are widely adopted for Java performance testing. Performance testing using Java microbenchmarks is composed of two phases: the warmup phase and the steady phase. Usually, testing results from the warmup phase are discarded because of the highly fluctuating performance caused by the optimization of Java Virtual Machine. The performance results collected during the steady phase are used for performance evaluation as they are assumed to be more stable. However, according to our study, severe performance fluctuations also occur during the steady phase, which leads to long tail latencies. Long tail latencies constitute a big problem in modern Java systems (of course, other systems and applications) as they hurt the user experience by prolonging the overall execution time. In this paper, we extensively evaluated the long tail performance of 586 Java microbenchmarks from 30 Java systems. The evaluation results show that, for 38% of the benchmarks in steady phase, their 99%tile execution times are over 30% higher than their median execution times. In the worst-case scenario, the 99%ile performance is 659 times higher than the median performance. Furthermore, the 95%ile execution times are above 30% higher than the median execution times for 11% of the steady phase benchmarks.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"02 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124996459","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Challenges Towards Modeling and Generating Infrastructure-as-Code 建模和生成基础设施即代码的挑战

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584937

G. N. Nedeltcheva, Bin Xiang, Laurentiu Niculut, Debora Benedetto

引用次数: 0

Continuum: Automate Infrastructure Deployment and Benchmarking in the Compute Continuum Continuum:在计算连续体中自动化基础设施部署和基准测试

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584936

Matthijs Jansen, Linus Wagner, A. Trivedi, A. Iosup

{"title":"Continuum: Automate Infrastructure Deployment and Benchmarking in the Compute Continuum","authors":"Matthijs Jansen, Linus Wagner, A. Trivedi, A. Iosup","doi":"10.1145/3578245.3584936","DOIUrl":"https://doi.org/10.1145/3578245.3584936","url":null,"abstract":"As the next generation of diverse workloads like autonomous driving and augmented/virtual reality evolves, computation is shifting from cloud-based services to the edge, leading to the emergence of a cloud-edge compute continuum. This continuum promises a wide spectrum of deployment opportunities for workloads that can leverage the strengths of cloud (scalable infrastructure, high reliability), edge (energy efficient, low latencies), and endpoints (sensing, user-owned). Designing and deploying software in the continuum is complex because of the variety of available hardware, each with unique properties and trade-offs. In practice, developers have limited access to these resources, limiting their ability to create software deployments. To simplify research and development in the compute continuum, in this paper, we propose Continuum, a framework for automated infrastructure deployment and benchmarking that helps researchers and engineers to deploy and test their use cases in a few lines of code. Continuum can automatically deploy a wide variety of emulated infrastructures and networks locally and in the cloud, install software for operating services and resource managers, and deploy and benchmark applications for users with diverse configuration options. In our evaluation, we show how our design covers these requirements, allowing Continuum to be (i) highly flexible, supporting any computing model, (ii) highly configurable, allowing users to alter framework components using an intuitive API, and (iii) highly extendable, allowing users to add support for more infrastructure, applications, and more. Continuum is available at https://github.com/atlarge-research/continuum.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114917539","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Efficient Data Processing: Assessing the Performance of Different Programming Languages 有效的数据处理:评估不同编程语言的性能

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584691

Lukas Beierlieb, A. Bauer, Robert Leppich, Lukas Iffländer, Samuel Kounev

引用次数: 0

Securing the Execution of ML Workflows across the Compute Continua 确保跨Compute Continua的ML工作流的执行

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584727

Francesc-Josep Lordan Gomis, André Martin, D. Lezzi

引用次数: 0

From UML/MARTE Specifications to ESL HW/SW Co-Design: Early Functional Verification and Timing Validation 从UML/MARTE规范到ESL硬件/软件协同设计:早期功能验证和时间验证

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584850

V. Cortellessa, L. Pomante, Vincenzo Stoico

{"title":"From UML/MARTE Specifications to ESL HW/SW Co-Design: Early Functional Verification and Timing Validation","authors":"V. Cortellessa, L. Pomante, Vincenzo Stoico","doi":"10.1145/3578245.3584850","DOIUrl":"https://doi.org/10.1145/3578245.3584850","url":null,"abstract":"The continuous adoption of embedded systems in the most diverse application domains contributes to the increasing complexity of their development. Hardware/Software Co-Design methodologies are usually employed to tackle the challenges deriving from even more stringent functional and non-functional requirements. Using these methodologies, several validation and verification steps can be carried out early in the design process using a unified, technology-independent system model. This work investigates the possibility of integrating formal functional verification and timing validation in a Hardware/Software Co-Design flow at the system-level of abstraction. Specifically, we introduce Co-V&V, namely an additional step that consists of two phases: (i) a transformation from UML/MARTE to UPPAAL Timed Automata, and (ii) a preliminary functional verification and timing validation that exploits the UPPAAL verifier. We describe the Co-V&V step through a case study characterized by a component-based architecture and reactive behavior. The verification and validation conducted with UPPAAL indicate that our approach is particularly effective in discovering design flaws located in the communication protocol as well as those arising from the internal behavior of components.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115771009","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Challenges and Future Directions in Efficiency Benchmarking (Vision Paper) 订立效率基准的挑战及未来方向(愿景文件)

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3585034

Maximilian Meissner, K. Lange, Sanjay Sharma, J. Arnold, Aaron Cragin, Patrick Galizia, Mike Petrich, Bin Zhang, Samuel Kounev

引用次数: 0

Enhancing the Configuration Tuning Pipeline of Large-Scale Distributed Applications Using Large Language Models (Idea Paper) 使用大型语言模型增强大规模分布式应用程序的配置调优管道(思想论文)

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3585032

Gagan Somashekar, R. Kumar

{"title":"Enhancing the Configuration Tuning Pipeline of Large-Scale Distributed Applications Using Large Language Models (Idea Paper)","authors":"Gagan Somashekar, R. Kumar","doi":"10.1145/3578245.3585032","DOIUrl":"https://doi.org/10.1145/3578245.3585032","url":null,"abstract":"The performance of distributed applications implemented using microservice architecture depends heavily on the configuration of various parameters, which are hard to tune due to large configuration search space and inter-dependence of parameters. While the information in product manuals and technical documents guides the tuning process, manual collection of meta-data for all application parameters is laborious and not scalable. Prior works have largely overlooked the automated use of product manuals, technical documents and source code for extracting such meta-data. In the current work, we propose using large language models for automated meta-data extraction and enhancing the configuration tuning pipeline. We further ideate on building an in-house knowledge system using experimental data to learn important parameters in configuration tuning using historical data on parameter dependence, workload statistics, performance metrics and resource utilization. We expect productionizing the proposed system will reduce the total time and experimental iterations required for configuration tuning in new applications, saving an organization both developer time and money.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"115 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117262908","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3