Companion of the 2023 ACM/SPEC International Conference on Performance Engineering最新文献_第7页

Hitchhiker's Guide for Explainability in Autoscaling 自动缩放的解释指南

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584728

Floriment Klinaku, Sandro Speth, Markus Zilch, Steffen Becker

{"title":"Hitchhiker's Guide for Explainability in Autoscaling","authors":"Floriment Klinaku, Sandro Speth, Markus Zilch, Steffen Becker","doi":"10.1145/3578245.3584728","DOIUrl":"https://doi.org/10.1145/3578245.3584728","url":null,"abstract":"Cloud-native applications force increasingly powerful and complex autoscalers to guarantee the applications' quality of service. For software engineers with operational tasks understanding the autoscalers' behavior and applying appropriate reconfigurations is challenging due to their internal mechanisms, inherent distribution, and decentralized decision-making. Hence, engineers seek appropriate explanations. However, engineers' expectations on feedback and explanations of autoscalers are unclear. In this paper, through a workshop with a representative sample of engineers responsible for operating an autoscaler, we elicit requirements for explainability in autoscaling. Based on the requirements, we propose an evaluation scheme for evaluating explainability as a non-functional property of the autoscaling process and guide software engineers in choosing the best-fitting autoscaler for their scenario. The evaluation scheme is based on a Goal Question Metric approach and contains three goals, nine questions to assess explainability, and metrics to answer these questions. The evaluation scheme should help engineers choose a suitable and explainable autoscaler or guide them in building their own.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128967429","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Event-based Simulation for Transient Systems with Capture Replay to Predict Self-Adaptive Systems (Work in Progress Paper) 基于事件的瞬态系统捕获重放预测自适应系统的仿真研究(论文)

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3585029

Sarah Stieß, S. Höppner, Steffen Becker, Matthias Tichy

{"title":"Event-based Simulation for Transient Systems with Capture Replay to Predict Self-Adaptive Systems (Work in Progress Paper)","authors":"Sarah Stieß, S. Höppner, Steffen Becker, Matthias Tichy","doi":"10.1145/3578245.3585029","DOIUrl":"https://doi.org/10.1145/3578245.3585029","url":null,"abstract":"Cloud-native systems are dynamic in nature as they always have to react to changes in the environment, e.g., how users utilize the system. Self-adaptive cloud-native systems manage those changes by predicting how future environmental changes will impact the system's service level objectives and how the system can subsequently reconfigure to ensure that the service level objectives stay fulfilled. The farther the predictions look into the future, the higher the chance that good reconfigurations can be identified and applied. However, this requires efficient exploration of potential future system states, particularly exploring alternative futures resulting from alternative system reconfiguration. We present in this paper an extension to the Slingshot simulator for Palladio component models to efficiently explore the future state space induced by environmental changes and reconfigurations. The extension creates snapshots of simulation states and reloads them to explore alternatives. We show that Slingshot's event-based publish-subscribe architecture enables us to extend the simulator easily and without changes to the simulator itself.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115726637","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

LTB'23 Workshop Chairs' Welcome LTB'23工作坊主席欢迎

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584312

A. Podelko, Heng Li, Chang-Yang Lin

引用次数: 0

Serverless Computing Revisited: Evolution, State-of-the-Art, and Performance Challenges 无服务器计算重访:演进、最新技术和性能挑战

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584856

Samuel Kounev

{"title":"Serverless Computing Revisited: Evolution, State-of-the-Art, and Performance Challenges","authors":"Samuel Kounev","doi":"10.1145/3578245.3584856","DOIUrl":"https://doi.org/10.1145/3578245.3584856","url":null,"abstract":"Market analysts are agreed that serverless computing has strong market potential, with projected compound annual growth rates varying between 21% and 28% through 2028 and a projected market value of 36.8 billion by that time. Although serverless computing has gained significant attention in industry and academia over the past years, there is still no consensus about its unique distinguishing characteristics and precise understanding of how these characteristics differ from classical cloud computing. For example, there is no wide agreement on whether serverless is solely a set of requirements from the cloud user's perspective or it should also mandate specific implementation choices on the provider side, such as implementing an autoscaling mechanism to achieve elasticity. Similarly, there is no agreement on whether serverless is just the operational part, or it should also include specific programming models, interfaces, or calling protocols. In this talk, we seek to dispel this confusion by evaluating the essential conceptual characteristics of serverless computing as a paradigm, while putting the various terms around it into perspective. We examine how the term serverless computing, and related terms, are used today. We explain the historical evolution leading to serverless computing, starting with mainframe virtualization in the 1960 through to Grid and cloud computing all the way up to today. We review existing cloud computing service models, including IaaS, PaaS, SaaS, CaaS, FaaS, and BaaS, discussing how they relate to the serverless paradigm. In the second part of talk, we focus on performance challenges in serverless computing both from the user's perspective (finding the optimal size of serverless functions) as well as from the provider's perspective (ensuring predictable and fast container start times coupled with fine-granular and accurate elastic scaling mechanisms).","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"139 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122767101","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Graph-Inceptor: Towards Extreme Data Ingestion, Massive Graph Creation and Storage 图启动器:走向极端数据摄取，海量图创建和存储

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3585339

Jože M. Rožanec, B. Elvesæter, D. Roman, M. Grobelnik, P. Haase

引用次数: 0

Graph Neural Networks for Anomaly Anticipation in HPC Systems 基于图神经网络的高性能计算系统异常预测

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3585335

Martin Molan, Junaid Ahmed Khan, Andrea Borghesi, Andrea Bartolini

引用次数: 1

Uncovering Steady State Executions in Java Microbenchmarking with Call Graph Analysis 用调用图分析揭示Java微基准测试中的稳态执行

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584689

Madeline Janecek, Sneh Patel, Naser Ezzati-Jivan

{"title":"Uncovering Steady State Executions in Java Microbenchmarking with Call Graph Analysis","authors":"Madeline Janecek, Sneh Patel, Naser Ezzati-Jivan","doi":"10.1145/3578245.3584689","DOIUrl":"https://doi.org/10.1145/3578245.3584689","url":null,"abstract":"Developers often use microbenchmarking tools to evaluate the performance of a Java program. These tools run a small section of code multiple times and measure its performance. However, this process can be problematic as Java execution is traditionally divided into two stages: a warmup stage where the JVM's JIT compiler optimizes frequently used code and a steady stage where performance is stable. Measuring performance before reaching the steady stage can provide an inaccurate representation of the program's efficiency. The challenge comes from determining when a program should be considered as in a steady state. In this paper, we propose that call stack sampling data should be considered when conducting steady state performance evaluations. By analyzing this data, we can generate call graphs for individual microbenchmark executions. Our proposed method of using call stack sampling data and visualizing call graphs intuitively empowers developers to effectively distinguish between warmup and steady state executions. Additionally, by utilizing machine learning classification techniques this method can automate the steady state detection, working towards a more accurate and efficient performance evaluation process.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"49 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130068590","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Towards Evaluation/Mitigation Risk of Systemic Failures in a Recoverable Network with Redistributed Elastic Load 对具有重分配弹性负荷的可恢复网络中系统故障风险的评估/缓解

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584926

V. Marbukh

引用次数: 0

Towards Novel Statistical Methods for Anomaly Detection in Industrial Processes 面向工业过程异常检测的新型统计方法

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3585036

Simone Tonini, Fernando Barsacchi, F. Chiaromonte, Daniele Licari, Andrea Vandin

{"title":"Towards Novel Statistical Methods for Anomaly Detection in Industrial Processes","authors":"Simone Tonini, Fernando Barsacchi, F. Chiaromonte, Daniele Licari, Andrea Vandin","doi":"10.1145/3578245.3585036","DOIUrl":"https://doi.org/10.1145/3578245.3585036","url":null,"abstract":"This paper presents a novel methodology based on first principles of statistics and statistical learning for anomaly detection in industrial processes and IoT environments. We present a 5-level analytical pipeline that cleans, smooths, and eliminates redundancies from the data, and identifies outliers as well as the features that contribute most to these anomalies. We show how smoothing can make our methodology less sensitive to short-lived anomalies that might be, e.g., due to sensor noise. We validate the methodology on a dataset freely available in the literature. Our results show that we can identify all anomalies in the considered dataset, with the ability of controlling the amount of false positives. This work is the result of a research project co-funded by the Tuscany Region and a company leader in the paper and nonwovens sector. Although the methodology was developed for this domain, we consider here a dataset from a different industrial sector. This shows that our methodology can be generalized to other contexts with similar constraints on limited resources, interpretability, time, and budget.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129587046","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Using eBPF for Database Workload Tracing: An Explorative Study 使用eBPF进行数据库工作负载跟踪:探索性研究

Companion of the 2023 ACM/SPEC International Conference on Performance Engineering Pub Date : 2023-04-15 DOI: 10.1145/3578245.3584313

Jörg Domaschka, Simon Volpert, Kevin Maier, G. Eisenhart, Daniel Seybold

{"title":"Using eBPF for Database Workload Tracing: An Explorative Study","authors":"Jörg Domaschka, Simon Volpert, Kevin Maier, G. Eisenhart, Daniel Seybold","doi":"10.1145/3578245.3584313","DOIUrl":"https://doi.org/10.1145/3578245.3584313","url":null,"abstract":"Database management systems~(DBMS) are crucial architectural components of any modern distributed software system. Yet, ensuring a smooth, high-performant operation of a DBMS is a black art that requires tweaking many knobs and is heavily dependent on the experienced workload. Misconfigurations at production systems have an heavy impact on the overall delivered service quality and hence, should be avoided at all costs. Replaying production workload on test and staging systems to estimate the ideal configuration are a valid approach. Yet, this requires traces from the production systems. While many DBMS's have built-in support to capture such traces these have a non-negligible impact on performance. eBPF is a Linux kernel feature claiming to enable low-overhead observability and application tracing. In this paper, we evaluate different eBPF-based approaches to DBMS workload tracing for PostgreSQL and MySQL. The results show that using eBPF causes lower overhead than the built-in mechanisms. Hence, eBPF can be a viable baseline for building a generic tracing framework. Yet, our current results also show that additional optimisation and fine-tuning is needed to further lower the performance overhead.","PeriodicalId":190503,"journal":{"name":"Companion of the 2023 ACM/SPEC International Conference on Performance Engineering","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130732871","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0