{"title":"Personalized In Situ Steering for Analysis and Visualization","authors":"Pascal Grosset, Jesus Pulido, J. Ahrens","doi":"10.1145/3426462.3426463","DOIUrl":"https://doi.org/10.1145/3426462.3426463","url":null,"abstract":"In situ analysis is now commonly used in many simulations. Prior to a simulation being run, the user specifies what in situ analysis should be run and the results of that analysis are saved to disk while the simulation is running. However, it is sometimes hard to know what analysis to run before a simulation has started, and that often results in the user saving full datasets to disk for analysis later. In this paper, we present a framework, Seer, that allows users to change, in real time, what in situ analysis to run. Moreover Seer also allows many users to each run their own in situ analysis, in a ”personalized workspace”, independent of each other. Finally Seer can be easily integrated into simulations and plays well with other in situ analysis frameworks, such as ParaView Catalyst.","PeriodicalId":320716,"journal":{"name":"ISAV'20 In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122442275","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yuya Kawakami, Nicole Marsaglia, Matthew Larsen, H. Childs
{"title":"Benchmarking In Situ Triggers Via Reconstruction Error","authors":"Yuya Kawakami, Nicole Marsaglia, Matthew Larsen, H. Childs","doi":"10.1145/3426462.3426469","DOIUrl":"https://doi.org/10.1145/3426462.3426469","url":null,"abstract":"This work considers evaluating in situ triggers using reconstruction error. Our experiments use data from the Nyx and Cloverleaf simulation codes, and focus on two key topics. The first topic aims to increase understanding of total reconstruction error, both with respect to the impact of adding more time slices and with respect to the variation from different time slice selections. The second topic evaluates performance for two current approaches: entropy-based triggers and evenly spaced time slices. Finally, we use these study components to construct a benchmarking system that enables visualization scientists to reason about triggers.","PeriodicalId":320716,"journal":{"name":"ISAV'20 In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132137984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"In Situ and Post-Processing Volume Rendering with Cinema","authors":"A. Bauer, J. Abras, N. Hariharan","doi":"10.1145/3426462.3426464","DOIUrl":"https://doi.org/10.1145/3426462.3426464","url":null,"abstract":"We present a new batch volume rendering technique which alleviates the time and expertise needed by the domain scientist in order to produce quality volume rendered results. This process can be done both in situ and as a post-processing step. The advantage of performing this as an in situ process is that the user is not required to have a priori knowledge of the exact physics and how best to create a transfer function to volume render that physics during the in situ run. For the post-processing use case, the user has the ability to easily examine a wide variety of transfer functions without the tedious work of manually generating each one.","PeriodicalId":320716,"journal":{"name":"ISAV'20 In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123027703","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Challenges of In Situ Analysis for Multiple Simulations","authors":"A. Ribés, B. Raffin","doi":"10.1145/3426462.3426468","DOIUrl":"https://doi.org/10.1145/3426462.3426468","url":null,"abstract":"In situ analysis and visualization have mainly been applied to the output of a single large-scale simulation. However, topics involving the execution of multiple simulations in supercomputers have only received minimal attention so far. Some important examples are uncertainty quantification, data assimilation, and complex optimization. In this position article, beyond highlighting the strengths and limitations of the tools that we have developed over the past few years, we share lessons learned from using them on large-scale platforms and from interacting with end users. We then discuss the forthcoming challenges, which future in situ analysis and visualization frameworks will face when dealing with the exascale execution of multiple simulations.","PeriodicalId":320716,"journal":{"name":"ISAV'20 In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131669199","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Aryaman Gupta, Pietro Incardona, Ata Deniz Aydin, S. Gumhold, Ulrik Günther, I. Sbalzarini
{"title":"An Architecture for Interactive In Situ Visualization and its Transparent Implementation in OpenFPM","authors":"Aryaman Gupta, Pietro Incardona, Ata Deniz Aydin, S. Gumhold, Ulrik Günther, I. Sbalzarini","doi":"10.1145/3426462.3426472","DOIUrl":"https://doi.org/10.1145/3426462.3426472","url":null,"abstract":"Live in situ visualization of numerical simulations – interactive visualization while the simulation is running – can enable new modes of interaction, including computational steering. Designing easy-to-use distributed in situ architectures, with viewing latency low enough, and frame rate high enough, for interactive use, is challenging. Here, we propose a fully asynchronous, hybrid CPU–GPU in situ architecture that emphasizes interactivity. We also present a transparent implementation of this architecture embedded into the OpenFPM simulation framework. The benchmarks show that our architecture minimizes visual latencies, and achieves frame rates between 6 and 60 frames/second – depending on simulation data size and degree of parallelism – by changing only a few lines of an existing simulation code.","PeriodicalId":320716,"journal":{"name":"ISAV'20 In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization","volume":"86 2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128875234","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"JIT’s Complicated: A Comprehensive System For Derived Field Generation","authors":"Seif Ibrahim, C. Harrison, Matthew Larsen","doi":"10.1145/3426462.3426467","DOIUrl":"https://doi.org/10.1145/3426462.3426467","url":null,"abstract":"Derived field calculations are a vital part of the visualization and analysis workflow. These calculations allow simulation users to create important quantities of interest that are not generated by the simulation, and systems that calculate derived quantities must be flexible enough to accommodate a wide variety of user requests. In situ analysis imposes additional constraints on the system, and derived field calculations must be able to leverage the same resources as the simulation to minimize the runtime and memory usage. Just-in-time (JIT) compilation defers code creation until runtime, and a JIT based system is capable of fusing a complex expression into a single kernel invocation (i.e., kernel fusion). Without kernel fusion, the system would be forced to evaluate each piece of the expression (e.g., an operator or function call) as separate kernel invocations, which increases both runtime and memory pressure on the host simulation. In this paper, we present a production-oriented in situ derived field system that leverages JIT compilation to target heterogeneous HPC architectures. Additionally, we explore the runtime costs of using this system to calculate three expressions in three simulation codes.","PeriodicalId":320716,"journal":{"name":"ISAV'20 In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization","volume":"67 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115529451","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. Ha, Wonyong Jeong, Gyorgy Matyasfalvi, C. Xie, K. Huck, J. Choi, A. Malik, Li Tang, H. V. Dam, Line C. Pouchard, W. Xu, Shinjae Yoo, N. D'Imperio, K. K. Dam
{"title":"Chimbuko: A Workflow-Level Scalable Performance Trace Analysis Tool","authors":"S. Ha, Wonyong Jeong, Gyorgy Matyasfalvi, C. Xie, K. Huck, J. Choi, A. Malik, Li Tang, H. V. Dam, Line C. Pouchard, W. Xu, Shinjae Yoo, N. D'Imperio, K. K. Dam","doi":"10.1145/3426462.3426465","DOIUrl":"https://doi.org/10.1145/3426462.3426465","url":null,"abstract":"Due to the sheer volume of data it is typically impractical to analyze the detailed performance of an HPC application running at-scale. While conventional small-scale benchmarking and scaling studies are often sufficient for simple applications, many modern workflow-based applications couple multiple elements with competing resource demands and complex inter-communication patterns for which performance cannot easily be studied in isolation and at small scale. This work discusses Chimbuko, a performance analysis framework that provides real-time, in situ anomaly detection. By focusing specifically on performance anomalies and their origin (aka provenance), data volumes are dramatically reduced without losing necessary details. To the best of our knowledge, Chimbuko is the first online, distributed, and scalable workflow-level performance trace analysis framework. We demonstrate the tool’s usefulness on Oak Ridge National Laboratory’s Summit system.","PeriodicalId":320716,"journal":{"name":"ISAV'20 In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127256939","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}