2016 Second Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV)最新文献

筛选
英文 中文
Scalable and Modular Online Data Processing for Ultrafast Computed Tomography Using CUDA Pipelines 使用CUDA管道的超快速计算机断层扫描的可扩展和模块化在线数据处理
Tobias Frust, G. Juckeland, A. Bieberle
{"title":"Scalable and Modular Online Data Processing for Ultrafast Computed Tomography Using CUDA Pipelines","authors":"Tobias Frust, G. Juckeland, A. Bieberle","doi":"10.5555/3018859.3018861","DOIUrl":"https://doi.org/10.5555/3018859.3018861","url":null,"abstract":"For investigations of rapidly moving structures in opaque technical devices ultrafast electron beam X-ray computed tomography (CT) scanners are available at the Helmholtz-Zentrum Dresden-Rossendorf (HZDR). Currently, measurement data must be initially downloaded after each CT scan from the scanner to a data processing machine. Afterwards, cross-sectional images are reconstructed. This limits the application fields of the scanners. For online observations and even automated process control of scanned objects a new modular data processing tool is presented consisting of user-definable pipeline stages that work independently together in a so called data processing pipeline that can keep up with the CT scanner's frame rate of up to 8 kHz. The data processing stages are arbitrarily programmable and combinable and are connected by a fast custom memory pool to optimize data transfer processes. As a result, this processing structure is not limited to CT application only. In order to achieve highest processing performances for the electron beam X-ray CT scanners all relevant data processing steps are individually implemented in separate stages using graphic processing units (GPUs) and NVIDIA's CUDA programming language. Data processing performance tests on two different high-end GPUs (Tesla K20c, GeForce GTX 1080) offer a slice image reconstruction performance that is well-suited for online application.","PeriodicalId":229382,"journal":{"name":"2016 Second Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131757330","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
In Situ Statistical Analysis for Parametric Studies 参数研究的原位统计分析
Théophile Terraz, B. Raffin, A. Ribés, Y. Fournier
{"title":"In Situ Statistical Analysis for Parametric Studies","authors":"Théophile Terraz, B. Raffin, A. Ribés, Y. Fournier","doi":"10.5555/3018859.3018866","DOIUrl":"https://doi.org/10.5555/3018859.3018866","url":null,"abstract":"In situ processing proposes to reduce storage needs and I/O traffic by processing results of parallel simulations as soon as they are available in the memory of the compute processes. We focus here on computing in situ statistics on the results of N simulations from a parametric study. The classical approach consists in running various instances of the same simulation with different values of input parameters. Results are then saved to disks and statistics are computed post mortem, leading to very I/O intensive applications. Our solution is to develop Melissa, an in situ library running on staging nodes as a parallel server. When starting, simulations connect to Melissa and send the results of each time step to Melissa as soon as they are available. Melissa implements iterative versions of classical statistical operations, enabling to update results as soon as a new time step from a simulation is available. Once all statistics ar updated, the time step can be discarded. We also discuss two different approaches for scheduling simulation runs: the jobs-in-job and the multi-jobs approaches. Experiments run instances of the Computational Fluid Dynamics Open Source solver Code_Saturne. They confirm that our approach enables one to avoid storing simulation results to disk or in memory.","PeriodicalId":229382,"journal":{"name":"2016 Second Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129098857","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Visualization and Analysis Requirements for In Situ Processing for a Large-Scale Fusion Simulation Code 大型核聚变模拟程序现场处理的可视化和分析要求
James Kress, D. Pugmire, S. Klasky, H. Childs
{"title":"Visualization and Analysis Requirements for In Situ Processing for a Large-Scale Fusion Simulation Code","authors":"James Kress, D. Pugmire, S. Klasky, H. Childs","doi":"10.1109/ISAV.2016.14","DOIUrl":"https://doi.org/10.1109/ISAV.2016.14","url":null,"abstract":"In situ techniques have become a very active research area since they have been shown to be an effective way to combat the issues associated with the ever growing gap between computation and I/O bandwidth. In order to take full advantage of in situ techniques with a large-scale simulation code, it is critical to understand the breadth and depth of its analysis requirements. In this paper, we present the results of a survey done with members of the XGC1 fusion simulation code team in order to gather their requirements for analysis and visualization. We look at these requirements from the perspective of in situ processing and present a list of XGC1 analysis tasks performed by its physicists, engineers, and visualization specialists. This analysis of the specific needs and use cases of a single code is important in understanding the nature of the needs that simulations have in terms of data movement and usage for visualization and analysis, now and in the future.","PeriodicalId":229382,"journal":{"name":"2016 Second Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV)","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129941252","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
The SENSEI Generic In Situ Interface SENSEI通用的原位界面
Utkarsh Ayachit, B. Whitlock, M. Wolf, B. Loring, Berk Geveci, David C. Lonie, E. W. Bethel
{"title":"The SENSEI Generic In Situ Interface","authors":"Utkarsh Ayachit, B. Whitlock, M. Wolf, B. Loring, Berk Geveci, David C. Lonie, E. W. Bethel","doi":"10.1109/ISAV.2016.13","DOIUrl":"https://doi.org/10.1109/ISAV.2016.13","url":null,"abstract":"The SENSEI generic in situ interface is an API that promotes code portability and reusability. From the simulation view, a developer can instrument their code with the SENSEI API and then make make use of any number of in situ infrastructures. From the method view, a developer can write an in situ method using the SENSEI API, then expect it to run in any number of in situ infrastructures, or be invoked directly from a simulation code, with little or no modification. This paper presents the design principles underlying the SENSEI generic interface, along with some simplified coding examples.","PeriodicalId":229382,"journal":{"name":"2016 Second Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132917764","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 68
Asynchronous In Situ Connected-Components Analysis for Complex Fluid flows 复杂流体流动的异步原位连接分量分析
J. McClure, M. Berrill, J. Prins, Cass T. Miller
{"title":"Asynchronous In Situ Connected-Components Analysis for Complex Fluid flows","authors":"J. McClure, M. Berrill, J. Prins, Cass T. Miller","doi":"10.1109/ISAV.2016.8","DOIUrl":"https://doi.org/10.1109/ISAV.2016.8","url":null,"abstract":"The simulation of multiscale physics is an important challenge for scientific computing. For this class of problem, large three-dimensional simulations are performed to advance scientific inquiry. On massively parallel computing systems, the volume of data generated by such approaches can become a productivity bottleneck if the raw data generated from the simulation is analyzed in a post-processing step. To address this, we present a physics-based framework for in situ data reduction that is theoretically grounded in multiscale averaging theory. We show how task parallelism can be exploited to concurrently perform a variety of analysis tasks with data-dependent costs, including the generation of iso-surfaces, morphological analyses, and connected components analysis. All analyses are performed in parallel using distributed memory and use the same domain decomposition as the simulation. A task management framework is constructed to leverage available parallelism within a node for analysis. The capabilities of the framework are to launch asynchronous analysis threads, manage dependencies between different tasks, promote data locality and minimize the impact of data transfers. The framework is applied to analyze GPU-based simulations of two-fluid-phase flow in porous media, generating a set of averaged measures that represents the overall system behavior. We demonstrate how the approach can be applied to perform physically-consistent analysis over fluid sub-regions determined from connected components analysis. Simulations performed on Oak Ridge National Lab's Titan supercomputer are profiled to demonstrate the performance of the associated multi-threaded in situ analysis approach for typical production simulation of two-fluid-phase flow.","PeriodicalId":229382,"journal":{"name":"2016 Second Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV)","volume":"557 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131258131","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Early Investigations into Using a Remote RAM Pool with the vl3 Visualization Framework 用vl3可视化框架使用远程RAM池的早期研究
Dawid Zawislak, B. Toonen, W. Allcock, S. Rizzi, J. Insley, V. Vishwanath, M. Papka
{"title":"Early Investigations into Using a Remote RAM Pool with the vl3 Visualization Framework","authors":"Dawid Zawislak, B. Toonen, W. Allcock, S. Rizzi, J. Insley, V. Vishwanath, M. Papka","doi":"10.1109/ISAV.2016.10","DOIUrl":"https://doi.org/10.1109/ISAV.2016.10","url":null,"abstract":"This paper discusses early efforts to integrate the RAN remote memory technology into the vl3 volume rendering framework. We successfully demonstrate this integration, achieving 73% of the theoretical hardware maximum with minimal variation.","PeriodicalId":229382,"journal":{"name":"2016 Second Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV)","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125807842","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
An I/O Mini-App Dedicated to In Situ Visualization 一个I/O迷你应用程序,致力于现场可视化
S. Ziegeler
{"title":"An I/O Mini-App Dedicated to In Situ Visualization","authors":"S. Ziegeler","doi":"10.1109/ISAV.2016.11","DOIUrl":"https://doi.org/10.1109/ISAV.2016.11","url":null,"abstract":"In situ visualization promises to offer one solution to the problem of stagnant I/O bandwidths relative to computing capacity. Yet, it has drawbacks, including a lack of explorable results. This can be addressed by producing derived or extracted results instead of just images. However, the I/O for these results is not guaranteed to be sufficiently scalable if not designed properly. We present an I/O mini app that measures derived quantity I/O performance. It produces isosurfaces with a data generation function allowing fine control of the volume, load imbalance, and other aspects of the isosurface geometry output data. We also provide ongoing results of scalability benchmarks with various output methodologies.","PeriodicalId":229382,"journal":{"name":"2016 Second Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV)","volume":"54 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130614878","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A HYDRA UQ Workflow for NIF Ignition Experiments NIF点火实验的HYDRA UQ工作流
S. Langer, B. Spears, J. Peterson, J. Field, R. Nora, S. Brandon
{"title":"A HYDRA UQ Workflow for NIF Ignition Experiments","authors":"S. Langer, B. Spears, J. Peterson, J. Field, R. Nora, S. Brandon","doi":"10.1109/ISAV.2016.6","DOIUrl":"https://doi.org/10.1109/ISAV.2016.6","url":null,"abstract":"We describe the use of our in-transit workflow infrastructure to run an ensemble of HYDRA [1] [2] Inertial Confinement Fusion (ICF) simulations in support of experiments conducted using the National Ignition Facility (NIF) laser. We discuss how our approach can be used to gain deeper insight into NIF experiments.We ran over 60,000 2D HYDRA simulations and generated over a billion synthetic x-ray images during 8 weeks on the Trinity Cray XC40 system. These represent a majority of all 2D simulations run during HYDRA's 20 year history. We implemented a producer-consumer in-transit framework to minimize the amount of disk space used to generate synthetic x-ray images. We describe our infrastructure and approach, and explore the scaling and performance issues we ran into. Our goal is to help others plan for large ensemble simulations and discuss changes to system software that would make it easier to run large ensembles.","PeriodicalId":229382,"journal":{"name":"2016 Second Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124864954","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 13
In-Situ Visual Exploration of Multivariate Volume Data Based on Particle Based Volume Rendering 基于粒子体绘制的多变量体数据的原位可视化勘探
Takuma Kawamura, Tomoyuki Noda, Y. Idomura
{"title":"In-Situ Visual Exploration of Multivariate Volume Data Based on Particle Based Volume Rendering","authors":"Takuma Kawamura, Tomoyuki Noda, Y. Idomura","doi":"10.1109/ISAV.2016.9","DOIUrl":"https://doi.org/10.1109/ISAV.2016.9","url":null,"abstract":"A novel in-situ online visualization framework is developed based on the Particle Based Volume Rendering (PBVR), which renders multivariate volume data using view-independent particle data. Our online approach enables visualization of particle data with interactive view exploration and changes of multi-dimensional transfer functions at runtime. The runtime visualization show excellent strong scaling up to thousands of cores, and its computational cost is small. These features enable flexible in-situ data exploration for monitoring extreme scale simulations. The utility of the proposed framework is demonstrated by applying it to simulations of molten debris relocation in reactor pressure vessels using the JUPITER code.","PeriodicalId":229382,"journal":{"name":"2016 Second Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV)","volume":"75 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127347331","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信