Workflow for high-quality visualisation of large-scale CFD simulations by volume rendering

IF 4 2区 工程技术 Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Markéta Faltýnková, Ondřej Meca, Tomáš Brzobohatý, Lubomír Říha, Milan Jaroš, Petr Strakoš
{"title":"Workflow for high-quality visualisation of large-scale CFD simulations by volume rendering","authors":"Markéta Faltýnková,&nbsp;Ondřej Meca,&nbsp;Tomáš Brzobohatý,&nbsp;Lubomír Říha,&nbsp;Milan Jaroš,&nbsp;Petr Strakoš","doi":"10.1016/j.advengsoft.2024.103822","DOIUrl":null,"url":null,"abstract":"<div><div>High-fidelity CFD simulations can easily generate terabytes to petabytes of resulting data. Post-processing of such data is not an easy task. It holds especially for volume rendering, one of the most illustrative but computationally intensive post-processing techniques.</div><div>This paper presents an HPC-ready workflow for post-processing large-scale CFD data computed on unstructured meshes by volume rendering using matured visual effects tools. The workflow consists of five steps: (1) parallel loading of unstructured data into memory, (2) data load-balancing among available resources, (3) re-sampling unstructured data into a regular grid (voxelisation), (4) storing data to OpenVDB format, and (5) final high-quality volume rendering of the (possibly sparse) regular grid in Blender. The workflow is based on open-source libraries, where we have improved all these steps to build an effective and robust approach. Due to parallel loading and appropriate load balancing, our workflow (a) allows loading sequential databases that do not fit into the memory of a single node and (b) significantly outperforms current scientific visualisation tools in voxelisation scalability. Moreover, due to the connection to professional visual effects tools such as Blender, interactive or photo-realistic volume rendering by path tracing, which includes global illumination effects, is allowed.</div><div>With the workflow, it is possible to re-sample hundreds of time steps on an unstructured mesh with 1 billion cells (tens of TB of data) to a sparse regular grid with a density of 11 billion voxels and prepare data for interactive visualisation in just a few minutes using thousands of CPU cores.</div></div>","PeriodicalId":50866,"journal":{"name":"Advances in Engineering Software","volume":"200 ","pages":"Article 103822"},"PeriodicalIF":4.0000,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advances in Engineering Software","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0965997824002291","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

High-fidelity CFD simulations can easily generate terabytes to petabytes of resulting data. Post-processing of such data is not an easy task. It holds especially for volume rendering, one of the most illustrative but computationally intensive post-processing techniques.
This paper presents an HPC-ready workflow for post-processing large-scale CFD data computed on unstructured meshes by volume rendering using matured visual effects tools. The workflow consists of five steps: (1) parallel loading of unstructured data into memory, (2) data load-balancing among available resources, (3) re-sampling unstructured data into a regular grid (voxelisation), (4) storing data to OpenVDB format, and (5) final high-quality volume rendering of the (possibly sparse) regular grid in Blender. The workflow is based on open-source libraries, where we have improved all these steps to build an effective and robust approach. Due to parallel loading and appropriate load balancing, our workflow (a) allows loading sequential databases that do not fit into the memory of a single node and (b) significantly outperforms current scientific visualisation tools in voxelisation scalability. Moreover, due to the connection to professional visual effects tools such as Blender, interactive or photo-realistic volume rendering by path tracing, which includes global illumination effects, is allowed.
With the workflow, it is possible to re-sample hundreds of time steps on an unstructured mesh with 1 billion cells (tens of TB of data) to a sparse regular grid with a density of 11 billion voxels and prepare data for interactive visualisation in just a few minutes using thousands of CPU cores.
通过体渲染实现大规模 CFD 模拟高质量可视化的工作流程
高保真 CFD 模拟很容易产生 TB 到 PB 级的结果数据。对这些数据进行后处理并非易事。本文介绍了一种适用于 HPC 的工作流程,可利用成熟的视觉效果工具,通过体渲染对非结构网格上计算的大规模 CFD 数据进行后处理。该工作流程包括五个步骤:(1) 将非结构化数据并行加载到内存中,(2) 在可用资源之间进行数据负载平衡,(3) 将非结构化数据重新采样到规则网格中(体素化),(4) 将数据存储为 OpenVDB 格式,(5) 在 Blender 中对规则网格(可能稀疏)进行最终的高质量体积渲染。该工作流程以开源库为基础,我们对所有这些步骤进行了改进,以建立一种有效而强大的方法。通过并行加载和适当的负载平衡,我们的工作流程(a)可以加载单个节点内存无法容纳的顺序数据库,(b)在体素化可扩展性方面明显优于当前的科学可视化工具。此外,由于与 Blender 等专业视觉效果工具相连接,还可以通过路径追踪(包括全局照明效果)进行交互式或照片般逼真的体积渲染。利用该工作流,可以在具有 10 亿个单元(数百 TB 数据)的非结构网格上重新采样数百个时间步长,将其转换为具有 110 亿体素密度的稀疏规则网格,并在几分钟内使用数千个 CPU 内核为交互式可视化准备数据。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Advances in Engineering Software
Advances in Engineering Software 工程技术-计算机:跨学科应用
CiteScore
7.70
自引率
4.20%
发文量
169
审稿时长
37 days
期刊介绍: The objective of this journal is to communicate recent and projected advances in computer-based engineering techniques. The fields covered include mechanical, aerospace, civil and environmental engineering, with an emphasis on research and development leading to practical problem-solving. The scope of the journal includes: • Innovative computational strategies and numerical algorithms for large-scale engineering problems • Analysis and simulation techniques and systems • Model and mesh generation • Control of the accuracy, stability and efficiency of computational process • Exploitation of new computing environments (eg distributed hetergeneous and collaborative computing) • Advanced visualization techniques, virtual environments and prototyping • Applications of AI, knowledge-based systems, computational intelligence, including fuzzy logic, neural networks and evolutionary computations • Application of object-oriented technology to engineering problems • Intelligent human computer interfaces • Design automation, multidisciplinary design and optimization • CAD, CAE and integrated process and product development systems • Quality and reliability.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信