M. Slawinska, Michael Clark, M. Wolf, Tanja Bode, Hongbo Zou, P. Laguna, Jeremy S. Logan, Matthew Kinsey, S. Klasky
{"title":"A Maya use case: adaptable scientific workflows with ADIOS for general relativistic astrophysics","authors":"M. Slawinska, Michael Clark, M. Wolf, Tanja Bode, Hongbo Zou, P. Laguna, Jeremy S. Logan, Matthew Kinsey, S. Klasky","doi":"10.1145/2484762.2484795","DOIUrl":null,"url":null,"abstract":"There are many challenges in analyzing and visualizing data from current cutting-edge general relativistic astrophysics simulations. Many of the associated tasks are time-consuming with large performance degradation due to the magnitude and complexity of the data. The Adaptable I/O System (ADIOS) is a componentization of the I/O layer that has demonstrated remarkable I/O performance improvements on applications running on leadership class machines while also offering new in-memory \"staging\" operations for transforming data in-situ. We have been incorporating ADIOS staging technologies into our Maya numerical relativity code based on Cactus infrastructure and Carpet mesh refinement. Incorporating ADIOS into the Maya code is the first step toward enabling a more adaptable Maya workflow. We provide descriptions how we intend to leverage FlexPath (an ADIOS transport method) to provide a richer user experience in real-time visualization and interactive steering.","PeriodicalId":426819,"journal":{"name":"Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery","volume":"108 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2013-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"11","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/2484762.2484795","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 11
Abstract
There are many challenges in analyzing and visualizing data from current cutting-edge general relativistic astrophysics simulations. Many of the associated tasks are time-consuming with large performance degradation due to the magnitude and complexity of the data. The Adaptable I/O System (ADIOS) is a componentization of the I/O layer that has demonstrated remarkable I/O performance improvements on applications running on leadership class machines while also offering new in-memory "staging" operations for transforming data in-situ. We have been incorporating ADIOS staging technologies into our Maya numerical relativity code based on Cactus infrastructure and Carpet mesh refinement. Incorporating ADIOS into the Maya code is the first step toward enabling a more adaptable Maya workflow. We provide descriptions how we intend to leverage FlexPath (an ADIOS transport method) to provide a richer user experience in real-time visualization and interactive steering.