Margaret Lawson, C. Ulmer, Shyamali Mukherjee, G. Templet, J. Lofstead, Scott Levy, Patrick M. Widener, T. Kordenbrock
{"title":"Empress: extensible metadata provider for extreme-scale scientific simulations","authors":"Margaret Lawson, C. Ulmer, Shyamali Mukherjee, G. Templet, J. Lofstead, Scott Levy, Patrick M. Widener, T. Kordenbrock","doi":"10.1145/3149393.3149403","DOIUrl":"https://doi.org/10.1145/3149393.3149403","url":null,"abstract":"Significant challenges exist in the efficient retrieval of data from extreme-scale simulations. An important and evolving method of addressing these challenges is application-level metadata management. Historically, HDF5 and NetCDF have eased data retrieval by offering rudimentary attribute capabilities that provide basic metadata. ADIOS simplified data retrieval by utilizing metadata for each process' data. EMPRESS provides a simple example of the next step in this evolution by integrating per-process metadata with the storage system itself, making it more broadly useful than single file or application formats. Additionally, it allows for more robust and customizable metadata.","PeriodicalId":262458,"journal":{"name":"Proceedings of the 2nd Joint International Workshop on Parallel Data Storage & Data Intensive Scalable Computing Systems","volume":"60 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121436611","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}