{"title":"一种提高仿真I/O性能的多分辨率数据模型","authors":"A. Foulks, R. Bergeron","doi":"10.1109/HiPC.2011.6152747","DOIUrl":null,"url":null,"abstract":"Numerical simulations running on very large High Performance Computer clusters still suffer from the I/O bottleneck. The cost of communication can overwhelm the cost of computation, and scales inversely with the number of processors used in the cluster. In previous work we have developed a multiresolution data model to help improve performance for visualizations of very large multi dimensional scientific data sets. In our approach, the data is represented as a multi level hierarchy. Reconstructive error analysis is used to identify regions in the data where the data loss is greatest. We have incorporated this data model into the OpenGGCM solar wind simulation environment. In this paper, we demonstrate that this approach can reduce the I/O and improve the overall performance of a large numerical simulation environment.1","PeriodicalId":122468,"journal":{"name":"2011 18th International Conference on High Performance Computing","volume":"44 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2011-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A multiresolution data model for improving simulation I/O performance\",\"authors\":\"A. Foulks, R. Bergeron\",\"doi\":\"10.1109/HiPC.2011.6152747\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Numerical simulations running on very large High Performance Computer clusters still suffer from the I/O bottleneck. The cost of communication can overwhelm the cost of computation, and scales inversely with the number of processors used in the cluster. In previous work we have developed a multiresolution data model to help improve performance for visualizations of very large multi dimensional scientific data sets. In our approach, the data is represented as a multi level hierarchy. Reconstructive error analysis is used to identify regions in the data where the data loss is greatest. We have incorporated this data model into the OpenGGCM solar wind simulation environment. In this paper, we demonstrate that this approach can reduce the I/O and improve the overall performance of a large numerical simulation environment.1\",\"PeriodicalId\":122468,\"journal\":{\"name\":\"2011 18th International Conference on High Performance Computing\",\"volume\":\"44 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2011-12-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2011 18th International Conference on High Performance Computing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/HiPC.2011.6152747\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2011 18th International Conference on High Performance Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/HiPC.2011.6152747","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A multiresolution data model for improving simulation I/O performance
Numerical simulations running on very large High Performance Computer clusters still suffer from the I/O bottleneck. The cost of communication can overwhelm the cost of computation, and scales inversely with the number of processors used in the cluster. In previous work we have developed a multiresolution data model to help improve performance for visualizations of very large multi dimensional scientific data sets. In our approach, the data is represented as a multi level hierarchy. Reconstructive error analysis is used to identify regions in the data where the data loss is greatest. We have incorporated this data model into the OpenGGCM solar wind simulation environment. In this paper, we demonstrate that this approach can reduce the I/O and improve the overall performance of a large numerical simulation environment.1