上下文感知隐式神经表示压缩地球系统模型数据。

IF 3.9 2区 综合性期刊 Q1 MULTIDISCIPLINARY SCIENCES
Farinaz Mostajeran, Nikhil M Pawar, Jonathan M Villarreal, Salah A Faroughi
{"title":"上下文感知隐式神经表示压缩地球系统模型数据。","authors":"Farinaz Mostajeran, Nikhil M Pawar, Jonathan M Villarreal, Salah A Faroughi","doi":"10.1038/s41598-025-11092-w","DOIUrl":null,"url":null,"abstract":"<p><p>Multiphysics, multiscale climate models, such as the Energy Exascale Earth System Model (E3SM) generate massive volumes of data over extended time periods to support long-term climate analysis. Data compression methods, both lossy and lossless, have been extensively used to manage these datasets. Implicit Neural Representation (INR) has recently emerged as a promising lossy compression technique. While INRs offer good compression rates, they often suffer from reconstruction errors that may impede downstream climatic analysis. To address this, we propose a Context-Aware Implicit Neural Representation (CA-INR), which is based on a multi-layer perceptron (MLP) architecture and takes both spatiotemporal coordinates and auxiliary physical variables, referred to as context, as inputs. The model is trained to memorize the data with the explicit goal of overfitting, thereby enabling accurate reconstruction of the original data. The inclusion of context allows the model to better capture the underlying structures and correlations in Earth system data. We evaluate different architectures of CA-INR using the surface temperature variable from the E3SM dataset and investigate the impact of incorporating different types, qualities, and numbers of contextual inputs, specifically, topography, mean climatological temperature, and their combination, on compression gain and reconstruction error. Our results demonstrate that incorporating contextual information reduces reconstruction error while maintaining a high compression rate, outperforming standard INR models. The resulting increase in peak signal-to-noise ratio (PSNR) is substantial, elevating the reconstructed data quality with CA-INR to a level suitable for downstream climate analysis.</p>","PeriodicalId":21811,"journal":{"name":"Scientific Reports","volume":"15 1","pages":"25932"},"PeriodicalIF":3.9000,"publicationDate":"2025-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12271555/pdf/","citationCount":"0","resultStr":"{\"title\":\"Context-aware implicit neural representations to compress Earth systems model data.\",\"authors\":\"Farinaz Mostajeran, Nikhil M Pawar, Jonathan M Villarreal, Salah A Faroughi\",\"doi\":\"10.1038/s41598-025-11092-w\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Multiphysics, multiscale climate models, such as the Energy Exascale Earth System Model (E3SM) generate massive volumes of data over extended time periods to support long-term climate analysis. Data compression methods, both lossy and lossless, have been extensively used to manage these datasets. Implicit Neural Representation (INR) has recently emerged as a promising lossy compression technique. While INRs offer good compression rates, they often suffer from reconstruction errors that may impede downstream climatic analysis. To address this, we propose a Context-Aware Implicit Neural Representation (CA-INR), which is based on a multi-layer perceptron (MLP) architecture and takes both spatiotemporal coordinates and auxiliary physical variables, referred to as context, as inputs. The model is trained to memorize the data with the explicit goal of overfitting, thereby enabling accurate reconstruction of the original data. The inclusion of context allows the model to better capture the underlying structures and correlations in Earth system data. We evaluate different architectures of CA-INR using the surface temperature variable from the E3SM dataset and investigate the impact of incorporating different types, qualities, and numbers of contextual inputs, specifically, topography, mean climatological temperature, and their combination, on compression gain and reconstruction error. Our results demonstrate that incorporating contextual information reduces reconstruction error while maintaining a high compression rate, outperforming standard INR models. The resulting increase in peak signal-to-noise ratio (PSNR) is substantial, elevating the reconstructed data quality with CA-INR to a level suitable for downstream climate analysis.</p>\",\"PeriodicalId\":21811,\"journal\":{\"name\":\"Scientific Reports\",\"volume\":\"15 1\",\"pages\":\"25932\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2025-07-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12271555/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Scientific Reports\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://doi.org/10.1038/s41598-025-11092-w\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MULTIDISCIPLINARY SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Scientific Reports","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1038/s41598-025-11092-w","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

多物理场、多尺度气候模型,如能源百亿亿次地球系统模型(E3SM),在长时间内产生大量数据,以支持长期气候分析。有损和无损两种数据压缩方法已被广泛用于管理这些数据集。内隐神经表示(INR)是近年来出现的一种很有前途的有损压缩技术。虽然INRs提供了良好的压缩率,但它们经常存在重建错误,可能会阻碍下游气候分析。为了解决这个问题,我们提出了一种基于多层感知器(MLP)架构的上下文感知隐式神经表征(CA-INR),并将时空坐标和辅助物理变量(称为上下文)作为输入。训练模型记忆数据,明确目标是过拟合,从而能够准确地重建原始数据。包含上下文使模型能够更好地捕获地球系统数据中的底层结构和相关性。我们使用来自E3SM数据集的地表温度变量评估了CA-INR的不同架构,并研究了纳入不同类型、质量和数量的上下文输入(特别是地形、平均气候温度及其组合)对压缩增益和重建误差的影响。我们的研究结果表明,结合上下文信息可以减少重建错误,同时保持高压缩率,优于标准INR模型。由此产生的峰值信噪比(PSNR)大幅增加,将CA-INR重建的数据质量提高到适合下游气候分析的水平。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Context-aware implicit neural representations to compress Earth systems model data.

Context-aware implicit neural representations to compress Earth systems model data.

Context-aware implicit neural representations to compress Earth systems model data.

Context-aware implicit neural representations to compress Earth systems model data.

Multiphysics, multiscale climate models, such as the Energy Exascale Earth System Model (E3SM) generate massive volumes of data over extended time periods to support long-term climate analysis. Data compression methods, both lossy and lossless, have been extensively used to manage these datasets. Implicit Neural Representation (INR) has recently emerged as a promising lossy compression technique. While INRs offer good compression rates, they often suffer from reconstruction errors that may impede downstream climatic analysis. To address this, we propose a Context-Aware Implicit Neural Representation (CA-INR), which is based on a multi-layer perceptron (MLP) architecture and takes both spatiotemporal coordinates and auxiliary physical variables, referred to as context, as inputs. The model is trained to memorize the data with the explicit goal of overfitting, thereby enabling accurate reconstruction of the original data. The inclusion of context allows the model to better capture the underlying structures and correlations in Earth system data. We evaluate different architectures of CA-INR using the surface temperature variable from the E3SM dataset and investigate the impact of incorporating different types, qualities, and numbers of contextual inputs, specifically, topography, mean climatological temperature, and their combination, on compression gain and reconstruction error. Our results demonstrate that incorporating contextual information reduces reconstruction error while maintaining a high compression rate, outperforming standard INR models. The resulting increase in peak signal-to-noise ratio (PSNR) is substantial, elevating the reconstructed data quality with CA-INR to a level suitable for downstream climate analysis.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Scientific Reports
Scientific Reports Natural Science Disciplines-
CiteScore
7.50
自引率
4.30%
发文量
19567
审稿时长
3.9 months
期刊介绍: We publish original research from all areas of the natural sciences, psychology, medicine and engineering. You can learn more about what we publish by browsing our specific scientific subject areas below or explore Scientific Reports by browsing all articles and collections. Scientific Reports has a 2-year impact factor: 4.380 (2021), and is the 6th most-cited journal in the world, with more than 540,000 citations in 2020 (Clarivate Analytics, 2021). •Engineering Engineering covers all aspects of engineering, technology, and applied science. It plays a crucial role in the development of technologies to address some of the world''s biggest challenges, helping to save lives and improve the way we live. •Physical sciences Physical sciences are those academic disciplines that aim to uncover the underlying laws of nature — often written in the language of mathematics. It is a collective term for areas of study including astronomy, chemistry, materials science and physics. •Earth and environmental sciences Earth and environmental sciences cover all aspects of Earth and planetary science and broadly encompass solid Earth processes, surface and atmospheric dynamics, Earth system history, climate and climate change, marine and freshwater systems, and ecology. It also considers the interactions between humans and these systems. •Biological sciences Biological sciences encompass all the divisions of natural sciences examining various aspects of vital processes. The concept includes anatomy, physiology, cell biology, biochemistry and biophysics, and covers all organisms from microorganisms, animals to plants. •Health sciences The health sciences study health, disease and healthcare. This field of study aims to develop knowledge, interventions and technology for use in healthcare to improve the treatment of patients.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信