利用具有物理先验的扩散模型进行分子去噪

IF 4.6 2区 化学 Q2 CHEMISTRY, PHYSICAL
Ishan Nadkarni, J.P. Martínez Cordeiro, Narayana R. Aluru
{"title":"利用具有物理先验的扩散模型进行分子去噪","authors":"Ishan Nadkarni, J.P. Martínez Cordeiro, Narayana R. Aluru","doi":"10.1021/acs.jpclett.5c00274","DOIUrl":null,"url":null,"abstract":"Denoising Diffusion Probabilistic Models (DDPMs) are powerful generative models that have demonstrated superior performance in a variety of tasks and applications in material science and molecular graph modeling. Inspired by nonequilibrium statistical mechanics, these models iteratively degrade data through a forward diffusion process and then restore it by learning the time-reversal of the forward process. Despite their success, a significant drawback of DDPMs is their reliance on numerous iterations to generate high-quality samples, resulting in slow sampling. In this Letter, we introduce a strategy to improve DDPMs for atomistic systems by leveraging the thermodynamics of the data by deriving physics-informed priors. Drawing on principles from statistical mechanics, we derive physics-informed parameters for the prior distribution to initialize the Markov chain closer to the true data distribution. This strategy shortens the Markov chain, thereby improving the model’s training efficiency and accelerating the sampling process. We demonstrate the effectiveness of our method in denoising noisy radial distribution functions obtained from a single atomic configuration of diverse Lennard-Jones and multiatomic liquids.","PeriodicalId":62,"journal":{"name":"The Journal of Physical Chemistry Letters","volume":"9 1","pages":""},"PeriodicalIF":4.6000,"publicationDate":"2025-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Molecular Denoising Using Diffusion Models with Physics-Informed Priors\",\"authors\":\"Ishan Nadkarni, J.P. Martínez Cordeiro, Narayana R. Aluru\",\"doi\":\"10.1021/acs.jpclett.5c00274\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Denoising Diffusion Probabilistic Models (DDPMs) are powerful generative models that have demonstrated superior performance in a variety of tasks and applications in material science and molecular graph modeling. Inspired by nonequilibrium statistical mechanics, these models iteratively degrade data through a forward diffusion process and then restore it by learning the time-reversal of the forward process. Despite their success, a significant drawback of DDPMs is their reliance on numerous iterations to generate high-quality samples, resulting in slow sampling. In this Letter, we introduce a strategy to improve DDPMs for atomistic systems by leveraging the thermodynamics of the data by deriving physics-informed priors. Drawing on principles from statistical mechanics, we derive physics-informed parameters for the prior distribution to initialize the Markov chain closer to the true data distribution. This strategy shortens the Markov chain, thereby improving the model’s training efficiency and accelerating the sampling process. We demonstrate the effectiveness of our method in denoising noisy radial distribution functions obtained from a single atomic configuration of diverse Lennard-Jones and multiatomic liquids.\",\"PeriodicalId\":62,\"journal\":{\"name\":\"The Journal of Physical Chemistry Letters\",\"volume\":\"9 1\",\"pages\":\"\"},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2025-03-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"The Journal of Physical Chemistry Letters\",\"FirstCategoryId\":\"1\",\"ListUrlMain\":\"https://doi.org/10.1021/acs.jpclett.5c00274\",\"RegionNum\":2,\"RegionCategory\":\"化学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"CHEMISTRY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Journal of Physical Chemistry Letters","FirstCategoryId":"1","ListUrlMain":"https://doi.org/10.1021/acs.jpclett.5c00274","RegionNum":2,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CHEMISTRY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

摘要

消噪扩散概率模型(ddpm)是一种功能强大的生成模型,在材料科学和分子图建模的各种任务和应用中表现出优异的性能。受非平衡统计力学的启发,这些模型通过前向扩散过程迭代地降低数据,然后通过学习前向过程的时间反转来恢复数据。尽管它们取得了成功,但ddpm的一个重大缺点是它们依赖于大量的迭代来生成高质量的样本,从而导致缓慢的采样。在这封信中,我们介绍了一种策略,通过利用数据的热力学,通过推导物理先验来改进原子系统的ddpm。根据统计力学的原理,我们为先验分布导出了物理参数,以初始化更接近真实数据分布的马尔可夫链。该策略缩短了马尔可夫链,从而提高了模型的训练效率,加快了采样过程。我们证明了我们的方法在从不同的Lennard-Jones和多原子液体的单原子构型获得的噪声径向分布函数中去噪的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Molecular Denoising Using Diffusion Models with Physics-Informed Priors

Molecular Denoising Using Diffusion Models with Physics-Informed Priors
Denoising Diffusion Probabilistic Models (DDPMs) are powerful generative models that have demonstrated superior performance in a variety of tasks and applications in material science and molecular graph modeling. Inspired by nonequilibrium statistical mechanics, these models iteratively degrade data through a forward diffusion process and then restore it by learning the time-reversal of the forward process. Despite their success, a significant drawback of DDPMs is their reliance on numerous iterations to generate high-quality samples, resulting in slow sampling. In this Letter, we introduce a strategy to improve DDPMs for atomistic systems by leveraging the thermodynamics of the data by deriving physics-informed priors. Drawing on principles from statistical mechanics, we derive physics-informed parameters for the prior distribution to initialize the Markov chain closer to the true data distribution. This strategy shortens the Markov chain, thereby improving the model’s training efficiency and accelerating the sampling process. We demonstrate the effectiveness of our method in denoising noisy radial distribution functions obtained from a single atomic configuration of diverse Lennard-Jones and multiatomic liquids.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
The Journal of Physical Chemistry Letters
The Journal of Physical Chemistry Letters CHEMISTRY, PHYSICAL-NANOSCIENCE & NANOTECHNOLOGY
CiteScore
9.60
自引率
7.00%
发文量
1519
审稿时长
1.6 months
期刊介绍: The Journal of Physical Chemistry (JPC) Letters is devoted to reporting new and original experimental and theoretical basic research of interest to physical chemists, biophysical chemists, chemical physicists, physicists, material scientists, and engineers. An important criterion for acceptance is that the paper reports a significant scientific advance and/or physical insight such that rapid publication is essential. Two issues of JPC Letters are published each month.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信