基于ænet-PyTorch的多组分数据集迁移学习增强机器学习潜力的经济有效策略

IF 3.2 3区 化学 Q2 CHEMISTRY, PHYSICAL
An Niza El Aisnada, Kajjana Boonpalit, Robin van der Kruit, Koen M. Draijer, Jon López-Zorrilla, Masahiro Miyauchi, Akira Yamaguchi, Nongnuch Artrith
{"title":"基于ænet-PyTorch的多组分数据集迁移学习增强机器学习潜力的经济有效策略","authors":"An Niza El Aisnada, Kajjana Boonpalit, Robin van der Kruit, Koen M. Draijer, Jon López-Zorrilla, Masahiro Miyauchi, Akira Yamaguchi, Nongnuch Artrith","doi":"10.1021/acs.jpcc.4c06235","DOIUrl":null,"url":null,"abstract":"Machine learning potentials (MLPs) offer efficient and accurate material simulations, but constructing the reference ab initio database remains a significant challenge, particularly for catalyst-adsorbate systems. Training an MLP with a small data set can lead to overfitting, thus limiting its practical applications. This study explores the feasibility of developing computationally cost-effective and accurate MLPs for catalyst-adsorbate systems with a limited number of ab initio references by leveraging a transfer learning strategy from subsets of a comprehensive public database. Using the Open Catalyst Project 2020 (OC20)─a data set closely related to our system of interest─we pretrained MLP models on OC20 subsets using the ænet-PyTorch framework. We compared several strategies for database subset selection. Our findings indicate that MLPs constructed via transfer learning exhibit better generalizability than those constructed from scratch, as demonstrated by the consistency in the dynamics simulations. Remarkably, transfer learning enhances the stability and accuracy of MLPs for the CuAu/H<sub>2</sub>O system with approximately 600 reference data points. This approach achieved excellent extrapolation performance in molecular dynamics simulations for the larger CuAu/6H<sub>2</sub>O system, maintaining stable and accurate predictions for up to 250 ps, whereas MLPs without transfer learning become unstable before reaching 50 ps. We also examine the potential limitations of this strategy. This work proposes an alternative, cost-effective approach for constructing MLPs for the challenging simulation of catalytic systems. Finally, we anticipate that this methodology will pave the way for broader applications in materials science and catalysis research, facilitating more efficient and accurate simulations across various systems.","PeriodicalId":61,"journal":{"name":"The Journal of Physical Chemistry C","volume":"224 1","pages":""},"PeriodicalIF":3.2000,"publicationDate":"2024-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Cost-Effective Strategy of Enhancing Machine Learning Potentials by Transfer Learning from a Multicomponent Data Set on ænet-PyTorch\",\"authors\":\"An Niza El Aisnada, Kajjana Boonpalit, Robin van der Kruit, Koen M. Draijer, Jon López-Zorrilla, Masahiro Miyauchi, Akira Yamaguchi, Nongnuch Artrith\",\"doi\":\"10.1021/acs.jpcc.4c06235\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Machine learning potentials (MLPs) offer efficient and accurate material simulations, but constructing the reference ab initio database remains a significant challenge, particularly for catalyst-adsorbate systems. Training an MLP with a small data set can lead to overfitting, thus limiting its practical applications. This study explores the feasibility of developing computationally cost-effective and accurate MLPs for catalyst-adsorbate systems with a limited number of ab initio references by leveraging a transfer learning strategy from subsets of a comprehensive public database. Using the Open Catalyst Project 2020 (OC20)─a data set closely related to our system of interest─we pretrained MLP models on OC20 subsets using the ænet-PyTorch framework. We compared several strategies for database subset selection. Our findings indicate that MLPs constructed via transfer learning exhibit better generalizability than those constructed from scratch, as demonstrated by the consistency in the dynamics simulations. Remarkably, transfer learning enhances the stability and accuracy of MLPs for the CuAu/H<sub>2</sub>O system with approximately 600 reference data points. This approach achieved excellent extrapolation performance in molecular dynamics simulations for the larger CuAu/6H<sub>2</sub>O system, maintaining stable and accurate predictions for up to 250 ps, whereas MLPs without transfer learning become unstable before reaching 50 ps. We also examine the potential limitations of this strategy. This work proposes an alternative, cost-effective approach for constructing MLPs for the challenging simulation of catalytic systems. Finally, we anticipate that this methodology will pave the way for broader applications in materials science and catalysis research, facilitating more efficient and accurate simulations across various systems.\",\"PeriodicalId\":61,\"journal\":{\"name\":\"The Journal of Physical Chemistry C\",\"volume\":\"224 1\",\"pages\":\"\"},\"PeriodicalIF\":3.2000,\"publicationDate\":\"2024-12-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"The Journal of Physical Chemistry C\",\"FirstCategoryId\":\"1\",\"ListUrlMain\":\"https://doi.org/10.1021/acs.jpcc.4c06235\",\"RegionNum\":3,\"RegionCategory\":\"化学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"CHEMISTRY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Journal of Physical Chemistry C","FirstCategoryId":"1","ListUrlMain":"https://doi.org/10.1021/acs.jpcc.4c06235","RegionNum":3,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CHEMISTRY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

摘要

机器学习潜力(mlp)提供了高效和准确的材料模拟,但构建参考从头算数据库仍然是一个重大挑战,特别是对于催化剂-吸附物系统。使用小数据集训练MLP可能导致过拟合,从而限制了其实际应用。本研究通过利用来自综合公共数据库子集的迁移学习策略,探讨了在有限数量的从头算参考的情况下,为催化剂-吸附物系统开发计算成本效益高且准确的mlp的可行性。使用开放催化剂项目2020 (OC20)──一个与我们感兴趣的系统密切相关的数据集──我们使用net- pytorch框架在OC20子集上预训练MLP模型。我们比较了几种数据库子集选择策略。我们的研究结果表明,通过迁移学习构建的mlp比从头构建的mlp具有更好的泛化能力,这一点在动力学模拟中的一致性得到了证明。值得注意的是,对于大约600个参考数据点的CuAu/H2O系统,迁移学习提高了mlp的稳定性和准确性。该方法在更大的CuAu/6H2O系统的分子动力学模拟中取得了出色的外推性能,在高达250 ps的情况下保持稳定和准确的预测,而没有迁移学习的MLPs在达到50 ps之前变得不稳定。我们还研究了该策略的潜在局限性。这项工作提出了一种替代的,具有成本效益的方法,用于构建具有挑战性的催化系统模拟的mlp。最后,我们预计该方法将为材料科学和催化研究中的更广泛应用铺平道路,促进跨各种系统的更有效和准确的模拟。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Cost-Effective Strategy of Enhancing Machine Learning Potentials by Transfer Learning from a Multicomponent Data Set on ænet-PyTorch

Cost-Effective Strategy of Enhancing Machine Learning Potentials by Transfer Learning from a Multicomponent Data Set on ænet-PyTorch
Machine learning potentials (MLPs) offer efficient and accurate material simulations, but constructing the reference ab initio database remains a significant challenge, particularly for catalyst-adsorbate systems. Training an MLP with a small data set can lead to overfitting, thus limiting its practical applications. This study explores the feasibility of developing computationally cost-effective and accurate MLPs for catalyst-adsorbate systems with a limited number of ab initio references by leveraging a transfer learning strategy from subsets of a comprehensive public database. Using the Open Catalyst Project 2020 (OC20)─a data set closely related to our system of interest─we pretrained MLP models on OC20 subsets using the ænet-PyTorch framework. We compared several strategies for database subset selection. Our findings indicate that MLPs constructed via transfer learning exhibit better generalizability than those constructed from scratch, as demonstrated by the consistency in the dynamics simulations. Remarkably, transfer learning enhances the stability and accuracy of MLPs for the CuAu/H2O system with approximately 600 reference data points. This approach achieved excellent extrapolation performance in molecular dynamics simulations for the larger CuAu/6H2O system, maintaining stable and accurate predictions for up to 250 ps, whereas MLPs without transfer learning become unstable before reaching 50 ps. We also examine the potential limitations of this strategy. This work proposes an alternative, cost-effective approach for constructing MLPs for the challenging simulation of catalytic systems. Finally, we anticipate that this methodology will pave the way for broader applications in materials science and catalysis research, facilitating more efficient and accurate simulations across various systems.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
The Journal of Physical Chemistry C
The Journal of Physical Chemistry C 化学-材料科学:综合
CiteScore
6.50
自引率
8.10%
发文量
2047
审稿时长
1.8 months
期刊介绍: The Journal of Physical Chemistry A/B/C is devoted to reporting new and original experimental and theoretical basic research of interest to physical chemists, biophysical chemists, and chemical physicists.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信