{"title":"跨量子化学层次的一体化基础模型学习","authors":"Yuxinxin Chen, Pavlo O. Dral","doi":"arxiv-2409.12015","DOIUrl":null,"url":null,"abstract":"Machine learning (ML) potentials typically target a single quantum chemical\n(QC) level while the ML models developed for multi-fidelity learning have not\nbeen shown to provide scalable solutions for foundational models. Here we\nintroduce the all-in-one (AIO) ANI model architecture based on multimodal\nlearning which can learn an arbitrary number of QC levels. Our all-in-one\nlearning approach offers a more general and easier-to-use alternative to\ntransfer learning. We use it to train the AIO-ANI-UIP foundational model with\nthe generalization capability comparable to semi-empirical GFN2-xTB and DFT\nwith a double-zeta basis set for organic molecules. We show that the AIO-ANI\nmodel can learn across different QC levels ranging from semi-empirical to\ndensity functional theory to coupled cluster. We also use AIO models to design\nthe foundational model {\\Delta}-AIO-ANI based on {\\Delta}-learning with\nincreased accuracy and robustness compared to AIO-ANI-UIP. The code and the\nfoundational models are available at https://github.com/dralgroup/aio-ani; they\nwill be integrated into the universal and updatable AI-enhanced QM (UAIQM)\nlibrary and made available in the MLatom package so that they can be used\nonline at the XACS cloud computing platform (see\nhttps://github.com/dralgroup/mlatom for updates).","PeriodicalId":501304,"journal":{"name":"arXiv - PHYS - Chemical Physics","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"All-in-one foundational models learning across quantum chemical levels\",\"authors\":\"Yuxinxin Chen, Pavlo O. Dral\",\"doi\":\"arxiv-2409.12015\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Machine learning (ML) potentials typically target a single quantum chemical\\n(QC) level while the ML models developed for multi-fidelity learning have not\\nbeen shown to provide scalable solutions for foundational models. Here we\\nintroduce the all-in-one (AIO) ANI model architecture based on multimodal\\nlearning which can learn an arbitrary number of QC levels. Our all-in-one\\nlearning approach offers a more general and easier-to-use alternative to\\ntransfer learning. We use it to train the AIO-ANI-UIP foundational model with\\nthe generalization capability comparable to semi-empirical GFN2-xTB and DFT\\nwith a double-zeta basis set for organic molecules. We show that the AIO-ANI\\nmodel can learn across different QC levels ranging from semi-empirical to\\ndensity functional theory to coupled cluster. We also use AIO models to design\\nthe foundational model {\\\\Delta}-AIO-ANI based on {\\\\Delta}-learning with\\nincreased accuracy and robustness compared to AIO-ANI-UIP. The code and the\\nfoundational models are available at https://github.com/dralgroup/aio-ani; they\\nwill be integrated into the universal and updatable AI-enhanced QM (UAIQM)\\nlibrary and made available in the MLatom package so that they can be used\\nonline at the XACS cloud computing platform (see\\nhttps://github.com/dralgroup/mlatom for updates).\",\"PeriodicalId\":501304,\"journal\":{\"name\":\"arXiv - PHYS - Chemical Physics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - PHYS - Chemical Physics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.12015\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - PHYS - Chemical Physics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.12015","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
All-in-one foundational models learning across quantum chemical levels
Machine learning (ML) potentials typically target a single quantum chemical
(QC) level while the ML models developed for multi-fidelity learning have not
been shown to provide scalable solutions for foundational models. Here we
introduce the all-in-one (AIO) ANI model architecture based on multimodal
learning which can learn an arbitrary number of QC levels. Our all-in-one
learning approach offers a more general and easier-to-use alternative to
transfer learning. We use it to train the AIO-ANI-UIP foundational model with
the generalization capability comparable to semi-empirical GFN2-xTB and DFT
with a double-zeta basis set for organic molecules. We show that the AIO-ANI
model can learn across different QC levels ranging from semi-empirical to
density functional theory to coupled cluster. We also use AIO models to design
the foundational model {\Delta}-AIO-ANI based on {\Delta}-learning with
increased accuracy and robustness compared to AIO-ANI-UIP. The code and the
foundational models are available at https://github.com/dralgroup/aio-ani; they
will be integrated into the universal and updatable AI-enhanced QM (UAIQM)
library and made available in the MLatom package so that they can be used
online at the XACS cloud computing platform (see
https://github.com/dralgroup/mlatom for updates).