Nursyiva Irsalinda , Maharani A. Bakar , Fatimah Noor Harun , Sugiyarto Surono , Danang A. Pratama
{"title":"求解偏微分方程的一种新的混合方法:将物理信息神经网络与基于猫捉老鼠的优化相结合","authors":"Nursyiva Irsalinda , Maharani A. Bakar , Fatimah Noor Harun , Sugiyarto Surono , Danang A. Pratama","doi":"10.1016/j.rinam.2025.100539","DOIUrl":null,"url":null,"abstract":"<div><div>Partial differential equations (PDEs) are essential for modeling a wide range of physical phenomena. Physics-Informed Neural Networks (PINNs) offer a promising numerical framework for solving PDEs, but their performance often depends on the choice of optimization strategy and network configuration. In this study, we propose a hybrid PINN with a Cat and Mouse-based Optimizer (CMBO) to enhance optimization effectiveness and improve accuracy across elliptic, parabolic, and hyperbolic PDEs. CMBO utilizes a cat and mouse interaction mechanism to effectively balance exploration and exploitation, improving parameter initialization and guiding the optimization process toward favorable regions of the parameter space. Extensive experiments were conducted under varying scenarios, including different numbers of hidden layers (3, 5, 7) and neurons per layer (10, 30, 50). The proposed PINN-CMBO was systematically evaluated against state-of-the-art optimization methods, including PINN Adam, PINN L-BFGS, PINN Adam L-BFGS, and PINN PSO, across a diverse set of PDE categories. Experimental results revealed that PINN CMBO consistently achieved superior performance, recording the lowest loss values among all methods within fewer iteration. For parabolic and hyperbolic PDEs, PINN CMBO achieved an impressive minimum loss value, significantly outperforming PINN Adam, PINN L-BFGS, PINN Adam L-BFGS, and PINN PSO. Similar improvements were observed in elliptic and parabolic PDEs, where PINN-CMBO demonstrated unparalleled accuracy and stability across all tested network configurations. The integration of CMBO into PINN enabled efficient parameter initialization, driving a substantial reduction in the loss function compared to conventional PINN approaches. By guiding the training process toward optimal regions of the parameter space, PINN-CMBO not only accelerates convergence but also enhances overall performance. These findings establish PINN-CMBO as a highly effective framework for solving complex PDE problems, surpassing existing methods in terms of accuracy and stability.</div></div>","PeriodicalId":36918,"journal":{"name":"Results in Applied Mathematics","volume":"25 ","pages":"Article 100539"},"PeriodicalIF":1.4000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A new hybrid approach for solving partial differential equations: Combining Physics-Informed Neural Networks with Cat-and-Mouse based Optimization\",\"authors\":\"Nursyiva Irsalinda , Maharani A. Bakar , Fatimah Noor Harun , Sugiyarto Surono , Danang A. Pratama\",\"doi\":\"10.1016/j.rinam.2025.100539\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Partial differential equations (PDEs) are essential for modeling a wide range of physical phenomena. Physics-Informed Neural Networks (PINNs) offer a promising numerical framework for solving PDEs, but their performance often depends on the choice of optimization strategy and network configuration. In this study, we propose a hybrid PINN with a Cat and Mouse-based Optimizer (CMBO) to enhance optimization effectiveness and improve accuracy across elliptic, parabolic, and hyperbolic PDEs. CMBO utilizes a cat and mouse interaction mechanism to effectively balance exploration and exploitation, improving parameter initialization and guiding the optimization process toward favorable regions of the parameter space. Extensive experiments were conducted under varying scenarios, including different numbers of hidden layers (3, 5, 7) and neurons per layer (10, 30, 50). The proposed PINN-CMBO was systematically evaluated against state-of-the-art optimization methods, including PINN Adam, PINN L-BFGS, PINN Adam L-BFGS, and PINN PSO, across a diverse set of PDE categories. Experimental results revealed that PINN CMBO consistently achieved superior performance, recording the lowest loss values among all methods within fewer iteration. For parabolic and hyperbolic PDEs, PINN CMBO achieved an impressive minimum loss value, significantly outperforming PINN Adam, PINN L-BFGS, PINN Adam L-BFGS, and PINN PSO. Similar improvements were observed in elliptic and parabolic PDEs, where PINN-CMBO demonstrated unparalleled accuracy and stability across all tested network configurations. The integration of CMBO into PINN enabled efficient parameter initialization, driving a substantial reduction in the loss function compared to conventional PINN approaches. By guiding the training process toward optimal regions of the parameter space, PINN-CMBO not only accelerates convergence but also enhances overall performance. These findings establish PINN-CMBO as a highly effective framework for solving complex PDE problems, surpassing existing methods in terms of accuracy and stability.</div></div>\",\"PeriodicalId\":36918,\"journal\":{\"name\":\"Results in Applied Mathematics\",\"volume\":\"25 \",\"pages\":\"Article 100539\"},\"PeriodicalIF\":1.4000,\"publicationDate\":\"2025-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Results in Applied Mathematics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2590037425000032\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MATHEMATICS, APPLIED\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Results in Applied Mathematics","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2590037425000032","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATHEMATICS, APPLIED","Score":null,"Total":0}
引用次数: 0
摘要
偏微分方程(PDEs)对于模拟广泛的物理现象是必不可少的。物理信息神经网络(pinn)为求解偏微分方程提供了一个很有前途的数值框架,但其性能往往取决于优化策略和网络配置的选择。在这项研究中,我们提出了一种基于猫和老鼠的优化器(CMBO)的混合PINN,以提高椭圆、抛物线和双曲偏微分方程的优化效率和精度。CMBO利用猫鼠交互机制,有效平衡了勘探和开采,改进了参数初始化,并将优化过程导向参数空间的有利区域。在不同的场景下进行了大量的实验,包括不同的隐藏层数(3、5、7)和每层神经元数(10、30、50)。针对最先进的优化方法,包括PINN Adam、PINN L-BFGS、PINN Adam L-BFGS和PINN PSO,在不同的PDE类别中对所提出的PINN- cmbo进行了系统评估。实验结果表明,PINN CMBO在迭代次数较少的情况下,在所有方法中记录了最低的损失值,始终保持着优异的性能。对于抛物线和双曲PDEs, PINN CMBO实现了令人印象深刻的最小损耗值,显著优于PINN Adam、PINN L-BFGS、PINN Adam L-BFGS和PINN PSO。在椭圆型和抛物线型pde中也观察到类似的改进,在所有测试的网络配置中,pin - cmbo都表现出无与伦比的准确性和稳定性。将CMBO集成到PINN中实现了有效的参数初始化,与传统的PINN方法相比,大大减少了损失函数。通过将训练过程引导到参数空间的最优区域,PINN-CMBO不仅加快了收敛速度,而且提高了整体性能。这些发现确立了PINN-CMBO作为解决复杂PDE问题的高效框架,在准确性和稳定性方面超越了现有方法。
A new hybrid approach for solving partial differential equations: Combining Physics-Informed Neural Networks with Cat-and-Mouse based Optimization
Partial differential equations (PDEs) are essential for modeling a wide range of physical phenomena. Physics-Informed Neural Networks (PINNs) offer a promising numerical framework for solving PDEs, but their performance often depends on the choice of optimization strategy and network configuration. In this study, we propose a hybrid PINN with a Cat and Mouse-based Optimizer (CMBO) to enhance optimization effectiveness and improve accuracy across elliptic, parabolic, and hyperbolic PDEs. CMBO utilizes a cat and mouse interaction mechanism to effectively balance exploration and exploitation, improving parameter initialization and guiding the optimization process toward favorable regions of the parameter space. Extensive experiments were conducted under varying scenarios, including different numbers of hidden layers (3, 5, 7) and neurons per layer (10, 30, 50). The proposed PINN-CMBO was systematically evaluated against state-of-the-art optimization methods, including PINN Adam, PINN L-BFGS, PINN Adam L-BFGS, and PINN PSO, across a diverse set of PDE categories. Experimental results revealed that PINN CMBO consistently achieved superior performance, recording the lowest loss values among all methods within fewer iteration. For parabolic and hyperbolic PDEs, PINN CMBO achieved an impressive minimum loss value, significantly outperforming PINN Adam, PINN L-BFGS, PINN Adam L-BFGS, and PINN PSO. Similar improvements were observed in elliptic and parabolic PDEs, where PINN-CMBO demonstrated unparalleled accuracy and stability across all tested network configurations. The integration of CMBO into PINN enabled efficient parameter initialization, driving a substantial reduction in the loss function compared to conventional PINN approaches. By guiding the training process toward optimal regions of the parameter space, PINN-CMBO not only accelerates convergence but also enhances overall performance. These findings establish PINN-CMBO as a highly effective framework for solving complex PDE problems, surpassing existing methods in terms of accuracy and stability.