Chengze Jiang , Aiping Ye , Huiting He , Xiuchun Xiao , Cong Lin
{"title":"自适应梯度感知神经动力学:动态凸优化的快速和准确的解决方案","authors":"Chengze Jiang , Aiping Ye , Huiting He , Xiuchun Xiao , Cong Lin","doi":"10.1016/j.engappai.2025.112798","DOIUrl":null,"url":null,"abstract":"<div><div>Constrained Dynamic Convex Optimization (CDCO) represents a core challenge in many engineering applications, where the objective is to minimize a time-varying cost function subject to dynamically evolving constraints. While recent neural network-based methods have demonstrated potential in addressing CDCO, they still suffer from limitations in convergence and solution accuracy, which restrict their effectiveness in real-world deployments. To overcome these challenges, we propose an Adaptive Gradient-Aware Neural Dynamics (AGAND). As an artificial intelligence model derived from a branch of Hopfield networks, AGAND integrates a gradient-aware term with a time derivative term to enhance solution performance. Our AGAND uses gradient information and time-derivative data to achieve faster and more accurate solutions for CDCO. Besides, the convergence of the model is further boosted by introducing state-aware coefficient with gradient feedback mechanism. Theoretical analysis demonstrates the global convergence of the AGAND, along with a detailed complexity assessment. To further adapt AGAND for practical deployment, a discretization scheme is proposed to facilitate implementation on digital hardware. Comparative experiments with state-of-the-art methods illustrate the competitiveness of our AGAND in terms of convergence and accuracy, achieving Average Steady-state Residual Error (ASSRE) of <span><math><mrow><mn>3</mn><mo>.</mo><mn>10</mn><mo>×</mo><mn>1</mn><msup><mrow><mn>0</mn></mrow><mrow><mo>−</mo><mn>3</mn></mrow></msup></mrow></math></span> and Convergence Time (CT) of 0.04 s. Finally, a robot kinematics scheme and hyperspectral image target detection are formulated on the basis of our AGAND, demonstrating the feasibility and practical utility of the AGAND in real-world engineering problems.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"162 ","pages":"Article 112798"},"PeriodicalIF":8.0000,"publicationDate":"2025-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Adaptive gradient-aware neural dynamics: Towards fast and accurate solutions for dynamic convex optimization\",\"authors\":\"Chengze Jiang , Aiping Ye , Huiting He , Xiuchun Xiao , Cong Lin\",\"doi\":\"10.1016/j.engappai.2025.112798\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Constrained Dynamic Convex Optimization (CDCO) represents a core challenge in many engineering applications, where the objective is to minimize a time-varying cost function subject to dynamically evolving constraints. While recent neural network-based methods have demonstrated potential in addressing CDCO, they still suffer from limitations in convergence and solution accuracy, which restrict their effectiveness in real-world deployments. To overcome these challenges, we propose an Adaptive Gradient-Aware Neural Dynamics (AGAND). As an artificial intelligence model derived from a branch of Hopfield networks, AGAND integrates a gradient-aware term with a time derivative term to enhance solution performance. Our AGAND uses gradient information and time-derivative data to achieve faster and more accurate solutions for CDCO. Besides, the convergence of the model is further boosted by introducing state-aware coefficient with gradient feedback mechanism. Theoretical analysis demonstrates the global convergence of the AGAND, along with a detailed complexity assessment. To further adapt AGAND for practical deployment, a discretization scheme is proposed to facilitate implementation on digital hardware. Comparative experiments with state-of-the-art methods illustrate the competitiveness of our AGAND in terms of convergence and accuracy, achieving Average Steady-state Residual Error (ASSRE) of <span><math><mrow><mn>3</mn><mo>.</mo><mn>10</mn><mo>×</mo><mn>1</mn><msup><mrow><mn>0</mn></mrow><mrow><mo>−</mo><mn>3</mn></mrow></msup></mrow></math></span> and Convergence Time (CT) of 0.04 s. Finally, a robot kinematics scheme and hyperspectral image target detection are formulated on the basis of our AGAND, demonstrating the feasibility and practical utility of the AGAND in real-world engineering problems.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"162 \",\"pages\":\"Article 112798\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2025-10-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197625028295\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625028295","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Adaptive gradient-aware neural dynamics: Towards fast and accurate solutions for dynamic convex optimization
Constrained Dynamic Convex Optimization (CDCO) represents a core challenge in many engineering applications, where the objective is to minimize a time-varying cost function subject to dynamically evolving constraints. While recent neural network-based methods have demonstrated potential in addressing CDCO, they still suffer from limitations in convergence and solution accuracy, which restrict their effectiveness in real-world deployments. To overcome these challenges, we propose an Adaptive Gradient-Aware Neural Dynamics (AGAND). As an artificial intelligence model derived from a branch of Hopfield networks, AGAND integrates a gradient-aware term with a time derivative term to enhance solution performance. Our AGAND uses gradient information and time-derivative data to achieve faster and more accurate solutions for CDCO. Besides, the convergence of the model is further boosted by introducing state-aware coefficient with gradient feedback mechanism. Theoretical analysis demonstrates the global convergence of the AGAND, along with a detailed complexity assessment. To further adapt AGAND for practical deployment, a discretization scheme is proposed to facilitate implementation on digital hardware. Comparative experiments with state-of-the-art methods illustrate the competitiveness of our AGAND in terms of convergence and accuracy, achieving Average Steady-state Residual Error (ASSRE) of and Convergence Time (CT) of 0.04 s. Finally, a robot kinematics scheme and hyperspectral image target detection are formulated on the basis of our AGAND, demonstrating the feasibility and practical utility of the AGAND in real-world engineering problems.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.