Amon Lahr, Andrea Zanelli, Andrea Carron, Melanie N. Zeilinger
{"title":"基于高斯过程的模型预测控制的零阶优化","authors":"Amon Lahr, Andrea Zanelli, Andrea Carron, Melanie N. Zeilinger","doi":"10.1016/j.ejcon.2023.100862","DOIUrl":null,"url":null,"abstract":"<div><p>By enabling constraint-aware online model adaptation, model predictive control using Gaussian process (GP) regression has exhibited impressive performance in real-world applications and received considerable attention in the learning-based control community. Yet, solving the resulting optimal control problem in real-time generally remains a major challenge, due to (i) the increased number of augmented states in the optimization problem, as well as (ii) computationally expensive evaluations of the posterior mean and covariance and their respective derivatives. To tackle these challenges, we employ (i) a tailored Jacobian approximation in a sequential quadratic programming (SQP) approach and combine it with (ii) a parallelizable GP inference and automatic differentiation framework. Reducing the numerical complexity with respect to the state dimension <span><math><msub><mi>n</mi><mi>x</mi></msub></math></span> for each SQP iteration from <span><math><mrow><mi>O</mi><mo>(</mo><msubsup><mi>n</mi><mi>x</mi><mn>6</mn></msubsup><mo>)</mo></mrow></math></span> to <span><math><mrow><mi>O</mi><mo>(</mo><msubsup><mi>n</mi><mi>x</mi><mn>3</mn></msubsup><mo>)</mo></mrow></math></span>, and accelerating GP evaluations on a graphical processing unit, the proposed algorithm computes suboptimal, yet feasible, solutions at drastically reduced computation times and exhibits favorable local convergence properties. Numerical experiments verify the scaling properties and investigate the runtime distribution across different parts of the algorithm.</p></div>","PeriodicalId":50489,"journal":{"name":"European Journal of Control","volume":"74 ","pages":"Article 100862"},"PeriodicalIF":2.5000,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0947358023000912/pdfft?md5=9dd7d9ddc254ef0cea7eea581f86ab23&pid=1-s2.0-S0947358023000912-main.pdf","citationCount":"1","resultStr":"{\"title\":\"Zero-order optimization for Gaussian process-based model predictive control\",\"authors\":\"Amon Lahr, Andrea Zanelli, Andrea Carron, Melanie N. Zeilinger\",\"doi\":\"10.1016/j.ejcon.2023.100862\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>By enabling constraint-aware online model adaptation, model predictive control using Gaussian process (GP) regression has exhibited impressive performance in real-world applications and received considerable attention in the learning-based control community. Yet, solving the resulting optimal control problem in real-time generally remains a major challenge, due to (i) the increased number of augmented states in the optimization problem, as well as (ii) computationally expensive evaluations of the posterior mean and covariance and their respective derivatives. To tackle these challenges, we employ (i) a tailored Jacobian approximation in a sequential quadratic programming (SQP) approach and combine it with (ii) a parallelizable GP inference and automatic differentiation framework. Reducing the numerical complexity with respect to the state dimension <span><math><msub><mi>n</mi><mi>x</mi></msub></math></span> for each SQP iteration from <span><math><mrow><mi>O</mi><mo>(</mo><msubsup><mi>n</mi><mi>x</mi><mn>6</mn></msubsup><mo>)</mo></mrow></math></span> to <span><math><mrow><mi>O</mi><mo>(</mo><msubsup><mi>n</mi><mi>x</mi><mn>3</mn></msubsup><mo>)</mo></mrow></math></span>, and accelerating GP evaluations on a graphical processing unit, the proposed algorithm computes suboptimal, yet feasible, solutions at drastically reduced computation times and exhibits favorable local convergence properties. Numerical experiments verify the scaling properties and investigate the runtime distribution across different parts of the algorithm.</p></div>\",\"PeriodicalId\":50489,\"journal\":{\"name\":\"European Journal of Control\",\"volume\":\"74 \",\"pages\":\"Article 100862\"},\"PeriodicalIF\":2.5000,\"publicationDate\":\"2023-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S0947358023000912/pdfft?md5=9dd7d9ddc254ef0cea7eea581f86ab23&pid=1-s2.0-S0947358023000912-main.pdf\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"European Journal of Control\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0947358023000912\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Journal of Control","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0947358023000912","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Zero-order optimization for Gaussian process-based model predictive control
By enabling constraint-aware online model adaptation, model predictive control using Gaussian process (GP) regression has exhibited impressive performance in real-world applications and received considerable attention in the learning-based control community. Yet, solving the resulting optimal control problem in real-time generally remains a major challenge, due to (i) the increased number of augmented states in the optimization problem, as well as (ii) computationally expensive evaluations of the posterior mean and covariance and their respective derivatives. To tackle these challenges, we employ (i) a tailored Jacobian approximation in a sequential quadratic programming (SQP) approach and combine it with (ii) a parallelizable GP inference and automatic differentiation framework. Reducing the numerical complexity with respect to the state dimension for each SQP iteration from to , and accelerating GP evaluations on a graphical processing unit, the proposed algorithm computes suboptimal, yet feasible, solutions at drastically reduced computation times and exhibits favorable local convergence properties. Numerical experiments verify the scaling properties and investigate the runtime distribution across different parts of the algorithm.
期刊介绍:
The European Control Association (EUCA) has among its objectives to promote the development of the discipline. Apart from the European Control Conferences, the European Journal of Control is the Association''s main channel for the dissemination of important contributions in the field.
The aim of the Journal is to publish high quality papers on the theory and practice of control and systems engineering.
The scope of the Journal will be wide and cover all aspects of the discipline including methodologies, techniques and applications.
Research in control and systems engineering is necessary to develop new concepts and tools which enhance our understanding and improve our ability to design and implement high performance control systems. Submitted papers should stress the practical motivations and relevance of their results.
The design and implementation of a successful control system requires the use of a range of techniques:
Modelling
Robustness Analysis
Identification
Optimization
Control Law Design
Numerical analysis
Fault Detection, and so on.