Bo Hu , Jianning Cai , Zuoxia Xing , Pengfei Zhang , Dongrui Wang , Komla Agbenyo Folly
{"title":"Control and optimization techniques for load frequency control of multi-area Cyber–Physical Power Systems: A literature review","authors":"Bo Hu , Jianning Cai , Zuoxia Xing , Pengfei Zhang , Dongrui Wang , Komla Agbenyo Folly","doi":"10.1016/j.arcontrol.2025.101009","DOIUrl":"10.1016/j.arcontrol.2025.101009","url":null,"abstract":"<div><div>In Cyber–Physical Power Systems (CPPSs), Load Frequency Control (LFC) needs an efficient information system and high performance strategies to ensure power system frequency stability. This paper focuses on these two aspects, comprehensively reviewing the challenges and research progress of LFC in multi-area CPPSs from three dimensions: modeling, control strategies, and mitigation methods of some information system abnormal conditions. Firstly, considering the high penetration of renewable energy and open network architectures, we review various LFC models applicable to CPPSs from physical dynamics and information layer features, providing a solid theoretical basis for future research. Secondly, we classify and summarize LFC control strategies in CPPSs, covering classical, modern control strategies, optimization technologies and analyze their strengths and limitations in LFC. Finally, we analyze information system challenges like cyber attacks, communication bandwidth limits and delays, and propose corresponding countermeasures. In conclusion, this paper delves into LFC issues in CPPSs, focusing on challenges such as communication bandwidth limitations, delays and cyber attacks. It is hoped to provide a powerful framework and valuable research direction for future work in the field.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101009"},"PeriodicalIF":7.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144686814","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Knock feedback control strategies: A review","authors":"J.C. Peyton Jones, V. Patel, J. Frey","doi":"10.1016/j.arcontrol.2025.100990","DOIUrl":"10.1016/j.arcontrol.2025.100990","url":null,"abstract":"<div><div>Knocking combustion is a limiting factor in otherwise highly efficient modern downsized engines, which therefore require some form of knock control strategy. These strategies are distinctive because knock behaves as a cyclically independent random process. An increased focus on the stochastic aspect of this problem has opened up new possibilities for controller design, as seen in the recent literature. This paper aims to organize and present some of the principal ideas and approaches in a consistent and structured framework. Controllers are broadly classified by the signal / statistic used for feedback and the method of its estimation. Both classical and advanced knock ‘event-based’ strategies apply a threshold to the measured knock intensity value and then regulate the resulting knock event probability. Knock ‘intensity-based’ controllers, by contrast, use the more informative raw knock intensity signal for feedback, and generally assume these intensities conform to a log-normal distribution. More recently, Bayesian estimators have been used in both event-based and intensity-based control, as an alternative to frequentist estimation methods. Within each of these broad classes, individual control strategies are discussed in detail, and, in some cases, simplifying expressions are derived. More generally, the choice of control objective, estimation method, and error metric are also discussed in depth since these have a significant impact on closed loop performance.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"59 ","pages":"Article 100990"},"PeriodicalIF":7.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143878567","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Luis Felipe Villegas, Marco Macchi, Adalberto Polenghi
{"title":"Digital twins in manufacturing: A unified conceptual framework","authors":"Luis Felipe Villegas, Marco Macchi, Adalberto Polenghi","doi":"10.1016/j.arcontrol.2025.101031","DOIUrl":"10.1016/j.arcontrol.2025.101031","url":null,"abstract":"<div><div>Digital Twins (DTs) have the potential to transform how manufacturers conceive, design, manage, and optimize products, manufacturing systems, and services. However, their rapid evolution has led to a fragmented landscape in terms of conceptualization, applications, maturity levels, and enabling technological capabilities, creating a misalignment between academic research and industrial implementation. This paper addresses these challenges by proposing a unified conceptual framework for DTs in manufacturing, which integrates DT applications and maturity levels across product, production, and service domains and derives a theory-driven DT definition. To this end, two complementary frameworks are developed: the Digital Twin Application-based Framework and the Digital Twin Technological Capabilities Framework, which together classify DT applications, maturity levels, and technological capabilities within the three manufacturing domains. To establish conceptual clarity and account for the evolving, adaptive, and granular nature of DTs, the framework introduces a definition grounded in Complex Adaptive Systems (CAS) Theory, framing DTs as dynamic, interconnected systems that evolve in complexity and functionality based on domain-specific needs. Overall, this research contributes to promote an alignment between academia and industry by providing a structured analysis and comprehensive conceptualization of DTs in manufacturing.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101031"},"PeriodicalIF":10.7,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145265650","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Juan Ramón Camarillo-Peñaranda , Ana Carolina Cunha , Bruno W. França , Francis de Abreu Oliveira , Luan de Oliveira Senna
{"title":"A review on VSC-HVDC control schemes","authors":"Juan Ramón Camarillo-Peñaranda , Ana Carolina Cunha , Bruno W. França , Francis de Abreu Oliveira , Luan de Oliveira Senna","doi":"10.1016/j.arcontrol.2025.100988","DOIUrl":"10.1016/j.arcontrol.2025.100988","url":null,"abstract":"<div><div>Designing a VSC-HVDC controller capable of effectively operating in most operational scenarios is challenging due to the highly complex dynamics, unexpected failures, and system uncertainty prevalent in a broad range of post-deployment situations. Furthermore, the stability of the closed-loop system stands as a crucial and undeniable aspect that necessitates special attention during the system development phase. From today’s point of view, this review provides a comprehensive overview of the literature on control technologies, their characteristics, and control options applicable to HVDC systems. This article discusses their applications, advantages, limitations, and recent developments within these techniques.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"59 ","pages":"Article 100988"},"PeriodicalIF":7.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143687059","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Leonardo Pedroso , Pedro Batista , W.P.M.H. (Maurice) Heemels
{"title":"Distributed design of ultra large-scale control systems: Progress, Challenges, and Prospects","authors":"Leonardo Pedroso , Pedro Batista , W.P.M.H. (Maurice) Heemels","doi":"10.1016/j.arcontrol.2025.100987","DOIUrl":"10.1016/j.arcontrol.2025.100987","url":null,"abstract":"<div><div>The transition from large centralized complex control systems to distributed configurations that rely on a network of a very large number of interconnected simpler subsystems is ongoing and inevitable in many applications. It is attributed to the quest for resilience, flexibility, and scalability in a multitude of engineering fields with far-reaching societal impact. Although many design methods for distributed and decentralized control systems are available, most of them rely on a centralized design procedure requiring some form of global information of the whole system. Clearly, beyond a certain scale of the network, these centralized design procedures for distributed controllers are no longer feasible and we refer to the corresponding systems as <em>ultra large-scale systems</em> (ULSS). For these ULSS, design algorithms are needed that are distributed themselves among the subsystems and are subject to stringent requirements regarding communication, computation, and memory usage of each subsystem. In this paper, a set of requirements is provided that assures a feasible real-time implementation of all phases of a control solution on an ultra large scale. State-of-the-art approaches are reviewed in the light of these requirements and the challenges hampering the development of befitting control algorithms are pinpointed. Comparing the challenges with the current progress leads to the identification and motivation of promising research directions.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"59 ","pages":"Article 100987"},"PeriodicalIF":7.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143792201","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Frequential lithium-ion battery impedance identification using automatic model selection and initialization","authors":"Omar Arahbi, Benoît Huard, Jean-Denis Gabano, Thierry Poinot","doi":"10.1016/j.arcontrol.2025.101011","DOIUrl":"10.1016/j.arcontrol.2025.101011","url":null,"abstract":"<div><div>Electrochemical Impedance Spectroscopy (EIS) is a useful tool for selecting a pertinent Equivalent Circuit Model (ECM) of a Lithium-ion battery. Impedance model is designed to describe low, middle and high frequency electrochemical processes involved. When considering low frequency restricted in the Warburg zone, diffusion impedance is modeled thanks to a Constant Phase Element (CPE) which behaves as a fractional integrator of order <span><math><mi>n</mi></math></span> close to 0.5. Phenomena observed in middle frequency are described using specific circuits called Zarc which consist in connecting a CPE in parallel with a resistor. Therefore, the global impedance model is characterized by non integer order operators and parameters can be estimated by a Complex Nonlinear Least Squares (CNLS) algorithm which requires a proper initialization in order to guarantee the convergence to a global optimum. The paper presents a method to analyze EIS data measurements in order to select automatically the number of middle frequency Zarc circuits required (one or two) and to initialize properly the CNLS algorithm. The method is validated using simulation data as well as experimental open source EIS data.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101011"},"PeriodicalIF":10.7,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144916745","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Enso Ndreko , Stéphane Victor , Jean-François Duhé , Pierre Melchior
{"title":"Modeling of bio-heat transfers in lungs with fractional models","authors":"Enso Ndreko , Stéphane Victor , Jean-François Duhé , Pierre Melchior","doi":"10.1016/j.arcontrol.2025.101010","DOIUrl":"10.1016/j.arcontrol.2025.101010","url":null,"abstract":"<div><div>In cardiac surgeries, when cardiopulmonary bypass (CPB) (or extracorporeal circulation (ECC)) is employed, the lungs are temporarily disconnected from the body. To minimize the risk of tissue damage or respiratory complications, the lungs are subjected to mild hypothermia. Incorporating dynamic heat transfer modeling offers the potential to enhance temperature regulation through a more advanced approach.</div><div>A complex thermal model, based on a thermal two-port network, offers a wide frequency range applicability, making it suitable for modeling the human breathing frequencies. This modeling approach can also be adapted to incorporate the influence of blood flow, which serves as a natural temperature regulator in the human body. This is accomplished by combining the thermal two-port network with the bio-heat equation.</div><div>The main contributions focus on introducing distinctive and simplified approximation models for the equivalent global impedance of thermal transfer within the lungs. These models, featuring minimal parameters, manifest comparable dynamic traits in the frequency domain, akin to the attributes of the two-port network model. This progress clears the way for broader utilization across various domains.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101010"},"PeriodicalIF":10.7,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144738316","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Implementation of deep reinforcement learning in permanent magnet synchronous motors control: A review","authors":"Larbi Assem Moulai , Fardila M. Zaihidee , Saad Mekhilef , Jing Rui Tang , Marizan Mubin","doi":"10.1016/j.arcontrol.2025.101014","DOIUrl":"10.1016/j.arcontrol.2025.101014","url":null,"abstract":"<div><div>Permanent Magnet Synchronous Motors (PMSMs) are recognized for high efficiency, torque-to-inertia ratio, and robust properties, making them ideal for the rapid development of electric vehicles, robotics, and the aerospace industry. Recently, Deep Reinforcement Learning (DRL) algorithms have gained significant attention in the control domain due to their independence from plant models and advanced decision-making capabilities. These features make DRL highly suitable for addressing challenges in PMSM control such as load disturbances, speed tracking, and parameter variations. This review explores recent DRL techniques applied to PMSM speed, current, and torque control. Discrete and continuous algorithms, including Deep Q-Network (DQN), Deep Deterministic Policy Gradient (DDPG), and Twin Delayed DDPG (TD3), are examined in terms of their basic principles, practical implementations, and the benefits they provide in overcoming challenges in PMSM control. In addition, to demonstrate the efficiency of DRL, the review provides a summary and comparison of DRL applied to optimize classical control methods elaborated within various PMSM control strategies. Comparisons of DRL implementations in PMSM control are highlighted to validate their real-time applicability in experiments, and potential areas for future research and improvement are outlined.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101014"},"PeriodicalIF":10.7,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144988558","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Generalized inverse optimal control and its application in biology","authors":"Julio R. Banga , Sebastian Sager","doi":"10.1016/j.arcontrol.2025.101029","DOIUrl":"10.1016/j.arcontrol.2025.101029","url":null,"abstract":"<div><div>Living organisms exhibit remarkable adaptations across all scales, from molecules to ecosystems. We believe that many of these adaptations correspond to optimal solutions driven by evolution, training, and underlying physical and chemical laws and constraints. While some argue against such optimality principles due to their potential ambiguity, we propose generalized inverse optimal control to infer them directly from data. This comprehensive approach incorporates multi-criteria optimality, nestedness of objective functions on different scales, the presence of active constraints, the possibility of switches of optimality principles during the observed time horizon, maximization of robustness and minimization of time as important special cases, as well as uncertainties involved with the mathematical modeling of biological systems. This data-driven approach ensures that optimality principles are not merely theoretical constructs but are firmly rooted in experimental observations. The inferred principles can also be used in forward optimal control to predict and manipulate biological systems, with possible applications in bio-medicine, biotechnology, and agriculture. As discussed and illustrated, the well-posed problem formulation and the inference are challenging and require a substantial interdisciplinary effort in the development of theory and robust numerical methods.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101029"},"PeriodicalIF":10.7,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145265649","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , R. Bhushan Gopaluni , Ali Mesbah
{"title":"A view on learning robust goal-conditioned value functions: Interplay between RL and MPC","authors":"Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , R. Bhushan Gopaluni , Ali Mesbah","doi":"10.1016/j.arcontrol.2025.101027","DOIUrl":"10.1016/j.arcontrol.2025.101027","url":null,"abstract":"<div><div>Reinforcement learning (RL) and model predictive control (MPC) offer a wealth of distinct approaches for automatic decision-making under uncertainty. Given the impact both fields have had independently across numerous domains, there is growing interest in combining the general-purpose learning capability of RL with the safety and robustness features of MPC. To this end, this paper presents a tutorial-style treatment of RL and MPC, treating them as alternative approaches to solving Markov decision processes. In our formulation, RL aims to learn a <em>global</em> value function through offline exploration in an uncertain environment, whereas MPC constructs a <em>local</em> value function through online optimization. This local–global perspective suggests new ways to design policies that combine robustness and goal-conditioned learning. Robustness is incorporated into the RL and MPC pipelines through a scenario-based approach. Goal-conditioned learning aims to alleviate the burden of engineering a reward function for RL. Combining the two leads to a single policy that unites a robust, high-level RL terminal value function with short-term, scenario-based MPC planning for reliable constraint satisfaction. This approach leverages the benefits of both RL and MPC, the effectiveness of which is demonstrated on classical control benchmarks.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101027"},"PeriodicalIF":10.7,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145265773","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}