{"title":"A Linear Programming-Based Reinforcement Learning Mechanism for Incomplete-Information Games","authors":"Baosen Yang;Changbing Tang;Yang Liu;Guanghui Wen;Guanrong Chen","doi":"10.1109/JAS.2024.124464","DOIUrl":"https://doi.org/10.1109/JAS.2024.124464","url":null,"abstract":"Dear Editor, Recently, with the development of artificial intelligence, game intelligence decision-making has attracted more and more attention. In particular, incomplete-information games (IIG) have gradually become a new research focus, where players make decisions without sufficient information, such as the opponent's strategies or preferences. In this case, a selfish player can only make reactive decisions based on the changes in environment and state. Thus, blind decisions by players may drift them away from the path of reward maximization, and may even hinder the health of the IIG environment. Therefore, it is necessary to design an effective mechanism to optimize decision-making for IIG players.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 11","pages":"2340-2342"},"PeriodicalIF":15.3,"publicationDate":"2024-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10707689","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142397478","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"On Zero Dynamics and Controllable Cyber-Attacks in Cyber-Physical Systems and Dynamic Coding Schemes as Their Countermeasures","authors":"Mahdi Taheri;Khashayar Khorasani;Nader Meskin","doi":"10.1109/JAS.2024.124692","DOIUrl":"https://doi.org/10.1109/JAS.2024.124692","url":null,"abstract":"In this paper, we study stealthy cyber-attacks on actuators of cyber-physical systems (CPS), namely zero dynamics and controllable attacks. In particular, under certain assumptions, we investigate and propose conditions under which one can execute zero dynamics and controllable attacks in the CPS. The above conditions are derived based on the Markov parameters of the CPS and elements of the system observability matrix. Consequently, in addition to outlining the number of required actuators to be attacked, these conditions provide one with the minimum system knowledge needed to perform zero dynamics and controllable cyber-attacks. As a countermeasure against the above stealthy cyber-attacks, we develop a dynamic coding scheme that increases the minimum number of the CPS required actuators to carry out zero dynamics and controllable cyber-attacks to its maximum possible value. It is shown that if at least one secure input channel exists, the proposed dynamic coding scheme can prevent adversaries from executing the zero dynamics and controllable attacks even if they have complete knowledge of the coding system. Finally, two illustrative numerical case studies are provided to demonstrate the effectiveness and capabilities of our derived conditions and proposed methodologies.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 11","pages":"2191-2203"},"PeriodicalIF":15.3,"publicationDate":"2024-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142397143","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Knowledge As Not Only Justified True Beliefs in Vision","authors":"Wenbo Zheng;Fei-Yue Wang","doi":"10.1109/JAS.2024.124584","DOIUrl":"https://doi.org/10.1109/JAS.2024.124584","url":null,"abstract":"Computational knowledge vision [1] is emphasized as a novel perspective or field in this paper. It first proposes the visual hierarchy and its connection to knowledge, stating that knowledge is a justified true belief. To further the previous research, we concisely summarize our recent works and suggest a new direction that knowledge is also a thought framework in vision.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"12 2","pages":"297-299"},"PeriodicalIF":15.3,"publicationDate":"2024-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10707099","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143106681","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Unifying Fixed Time and Prescribed Time Control for Strict-Feedback Nonlinear Systems","authors":"Xiang Chen;Yujuan Wang;Yongduan Song","doi":"10.1109/JAS.2024.124401","DOIUrl":"https://doi.org/10.1109/JAS.2024.124401","url":null,"abstract":"This paper investigates the prescribed-time tracking control problem for a class of multi-input multi-output (MIMO) nonlinear strict-feedback systems subject to non-vanishing uncertainties. The inherent unmatched and non-vanishing uncertainties make the prescribed-time control problem become much more nontrivial. The solution to address the challenges mentioned above involves incorporating a prescribed-time filter, as opposed to a finite-time filter, and formulating a prescribed-time Lyapunov stability lemma (Lemma 5). The prescribed-time Lyapunov stability lemma is based on time axis shifting time-varying yet bounded gain, which establishes a novel link between the fixed-time and prescribed-time control method. This allows the restriction condition that the time-varying gain function must satisfy as imposed in most exist prescribed-time control works to be removed. Under the proposed control method, the desire trajectory is ensured to closely track the output of the system in prescribed time. The effectiveness of the theoretical results are verified through numerical simulation.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"12 2","pages":"347-355"},"PeriodicalIF":15.3,"publicationDate":"2024-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143106672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Optimal Production Capacity Matching for Blockchain-Enabled Manufacturing Collaboration with the Iterative Double Auction Method","authors":"Ying Chen;Feilong Lin;Zhongyu Chen;Changbing Tang;Cailian Chen","doi":"10.1109/JAS.2024.124626","DOIUrl":"https://doi.org/10.1109/JAS.2024.124626","url":null,"abstract":"The increased demand for personalized customization calls for new production modes to enhance collaborations among a wide range of manufacturing practitioners who unnecessarily trust each other. In this article, a blockchain-enabled manufacturing collaboration framework is proposed, with a focus on the production capacity matching problem for blockchain-based peer-to-peer (P2P) collaboration. First, a digital model of production capacity description is built for trustworthy and transparent sharing over the blockchain. Second, an optimization problem is formulated for P2P production capacity matching with objectives to maximize both social welfare and individual benefits of all participants. Third, a feasible solution based on an iterative double auction mechanism is designed to determine the optimal price and quantity for production capacity matching with a lack of personal information. It facilitates automation of the matching process while protecting users' privacy via blockchain-based smart contracts. Finally, simulation results from the Hyperledger Fabric-based prototype show that the proposed approach increases social welfare by 1.4% compared to the Bayesian game-based approach, makes all participants profitable, and achieves 90% fairness of enterprises.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"12 3","pages":"550-562"},"PeriodicalIF":15.3,"publicationDate":"2024-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143535554","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Distributed Cooperative Regulation for Networked Re-Entrant Manufacturing Systems","authors":"Chenguang Liu;Qing Gao;Wei Wang;Jinhu Lü","doi":"10.1109/JAS.2024.124728","DOIUrl":"https://doi.org/10.1109/JAS.2024.124728","url":null,"abstract":"Dear Editor, This letter focuses on the distributed cooperative regulation problem for a class of networked re-entrant manufacturing systems (RMSs). The networked system is structured with a three-tier architecture: the production line, the manufacturing layer and the workshop layer. The dynamics of re-entrant production lines are governed by hyperbolic partial differential equations (PDEs) based on the law of mass conservation. Distributed cooperative controllers are designed for the leaderless synchronization of the networked system. Numerical simulations validate the effectiveness of the proposed control scheme.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"12 3","pages":"636-638"},"PeriodicalIF":15.3,"publicationDate":"2024-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10707109","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143535529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Pure State Feedback Switching Control Based on the Online Estimated State for Stochastic Open Quantum Systems","authors":"Shuang Cong;Zhixiang Dong","doi":"10.1109/JAS.2023.124071","DOIUrl":"https://doi.org/10.1109/JAS.2023.124071","url":null,"abstract":"For the \u0000<tex>$n$</tex>\u0000-qubit stochastic open quantum systems, based on the Lyapunov stability theorem and LaSalle's invariant set principle, a pure state switching control based on on-line estimated state feedback (short for OQST-SFC) is proposed to realize the state transition the pure state of the target state including eigenstate and superposition state. The proposed switching control consists of a constant control and a control law designed based on the Lyapunov method, in which the Lyapunov function is the state distance of the system. The constant control is used to drive the system state from an initial state to the convergence domain only containing the target state, and a Lyapunov-based control is used to make the state enter the convergence domain and then continue to converge to the target state. At the same time, the continuous weak measurement of quantum system and the quantum state tomography method based on the on-line alternating direction multiplier (QST-OADM) are used to obtain the system information and estimate the quantum state which is used as the input of the quantum system controller. Then, the pure state feedback switching control method based on the on-line estimated state feedback is realized in an \u0000<tex>$n$</tex>\u0000-qubit stochastic open quantum system. The complete derivation process of \u0000<tex>$n$</tex>\u0000-qubit QST-OADM algorithm is given; Through strict theoretical proof and analysis, the convergence conditions to ensure any initial state of the quantum system to converge the target pure state are given. The proposed control method is applied to a 2-qubit stochastic open quantum system for numerical simulation experiments. Four possible different position cases between the initial estimated state and that of the controlled system are studied and discussed, and the performances of the state transition under the corresponding cases are analyzed.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 10","pages":"2166-2178"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137610","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Distributed Predefined-Time Control for Cooperative Tracking of Multiple Quadrotor UAVs","authors":"Kewei Xia;Xinyi Li;Kaidan Li;Yao Zou","doi":"10.1109/JAS.2023.123861","DOIUrl":"https://doi.org/10.1109/JAS.2023.123861","url":null,"abstract":"Dear Editor, This letter addresses the predefined-time control for cooperative tracking of multiple quadrotor unmanned aerial vehicles (UAVs) under a directed communication network. A predefined-time distributed estimator is first introduced to accurately get the reference velocity and acceleration for each UAV. Then, a cascade predefined-time control strategy is proposed to guarantee that all the UAVs track the reference trajectory while maintaining a preassigned configuration, where an attitude constraint algorithm is developed to avoid the flipping over of each VAV. Stability analysis demonstrates that the tracking errors of the closed-loop systems converge to zero within a predefined time. Finally, experiment results validate the proposed control strategy.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 10","pages":"2179-2181"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10664603","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Distributed State and Fault Estimation for Cyber-Physical Systems Under DoS Attacks","authors":"Limei Liang;Rong Su;Haotian Xu","doi":"10.1109/JAS.2024.124527","DOIUrl":"https://doi.org/10.1109/JAS.2024.124527","url":null,"abstract":"Dear Editor, The letter deals with the distributed state and fault estimation of the whole physical layer for cyber-physical systems (CPSs) when the cyber layer suffers from DoS attacks. With the advancement of embedded computing, communication and related hardware technologies, CPSs have attracted extensive attention and have been widely used in power system, traffic network, refrigeration system and other fields. As a new generation of systems that integrate computation resources, communication medium and physical processes, CPS is generally safety critical, and any attack or fault may result in degraded system performance, system crashes, or even catastrophic conditions. Thus, the security of CPS has become a new research frontier [1].","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"12 1","pages":"261-263"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10664194","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142993534","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evolution and Role of Optimizers in Training Deep Learning Models","authors":"XiaoHao Wen;MengChu Zhou","doi":"10.1109/JAS.2024.124806","DOIUrl":"https://doi.org/10.1109/JAS.2024.124806","url":null,"abstract":"To perform well, deep learning (DL) models have to be trained well. Which optimizer should be adopted? We answer this question by discussing how optimizers have evolved from traditional methods like gradient descent to more advanced techniques to address challenges posed by high-dimensional and non-convex problem space. Ongoing challenges include their hyperparameter sensitivity, balancing between convergence and generalization performance, and improving interpretability of optimization processes. Researchers continue to seek robust, efficient, and universally applicable optimizers to advance the field of DL across various domains.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 10","pages":"2039-2042"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10664602","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}