{"title":"Distributed Predefined-Time Control for Cooperative Tracking of Multiple Quadrotor UAVs","authors":"Kewei Xia;Xinyi Li;Kaidan Li;Yao Zou","doi":"10.1109/JAS.2023.123861","DOIUrl":"https://doi.org/10.1109/JAS.2023.123861","url":null,"abstract":"Dear Editor, This letter addresses the predefined-time control for cooperative tracking of multiple quadrotor unmanned aerial vehicles (UAVs) under a directed communication network. A predefined-time distributed estimator is first introduced to accurately get the reference velocity and acceleration for each UAV. Then, a cascade predefined-time control strategy is proposed to guarantee that all the UAVs track the reference trajectory while maintaining a preassigned configuration, where an attitude constraint algorithm is developed to avoid the flipping over of each VAV. Stability analysis demonstrates that the tracking errors of the closed-loop systems converge to zero within a predefined time. Finally, experiment results validate the proposed control strategy.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 10","pages":"2179-2181"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10664603","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evolution and Role of Optimizers in Training Deep Learning Models","authors":"XiaoHao Wen;MengChu Zhou","doi":"10.1109/JAS.2024.124806","DOIUrl":"https://doi.org/10.1109/JAS.2024.124806","url":null,"abstract":"To perform well, deep learning (DL) models have to be trained well. Which optimizer should be adopted? We answer this question by discussing how optimizers have evolved from traditional methods like gradient descent to more advanced techniques to address challenges posed by high-dimensional and non-convex problem space. Ongoing challenges include their hyperparameter sensitivity, balancing between convergence and generalization performance, and improving interpretability of optimization processes. Researchers continue to seek robust, efficient, and universally applicable optimizers to advance the field of DL across various domains.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 10","pages":"2039-2042"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10664602","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Hierarchical Controller Synthesis Under Linear Temporal Logic Specifications Using Dynamic Quantization","authors":"Wei Ren;Zhuo-Rui Pan;Weiguo Xia;Xi-Ming Sun","doi":"10.1109/JAS.2024.124473","DOIUrl":"https://doi.org/10.1109/JAS.2024.124473","url":null,"abstract":"Linear temporal logic (LTL) is an intuitive and expressive language to specify complex control tasks, and how to design an efficient control strategy for LTL specification is still a challenge. In this paper, we implement the dynamic quantization technique to propose a novel hierarchical control strategy for nonlinear control systems under LTL specifications. Based on the regions of interest involved in the LTL formula, an accepting path is derived first to provide a high-level solution for the controller synthesis problem. Second, we develop a dynamic quantization based approach to verify the realization of the accepting path. The realization verification results in the necessity of the controller design and a sequence of quantization regions for the controller design. Third, the techniques of dynamic quantization and abstraction-based control are combined together to establish the local-to-global control strategy. Both abstraction construction and controller design are local and dynamic, thereby resulting in the potential reduction of the computational complexity. Since each quantization region can be considered locally and individually, the proposed hierarchical mechanism is more efficient and can solve much larger problems than many existing methods. Finally, the proposed control strategy is illustrated via two examples from the path planning and tracking problems of mobile robots.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 10","pages":"2082-2098"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137597","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Haijing Wang;Jinzhu Peng;Fangfang Zhang;Yaonan Wang
{"title":"High-Order Control Barrier Function-Based Safety Control of Constrained Robotic Systems: An Augmented Dynamics Approach","authors":"Haijing Wang;Jinzhu Peng;Fangfang Zhang;Yaonan Wang","doi":"10.1109/JAS.2024.124524","DOIUrl":"https://doi.org/10.1109/JAS.2024.124524","url":null,"abstract":"Although constraint satisfaction approaches have achieved fruitful results, system states may lose their smoothness and there may be undesired chattering of control inputs due to switching characteristics. Furthermore, it remains a challenge when there are additional constraints on control torques of robotic systems. In this article, we propose a novel high-order control barrier function (HoCBF)-based safety control method for robotic systems subject to input-output constraints, which can maintain the desired smoothness of system states and reduce undesired chattering vibration in the control torque. In our design, augmented dynamics are introduced into the HoCBF by constructing its output as the control input of the robotic system, so that the constraint satisfaction is facilitated by HoCBFs and the smoothness of system states is maintained by the augmented dynamics. This proposed scheme leads to the quadratic program (QP), which is more user-friendly in implementation since the constraint satisfaction control design is implemented as an add-on to an existing tracking control law. The proposed closed-loop control system not only achieves the requirements of real-time capability, stability, safety and compliance, but also reduces undesired chattering of control inputs. Finally, the effectiveness of the proposed control scheme is verified by simulations and experiments on robotic manipulators.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 12","pages":"2487-2496"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142679274","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Dynamic Vision-Based Machinery Fault Diagnosis with Cross-Modality Feature Alignment","authors":"Xiang Li;Shupeng Yu;Yaguo Lei;Naipeng Li;Bin Yang","doi":"10.1109/JAS.2024.124470","DOIUrl":"https://doi.org/10.1109/JAS.2024.124470","url":null,"abstract":"Intelligent machinery fault diagnosis methods have been popularly and successfully developed in the past decades, and the vibration acceleration data collected by contact accelerometers have been widely investigated. In many industrial scenarios, contactless sensors are more preferred. The event camera is an emerging bio-inspired technology for vision sensing, which asynchronously records per-pixel brightness change polarity with high temporal resolution and low latency. It offers a promising tool for contactless machine vibration sensing and fault diagnosis. However, the dynamic vision-based methods suffer from variations of practical factors such as camera position, machine operating condition, etc. Furthermore, as a new sensing technology, the labeled dynamic vision data are limited, which generally cannot cover a wide range of machine fault modes. Aiming at these challenges, a novel dynamic vision-based machinery fault diagnosis method is proposed in this paper. It is motivated to explore the abundant vibration acceleration data for enhancing the dynamic vision-based model performance. A cross-modality feature alignment method is thus proposed with deep adversarial neural networks to achieve fault diagnosis knowledge transfer. An event erasing method is further proposed for improving model robustness against variations. The proposed method can effectively identify unseen fault mode with dynamic vision data. Experiments on two rotating machine monitoring datasets are carried out for validations, and the results suggest the proposed method is promising for generalized contactless machinery fault diagnosis.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 10","pages":"2068-2081"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137595","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Bridge Bidding via Deep Reinforcement Learning and Belief Monte Carlo Search","authors":"Zizhang Qiu;Shouguang Wang;Dan You;MengChu Zhou","doi":"10.1109/JAS.2024.124488","DOIUrl":"https://doi.org/10.1109/JAS.2024.124488","url":null,"abstract":"Contract Bridge, a four-player imperfect information game, comprises two phases: bidding and playing. While computer programs excel at playing, bidding presents a challenging aspect due to the need for information exchange with partners and interference with communication of opponents. In this work, we introduce a Bridge bidding agent that combines supervised learning, deep reinforcement learning via self-play, and a test-time search approach. Our experiments demonstrate that our agent outperforms WBridge5, a highly regarded computer Bridge software that has won multiple world championships, by a performance of 0.98 IMPs (international match points) per deal over 10 000 deals, with a much cost-effective approach. The performance significantly surpasses previous state-of-the-art (0.85 IMPs per deal). Note 0.1 IMPs per deal is a significant improvement in Bridge bidding.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 10","pages":"2111-2122"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137609","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Urban Traffic Control Meets Decision Recommendation System: A Survey and Perspective","authors":"Qingyuan Ji;Xiaoyue Wen;Junchen Jin;Yongdong Zhu;Yisheng Lv","doi":"10.1109/JAS.2024.124659","DOIUrl":"https://doi.org/10.1109/JAS.2024.124659","url":null,"abstract":"Urban traffic control is a multifaceted and demanding task that necessitates extensive decision-making to ensure the safety and efficiency of urban transportation systems. Traditional approaches require traffic signal professionals to manually intervene on traffic control devices at the intersection level, utilizing their knowledge and expertise. However, this process is cumbersome, labor-intensive, and cannot be applied on a large network scale. Recent studies have begun to explore the applicability of recommendation system for urban traffic control, which offer increased control efficiency and scalability. Such a decision recommendation system is complex, with various interdependent components, but a systematic literature review has not yet been conducted. In this work, we present an up-to-date survey that elucidates all the detailed components of a recommendation system for urban traffic control, demonstrates the utility and efficacy of such a system in the real world using data and knowledge-driven approaches, and discusses the current challenges and potential future directions of this field.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 10","pages":"2043-2058"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137523","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Neural Network-Based State Estimation for Nonlinear Systems with Denial-of-Service Attack Under Try-Once-Discard Protocol","authors":"Xueli Wang;Shangwei Zhao;Ming Yang;Xin Wang;Xiaoming Wu","doi":"10.1109/JAS.2023.123690","DOIUrl":"https://doi.org/10.1109/JAS.2023.123690","url":null,"abstract":"Dear Editor, This letter deals with state estimation issues of discrete-time non-linear systems subject to denial-of-service (DoS) attacks under the try-once-discard (TOD) protocol. More specifically, to reduce the communication burden, a TOD protocol with novel update rules on protocol weights is designed for scheduling measurement outputs. In addition, unknown nonlinear functions vulnerable to DoS attacks are considered due to the openness and vulnerability of the network. For such systems, the neural networks (NNs) are exploited to estimate the unknown nonlinear system dynamics in the designed Luenberger-like observer. With the help of Lyapunov theory, some sufficient conditions are derived under which the estimation error and the approximation errors of NNs weights are uniformly ultimately bounded (UUB). Finally, the validity of designed observers is demonstrated by a power system example.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 10","pages":"2182-2184"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10664600","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137598","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Scalable Temporal Dimension Preserved Tensor Completion for Missing Traffic Data Imputation with Orthogonal Initialization","authors":"Hong Chen;Mingwei Lin;Jiaqi Liu;Zeshui Xu","doi":"10.1109/JAS.2024.124278","DOIUrl":"https://doi.org/10.1109/JAS.2024.124278","url":null,"abstract":"Dear Editor, This letter puts forward a novel scalable temporal dimension preserved tensor completion model based on orthogonal initialization for missing traffic data (MTD) imputation. The MTD imputation acts directly on accessing the traffic state, and affects the traffic management. However, it still faces the following challenges: 1) The MTD imputation is usually formulated as matrix completion or tensor completion, which ignores the information across different dimensions; 2) Most of the existing models cannot generalize to traffic datasets of different scales or different missing rates; and 3) The MTD imputation models based on Gaussian random initialization easily leads to gradient explosion or vanishing, so that the training accuracy is not effectively improved. Inspired by these findings, the proposed scalable temporal dimension preserved tensor completion (ST-DPTC) model creatively establishes the following three-fold ideas: a) Incorporating the dimension preserved tensor completion (DPTC) to extract more distinctive traffic structure changes from the low-rank latent factor tensors; b) Adopting a scalable temporal (ST) regularization with first-order difference and second-order difference operators to adapt to different scales of traffic data; and c) Embedding ST regularization into DPTC with orthogonal initialization to perform low-rank latent factor tensor extraction and MTD imputation. Results on real-world traffic datasets with different scales show that our proposed model exceeds the state-of-the-art models in terms of the imputation accuracy.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 10","pages":"2188-2190"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10664599","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137608","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Safe Q-Learning for Data-Driven Nonlinear Optimal Control with Asymmetric State Constraints","authors":"Mingming Zhao;Ding Wang;Shijie Song;Junfei Qiao","doi":"10.1109/JAS.2024.124509","DOIUrl":"https://doi.org/10.1109/JAS.2024.124509","url":null,"abstract":"This article develops a novel data-driven safe Q-learning method to design the safe optimal controller which can guarantee constrained states of nonlinear systems always stay in the safe region while providing an optimal performance. First, we design an augmented utility function consisting of an adjustable positive definite control obstacle function and a quadratic form of the next state to ensure the safety and optimality. Second, by exploiting a pre-designed admissible policy for initialization, an off-policy stabilizing value iteration Q-learning (SVIQL) algorithm is presented to seek the safe optimal policy by using offline data within the safe region rather than the mathematical model. Third, the monotonicity, safety, and optimality of the SVIQL algorithm are theoretically proven. To obtain the initial admissible policy for SVIQL, an offline VIQL algorithm with zero initialization is constructed and a new admissibility criterion is established for immature iterative policies. Moreover, the critic and action networks with precise approximation ability are established to promote the operation of VIQL and SVIQL algorithms. Finally, three simulation experiments are conducted to demonstrate the virtue and superiority of the developed safe Q-learning method.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 12","pages":"2408-2422"},"PeriodicalIF":15.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142679333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}