{"title":"Enhancing unmanned aerial vehicle communication through distributed ledger and multi-agent deep reinforcement learning for fairness and scalability","authors":"Farman Ali, Muhammad Ahtasham, Zahra Anfaal","doi":"10.20517/ces.2024.10","DOIUrl":"https://doi.org/10.20517/ces.2024.10","url":null,"abstract":"Unmanned Aerial Vehicles (UAVs) are pivotal in enhancing connectivity in diverse applications such as search and rescue, remote communications, and battlefield networking, especially in environments lacking ground-based infrastructure. This paper introduces a novel approach that harnesses Multi-Agent Deep Reinforcement Learning to optimize UAV communication systems. The methodology, centered on the Independent Proximal Policy Optimization technique, significantly improves fairness, throughput, and energy efficiency by enabling UAVs to autonomously adapt their operational strategies based on real-time environmental data and individual performance metrics. Moreover, the integration of Distributed Ledger Technologies with Multi-Agent Deep Reinforcement Learning enhances the security and scalability of UAV communications, ensuring robustness against disruptions and adversarial attacks. Extensive simulations demonstrate that this approach surpasses existing benchmarks in critical performance metrics, highlighting its potential implications for future UAV-assisted communication networks. By focusing on these technological advancements, the groundwork is laid for more efficient, fair, and resilient UAV systems.","PeriodicalId":504274,"journal":{"name":"Complex Engineering Systems","volume":"22 7","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141802962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Haiwen Wang, Chun Liu, Xiao Huang, Yuxuan Zhong, Dong Qu, Ron J. Patton
{"title":"Extended state observer-based fault-tolerant control for an unmanned surface vehicle under asynchronous injection and deception attacks","authors":"Haiwen Wang, Chun Liu, Xiao Huang, Yuxuan Zhong, Dong Qu, Ron J. Patton","doi":"10.20517/ces.2024.19","DOIUrl":"https://doi.org/10.20517/ces.2024.19","url":null,"abstract":"This paper explores the problem of fault-tolerant control concerning an underactuated unmanned surface vehicle affected by actuator faults and disturbances in the physical layer and multiple cyber threats (time-varying delays, injection attacks, and deception attacks) in the networked layer. Firstly, an extended state observer is designed to estimate the relative state and fault information by constructing the estimation error term based on the output information affected by injection attack and delay. Secondly, a novel fault-tolerant controller is designed to deal with random Bernoulli deception attacks and compensate for time-varying delay and actuator faults by using the estimated information and considering the probability dynamics of deception attacks. Assuming that dual-channel asynchronous independent injection and deception attacks occur on the sensor-to-observer and observer-to-controller channels. A sufficient condition for asymptotic stability of the unmanned surface vehicle is derived by using Lyapunov-Krasovskii functional within the co-design framework of fault estimation and fault-tolerant control, and ensured by eliminating the equality constraint. Finally, the efficacy of the proposed algorithm is assessed through simulations of the unmanned surface vehicle under two distinct scenarios: low forward speed and high forward speed.","PeriodicalId":504274,"journal":{"name":"Complex Engineering Systems","volume":"16 7","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141806707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Layered random fault injection method for the air braking system based on multiple Markov chains","authors":"Zhiwen Chen, Jingke Fan, Lijuan Peng, Hao Luo, Chao Cheng, Zhiyong Chen","doi":"10.20517/ces.2024.02","DOIUrl":"https://doi.org/10.20517/ces.2024.02","url":null,"abstract":"The air braking system is crucial for the safe operation of high-speed trains but is susceptible to faults from harsh environments and prolonged use. However, faulty data in practice are still rare because of the \"safety oriented principle\". For this purpose, fault injection is regularly employed. Due to the stochastic nature of faults in the system, random fault injection can more realistically simulate faulty scenarios compared to the deterministic fault injection. The traditional method entails analyzing a significant amount of raw data to extract the fault distribution function, followed by random sampling. However, the obstacles lie in the scarcity of raw fault data and the labor-intensive nature of constructing the fault distribution function. This paper proposes a layered random fault injection method based on multiple Markov chains. First, a multi-layer structured fault model base is established for the system, followed by the implementation of layered fault injection. Then, the random fault types and degrees are realized using Markov chains, in which the fault probability function is determined by the state transition matrix. Subsequently, a low-complexity Alias sampling algorithm is proposed for discrete random sampling. The nominal model is transformed into a corresponding fault model based on the sampling outcomes, facilitating the acquisition of fault data. Finally, a graphical user interface is developed to present and visualize the validation results.","PeriodicalId":504274,"journal":{"name":"Complex Engineering Systems","volume":"54 18","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140788386","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Active manipulation of a tethered drone using explainable AI","authors":"Shraddha Barawkar, Manish Kumar","doi":"10.20517/ces.2023.33","DOIUrl":"https://doi.org/10.20517/ces.2023.33","url":null,"abstract":"Tethered drones are currently finding a wide range of applications such as for aerial surveillance, traffic monitoring, and setting up ad-hoc communication networks. However, many technological gaps are required to be addressed for such systems. Most commercially available tethered drones hover at a certain position; however, the control task becomes challenging when the ground robot or station needs to move. In such a scenario, the drone is required to coordinate its motion with the moving ground vehicle without which the tether can destabilize the drone. Another challenging aspect is when the system is required to operate in GPS denied environments, such as in planetary exploration. In this paper, to address these issues, we take advantage of passive or force-based control in which the tension in the tether is sensed and used to drive the drone. Fuzzy logic is used to implement the force-based controller as a tool for explainable Artificial Intelligence. The proposed fuzzy logic controller takes tether force and its rate of change as the inputs and provides desired attitudes as the outputs. Via simulations and experiments, we show that the proposed controller allows effective coordination between the drone and the moving ground rover. The rule-based feature of fuzzy logic provides linguistic explainability for its decisions. Simulation and experimental results are provided to validate the novel controller. This paper additionally develops an adaptive controller for estimating unknown constant winds on these tethered drone systems using a proportional controller. The simulation results demonstrate the effectiveness of the proposed adaptive control scheme in addressing the effect of wind on a tethered drone.","PeriodicalId":504274,"journal":{"name":"Complex Engineering Systems","volume":"92 7","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140371023","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Command filter-based adaptive neural tracking control of nonlinear systems with multiple actuator constraints and disturbances","authors":"Yinguang Li, Jianhua Zhang, Yang Li","doi":"10.20517/ces.2023.38","DOIUrl":"https://doi.org/10.20517/ces.2023.38","url":null,"abstract":"In this paper, the adaptive practical finite-time tracking control problem for a class of strictly feedback nonlinear systems with multiple actuator constraints is investigated using backstepping techniques and practical finite-time stability theory. The effects of deadband and saturated nonlinear constraints on the controller design of nonlinear systems are addressed by the equivalent transformation method. The problem of complexity explosion due to the derivatives of virtual control signals is solved by using the virtual control signals as inputs to the command filters and using the outputs of the command filters to perform the corresponding control tasks. An adaptive neural network tracking backstepping control strategy based on the command filter technique and the backstepping design algorithm is proposed by approximating an unknown nonlinear function using a neural network. The control strategy ensures the boundedness of all variables in the closed-loop system, and the output tracking error fluctuates in a small region near the origin. Finally, simulations verify the effectiveness of the control strategy designed in this paper.","PeriodicalId":504274,"journal":{"name":"Complex Engineering Systems","volume":"25 2","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140443964","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Continual online learning-based optimal tracking control of nonlinear strict-feedback systems: application to unmanned aerial vehicles","authors":"I. Ganie, S. Jagannathan","doi":"10.20517/ces.2023.35","DOIUrl":"https://doi.org/10.20517/ces.2023.35","url":null,"abstract":"A novel optimal trajectory tracking scheme is introduced for nonlinear continuous-time systems in strict feedback form with uncertain dynamics by using neural networks (NNs). The method employs an actor-critic-based NN backstepping technique for minimizing a discounted value function along with an identifier to approximate unknown system dynamics that are expressed in augmented form. Novel online weight update laws for the actor and critic NNs are derived by using both the NN identifier and Hamilton-Jacobi-Bellman residual error. A new continual lifelong learning technique utilizing the Fisher Information Matrix via Hamilton-Jacobi-Bellman residual error is introduced to obtain the significance of weights in an online mode to overcome the issue of catastrophic forgetting for NNs, and closed-loop stability is analyzed and demonstrated. The effectiveness of the proposed method is shown in simulation by contrasting the proposed with a recent method from the literature on an underactuated unmanned aerial vehicle, covering both its translational and attitude dynamics.","PeriodicalId":504274,"journal":{"name":"Complex Engineering Systems","volume":"40 32","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140449084","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shurendher Kumar Sampathkumar, Daegyun Choi, Donghoon Kim
{"title":"Fuzzy inference system-assisted human-aware navigation framework based on enhanced potential field","authors":"Shurendher Kumar Sampathkumar, Daegyun Choi, Donghoon Kim","doi":"10.20517/ces.2023.34","DOIUrl":"https://doi.org/10.20517/ces.2023.34","url":null,"abstract":"With the advent of Autonomous Mobile Robots (AMRs) in public areas such as malls and airports, their harmonious coexistence with humans is crucial. AMRs must operate in a manner that ensures human safety, comfort, and acceptability to reduce stress. This is called Human Aware Navigation. This study introduces a framework for AMR navigation that prioritizes safety and human comfort in such environments, utilizing an enhanced Potential Field approach augmented by Fuzzy Inference Systems. To achieve a smooth AMR trajectory, the framework employs these systems based on AMR, human, and obstacle information. The proposed approach is tested across various scenarios, including complex, cluttered environments that mimic practical situations. Simulation results demonstrate that AMRs using the proposed method navigate human-rich environments safely and comfortably while mitigating common issues associated with Potential Field-based approaches, such as local minima and obstacles near the goal.","PeriodicalId":504274,"journal":{"name":"Complex Engineering Systems","volume":"24 13","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139531061","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jiawang Yong, Yiyao Dong, Zhilin Zhang, Nenglian Feng, Wanting Li
{"title":"Integrated control of anti-lock and regenerative braking for in-wheel-motor-driven electric vehicles","authors":"Jiawang Yong, Yiyao Dong, Zhilin Zhang, Nenglian Feng, Wanting Li","doi":"10.20517/ces.2023.36","DOIUrl":"https://doi.org/10.20517/ces.2023.36","url":null,"abstract":"The in-wheel motor is increasingly used in electric vehicles due to the significantly improved controllability, response capability, and energy recovery efficiency based on this technology. However, the independent control of in-wheel motors will lead to braking torque distribution problems, especially in a situation where anti-lock braking systems (ABS) are triggered, which may cause the braking energy to be unrecoverable without the coordinated control between anti-lock and RB for two in-wheel motor-driven electric vehicles based on the RB efficiency map. Control-oriented wheel dynamics and slip ratio models of the system are generated. A sliding mode intervention of regenerative braking (RB) control. This paper presents an integrated algorithm to realize the control-based ABS controller is designed to prevent the wheels from locking and to maintain the slip ratio within a desired level, and the stability and robustness of the controller to uncertainties and disturbances are discussed. Moreover, the braking strength of the driver is calculated and divided into different modes to derive a dynamic braking torque distribution to improve the energy recovery efficiency. The hardware-in-the-loop simulation results show that the recovered energy of the proposed strategy under ABS-triggered maneuver is increased by 52.9% than that of the Proportional, Integral, and Derivative controller and can effectively improve the braking performance and stability.","PeriodicalId":504274,"journal":{"name":"Complex Engineering Systems","volume":"48 19","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139533203","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Adaptive neural control for delayed discrete-time switched systems under deception attacks","authors":"Dongke Zhao, Yongjie Tian, Ning Zhao","doi":"10.20517/ces.2023.29","DOIUrl":"https://doi.org/10.20517/ces.2023.29","url":null,"abstract":"This paper focuses on the issue of adaptive neural control for discrete-time switched systems with time delay and deception attacks. Firstly, the switching signal is constrained by the dwell time. Considering that the deception attacks are unknown, the neural network technique is employed to approximate the attack signals. Then, an adaptive state feedback controller is established to compensate for the adverse effects of deception attacks for switched systems. Meanwhile, sufficient conditions for the boundedness of the switched system are given through the Lyapunov functional method, and the controller gains can be obtained by resolving the linear matrix inequality. Finally, the feasibility of the proposed method is illustrated via a numerical example.","PeriodicalId":504274,"journal":{"name":"Complex Engineering Systems","volume":"20 15","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139455887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Non-fragile state estimation for reaction-diffusion genetic regulatory networks with mode-dependent timevarying delays","authors":"Jiarui Liu, Shuai Song, Yulong Song, Xiaona Song","doi":"10.20517/ces.2023.32","DOIUrl":"https://doi.org/10.20517/ces.2023.32","url":null,"abstract":"This paper investigates the problem of non-fragile state estimation for a class of reaction-diffusion genetic regulatory networks with mode-dependent time-varying delays and Markovian jump parameters. First, the Markov chain with partially unknown probabilities is used in this paper to describe the switching between system modes, which can make the model more generalizable. Moreover, considering the possible gain variations, we design a non-fragile state estimator that makes the estimation performance non-fragile to gain variations, thus guaranteeing the estimation performance. Sufficient conditions that ensure the asymptotic stability of the estimation error can be derived by using the Lyapunov stabilization theory and several inequality treatments. Finally, a simulation example is presented to demonstrate the effectiveness of the proposed estimator design scheme.","PeriodicalId":504274,"journal":{"name":"Complex Engineering Systems","volume":"23 9","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139167652","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}