Reinforcement Learning-Based Online Estimation of the Inductances of the Permanent Magnet Synchronous Machines

Abstract

This article proposes a novel method to estimate the d- and q-axis inductances of the permanent magnet synchronous machine (PMSM) based on reinforcement learning (RL) algorithms. The main challenges in online inductance estimation are the nonlinearity of the inverter and the complex dependence of machine inductances on the operating d- and q-axis currents. A feedforward neural network (FNN) was developed and trained to compensate for the nonlinearity of the inverter in the measured d- and q-axis voltages. The twin-delayed deep deterministic (TD3) policy gradient RL-based estimator was developed and trained to identify the machine inductances in real time using the compensated d- and q-axis voltages, the measured d- and q-axis currents, and the rotor speed, allowing high flexibility to adapt to variations in the system during operation by retraining with updated data. The proposed technique was experimentally validated and demonstrated high estimation accuracy under critical operating conditions, including full load variation, field weakening, and speed changes. The simulation and experimental results also showed that the proposed approach outperforms the conventional recursive least squares (RLS) and Adaline neural network (ANN) methods, achieving over 10% improvement in estimation accuracy and enhanced robustness against the inverter’s nonlinearity.