Policy iteration-based integral reinforcement learning for online adaptive trajectory tracking of mobile robot

Abstract

This paper considers trajectory tracking control for a nonholonomic mobile robot using integral reinforcement learning (IRL) based on a value functional represented by integrating a local cost. The tracking error dynamics between the robot and reference trajectories takes the form of time-invariant input-affine continuous-time nonlinear systems if the reference trajectory counterpart of the translational and angular velocities are constant. This paper applies integral reinforcement learning to the tracking error dynamics by approximating the value functional from the data collected along the robot trajectory. The paper proposes a specific procedure to implement the IRL-based policy iteration online, including a batch least-squares minimization. The approximate value function updates the control policy to compensate for the translational and angular velocities that drive the robot. Numerical examples illustrate to demonstrate the tracking performance of integral reinforcement learning.