A Novel Framework for Multiple Ground Target Detection, Recognition and Inspection in Precision Agriculture Applications Using a UAV

Abstract

Unmanned Aerial Vehicles (UAVs) have been recently used for different civilian applications such as remote sensing, search, and rescue (SAR), precision agriculture (PA), etc. A UAVs ability to sense and find targets remotely and, based on that, hover close to the target for a particular action makes it an ideal platform for the aforementioned applications. There has been extensive work carried out in the field of visual-based detection, navigation, and control, but the problem of detecting different ground targets and performing certain actions is still an open research area. This study proposes a novel framework for multiple target detection, recognition, and navigation of the UAV to the desired target and closely inspect it. This proposed framework can be deployed for accurately spot spraying in PA applications or SAR. The target detection and recognition in the framework are achieved through a computationally efficient Convolutional Neural Network (CNN) trained model, whereas the close inspection of the target is achieved through a PID-based tracking algorithm which ensures the UAV hover around the target for few seconds. The developed framework performed the desired objective in five stages employing Lawson’s control theory of sense, process, compare, decide and act. The target detection and recognition in the framework were validated with the field experiment, while the entire framework was validated through a variety of simulation flights conducted in Gazebo and PX4. The experiments’ results showed the versatility of the developed system to many complex missions where the targets are added or removed.