Detection of a vascular wilt disease in potato (‘Blackleg’) based on UAV hyperspectral imagery: Can structural features from LiDAR or SfM improve plant-wise classification accuracy?
Marston H.D. Franceschini , Benjamin Brede , Jan Kamp , Harm Bartholomeus , Lammert Kooistra
{"title":"Detection of a vascular wilt disease in potato (‘Blackleg’) based on UAV hyperspectral imagery: Can structural features from LiDAR or SfM improve plant-wise classification accuracy?","authors":"Marston H.D. Franceschini , Benjamin Brede , Jan Kamp , Harm Bartholomeus , Lammert Kooistra","doi":"10.1016/j.compag.2024.109527","DOIUrl":null,"url":null,"abstract":"<div><div>Ensuring plant health is a key factor to maximize crop yield. Despite that, the current field scouting and disease monitoring approaches often rely on visual evaluations and are, therefore, subjective and time demanding. New methods to assist in disease detection and severity assessment are required to allow better crop management and higher throughput in field phenotyping studies. With this objective, techniques involving the use of multi- and hyperspectral imagery for retrieval of plant traits and assessment of general crop health status are increasingly being proposed as alternatives to conventional disease monitoring approaches. Conversely, research focusing on specific pathogens are still lacking in many cases, in particular studies investigating multi-source sensing approaches, which have the potential to improve retrieval/classification accuracy. In this study, hyperspectral imagery and point clouds obtained with LiDAR or through Structure from Motion algorithm (SfM) applied to high resolution RGB images were evaluated as possible alternatives to detect Blackleg (caused by bacteria of the genera <em>Pectobacterium</em> and <em>Dickeya</em>) in potato. It was demonstrated that all the different datasets have potential to discriminate healthy from diseased plants. The combination of Vegetation Indices (VIs) derived from hyperspectral images with structural features from LiDAR resulted in the best validation results (Balanced Accuracy – BA = 0.915). Small improvements were also achieved by combining VIs with SfM features (BA = 0.876) in comparison to VIs alone (BA = 0.846). Evaluation of feature importance for classification models derived from the different datasets indicated that after structural features derived from LiDAR or RGB imagery were added as predictor variables the relative importance of VIs for the predictions decreased, in particular for VIs related to LAI or other traits describing canopy properties. Finally, analysis of false negatives and positives indicated some limitations to the predictive potential of the different datasets, with diseased and healthy plants eventually presenting atypical structural and spectral characteristics in comparison to those expected for their classes. Therefore, multi-source sensing, including additional modalities (e.g., thermal or fluorescence), might be required to further improve detection of pathogens with complex symptoms, as those affecting roots, tubers and stems.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"227 ","pages":"Article 109527"},"PeriodicalIF":7.7000,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169924009189","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
Ensuring plant health is a key factor to maximize crop yield. Despite that, the current field scouting and disease monitoring approaches often rely on visual evaluations and are, therefore, subjective and time demanding. New methods to assist in disease detection and severity assessment are required to allow better crop management and higher throughput in field phenotyping studies. With this objective, techniques involving the use of multi- and hyperspectral imagery for retrieval of plant traits and assessment of general crop health status are increasingly being proposed as alternatives to conventional disease monitoring approaches. Conversely, research focusing on specific pathogens are still lacking in many cases, in particular studies investigating multi-source sensing approaches, which have the potential to improve retrieval/classification accuracy. In this study, hyperspectral imagery and point clouds obtained with LiDAR or through Structure from Motion algorithm (SfM) applied to high resolution RGB images were evaluated as possible alternatives to detect Blackleg (caused by bacteria of the genera Pectobacterium and Dickeya) in potato. It was demonstrated that all the different datasets have potential to discriminate healthy from diseased plants. The combination of Vegetation Indices (VIs) derived from hyperspectral images with structural features from LiDAR resulted in the best validation results (Balanced Accuracy – BA = 0.915). Small improvements were also achieved by combining VIs with SfM features (BA = 0.876) in comparison to VIs alone (BA = 0.846). Evaluation of feature importance for classification models derived from the different datasets indicated that after structural features derived from LiDAR or RGB imagery were added as predictor variables the relative importance of VIs for the predictions decreased, in particular for VIs related to LAI or other traits describing canopy properties. Finally, analysis of false negatives and positives indicated some limitations to the predictive potential of the different datasets, with diseased and healthy plants eventually presenting atypical structural and spectral characteristics in comparison to those expected for their classes. Therefore, multi-source sensing, including additional modalities (e.g., thermal or fluorescence), might be required to further improve detection of pathogens with complex symptoms, as those affecting roots, tubers and stems.
期刊介绍:
Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.