Övünç Öztürk, Bora Canbula, Tuğba Özacar, Vehbi Özacar
{"title":"Lesion-Aware Multiple-Instance Learning for Grapevine Disease Recognition from Field RGB Images.","authors":"Övünç Öztürk, Bora Canbula, Tuğba Özacar, Vehbi Özacar","doi":"10.3390/s26196318","DOIUrl":null,"url":null,"abstract":"<p><p>This retrospective offline study examines how dense manual regional annotations can be organized for image-level grapevine disease recognition using pre-acquired HERMOS RGB images. After audit and filtering, 491 source images and 13,765 Pascal VOC regions were retained. A leakage-safe source-image split was used across full-image classification, regional crop classification, crop-to-image aggregation, annotation-guided multiple-instance learning (MIL), and YOLO11 localization. MIL bags in training, validation, and testing were constructed from crops derived from manual boxes; the results therefore describe annotation-assisted aggregation rather than raw-image deployment. The original ConvNeXt-Tiny MIL model achieved macro-F1 0.922 (95% source-image bootstrap CI 0.882-0.956), compared with 0.836 (0.754-0.895) for full-image ConvNeXt-Tiny and 0.869 (0.804-0.917) for the best fixed crop aggregation. Paired macro-F1 differences favored MIL over these baselines by 0.087 (95% CI 0.029-0.163; Holm-adjusted <i>p</i> = 0.013) and 0.053 (0.005-0.114; adjusted <i>p</i> = 0.036), respectively. Downy mildew precision and recall were 1.000 on nine positive test images, but the corresponding exact 95% binomial intervals were 0.664-1.000. Controlled ablations produced lower point estimates without learned attention or the auxiliary instance loss, whereas removing context expansion did not reduce performance; none of the three paired ablation tests was significant after Holm correction. Increasing detector capacity from YOLO11n to YOLO11s did not improve full-image mAP@0.50 (0.175 versus 0.170). These findings support annotation-guided local-evidence aggregation as an offline exploratory benchmark, while not establishing split-to-split stability, computational efficiency, or external-vineyard generalization.</p>","PeriodicalId":21698,"journal":{"name":"Sensors","volume":"26 19","pages":""},"PeriodicalIF":4.0000,"publicationDate":"2026-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13667579/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Sensors","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.3390/s26196318","RegionNum":3,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CHEMISTRY, ANALYTICAL","Score":null,"Total":0}
引用次数: 0
Abstract
This retrospective offline study examines how dense manual regional annotations can be organized for image-level grapevine disease recognition using pre-acquired HERMOS RGB images. After audit and filtering, 491 source images and 13,765 Pascal VOC regions were retained. A leakage-safe source-image split was used across full-image classification, regional crop classification, crop-to-image aggregation, annotation-guided multiple-instance learning (MIL), and YOLO11 localization. MIL bags in training, validation, and testing were constructed from crops derived from manual boxes; the results therefore describe annotation-assisted aggregation rather than raw-image deployment. The original ConvNeXt-Tiny MIL model achieved macro-F1 0.922 (95% source-image bootstrap CI 0.882-0.956), compared with 0.836 (0.754-0.895) for full-image ConvNeXt-Tiny and 0.869 (0.804-0.917) for the best fixed crop aggregation. Paired macro-F1 differences favored MIL over these baselines by 0.087 (95% CI 0.029-0.163; Holm-adjusted p = 0.013) and 0.053 (0.005-0.114; adjusted p = 0.036), respectively. Downy mildew precision and recall were 1.000 on nine positive test images, but the corresponding exact 95% binomial intervals were 0.664-1.000. Controlled ablations produced lower point estimates without learned attention or the auxiliary instance loss, whereas removing context expansion did not reduce performance; none of the three paired ablation tests was significant after Holm correction. Increasing detector capacity from YOLO11n to YOLO11s did not improve full-image mAP@0.50 (0.175 versus 0.170). These findings support annotation-guided local-evidence aggregation as an offline exploratory benchmark, while not establishing split-to-split stability, computational efficiency, or external-vineyard generalization.
期刊介绍:
Sensors (ISSN 1424-8220) provides an advanced forum for the science and technology of sensors and biosensors. It publishes reviews (including comprehensive reviews on the complete sensors products), regular research papers and short notes. Our aim is to encourage scientists to publish their experimental and theoretical results in as much detail as possible. There is no restriction on the length of the papers. The full experimental details must be provided so that the results can be reproduced.