Emmanuel ZE Butsana;Zahid Rashid Sheikh;Navid Yazdi
{"title":"Deep Learning-Based Image Analysis for Automated Fruit Sizing","authors":"Emmanuel ZE Butsana;Zahid Rashid Sheikh;Navid Yazdi","doi":"10.1109/TAFE.2026.3718736","DOIUrl":null,"url":null,"abstract":"Accurate fruit sizing is a critical task in the agricultural supply chain, but current methods are either labor-intensive or rely on expensive, calibration-sensitive hardware. This study develops and evaluates a novel, low-cost deep learning framework for automated tomato circumference estimation using multiview RGB imagery and an embedded physical scale reference. A dataset of tomato images from two orthogonal viewpoints was captured using a smartphone, and a custom-designed gridded marker was applied to provide an embedded reference for scale and local curvature. A dual-branch convolutional neural network (CNN) based on EfficientNet-B1 was trained to regress circumference by fusing image features with extracted geometric metadata, such as curvature, eccentricity, and scale factor. The proposed dual-view model, which integrates the reference marker and extracted geometric features, achieved high accuracy, yielding an mean absolute error (MAE) of 3.70 mm (1.46% MAPE). This result represents a 55% improvement in MAE over the single-view baseline (8.19 mm MAE), and establishes a highly competitive relative percentage error (1.46% MAPE) that outperforms recent state of the art depth-sensing and artificial intelligence pipelines. The fusion of image features with metadata was found to be critical, as dual-view models without these features failed to converge effectively. The study concludes that the fusion of multiview geometric constraints with explicit, marker-derived physical scale cues is essential for achieving high-accuracy, low-cost fruit sizing. This framework presents a viable, scalable, and low-cost alternative to complex depth-sensing or stereo-vision systems, enabling field-deployable, millimeter-scale fruit sizing using only standard RGB cameras. Using this method, we achieve a 36% increase in accuracy compared to approaches relying on 3-D vision systems and outperform existing automated RGB vision systems.","PeriodicalId":100637,"journal":{"name":"IEEE Transactions on AgriFood Electronics","volume":"4 2","pages":"720-732"},"PeriodicalIF":0.0000,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11667678","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on AgriFood Electronics","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/11667678/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/8/26 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Accurate fruit sizing is a critical task in the agricultural supply chain, but current methods are either labor-intensive or rely on expensive, calibration-sensitive hardware. This study develops and evaluates a novel, low-cost deep learning framework for automated tomato circumference estimation using multiview RGB imagery and an embedded physical scale reference. A dataset of tomato images from two orthogonal viewpoints was captured using a smartphone, and a custom-designed gridded marker was applied to provide an embedded reference for scale and local curvature. A dual-branch convolutional neural network (CNN) based on EfficientNet-B1 was trained to regress circumference by fusing image features with extracted geometric metadata, such as curvature, eccentricity, and scale factor. The proposed dual-view model, which integrates the reference marker and extracted geometric features, achieved high accuracy, yielding an mean absolute error (MAE) of 3.70 mm (1.46% MAPE). This result represents a 55% improvement in MAE over the single-view baseline (8.19 mm MAE), and establishes a highly competitive relative percentage error (1.46% MAPE) that outperforms recent state of the art depth-sensing and artificial intelligence pipelines. The fusion of image features with metadata was found to be critical, as dual-view models without these features failed to converge effectively. The study concludes that the fusion of multiview geometric constraints with explicit, marker-derived physical scale cues is essential for achieving high-accuracy, low-cost fruit sizing. This framework presents a viable, scalable, and low-cost alternative to complex depth-sensing or stereo-vision systems, enabling field-deployable, millimeter-scale fruit sizing using only standard RGB cameras. Using this method, we achieve a 36% increase in accuracy compared to approaches relying on 3-D vision systems and outperform existing automated RGB vision systems.
准确的水果分级是农业供应链中的一项关键任务,但目前的方法要么是劳动密集型的,要么依赖于昂贵的校准敏感硬件。本研究开发并评估了一种新的、低成本的深度学习框架,用于使用多视图RGB图像和嵌入式物理尺度参考来自动估计番茄周长。使用智能手机捕获两个正交视点的番茄图像数据集,并使用定制设计的网格标记为尺度和局部曲率提供嵌入式参考。基于EfficientNet-B1的双分支卷积神经网络(CNN)通过融合图像特征和提取的几何元数据(如曲率、偏心和比例因子)来回归周长。该模型结合了参考标记和提取的几何特征,获得了较高的精度,平均绝对误差(MAE)为3.70 mm (1.46% MAPE)。这一结果表明,与单视图基线(8.19 mm MAE)相比,MAE提高了55%,并建立了一个极具竞争力的相对百分比误差(1.46% MAPE),优于最新的深度传感和人工智能管道。图像特征与元数据的融合至关重要,因为没有这些特征的双视图模型无法有效收敛。该研究得出结论,多视角几何约束与明确的、标记衍生的物理尺度线索的融合对于实现高精度、低成本的水果尺寸至关重要。该框架为复杂的深度传感或立体视觉系统提供了一种可行的、可扩展的、低成本的替代方案,仅使用标准RGB相机就可以实现现场部署的毫米级水果尺寸。使用这种方法,与依赖于3d视觉系统的方法相比,我们实现了36%的精度提高,并且优于现有的自动化RGB视觉系统。