RTFVE-YOLOv9:结合YOLOv9和双目立体视觉的水果体积实时估计模型

IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY
Wenlong Yi , Shuokang Xia , Sergey Kuzmin , Igor Gerasimov , Xiangping Cheng
{"title":"RTFVE-YOLOv9:结合YOLOv9和双目立体视觉的水果体积实时估计模型","authors":"Wenlong Yi ,&nbsp;Shuokang Xia ,&nbsp;Sergey Kuzmin ,&nbsp;Igor Gerasimov ,&nbsp;Xiangping Cheng","doi":"10.1016/j.compag.2025.110401","DOIUrl":null,"url":null,"abstract":"<div><div>This study proposes a real-time fruit volume estimation model based on YOLOv9 (RTFVE-YOLOv9) and binocular stereo vision technology to address the challenges of low automation and insufficient accuracy in fruit volume measurement in complex orchard environments, particularly in scenarios with diverse canopy structures and severe branch-leaf occlusion. The model achieves effective recognition of occluded fruits through the innovative design of a Dual-Scale and Global–Local Sequence (DSGLSeq) module while incorporating a Multi-Head and Multi-Scale Self-Interaction (MHMSI) module to improve the detection performance of small fruit targets. Systematic validation experiments conducted on major economic fruit tree varieties, including apples, pears, pomelos, and kiwifruit, demonstrate that RTFVE-YOLOv9 improved the mean Average Precision (mAP) by 2.1%, 1.6%, 4%, and 3.8% respectively on the four fruit datasets compared to the baseline YOLOv9-c model. The model’s internal working mechanisms were thoroughly revealed through multi-dimensional evaluation, including ablation experiments, Heatmap Analysis, and Effective Receptive Field (ERF) analysis, providing a theoretical foundation for subsequent optimization. The research findings enrich the application theory of computer vision in smart agriculture and provide reliable technical support for achieving precise orchard management.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"236 ","pages":"Article 110401"},"PeriodicalIF":7.7000,"publicationDate":"2025-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"RTFVE-YOLOv9: Real-time fruit volume estimation model integrating YOLOv9 and binocular stereo vision\",\"authors\":\"Wenlong Yi ,&nbsp;Shuokang Xia ,&nbsp;Sergey Kuzmin ,&nbsp;Igor Gerasimov ,&nbsp;Xiangping Cheng\",\"doi\":\"10.1016/j.compag.2025.110401\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>This study proposes a real-time fruit volume estimation model based on YOLOv9 (RTFVE-YOLOv9) and binocular stereo vision technology to address the challenges of low automation and insufficient accuracy in fruit volume measurement in complex orchard environments, particularly in scenarios with diverse canopy structures and severe branch-leaf occlusion. The model achieves effective recognition of occluded fruits through the innovative design of a Dual-Scale and Global–Local Sequence (DSGLSeq) module while incorporating a Multi-Head and Multi-Scale Self-Interaction (MHMSI) module to improve the detection performance of small fruit targets. Systematic validation experiments conducted on major economic fruit tree varieties, including apples, pears, pomelos, and kiwifruit, demonstrate that RTFVE-YOLOv9 improved the mean Average Precision (mAP) by 2.1%, 1.6%, 4%, and 3.8% respectively on the four fruit datasets compared to the baseline YOLOv9-c model. The model’s internal working mechanisms were thoroughly revealed through multi-dimensional evaluation, including ablation experiments, Heatmap Analysis, and Effective Receptive Field (ERF) analysis, providing a theoretical foundation for subsequent optimization. The research findings enrich the application theory of computer vision in smart agriculture and provide reliable technical support for achieving precise orchard management.</div></div>\",\"PeriodicalId\":50627,\"journal\":{\"name\":\"Computers and Electronics in Agriculture\",\"volume\":\"236 \",\"pages\":\"Article 110401\"},\"PeriodicalIF\":7.7000,\"publicationDate\":\"2025-04-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Electronics in Agriculture\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0168169925005071\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169925005071","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

针对复杂果园环境下,特别是树冠结构多样、枝叶遮挡严重的情况下,果实体积测量自动化程度低、精度不足的问题,提出了一种基于YOLOv9 (RTFVE-YOLOv9)和双目立体视觉技术的果实体积实时估算模型。该模型通过双尺度和全局-局部序列(DSGLSeq)模块的创新设计,实现了对遮挡水果的有效识别,同时结合了头部和多尺度自交互(MHMSI)模块,提高了水果小目标的检测性能。通过对苹果、梨、柚子、猕猴桃等主要经济果树品种进行系统验证实验,结果表明,RTFVE-YOLOv9模型在4种水果数据集上的平均精度(mAP)比基线YOLOv9-c模型分别提高了2.1%、1.6%、4%和3.8%。通过烧蚀实验、热图分析、有效感受野(ERF)分析等多维度评价,全面揭示了模型的内部工作机制,为后续优化提供理论基础。研究成果丰富了计算机视觉在智慧农业中的应用理论,为实现果园精准管理提供了可靠的技术支撑。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
RTFVE-YOLOv9: Real-time fruit volume estimation model integrating YOLOv9 and binocular stereo vision
This study proposes a real-time fruit volume estimation model based on YOLOv9 (RTFVE-YOLOv9) and binocular stereo vision technology to address the challenges of low automation and insufficient accuracy in fruit volume measurement in complex orchard environments, particularly in scenarios with diverse canopy structures and severe branch-leaf occlusion. The model achieves effective recognition of occluded fruits through the innovative design of a Dual-Scale and Global–Local Sequence (DSGLSeq) module while incorporating a Multi-Head and Multi-Scale Self-Interaction (MHMSI) module to improve the detection performance of small fruit targets. Systematic validation experiments conducted on major economic fruit tree varieties, including apples, pears, pomelos, and kiwifruit, demonstrate that RTFVE-YOLOv9 improved the mean Average Precision (mAP) by 2.1%, 1.6%, 4%, and 3.8% respectively on the four fruit datasets compared to the baseline YOLOv9-c model. The model’s internal working mechanisms were thoroughly revealed through multi-dimensional evaluation, including ablation experiments, Heatmap Analysis, and Effective Receptive Field (ERF) analysis, providing a theoretical foundation for subsequent optimization. The research findings enrich the application theory of computer vision in smart agriculture and provide reliable technical support for achieving precise orchard management.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computers and Electronics in Agriculture
Computers and Electronics in Agriculture 工程技术-计算机:跨学科应用
CiteScore
15.30
自引率
14.50%
发文量
800
审稿时长
62 days
期刊介绍: Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信