Jianing Shen , Jibo Yue , Yang Liu , Yihan Yao , Haikuan Feng , Hao Yang , Wei Guo , Xinming Ma , Yuanyuan Fu , Meiyan Shu , Guijun Yang , Hongbo Qiao
{"title":"利用无人机、UGV和深度学习分析玉米茎周长、茎高和茎周高比","authors":"Jianing Shen , Jibo Yue , Yang Liu , Yihan Yao , Haikuan Feng , Hao Yang , Wei Guo , Xinming Ma , Yuanyuan Fu , Meiyan Shu , Guijun Yang , Hongbo Qiao","doi":"10.1016/j.compag.2025.111019","DOIUrl":null,"url":null,"abstract":"<div><div>Maize (Zea mays L.) is a crucial grain and economic crop with extensive applications in food, feed, and industry. Phenotypic traits such as stem circumference (SC), stem height (SH), and the stem circumference-to-height ratio (SCHR) are essential indicators for studying maize development, environmental adaptation, and lodging resistance. Traditional manual measurement methods are inefficient, costly, and unsuitable for large-scale phenotypic monitoring. While unmanned aerial vehicle (UAV)-based approaches have achieved relatively accurate SH estimation, SC estimation remains challenging using UAV technology alone, limiting SCHR estimation. This study combined digital camera sensors on unmanned ground vehicle (UGV) and UAV platforms to capture maize stem and canopy images, enabling the estimation of SC, SH, and SCHR. The primary contributions of this study are as follows: (1) We propose the maize-stem segmentation network for calculating stem diameter and circumference (MSSDCNet) to segment maize stems in images and estimate SC based on the segmentation results. (2) We process UAV-derived digital surface models to extract SH information and employ a linear regression (LR) model for SH estimation. (3) Using the estimated SC and SH, we calculate SCHR and analyze its temporal variations across different growth stages. The results demonstrate that: (1) MSSDCNet accurately segments maize stems from images and facilitates SC estimation (<em>R<sup>2</sup></em> = 0.759, <em>RMSE</em> = 0.414 cm, <em>nRMSE</em> = 0.087). Temporal analysis of SC reveals a gradual decrease during the reproductive growth stage, potentially due to the transfer of photosynthetic products to the maize cob and stem water loss. (2) This study accurately estimated SH (<em>R</em><sup>2</sup> = 0.941, <em>RMSE</em> = 0.151 m, <em>nRMSE</em> = 0.078). However, SH estimates during the reproductive growth stage tend to be underestimated, likely due to DSM point clouds being more sensitive to sharp features such as tassels. (3) SCHR estimation achieves <em>R</em><sup>2</sup> = 0.453, <em>RMSE</em> = 2.287 × 10<sup>−3</sup>, <em>nRMSE</em> = 0.136. Temporal analysis reveals a general decline in SCHR from the kernel blister stage to the dough stage, with some maize materials consistently exhibiting lower SCHR levels during each growth stage. This may be related to genetic traits, planting density, soil fertility, or other environmental factors. By integrating UGV-based maize stem images and UAV-based maize canopy images with MSSDCNet and LR, this study successfully estimates SC, SH, and SCHR for various maize materials. This study provides a novel technique for maize, early lodging risk prediction, and lodging-resistant breeding lines screening, contributing to rapid and efficient maize phenotypic monitoring under field conditions.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"239 ","pages":"Article 111019"},"PeriodicalIF":8.9000,"publicationDate":"2025-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Analyzing maize stem circumference, stem height, and stem circumference-to-height ratio using UAV, UGV, and deep learning\",\"authors\":\"Jianing Shen , Jibo Yue , Yang Liu , Yihan Yao , Haikuan Feng , Hao Yang , Wei Guo , Xinming Ma , Yuanyuan Fu , Meiyan Shu , Guijun Yang , Hongbo Qiao\",\"doi\":\"10.1016/j.compag.2025.111019\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Maize (Zea mays L.) is a crucial grain and economic crop with extensive applications in food, feed, and industry. Phenotypic traits such as stem circumference (SC), stem height (SH), and the stem circumference-to-height ratio (SCHR) are essential indicators for studying maize development, environmental adaptation, and lodging resistance. Traditional manual measurement methods are inefficient, costly, and unsuitable for large-scale phenotypic monitoring. While unmanned aerial vehicle (UAV)-based approaches have achieved relatively accurate SH estimation, SC estimation remains challenging using UAV technology alone, limiting SCHR estimation. This study combined digital camera sensors on unmanned ground vehicle (UGV) and UAV platforms to capture maize stem and canopy images, enabling the estimation of SC, SH, and SCHR. The primary contributions of this study are as follows: (1) We propose the maize-stem segmentation network for calculating stem diameter and circumference (MSSDCNet) to segment maize stems in images and estimate SC based on the segmentation results. (2) We process UAV-derived digital surface models to extract SH information and employ a linear regression (LR) model for SH estimation. (3) Using the estimated SC and SH, we calculate SCHR and analyze its temporal variations across different growth stages. The results demonstrate that: (1) MSSDCNet accurately segments maize stems from images and facilitates SC estimation (<em>R<sup>2</sup></em> = 0.759, <em>RMSE</em> = 0.414 cm, <em>nRMSE</em> = 0.087). Temporal analysis of SC reveals a gradual decrease during the reproductive growth stage, potentially due to the transfer of photosynthetic products to the maize cob and stem water loss. (2) This study accurately estimated SH (<em>R</em><sup>2</sup> = 0.941, <em>RMSE</em> = 0.151 m, <em>nRMSE</em> = 0.078). However, SH estimates during the reproductive growth stage tend to be underestimated, likely due to DSM point clouds being more sensitive to sharp features such as tassels. (3) SCHR estimation achieves <em>R</em><sup>2</sup> = 0.453, <em>RMSE</em> = 2.287 × 10<sup>−3</sup>, <em>nRMSE</em> = 0.136. Temporal analysis reveals a general decline in SCHR from the kernel blister stage to the dough stage, with some maize materials consistently exhibiting lower SCHR levels during each growth stage. This may be related to genetic traits, planting density, soil fertility, or other environmental factors. By integrating UGV-based maize stem images and UAV-based maize canopy images with MSSDCNet and LR, this study successfully estimates SC, SH, and SCHR for various maize materials. This study provides a novel technique for maize, early lodging risk prediction, and lodging-resistant breeding lines screening, contributing to rapid and efficient maize phenotypic monitoring under field conditions.</div></div>\",\"PeriodicalId\":50627,\"journal\":{\"name\":\"Computers and Electronics in Agriculture\",\"volume\":\"239 \",\"pages\":\"Article 111019\"},\"PeriodicalIF\":8.9000,\"publicationDate\":\"2025-09-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Electronics in Agriculture\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0168169925011251\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169925011251","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
Analyzing maize stem circumference, stem height, and stem circumference-to-height ratio using UAV, UGV, and deep learning
Maize (Zea mays L.) is a crucial grain and economic crop with extensive applications in food, feed, and industry. Phenotypic traits such as stem circumference (SC), stem height (SH), and the stem circumference-to-height ratio (SCHR) are essential indicators for studying maize development, environmental adaptation, and lodging resistance. Traditional manual measurement methods are inefficient, costly, and unsuitable for large-scale phenotypic monitoring. While unmanned aerial vehicle (UAV)-based approaches have achieved relatively accurate SH estimation, SC estimation remains challenging using UAV technology alone, limiting SCHR estimation. This study combined digital camera sensors on unmanned ground vehicle (UGV) and UAV platforms to capture maize stem and canopy images, enabling the estimation of SC, SH, and SCHR. The primary contributions of this study are as follows: (1) We propose the maize-stem segmentation network for calculating stem diameter and circumference (MSSDCNet) to segment maize stems in images and estimate SC based on the segmentation results. (2) We process UAV-derived digital surface models to extract SH information and employ a linear regression (LR) model for SH estimation. (3) Using the estimated SC and SH, we calculate SCHR and analyze its temporal variations across different growth stages. The results demonstrate that: (1) MSSDCNet accurately segments maize stems from images and facilitates SC estimation (R2 = 0.759, RMSE = 0.414 cm, nRMSE = 0.087). Temporal analysis of SC reveals a gradual decrease during the reproductive growth stage, potentially due to the transfer of photosynthetic products to the maize cob and stem water loss. (2) This study accurately estimated SH (R2 = 0.941, RMSE = 0.151 m, nRMSE = 0.078). However, SH estimates during the reproductive growth stage tend to be underestimated, likely due to DSM point clouds being more sensitive to sharp features such as tassels. (3) SCHR estimation achieves R2 = 0.453, RMSE = 2.287 × 10−3, nRMSE = 0.136. Temporal analysis reveals a general decline in SCHR from the kernel blister stage to the dough stage, with some maize materials consistently exhibiting lower SCHR levels during each growth stage. This may be related to genetic traits, planting density, soil fertility, or other environmental factors. By integrating UGV-based maize stem images and UAV-based maize canopy images with MSSDCNet and LR, this study successfully estimates SC, SH, and SCHR for various maize materials. This study provides a novel technique for maize, early lodging risk prediction, and lodging-resistant breeding lines screening, contributing to rapid and efficient maize phenotypic monitoring under field conditions.
期刊介绍:
Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.