Shaolong Zhu, Weijun Zhang, Tianle Yang, Fei Wu, Yihan Jiang, Guanshuo Yang, Muhammad Zain, Yuanyuan Zhao, Zhaosheng Yao, Tao Liu, Chengming Sun
{"title":"结合二维图像和点云深度学习预测小麦地上生物量","authors":"Shaolong Zhu, Weijun Zhang, Tianle Yang, Fei Wu, Yihan Jiang, Guanshuo Yang, Muhammad Zain, Yuanyuan Zhao, Zhaosheng Yao, Tao Liu, Chengming Sun","doi":"10.1007/s11119-024-10186-1","DOIUrl":null,"url":null,"abstract":"<h3 data-test=\"abstract-sub-heading\">Purpose</h3><p>The use of Unmanned aerial vehicle (UAV) data for predicting crop above-ground biomass (AGB) is becoming a more feasible alternative to destructive methods. However, canopy height, vegetation index (VI), and other traditional features can become saturated during the mid to late stages of crop growth, significantly impacting the accuracy of AGB prediction.</p><h3 data-test=\"abstract-sub-heading\">Methods</h3><p> In 2022 and 2023, UAV multispectral, RGB, and light detection and ranging point cloud data of wheat populations were collected at seven growth stages across two experimental fields. The point cloud depth features were extracted using the improved PointNet++ network, and AGB was predicted by fusion with VI, color index (CI), and texture index (TI) raster image features.</p><h3 data-test=\"abstract-sub-heading\">Results</h3><p>The findings indicate that when the point cloud depth features were fused, the <i>R</i><sup>2</sup> values predicted from VI, CI, TI, and canopy height model images increased by 0.05, 0.08, 0.06, and 0.07, respectively. For the combination of VI, CI, and TI, <i>R</i><sup>2</sup> increased from 0.86 to a maximum of 0.9, while the root-mean-square error (RMSE) and mean absolute error were 1.80 t ha<sup>−1</sup> and 1.36 t ha<sup>−1</sup>, respectively. Additionally, our findings revealed that the hybrid fusion exhibits the highest accuracy, it demonstrates robust adaptability in predicting AGB across various years, growth stages, crop varieties, nitrogen fertilizer applications, and densities.</p><h3 data-test=\"abstract-sub-heading\">Conclusion</h3><p> This study effectively addresses the saturation in spectral and chemical information, provides valuable insights for high-precision phenotyping and advanced crop field management, and serves as a reference for studying other crops and phenotypic parameters. </p>","PeriodicalId":20423,"journal":{"name":"Precision Agriculture","volume":"72 1","pages":""},"PeriodicalIF":5.4000,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Combining 2D image and point cloud deep learning to predict wheat above ground biomass\",\"authors\":\"Shaolong Zhu, Weijun Zhang, Tianle Yang, Fei Wu, Yihan Jiang, Guanshuo Yang, Muhammad Zain, Yuanyuan Zhao, Zhaosheng Yao, Tao Liu, Chengming Sun\",\"doi\":\"10.1007/s11119-024-10186-1\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<h3 data-test=\\\"abstract-sub-heading\\\">Purpose</h3><p>The use of Unmanned aerial vehicle (UAV) data for predicting crop above-ground biomass (AGB) is becoming a more feasible alternative to destructive methods. However, canopy height, vegetation index (VI), and other traditional features can become saturated during the mid to late stages of crop growth, significantly impacting the accuracy of AGB prediction.</p><h3 data-test=\\\"abstract-sub-heading\\\">Methods</h3><p> In 2022 and 2023, UAV multispectral, RGB, and light detection and ranging point cloud data of wheat populations were collected at seven growth stages across two experimental fields. The point cloud depth features were extracted using the improved PointNet++ network, and AGB was predicted by fusion with VI, color index (CI), and texture index (TI) raster image features.</p><h3 data-test=\\\"abstract-sub-heading\\\">Results</h3><p>The findings indicate that when the point cloud depth features were fused, the <i>R</i><sup>2</sup> values predicted from VI, CI, TI, and canopy height model images increased by 0.05, 0.08, 0.06, and 0.07, respectively. For the combination of VI, CI, and TI, <i>R</i><sup>2</sup> increased from 0.86 to a maximum of 0.9, while the root-mean-square error (RMSE) and mean absolute error were 1.80 t ha<sup>−1</sup> and 1.36 t ha<sup>−1</sup>, respectively. Additionally, our findings revealed that the hybrid fusion exhibits the highest accuracy, it demonstrates robust adaptability in predicting AGB across various years, growth stages, crop varieties, nitrogen fertilizer applications, and densities.</p><h3 data-test=\\\"abstract-sub-heading\\\">Conclusion</h3><p> This study effectively addresses the saturation in spectral and chemical information, provides valuable insights for high-precision phenotyping and advanced crop field management, and serves as a reference for studying other crops and phenotypic parameters. </p>\",\"PeriodicalId\":20423,\"journal\":{\"name\":\"Precision Agriculture\",\"volume\":\"72 1\",\"pages\":\"\"},\"PeriodicalIF\":5.4000,\"publicationDate\":\"2024-09-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Precision Agriculture\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://doi.org/10.1007/s11119-024-10186-1\",\"RegionNum\":2,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Precision Agriculture","FirstCategoryId":"97","ListUrlMain":"https://doi.org/10.1007/s11119-024-10186-1","RegionNum":2,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
Combining 2D image and point cloud deep learning to predict wheat above ground biomass
Purpose
The use of Unmanned aerial vehicle (UAV) data for predicting crop above-ground biomass (AGB) is becoming a more feasible alternative to destructive methods. However, canopy height, vegetation index (VI), and other traditional features can become saturated during the mid to late stages of crop growth, significantly impacting the accuracy of AGB prediction.
Methods
In 2022 and 2023, UAV multispectral, RGB, and light detection and ranging point cloud data of wheat populations were collected at seven growth stages across two experimental fields. The point cloud depth features were extracted using the improved PointNet++ network, and AGB was predicted by fusion with VI, color index (CI), and texture index (TI) raster image features.
Results
The findings indicate that when the point cloud depth features were fused, the R2 values predicted from VI, CI, TI, and canopy height model images increased by 0.05, 0.08, 0.06, and 0.07, respectively. For the combination of VI, CI, and TI, R2 increased from 0.86 to a maximum of 0.9, while the root-mean-square error (RMSE) and mean absolute error were 1.80 t ha−1 and 1.36 t ha−1, respectively. Additionally, our findings revealed that the hybrid fusion exhibits the highest accuracy, it demonstrates robust adaptability in predicting AGB across various years, growth stages, crop varieties, nitrogen fertilizer applications, and densities.
Conclusion
This study effectively addresses the saturation in spectral and chemical information, provides valuable insights for high-precision phenotyping and advanced crop field management, and serves as a reference for studying other crops and phenotypic parameters.
期刊介绍:
Precision Agriculture promotes the most innovative results coming from the research in the field of precision agriculture. It provides an effective forum for disseminating original and fundamental research and experience in the rapidly advancing area of precision farming.
There are many topics in the field of precision agriculture; therefore, the topics that are addressed include, but are not limited to:
Natural Resources Variability: Soil and landscape variability, digital elevation models, soil mapping, geostatistics, geographic information systems, microclimate, weather forecasting, remote sensing, management units, scale, etc.
Managing Variability: Sampling techniques, site-specific nutrient and crop protection chemical recommendation, crop quality, tillage, seed density, seed variety, yield mapping, remote sensing, record keeping systems, data interpretation and use, crops (corn, wheat, sugar beets, potatoes, peanut, cotton, vegetables, etc.), management scale, etc.
Engineering Technology: Computers, positioning systems, DGPS, machinery, tillage, planting, nutrient and crop protection implements, manure, irrigation, fertigation, yield monitor and mapping, soil physical and chemical characteristic sensors, weed/pest mapping, etc.
Profitability: MEY, net returns, BMPs, optimum recommendations, crop quality, technology cost, sustainability, social impacts, marketing, cooperatives, farm scale, crop type, etc.
Environment: Nutrient, crop protection chemicals, sediments, leaching, runoff, practices, field, watershed, on/off farm, artificial drainage, ground water, surface water, etc.
Technology Transfer: Skill needs, education, training, outreach, methods, surveys, agri-business, producers, distance education, Internet, simulations models, decision support systems, expert systems, on-farm experimentation, partnerships, quality of rural life, etc.