{"title":"In situ volume measurement of dairy cattle via neural radiance fields-based 3D reconstruction","authors":"Xueyao Jing , Tingting Wu , Peng Shen , Zhiqian Chen , Hanyue Jia , Huaibo Song","doi":"10.1016/j.biosystemseng.2024.12.009","DOIUrl":null,"url":null,"abstract":"<div><div>Accurate body measurements in dairy farming are labour-intensive and stressful for animals. A more efficient, animal-friendly method for <em>in situ</em> measuring is strongly needed. This study proposes a novel non-contact 3D volume measurement technique for dairy cows using Neural Radiance Fields (NeRF) and short videos captured with a mobile phone. First, multi-view point matching was performed to calculate the camera pose from the sequence of video-extracted images. Then, given that NeRF represented the latest advancement in 3D reconstruction with significant advantages, it was introduced for the first time in the reconstruction of cows. Multi-resolution Hash encoding and Neural Signed Distance Functions (SDF) were employed for refined surface reconstruction. Finally, to achieve accurate volume calculations, Poisson reconstruction and local triangulation were used as specific post-processing techniques to form a closed envelope around the cow's trunk. The measuring effectiveness of the method was verified through two experiments conducted on a sample of 13 cows in a commercial dairy farm. Results showed that Peak Signal-to-noise Ratios were above 25, confirming that the proposed method exhibited a high degree of fidelity to the actual live cow. Coefficient of variation below 2% for 10 measurements on a same cow demonstrated high reproducibility. Comparing this method with a laser-scanned resin cow model yielded a relative error that was found to be 1.25%, demonstrating the method's reliability. This innovative approach provided a reliable and efficient solution for non-contact live cow volume measurement, without the need for additional devices, highlighting its potential to improve herd management through precise volumetric data.</div></div>","PeriodicalId":9173,"journal":{"name":"Biosystems Engineering","volume":"250 ","pages":"Pages 105-116"},"PeriodicalIF":4.4000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biosystems Engineering","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1537511024002824","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURAL ENGINEERING","Score":null,"Total":0}
引用次数: 0
Abstract
Accurate body measurements in dairy farming are labour-intensive and stressful for animals. A more efficient, animal-friendly method for in situ measuring is strongly needed. This study proposes a novel non-contact 3D volume measurement technique for dairy cows using Neural Radiance Fields (NeRF) and short videos captured with a mobile phone. First, multi-view point matching was performed to calculate the camera pose from the sequence of video-extracted images. Then, given that NeRF represented the latest advancement in 3D reconstruction with significant advantages, it was introduced for the first time in the reconstruction of cows. Multi-resolution Hash encoding and Neural Signed Distance Functions (SDF) were employed for refined surface reconstruction. Finally, to achieve accurate volume calculations, Poisson reconstruction and local triangulation were used as specific post-processing techniques to form a closed envelope around the cow's trunk. The measuring effectiveness of the method was verified through two experiments conducted on a sample of 13 cows in a commercial dairy farm. Results showed that Peak Signal-to-noise Ratios were above 25, confirming that the proposed method exhibited a high degree of fidelity to the actual live cow. Coefficient of variation below 2% for 10 measurements on a same cow demonstrated high reproducibility. Comparing this method with a laser-scanned resin cow model yielded a relative error that was found to be 1.25%, demonstrating the method's reliability. This innovative approach provided a reliable and efficient solution for non-contact live cow volume measurement, without the need for additional devices, highlighting its potential to improve herd management through precise volumetric data.
期刊介绍:
Biosystems Engineering publishes research in engineering and the physical sciences that represent advances in understanding or modelling of the performance of biological systems for sustainable developments in land use and the environment, agriculture and amenity, bioproduction processes and the food chain. The subject matter of the journal reflects the wide range and interdisciplinary nature of research in engineering for biological systems.