基于三维重建和点云分割的羊体尺寸自动测量方法

IF 8.9 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY
Yuxing Wei , Lina Zhang , Fan Yang , Xinhua Jiang , Jue Zhang , Lin Zhu , Meijia Yu , Maoguo Gong
{"title":"基于三维重建和点云分割的羊体尺寸自动测量方法","authors":"Yuxing Wei ,&nbsp;Lina Zhang ,&nbsp;Fan Yang ,&nbsp;Xinhua Jiang ,&nbsp;Jue Zhang ,&nbsp;Lin Zhu ,&nbsp;Meijia Yu ,&nbsp;Maoguo Gong","doi":"10.1016/j.compag.2025.110978","DOIUrl":null,"url":null,"abstract":"<div><div>Sheep body measurement data can comprehensively reflect body size, structural characteristics, growth status, and developmental relationships between different body parts. Automatically obtaining sheep body size parameters represents a critical technological advancement towards digital intelligent livestock farming. Currently, computer vision-based livestock body measurement techniques have garnered significant research interest due to their non-contact and efficient nature. However, sheep’s collective behavior and highly flexible body postures present challenges to vision-based measurement methodologies. Addressing these challenges, this paper proposes an automatic body size measurement method for sheep utilizing 3D reconstruction and point cloud segmentation technologies. Three KinectV2 cameras were strategically positioned in the passageway leading to the activity field to capture multi-view sheep images. Through multi-view image alignment, a 3D reconstruction was achieved to reproduce the sheep’s spatial morphology. The PointNet++ deep learning model was trained to develop an automatic sheep body segmentation model. Based on local pose normalization, keypoints were automatically detected by utilizing morphometric features, then body size parameters were computed. Farm experiment results demonstrated measurement accuracy: average relative errors for wither height, chest width, rump height, rump width, body length, and chest girth were 1.67 %, 3.63 %, 1.14, 2.71 %, 3.57 %, and 3.71 %, respectively. Experimental validation demonstrates the proposed approach reduces hardware requirements for automated body‑size measurement while maintaining the accuracy of body measurements. This enhancement facilitates its broader adoption and improves animal welfare. Meanwhile, experimental outcomes revealed that irregular posture challenges the efficiency of automated body size measurements, highlighting the necessity of integrating pose estimation techniques to further enhance measurement precision in future research.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"239 ","pages":"Article 110978"},"PeriodicalIF":8.9000,"publicationDate":"2025-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Automatic measurement method of sheep body size based on 3D reconstruction and point cloud segmentation\",\"authors\":\"Yuxing Wei ,&nbsp;Lina Zhang ,&nbsp;Fan Yang ,&nbsp;Xinhua Jiang ,&nbsp;Jue Zhang ,&nbsp;Lin Zhu ,&nbsp;Meijia Yu ,&nbsp;Maoguo Gong\",\"doi\":\"10.1016/j.compag.2025.110978\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Sheep body measurement data can comprehensively reflect body size, structural characteristics, growth status, and developmental relationships between different body parts. Automatically obtaining sheep body size parameters represents a critical technological advancement towards digital intelligent livestock farming. Currently, computer vision-based livestock body measurement techniques have garnered significant research interest due to their non-contact and efficient nature. However, sheep’s collective behavior and highly flexible body postures present challenges to vision-based measurement methodologies. Addressing these challenges, this paper proposes an automatic body size measurement method for sheep utilizing 3D reconstruction and point cloud segmentation technologies. Three KinectV2 cameras were strategically positioned in the passageway leading to the activity field to capture multi-view sheep images. Through multi-view image alignment, a 3D reconstruction was achieved to reproduce the sheep’s spatial morphology. The PointNet++ deep learning model was trained to develop an automatic sheep body segmentation model. Based on local pose normalization, keypoints were automatically detected by utilizing morphometric features, then body size parameters were computed. Farm experiment results demonstrated measurement accuracy: average relative errors for wither height, chest width, rump height, rump width, body length, and chest girth were 1.67 %, 3.63 %, 1.14, 2.71 %, 3.57 %, and 3.71 %, respectively. Experimental validation demonstrates the proposed approach reduces hardware requirements for automated body‑size measurement while maintaining the accuracy of body measurements. This enhancement facilitates its broader adoption and improves animal welfare. Meanwhile, experimental outcomes revealed that irregular posture challenges the efficiency of automated body size measurements, highlighting the necessity of integrating pose estimation techniques to further enhance measurement precision in future research.</div></div>\",\"PeriodicalId\":50627,\"journal\":{\"name\":\"Computers and Electronics in Agriculture\",\"volume\":\"239 \",\"pages\":\"Article 110978\"},\"PeriodicalIF\":8.9000,\"publicationDate\":\"2025-09-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Electronics in Agriculture\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0168169925010841\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169925010841","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

羊体测量数据可以综合反映羊体大小、结构特征、生长状况以及不同身体部位之间的发育关系。自动获取羊体尺寸参数是实现数字化智能畜牧的关键技术进步。目前,基于计算机视觉的家畜身体测量技术因其非接触和高效的特性而获得了很大的研究兴趣。然而,绵羊的集体行为和高度灵活的身体姿势对基于视觉的测量方法提出了挑战。针对这些问题,本文提出了一种基于三维重建和点云分割技术的羊体尺寸自动测量方法。在通往活动场的通道中策略性地放置了三台KinectV2摄像机,以捕获多视角绵羊图像。通过多视角图像对齐,实现了羊的三维重建,再现了羊的空间形态。对PointNet++深度学习模型进行训练,开发羊体自动分割模型。在局部姿态归一化的基础上,利用形态特征自动检测关键点,进而计算出人体尺寸参数。农场试验结果证明了测量精度:枯高、胸宽、臀高、臀宽、体长和胸围的平均相对误差分别为1.67%、3.63%、1.14%、2.71%、3.57%和3.71%。实验验证表明,所提出的方法在保持身体测量精度的同时,降低了自动化身体尺寸测量的硬件要求。这种改进促进了其更广泛的采用,并改善了动物福利。同时,实验结果表明,不规则姿态对人体尺寸自动化测量的效率提出了挑战,强调了在未来的研究中整合姿态估计技术以进一步提高测量精度的必要性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Automatic measurement method of sheep body size based on 3D reconstruction and point cloud segmentation
Sheep body measurement data can comprehensively reflect body size, structural characteristics, growth status, and developmental relationships between different body parts. Automatically obtaining sheep body size parameters represents a critical technological advancement towards digital intelligent livestock farming. Currently, computer vision-based livestock body measurement techniques have garnered significant research interest due to their non-contact and efficient nature. However, sheep’s collective behavior and highly flexible body postures present challenges to vision-based measurement methodologies. Addressing these challenges, this paper proposes an automatic body size measurement method for sheep utilizing 3D reconstruction and point cloud segmentation technologies. Three KinectV2 cameras were strategically positioned in the passageway leading to the activity field to capture multi-view sheep images. Through multi-view image alignment, a 3D reconstruction was achieved to reproduce the sheep’s spatial morphology. The PointNet++ deep learning model was trained to develop an automatic sheep body segmentation model. Based on local pose normalization, keypoints were automatically detected by utilizing morphometric features, then body size parameters were computed. Farm experiment results demonstrated measurement accuracy: average relative errors for wither height, chest width, rump height, rump width, body length, and chest girth were 1.67 %, 3.63 %, 1.14, 2.71 %, 3.57 %, and 3.71 %, respectively. Experimental validation demonstrates the proposed approach reduces hardware requirements for automated body‑size measurement while maintaining the accuracy of body measurements. This enhancement facilitates its broader adoption and improves animal welfare. Meanwhile, experimental outcomes revealed that irregular posture challenges the efficiency of automated body size measurements, highlighting the necessity of integrating pose estimation techniques to further enhance measurement precision in future research.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computers and Electronics in Agriculture
Computers and Electronics in Agriculture 工程技术-计算机:跨学科应用
CiteScore
15.30
自引率
14.50%
发文量
800
审稿时长
62 days
期刊介绍: Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信