Jiazhou Li, Yuxiang Yang, Yao Yao, Huawei Zou, Xi Guo, Jianxin Xiao, Rui Hu, Shijing Cheng, Yipeng Wang, Yingqi Peng, Zhisheng Wang
{"title":"复杂环境监测中基于关键点检测的牦牛小母牛动态姿态估计模型。","authors":"Jiazhou Li, Yuxiang Yang, Yao Yao, Huawei Zou, Xi Guo, Jianxin Xiao, Rui Hu, Shijing Cheng, Yipeng Wang, Yingqi Peng, Zhisheng Wang","doi":"10.3168/jds.2025-27099","DOIUrl":null,"url":null,"abstract":"<p><p>Behavior is an important indicator of yak heifer welfare and health status, with key behavioral patterns reflecting critical conditions, including fattening, reproduction, and disease. Computer vision-based pose estimation has become an essential technology for livestock behavior monitoring. This study developed a yak heifer pose estimation model named Multistage Feature Attention PVT-based Dynamic Yak Heifer Pose Estimation Model (MFPVT-YakHeifer) based on improved Pyramid Vision Transformer version 2 (PVT v2) and keypoint detection modeling. The proposed and compared models were trained with a novel YakPoseData set encompassing yak heifer images collected in different poses and environmental conditions. The results showed that the model achieved performance metrics of 90.41% mean average precision at an intersection over union (IoU) threshold of 0.5, 64.37% mean average precision at 0.75 IoU, 64.11% mean average precision, and 91.95% mean average recall at 0.5 IoU, all of which are higher than those of the other 4 benchmark models. Finally, the MFPVT-YakHeifer model has been deployed on edge computing device for livestock farm applications. The future work will focus on animal dataset expansion, real-time video analysis implementation, and computational efficiency optimization for edge deployment.</p>","PeriodicalId":354,"journal":{"name":"Journal of Dairy Science","volume":" ","pages":""},"PeriodicalIF":4.4000,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A dynamic yak heifer pose estimation model based on keypoints detection for complex environmental monitoring.\",\"authors\":\"Jiazhou Li, Yuxiang Yang, Yao Yao, Huawei Zou, Xi Guo, Jianxin Xiao, Rui Hu, Shijing Cheng, Yipeng Wang, Yingqi Peng, Zhisheng Wang\",\"doi\":\"10.3168/jds.2025-27099\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Behavior is an important indicator of yak heifer welfare and health status, with key behavioral patterns reflecting critical conditions, including fattening, reproduction, and disease. Computer vision-based pose estimation has become an essential technology for livestock behavior monitoring. This study developed a yak heifer pose estimation model named Multistage Feature Attention PVT-based Dynamic Yak Heifer Pose Estimation Model (MFPVT-YakHeifer) based on improved Pyramid Vision Transformer version 2 (PVT v2) and keypoint detection modeling. The proposed and compared models were trained with a novel YakPoseData set encompassing yak heifer images collected in different poses and environmental conditions. The results showed that the model achieved performance metrics of 90.41% mean average precision at an intersection over union (IoU) threshold of 0.5, 64.37% mean average precision at 0.75 IoU, 64.11% mean average precision, and 91.95% mean average recall at 0.5 IoU, all of which are higher than those of the other 4 benchmark models. Finally, the MFPVT-YakHeifer model has been deployed on edge computing device for livestock farm applications. The future work will focus on animal dataset expansion, real-time video analysis implementation, and computational efficiency optimization for edge deployment.</p>\",\"PeriodicalId\":354,\"journal\":{\"name\":\"Journal of Dairy Science\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2025-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Dairy Science\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://doi.org/10.3168/jds.2025-27099\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, DAIRY & ANIMAL SCIENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Dairy Science","FirstCategoryId":"97","ListUrlMain":"https://doi.org/10.3168/jds.2025-27099","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, DAIRY & ANIMAL SCIENCE","Score":null,"Total":0}
引用次数: 0
摘要
行为是牦牛小母牛福利和健康状况的重要指标,关键的行为模式反映了牦牛小母牛的关键状况,包括肥育、繁殖和疾病。基于计算机视觉的姿态估计已经成为家畜行为监测的一项重要技术。本研究基于改进的金字塔视觉Transformer version 2 (PVT v2)和关键点检测模型,开发了基于多阶段特征注意PVT的牦牛小母牛动态姿态估计模型(MFPVT-YakHeifer)。所提出的模型和所比较的模型使用一个新的YakPoseData集进行训练,该集包含在不同姿势和环境条件下收集的牦牛小母牛图像。结果表明,该模型在交叉超过联合(IoU)阈值为0.5时的平均精度为90.41%,在0.75 IoU时的平均精度为64.37%,在0.5 IoU时的平均精度为64.11%,平均召回率为91.95%,均高于其他4个基准模型。最后,MFPVT-YakHeifer模型已部署在畜牧农场应用的边缘计算设备上。未来的工作将集中在动物数据集扩展、实时视频分析实现和边缘部署的计算效率优化上。
A dynamic yak heifer pose estimation model based on keypoints detection for complex environmental monitoring.
Behavior is an important indicator of yak heifer welfare and health status, with key behavioral patterns reflecting critical conditions, including fattening, reproduction, and disease. Computer vision-based pose estimation has become an essential technology for livestock behavior monitoring. This study developed a yak heifer pose estimation model named Multistage Feature Attention PVT-based Dynamic Yak Heifer Pose Estimation Model (MFPVT-YakHeifer) based on improved Pyramid Vision Transformer version 2 (PVT v2) and keypoint detection modeling. The proposed and compared models were trained with a novel YakPoseData set encompassing yak heifer images collected in different poses and environmental conditions. The results showed that the model achieved performance metrics of 90.41% mean average precision at an intersection over union (IoU) threshold of 0.5, 64.37% mean average precision at 0.75 IoU, 64.11% mean average precision, and 91.95% mean average recall at 0.5 IoU, all of which are higher than those of the other 4 benchmark models. Finally, the MFPVT-YakHeifer model has been deployed on edge computing device for livestock farm applications. The future work will focus on animal dataset expansion, real-time video analysis implementation, and computational efficiency optimization for edge deployment.
期刊介绍:
The official journal of the American Dairy Science Association®, Journal of Dairy Science® (JDS) is the leading peer-reviewed general dairy research journal in the world. JDS readers represent education, industry, and government agencies in more than 70 countries with interests in biochemistry, breeding, economics, engineering, environment, food science, genetics, microbiology, nutrition, pathology, physiology, processing, public health, quality assurance, and sanitation.