Md Nasim Reza, Md Sazzadul Kabir, Md Asrakul Haque, Hongbin Jin, Hyunjin Kyoung, Young Kyoung Choi, Gookhwan Kim, Sun-Ok Chung
{"title":"用于智能健康管理的实例分割和自动猪姿识别。","authors":"Md Nasim Reza, Md Sazzadul Kabir, Md Asrakul Haque, Hongbin Jin, Hyunjin Kyoung, Young Kyoung Choi, Gookhwan Kim, Sun-Ok Chung","doi":"10.5187/jast.2024.e112","DOIUrl":null,"url":null,"abstract":"<p><p>Changes in posture and movement during the growing period can often indicate abnormal development or health in pigs, making it possible to monitor and detect early morphological symptoms and health risks, potentially helping to limit the spread of infections. Large-scale pig farming requires extensive visual monitoring by workers, which is time-consuming and laborious. However, a potential solution is computer vision-based monitoring of posture and movement. The objective of this study was to recognize and detect pig posture using a masked-based instance segmentation for automated pig monitoring in a closed pig farm environment. Two automatic video acquisition systems were installed from the top and side views. RGB images were extracted from the RGB video files and used for annotation work. Manual annotation of 600 images was used to prepare a training dataset, including the four postures: standing, sitting, lying, and eating from the food bin. An instance segmentation framework was employed to recognize and detect pig posture. A region proposal network was used in the Mask R-CNN-generated candidate boxes and the features from these boxes were extracted using RoIPool, followed by classification and bounding-box regression. The model effectively identified standard postures, achieving a mean average precision of 0.937 for piglets and 0.935 for adults. The proposed model showed strong potential for real-time posture monitoring and early welfare issue detection in pigs, aiding in the optimization of farm management practices. Additionally, the study explored body weight estimation using 2D image pixel areas, which showed a high correlation with actual weight, although limitations in capturing 3D volume could affect precision. Future work should integrate 3D imaging or depth sensors and expand the use of the model across diverse farm conditions to enhance real-world applicability.</p>","PeriodicalId":14923,"journal":{"name":"Journal of Animal Science and Technology","volume":"67 3","pages":"677-700"},"PeriodicalIF":2.7000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12159697/pdf/","citationCount":"0","resultStr":"{\"title\":\"Instance segmentation and automated pig posture recognition for smart health management.\",\"authors\":\"Md Nasim Reza, Md Sazzadul Kabir, Md Asrakul Haque, Hongbin Jin, Hyunjin Kyoung, Young Kyoung Choi, Gookhwan Kim, Sun-Ok Chung\",\"doi\":\"10.5187/jast.2024.e112\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Changes in posture and movement during the growing period can often indicate abnormal development or health in pigs, making it possible to monitor and detect early morphological symptoms and health risks, potentially helping to limit the spread of infections. Large-scale pig farming requires extensive visual monitoring by workers, which is time-consuming and laborious. However, a potential solution is computer vision-based monitoring of posture and movement. The objective of this study was to recognize and detect pig posture using a masked-based instance segmentation for automated pig monitoring in a closed pig farm environment. Two automatic video acquisition systems were installed from the top and side views. RGB images were extracted from the RGB video files and used for annotation work. Manual annotation of 600 images was used to prepare a training dataset, including the four postures: standing, sitting, lying, and eating from the food bin. An instance segmentation framework was employed to recognize and detect pig posture. A region proposal network was used in the Mask R-CNN-generated candidate boxes and the features from these boxes were extracted using RoIPool, followed by classification and bounding-box regression. The model effectively identified standard postures, achieving a mean average precision of 0.937 for piglets and 0.935 for adults. The proposed model showed strong potential for real-time posture monitoring and early welfare issue detection in pigs, aiding in the optimization of farm management practices. Additionally, the study explored body weight estimation using 2D image pixel areas, which showed a high correlation with actual weight, although limitations in capturing 3D volume could affect precision. Future work should integrate 3D imaging or depth sensors and expand the use of the model across diverse farm conditions to enhance real-world applicability.</p>\",\"PeriodicalId\":14923,\"journal\":{\"name\":\"Journal of Animal Science and Technology\",\"volume\":\"67 3\",\"pages\":\"677-700\"},\"PeriodicalIF\":2.7000,\"publicationDate\":\"2025-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12159697/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Animal Science and Technology\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://doi.org/10.5187/jast.2024.e112\",\"RegionNum\":3,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/5/31 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, DAIRY & ANIMAL SCIENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Animal Science and Technology","FirstCategoryId":"97","ListUrlMain":"https://doi.org/10.5187/jast.2024.e112","RegionNum":3,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/5/31 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"AGRICULTURE, DAIRY & ANIMAL SCIENCE","Score":null,"Total":0}
引用次数: 0
摘要
生长期姿势和动作的变化通常可以表明猪的发育或健康状况不正常,这使得监测和发现早期形态症状和健康风险成为可能,可能有助于限制感染的传播。大规模养猪需要工人进行广泛的目视监控,这既耗时又费力。然而,一个潜在的解决方案是基于计算机视觉的姿势和运动监测。本研究的目的是在一个封闭的养猪场环境中,使用基于掩膜的实例分割来识别和检测猪的姿势。从顶部和侧面安装了两个自动视频采集系统。从RGB视频文件中提取RGB图像并用于注释工作。对600张图片进行手工标注,准备训练数据集,包括站、坐、躺、吃垃圾桶里的食物四种姿势。采用实例分割框架对猪的姿态进行识别和检测。在Mask r - cnn生成的候选框中使用区域建议网络,利用RoIPool提取候选框的特征,然后进行分类和边界盒回归。该模型有效地识别了标准姿势,仔猪的平均精度为0.937,成人的平均精度为0.935。该模型在猪的实时姿态监测和早期福利问题检测方面显示出强大的潜力,有助于优化农场管理实践。此外,该研究还探索了使用2D图像像素区域估算体重的方法,该方法与实际体重高度相关,尽管捕获3D体积的限制可能会影响精度。未来的工作应该集成3D成像或深度传感器,并扩大模型在不同农场条件下的使用,以增强现实世界的适用性。
Instance segmentation and automated pig posture recognition for smart health management.
Changes in posture and movement during the growing period can often indicate abnormal development or health in pigs, making it possible to monitor and detect early morphological symptoms and health risks, potentially helping to limit the spread of infections. Large-scale pig farming requires extensive visual monitoring by workers, which is time-consuming and laborious. However, a potential solution is computer vision-based monitoring of posture and movement. The objective of this study was to recognize and detect pig posture using a masked-based instance segmentation for automated pig monitoring in a closed pig farm environment. Two automatic video acquisition systems were installed from the top and side views. RGB images were extracted from the RGB video files and used for annotation work. Manual annotation of 600 images was used to prepare a training dataset, including the four postures: standing, sitting, lying, and eating from the food bin. An instance segmentation framework was employed to recognize and detect pig posture. A region proposal network was used in the Mask R-CNN-generated candidate boxes and the features from these boxes were extracted using RoIPool, followed by classification and bounding-box regression. The model effectively identified standard postures, achieving a mean average precision of 0.937 for piglets and 0.935 for adults. The proposed model showed strong potential for real-time posture monitoring and early welfare issue detection in pigs, aiding in the optimization of farm management practices. Additionally, the study explored body weight estimation using 2D image pixel areas, which showed a high correlation with actual weight, although limitations in capturing 3D volume could affect precision. Future work should integrate 3D imaging or depth sensors and expand the use of the model across diverse farm conditions to enhance real-world applicability.
期刊介绍:
Journal of Animal Science and Technology (J. Anim. Sci. Technol. or JAST) is a peer-reviewed, open access journal publishing original research, review articles and notes in all fields of animal science.
Topics covered by the journal include: genetics and breeding, physiology, nutrition of monogastric animals, nutrition of ruminants, animal products (milk, meat, eggs and their by-products) and their processing, grasslands and roughages, livestock environment, animal biotechnology, animal behavior and welfare.
Articles generally report research involving beef cattle, dairy cattle, pigs, companion animals, goats, horses, and sheep. However, studies involving other farm animals, aquatic and wildlife species, and laboratory animal species that address fundamental questions related to livestock and companion animal biology will also be considered for publication.
The Journal of Animal Science and Technology (J. Anim. Technol. or JAST) has been the official journal of The Korean Society of Animal Science and Technology (KSAST) since 2000, formerly known as The Korean Journal of Animal Sciences (launched in 1956).