Junpeng Zhang , Zihan Bai , Yifan Wei , Jinglei Tang , Ruizi Han , Jiaying Jiang
{"title":"Behavior detection of dairy goat based on YOLO11 and ELSlowFast-LSTM","authors":"Junpeng Zhang , Zihan Bai , Yifan Wei , Jinglei Tang , Ruizi Han , Jiaying Jiang","doi":"10.1016/j.compag.2025.110224","DOIUrl":null,"url":null,"abstract":"<div><div>Monitoring dairy goat behavior can effectively assess their health status and welfare levels, ensuring both the yield and quality of goat milk. However, achieving accurate and rapid detection of dairy goat behaviors remains challenging. This study proposes a dairy goat behavior detection method based on YOLO11 and ELSlowFast-LSTM (3D-ELA-SlowFast-LSTM) to locate dairy goats and recognize five behaviors: standing, walking, lying down, climbing, and fighting. Firstly, the YOLO11 object detection module is used to pinpoint the locations of dairy goats. Next, the ELSlowFast-LSTM behavior recognition module is introduced to classify behaviors within the detected regions. This module utilizes the SlowFast network for spatiotemporal feature extraction, incorporating the 3D-Efficient Local (EL) attention mechanism specifically designed to enhance the extraction of behavior-related features. Additionally, the Long Short-Term Memory (LSTM) module is applied to model temporal sequence features. Finally, by combining the results of the two modules, the task of dairy goat behavior detection is accomplished. To evaluate the proposed method, we constructed the DairyGoat dataset. Experimental results show that our method achieved a <span><math><mrow><mi>m</mi><mi>A</mi><mi>P</mi></mrow></math></span> value of 78.70%. Additionally, we compared the <span><math><mrow><mi>m</mi><mi>A</mi><mi>P</mi></mrow></math></span> value of our proposed method with other behavior detection models, and the results demonstrate that our method achieves the best detection performance while maintaining a relatively low parameter count and computational load. In summary, this is an effective dairy goat behavior detection method that provides a new strategy for intelligent farming. The dataset and code are available at <span><span>https://github.com/JunpengZZhang/ELSlowFast-LSTM</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"234 ","pages":"Article 110224"},"PeriodicalIF":7.7000,"publicationDate":"2025-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169925003308","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
Monitoring dairy goat behavior can effectively assess their health status and welfare levels, ensuring both the yield and quality of goat milk. However, achieving accurate and rapid detection of dairy goat behaviors remains challenging. This study proposes a dairy goat behavior detection method based on YOLO11 and ELSlowFast-LSTM (3D-ELA-SlowFast-LSTM) to locate dairy goats and recognize five behaviors: standing, walking, lying down, climbing, and fighting. Firstly, the YOLO11 object detection module is used to pinpoint the locations of dairy goats. Next, the ELSlowFast-LSTM behavior recognition module is introduced to classify behaviors within the detected regions. This module utilizes the SlowFast network for spatiotemporal feature extraction, incorporating the 3D-Efficient Local (EL) attention mechanism specifically designed to enhance the extraction of behavior-related features. Additionally, the Long Short-Term Memory (LSTM) module is applied to model temporal sequence features. Finally, by combining the results of the two modules, the task of dairy goat behavior detection is accomplished. To evaluate the proposed method, we constructed the DairyGoat dataset. Experimental results show that our method achieved a value of 78.70%. Additionally, we compared the value of our proposed method with other behavior detection models, and the results demonstrate that our method achieves the best detection performance while maintaining a relatively low parameter count and computational load. In summary, this is an effective dairy goat behavior detection method that provides a new strategy for intelligent farming. The dataset and code are available at https://github.com/JunpengZZhang/ELSlowFast-LSTM.
期刊介绍:
Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.