Reza Arablouei , Greg J. Bishop-Hurley , Neil Bagnall , Aaron Ingham
{"title":"Cattle behavior recognition from accelerometer data: Leveraging in-situ cross-device model learning","authors":"Reza Arablouei , Greg J. Bishop-Hurley , Neil Bagnall , Aaron Ingham","doi":"10.1016/j.compag.2024.109546","DOIUrl":null,"url":null,"abstract":"<div><div>Automating livestock behavior recognition using wearable sensors offers significant benefits for monitoring animal health, ensuring welfare, and enhancing farm productivity. While collar-mounted accelerometers provide useful data leading to accurate behavior recognition models, ear-tags offer greater practicality and scalability. However, ear-tag data is affected by independent ear movements (e.g., for flicking flies), necessitating extensive labeled data for accurate recognition, which is time-consuming and costly to obtain. To address this challenge, we propose a pioneering cross-device learning approach. By leveraging a pre-trained behavior recognition model from collar data to guide ear-tag model training, we significantly reduce the need for manual labeling of ear-tag data. This facilitates the development of efficient and scalable behavior recognition models suitable for wider deployment. Additionally, we introduce a novel deep neural network architecture that integrates linearly-constrained convolutional layers specifically designed to counteract gravity’s impact on accelerometer data, along with a confidence penalty term to combat overfitting when training on limited labeled data. Evaluation on real-world cattle data demonstrates that our approach yields ear-tag model performance nearly on par with collar models. This breakthrough paves the way for personalized behavior recognition models using ear-tags, requiring only brief periods of collar-based labeling per animal.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":null,"pages":null},"PeriodicalIF":7.7000,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169924009372","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
Automating livestock behavior recognition using wearable sensors offers significant benefits for monitoring animal health, ensuring welfare, and enhancing farm productivity. While collar-mounted accelerometers provide useful data leading to accurate behavior recognition models, ear-tags offer greater practicality and scalability. However, ear-tag data is affected by independent ear movements (e.g., for flicking flies), necessitating extensive labeled data for accurate recognition, which is time-consuming and costly to obtain. To address this challenge, we propose a pioneering cross-device learning approach. By leveraging a pre-trained behavior recognition model from collar data to guide ear-tag model training, we significantly reduce the need for manual labeling of ear-tag data. This facilitates the development of efficient and scalable behavior recognition models suitable for wider deployment. Additionally, we introduce a novel deep neural network architecture that integrates linearly-constrained convolutional layers specifically designed to counteract gravity’s impact on accelerometer data, along with a confidence penalty term to combat overfitting when training on limited labeled data. Evaluation on real-world cattle data demonstrates that our approach yields ear-tag model performance nearly on par with collar models. This breakthrough paves the way for personalized behavior recognition models using ear-tags, requiring only brief periods of collar-based labeling per animal.
期刊介绍:
Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.