Ao Xu , Zhenjie Hou , Jiuzhen Liang , Xing Li , Xinwen Zhou , Hongbo Geng
{"title":"高效双流神经网络:从视频数据推断野生哺乳动物行为的建模方法","authors":"Ao Xu , Zhenjie Hou , Jiuzhen Liang , Xing Li , Xinwen Zhou , Hongbo Geng","doi":"10.1016/j.ecoinf.2024.102902","DOIUrl":null,"url":null,"abstract":"<div><div>Monitoring animal behavior is crucial for protecting ecosystems, maintaining ecological balance, and improving animal welfare. By utilizing various monitoring devices, a wealth of behavioral data can be collected, which machine learning techniques can then analyze to identify specific behaviors. Artificial neural networks are particularly important in movement ecology. However, current research on animal behavior recognition faces several limitations. Many existing datasets are limited by homogeneous species categories, simplistic environmental conditions, restricted video perspectives, and a lack of alignment with the complexity of real-world environments. Consequently, there is significant room for improvement in the robustness and generalization of automatic animal behavior recognition models. To address these challenges, this paper introduces a diverse dataset of wild mammal behaviors. This dataset includes a wide variety of typical wild mammal species, providing a foundation for enhancing the generality and robustness of recognition models. The videos in this dataset capture different environmental contexts where wild mammals reside, across various times of day. Based on this dataset, a novel and highly efficient wild mammal behavior recognition model, EDNN, is proposed. The EDNN model integrates both temporal and spatial scales and achieves an average recognition accuracy of 79.17 % for basic locomotion behaviors, with a Top-1 accuracy of 81.37 % and a Top-5 accuracy of 98.04 %. These results demonstrate the feasibility of automating animal behavior recognition using large datasets collected from modern monitoring devices. The EDNN model is highly effective for behavior recognition and can be readily applied across diverse species and scenarios. It efficiently processes various video data and contributes to a deeper understanding of the movement ecology of species that are challenging to observe.</div></div>","PeriodicalId":51024,"journal":{"name":"Ecological Informatics","volume":"84 ","pages":"Article 102902"},"PeriodicalIF":5.8000,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Efficient dual-stream neural networks: A modeling approach for inferring wild mammal behavior from video data\",\"authors\":\"Ao Xu , Zhenjie Hou , Jiuzhen Liang , Xing Li , Xinwen Zhou , Hongbo Geng\",\"doi\":\"10.1016/j.ecoinf.2024.102902\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Monitoring animal behavior is crucial for protecting ecosystems, maintaining ecological balance, and improving animal welfare. By utilizing various monitoring devices, a wealth of behavioral data can be collected, which machine learning techniques can then analyze to identify specific behaviors. Artificial neural networks are particularly important in movement ecology. However, current research on animal behavior recognition faces several limitations. Many existing datasets are limited by homogeneous species categories, simplistic environmental conditions, restricted video perspectives, and a lack of alignment with the complexity of real-world environments. Consequently, there is significant room for improvement in the robustness and generalization of automatic animal behavior recognition models. To address these challenges, this paper introduces a diverse dataset of wild mammal behaviors. This dataset includes a wide variety of typical wild mammal species, providing a foundation for enhancing the generality and robustness of recognition models. The videos in this dataset capture different environmental contexts where wild mammals reside, across various times of day. Based on this dataset, a novel and highly efficient wild mammal behavior recognition model, EDNN, is proposed. The EDNN model integrates both temporal and spatial scales and achieves an average recognition accuracy of 79.17 % for basic locomotion behaviors, with a Top-1 accuracy of 81.37 % and a Top-5 accuracy of 98.04 %. These results demonstrate the feasibility of automating animal behavior recognition using large datasets collected from modern monitoring devices. The EDNN model is highly effective for behavior recognition and can be readily applied across diverse species and scenarios. It efficiently processes various video data and contributes to a deeper understanding of the movement ecology of species that are challenging to observe.</div></div>\",\"PeriodicalId\":51024,\"journal\":{\"name\":\"Ecological Informatics\",\"volume\":\"84 \",\"pages\":\"Article 102902\"},\"PeriodicalIF\":5.8000,\"publicationDate\":\"2024-11-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ecological Informatics\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1574954124004448\",\"RegionNum\":2,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ECOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ecological Informatics","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1574954124004448","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ECOLOGY","Score":null,"Total":0}
Efficient dual-stream neural networks: A modeling approach for inferring wild mammal behavior from video data
Monitoring animal behavior is crucial for protecting ecosystems, maintaining ecological balance, and improving animal welfare. By utilizing various monitoring devices, a wealth of behavioral data can be collected, which machine learning techniques can then analyze to identify specific behaviors. Artificial neural networks are particularly important in movement ecology. However, current research on animal behavior recognition faces several limitations. Many existing datasets are limited by homogeneous species categories, simplistic environmental conditions, restricted video perspectives, and a lack of alignment with the complexity of real-world environments. Consequently, there is significant room for improvement in the robustness and generalization of automatic animal behavior recognition models. To address these challenges, this paper introduces a diverse dataset of wild mammal behaviors. This dataset includes a wide variety of typical wild mammal species, providing a foundation for enhancing the generality and robustness of recognition models. The videos in this dataset capture different environmental contexts where wild mammals reside, across various times of day. Based on this dataset, a novel and highly efficient wild mammal behavior recognition model, EDNN, is proposed. The EDNN model integrates both temporal and spatial scales and achieves an average recognition accuracy of 79.17 % for basic locomotion behaviors, with a Top-1 accuracy of 81.37 % and a Top-5 accuracy of 98.04 %. These results demonstrate the feasibility of automating animal behavior recognition using large datasets collected from modern monitoring devices. The EDNN model is highly effective for behavior recognition and can be readily applied across diverse species and scenarios. It efficiently processes various video data and contributes to a deeper understanding of the movement ecology of species that are challenging to observe.
期刊介绍:
The journal Ecological Informatics is devoted to the publication of high quality, peer-reviewed articles on all aspects of computational ecology, data science and biogeography. The scope of the journal takes into account the data-intensive nature of ecology, the growing capacity of information technology to access, harness and leverage complex data as well as the critical need for informing sustainable management in view of global environmental and climate change.
The nature of the journal is interdisciplinary at the crossover between ecology and informatics. It focuses on novel concepts and techniques for image- and genome-based monitoring and interpretation, sensor- and multimedia-based data acquisition, internet-based data archiving and sharing, data assimilation, modelling and prediction of ecological data.