Bird Sound Classification : Leveraging Deep Learning for Species Identification

Ardon Kotey, Allan Almeida, Nihal Gupta, Dr. Vinaya Sawant
{"title":"Bird Sound Classification : Leveraging Deep Learning for Species Identification","authors":"Ardon Kotey, Allan Almeida, Nihal Gupta, Dr. Vinaya Sawant","doi":"10.32628/cseit24103127","DOIUrl":null,"url":null,"abstract":"Birds are meaningful to a wide audience including the public. They live in almost every type of environment and in almost every niche (place or role) within those environments. The monitoring of species diversity and migration is important for almost all conservation efforts. The analysis of long-term audio data is vital to support those efforts but relies on complex algorithms that need to adapt to changing environmental conditions. Convolutional neural networks (CNNs) are powerful toolkits of machine learning that have proven efficient in the field of image processing and sound recognition. In this paper, a CNN system classifying bird sounds is presented and tested through different configurations and hyperparameters. The MobileNet pre-trained CNN model is finetuned using a dataset acquired from the Xeno-canto bird song sharing portal, which provides a large collection of labeled and categorized recordings. Spectrograms generated from the downloaded data represent the input of the neural network. The attached experiments compare various configurations including the number of classes (bird species) and the color scheme of the spectrograms. Results suggest that choosing a color map in line with the images the network has been pre-trained with provides a measurable advantage. The presented system is viable only for a low number of classes.","PeriodicalId":313456,"journal":{"name":"International Journal of Scientific Research in Computer Science, Engineering and Information Technology","volume":"73 S105","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Scientific Research in Computer Science, Engineering and Information Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.32628/cseit24103127","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Birds are meaningful to a wide audience including the public. They live in almost every type of environment and in almost every niche (place or role) within those environments. The monitoring of species diversity and migration is important for almost all conservation efforts. The analysis of long-term audio data is vital to support those efforts but relies on complex algorithms that need to adapt to changing environmental conditions. Convolutional neural networks (CNNs) are powerful toolkits of machine learning that have proven efficient in the field of image processing and sound recognition. In this paper, a CNN system classifying bird sounds is presented and tested through different configurations and hyperparameters. The MobileNet pre-trained CNN model is finetuned using a dataset acquired from the Xeno-canto bird song sharing portal, which provides a large collection of labeled and categorized recordings. Spectrograms generated from the downloaded data represent the input of the neural network. The attached experiments compare various configurations including the number of classes (bird species) and the color scheme of the spectrograms. Results suggest that choosing a color map in line with the images the network has been pre-trained with provides a measurable advantage. The presented system is viable only for a low number of classes.
鸟类声音分类 :利用深度学习进行物种识别
鸟类对包括公众在内的广大观众来说意义非凡。它们生活在几乎所有类型的环境中,以及这些环境中的几乎所有生态位(地点或角色)中。监测物种多样性和迁徙对于几乎所有的保护工作都非常重要。对长期音频数据的分析对于支持这些工作至关重要,但它依赖于需要适应不断变化的环境条件的复杂算法。卷积神经网络(CNN)是强大的机器学习工具包,在图像处理和声音识别领域已被证明是高效的。本文通过不同的配置和超参数,介绍并测试了一种对鸟类声音进行分类的 CNN 系统。MobileNet 预训练 CNN 模型使用从 Xeno-canto 鸟鸣共享门户网站获取的数据集进行微调,该门户网站提供了大量带标签和分类的录音。从下载的数据中生成的频谱图是神经网络的输入。所附实验比较了各种配置,包括类别(鸟类种类)的数量和频谱图的颜色方案。结果表明,选择与网络预先训练过的图像一致的颜色图具有明显的优势。所介绍的系统仅适用于较少类别的情况。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信