Bird species classification using visual and acoustic features extracted from audio signal

Abstract

This work aims to present a system for automatic bird species classification based on acoustic and visual features extracted from the birdsong. The visual features are extracted from spectrogram images generated from the birdsong audio, while the acoustic features are taken directly from the audio. Texture descriptors were used to describe the spectrogram content, as this is the main visual content found in this kind of image. The texture operators used are Local Binary Pattern (LBP), Local Phase Quantization (LPQ), Robust Local Binary Pattern (RLBP), Gray-Scale Level Co-occurrence Matrix (GLCM) and Gabor filters. The acoustic features are, in turn, described using Rhythm Histogram (RH), Rhythm Patterns (RP) and Statistical Spectrum Descriptor (SSD.) Aiming to perform more fare comparisons, the experiments performed were made on a similar database already used in other works. In the classification step, SVM classifier was used and the final results were taken by using 10-fold cross validation. And over all performed tests the combination between acoustic and visual features produce the best rate of this work 91.08%.