Fundamental Frequencies Contour Extraction Based on the Extended Harmonic-Percussive Source Separation

Abstract

Introduction. Amidst the multiplicity of audio signal processing tasks connected with the necessity of source separation, the problem of obtaining of its most prominent components occupies special place. One of the approaches, dedicated to solve such task, is based on melody extraction from musical audio recording. If generalized, such technique can be applied to a wider class of audio signals for extraction from them of the so-called fundamental frequencies contour. For its realization, an attempt was made to combine the method of median filtering with the salience estimation method, for their application at various stages of the analysis of the input audio signal. A combination of methods is used to obtain the f_0-representation of the melody, based on the processing of the filtered values obtained at the first step. The purpose of the article is to obtain the trajectory of f_0-values of the input audio signal and filtering of the corresponding to this trajectory harmonics. Results. The proposed method is effective for use in audio signal processing systems for fundamental frequencies contour of the most prominent tonal components extraction and its further reuse. Conclusions. Realized spectrum decomposition technique, based on the tendency of the time-frequency distribution of its constituent sounds, allows to effectively extract melodic contours from non-melodic contours. Nevertheless, there is a necessity for further research regarding the distribution model of harmonic and percussive characteristics relative to each other. Such a model should be extended with heuristics for more accurate filtering of stable in time tonal components of complex audio signals.