Tracking and separation of multiple moving speech sources via cardinality balanced multi-target multi Bernoulli (CBMeMBer) filter and time frequency masking

Abstract

In a “conference room scenario”, the number of speech sources are not known a priori and the number of speech sources which are active remains unknown as these speech sources appear and disappear throughout the measurement period. Furthermore, the speech sources are moving so their mixing parameters change with time. As a result of this, traditional source separation techniques are limited by their capability to properly attribute the correct mixing parameters to the respective sources. The “conference room scenario” problem is very challenging as it involves the localization, tracking and separation of a time varying number of moving speech sources. An online solution which systematically solves “conference room scenario” problem by solving the source localization, tracking and separation in stages is proposed in this paper.