Neuroanatomy-Informed Brain-Machine Hybrid Intelligence for Robust Acoustic Target Detection.

Abstract

Sound target detection (STD) plays a critical role in modern acoustic sensing systems. However, existing automated STD methods show poor robustness and limited generalization, especially under low signal-to-noise ratio (SNR) conditions or when processing previously unencountered sound categories. To overcome these limitations, we first propose a brain-computer interface (BCI)-based STD method that utilizes neural responses to auditory stimuli. Our approach features the Triple-Region Spatiotemporal Dynamics Attention Network (Tri-SDANet), an electroencephalogram (EEG) decoding model incorporating neuroanatomical priors derived from EEG source analysis to enhance decoding accuracy and provide interpretability in complex auditory scenes. Recognizing the inherent limitations of stand-alone BCI systems (notably their high false alarm rates), we further develop an adaptive confidence-based brain-machine fusion strategy that intelligently combines decisions from both the BCI and conventional acoustic detection models. This hybrid approach effectively merges the complementary strengths of neural perception and acoustic feature learning. We validate the proposed method through experiments with 16 participants. Experimental results demonstrate that the Tri-SDANet achieves state-of-the-art performance in neural decoding under complex acoustic conditions. Moreover, the hybrid system maintains reliable detection performance at low SNR levels while exhibiting remarkable generalization to unseen target classes. In addition, source-level EEG analysis reveals distinct brain activation patterns associated with target perception, offering neuroscientific validation for our model design. This work pioneers a neuro-acoustic fusion paradigm for robust STD, offering a generalizable solution for real-world applications through the integration of noninvasive neural signals with artificial intelligence.