Self-powered multisensory neuromorphic device with auditory and rotational perception integration inspired by the labyrinth of the inner ear

The labyrinth of the inner ear plays a crucial role in the multisensory integration of auditory and vestibular inputs, facilitating precise spatial awareness and movement perception. Drawing inspiration from this biological system, we present a self-powered neuromorphic device tailored to enhance adaptability for artificial intelligence systems in complex environments. This device integrates auditory and rotational perception through a sound-detecting triboelectric nanogenerator (TENG), a rotational angle-detecting TENG, and a synaptic transistor. The sound-detecting TENG, featuring micropyramid arrays fabricated via electrospun self-assembly exhibits detection ranges of sound pressure levels and frequencies comparable to the human auditory system. The rotational angle-detecting TENG operates by utilizing the rotation of polytetrafluoroethylene rollers to generate spikes for rotational angle counting. A porous SiO₂ dielectric layer with high specific surface area and elevated proton mobility enables ultralow energy consumption in the synaptic transistor. By employing the temporal congruency principle for multisensory integration, the synaptic transistor dynamically processes sensory inputs from the two TENGs, enabling real-time sound direction. The proof-of-concept device demonstrates the potential of auditory-rotational multisensory integration to advance intelligent perception in robotics.