Bionic Visual-Auditory Perceptual System Based on Ionotronic Neuromorphic Transistor for Information Encryption and Decryption with Sound Recognition Functions

The human perceptual system is a multi-modal synergetic sensory learning system. As helps individuals to perceive and understand the world more comprehensively and deeply. Replication of human perceptual systems at the hardware level will significantly boost the progress of neuromorphic platforms. Interestingly, ionotronic device provides rich ionic dynamics for designing neuromorphic devices. It also provides interesting methodology to implement bionic perceptual learning system with multi-modal sensory activities. Here, a bionic visual-auditory perceptual system has been proposed by integrating chitosan-gated oxide ionotronic neuromorphic transistors and auditory sensors. With strong proton gating effects, the system exhibits remarkable multi-modal sensory abilities to sound and light, enabling diverse functions including encrypted sound information transmission and information decoding. The perceptual system can also perform sound recognition by perceiving the volume, tone, and timbre of sound, which results in the implementation of a sound lock function. Thanks to visual-auditory fusion, image encryption and decryption function can also be addressed. This advancement poses innovative insights for the advanced collaborative multi-perceptual intelligent platform.