Self-powered bimodal tactile imaging device for ultrasensitive pressure sensing, real-time visualization recognition, and intelligent control

Abstract

In the domain of smart robotics, the refinement of tactile imaging constitutes a seminal element for enhancement of human–machine interaction (HMI) and enrichment of artificial intelligence (AI). This field is confronted with dual challenges of achieving high-sensitive pressure detection and precise localization of tactile stimuli. In response, the current research introduces a groundbreaking self-powered bimodal tactile imaging device (TID), featuring a configuration of high-dielectric thin film superimposed on laser-induced graphene (LIG) electrodes. This pioneering design is conceived to facilitate not only the detection of subtle pressure but also to support real-time visual recognition and intelligent control functionalities. The bimodal nature of the TID allows for the transformation of slight tactile inputs into both luminous triboelectrification-induced electroluminescence (TIEL) and measurable electrical signals, thereby seamlessly merging the realms of tactile perception and optical display. Leveraging the luminosity of TIEL, the TID adeptly achieves tactile imaging and immediate visual recognition, with its capabilities further enhanced through the integration of machine learning algorithms. Additionally, the TID exhibits a remarkable proficiency in precise tactile localization, through the analysis of voltage outputs initiated by delicate touching and sliding motions. Moreover, an advanced intelligent control system, predicated on the optical-electrical dual-modal sensing provided by the TID, has been developed. This system illustrates the synergistic fusion of visual recognition with accurate tactile localization, underscoring the substantial utility of the bimodal TID across diverse applications in HMI, AI, and intelligent robotic platforms and heralding new avenues for interactive and responsive robotic systems.