EAR: Exploiting Uncontrollable Ambient RF Signals in Heterogeneous Networks for Gesture Recognition

Abstract

The exponentially increasing number of Internet-of-Thing (IoT) devices introduces a spectrum crisis in the shared ISM band. However, it also introduces opportunities for conducting radio frequency (RF) sensing using pervasively available signals generated by heterogeneous IoT devices. In this paper, we explore how to leverage the ambient wireless traffic that i) generated by uncontrollable IoT devices and ii sensed by ambient noise floor measurements (a widely available metric in IoT devices) for human gesture recognition. Specifically, we introduce our system EAR, which can conduct fine-grained human gesture recognition using coarse-grained measurements (i.e., noise floor) of ambient RF signals generated from uncontrollable signal sources. We conducted extensive evaluations in both residential and academic buildings. Experimental results show that although EAR uses coarse-grained noise floor measurements to sense the uncontrollable signal sources, the signal sources can be distinguished with an accuracy up to 99.76%. Moreover, EAR can recognize fine-grained human gestures with high accuracy even under extremely low traffic rate (i.e., 4%) from uncontrollable ambient signal sources.