User Interface Beaming -- Seamless Interaction with Smart Things Using Personal Wearable Computers

Abstract

For the Internet of Things to be adopted in people's homes and at their workplaces, it is important to provide mechanisms that support them when controlling and monitoring smart things in their surroundings. We present the concept of user interface beaming, where the capabilities of different personal wearable computers are combined to allow users to conveniently interact with smart things in their environment. Smartglasses are used to select a target smart thing by means of current object recognition technologies. Then, an appropriate user interface for the target is rendered on the user's smartwatch. This interface is continuously updated to reflect state changes of the target and can be used to interact with that smart thing using different interaction modalities.