BlowU: physical feedback for seamless remote interaction in mobile

The modality for interaction between users in a mobile environment usually provides a limited communication centered on visual and auditory elements such as voice calls, video conferencing, emoticons and text messages. Therefore, in a mobile environment, an experience occurs where the senses are limited according to the message intended to be delivered by the user. From this perspective, we intend to combine the multisensory affordance of realistic interface and the method of providing interaction on the mobile environment. Tangible design expands the affordances of physical objects so they can support direct engagement with the digital world [1]. To achieve this, the researcher of this study has structured the environment that can receive the input through the mouth shape recognition and sound level analysis where it can be delivered and generated using the Bluetooth and OSC communication in order to deliver the act of blowing the breath as a sense of touch to the other party. Through the application associated with the tangible user interface, the user can utilize and experience the expanded interaction modality.