Challenges for usability testing in ubiquitous systems

Ubiquitous computing expands both the place where the software system is used and the traditional way of interacting with its users. This happens since technologies should be fully integrated in the user daily activities in such way they become indistinguishable. So, in this scenario, new characteristics can emerge like calmness, transparency and context awareness that should be evaluated to assure the ubiquitous system quality. One of the methods used for evaluation of traditional systems is usability testing. Then, in this paper, we identify the main challenges to perform usability testing in ubiquitous systems based on an overview of the literature studies and on our own experience in testing this kind of systems. We also describe our ongoing work where we investigate usability testing to be designed considering context-awareness and to be supported by specific measurements to the ubiquitous computing scenario.