Visually prototyping perceptual user interfaces through multimodal storyboarding

We are applying our knowledge in designing informal prototyping tools for user interface design to create an interactive visual prototyping tool for perceptual user interfaces. Our tool allows a designer to quickly map out certain types of multimodal, cross-device user interface scenarios. These sketched designs form a multimodal storyboard that can then be executed, quickly testing the interaction and collecting feedback about refinements necessary for the design. By relying on visual prototyping, our multimodal storyboarding tool simplifies and speeds perceptual user interface prototyping and opens up the challenging space of perceptual user interface design to non-programmers.