Exploratory usability comparison of three inter­action paradigms for touchless spatio-temporal manipulations of 3D images using Leap Motion

Abstract

New devices redefining human/machine interactions are constantly entering the consumer market. After integrated mouse interactions and, later, tactile interactions, more changes are ongoing with the increasing popularity of devices allowing contactless interactions. This type of interaction device is particularly interesting in healthcare environments where physical contacts are prohibited. For instance, it can be used in the operating theatre to avoid contamination while surgeons manipulate medical images. Finding a new touchless interaction paradigm that allows manipulation of 3D images in space and time in a simple and efficient manner is not a simple task. We performed an explorative study to compare three different ways of interacting with the Leap Motion™, a device allowing interaction with a computer system through hand movements. Three interaction strategies have been implemented, one copying the traditional mouse interaction paradigm, one assigning a different hand gesture for each possible action and one using a single gesture but allowing switching between interaction modes. The qualitative results obtained during the debriefing and observation of three participants testing the systems revealed a clear preference for using a limited number of gestures. The next step in the process will be to link the device with a real medical imagery system and to use a medical scenario to confirm that these early findings are still valid in more realistic situations.