Action coordination with agents: crossing roads with a computer-generated character in a virtual environment

We investigated how people jointly coordinate their decisions and actions with a computer-generated character (agent) in a large-screen virtual environment. The task for participants was to physically cross a steady stream of traffic on a virtual road without getting hit by a car. Participants performed this task with another person or with a computer-generated character (Fig. 1). The character was programmed to be either safe (taking only large gaps) or risky (also taking relatively small gaps). We found that participants behaved in many respects similarly with real and virtual partners. They maintained similar distances between themselves and their partner, they often crossed the same gap with their partner, and they synchronized their crossing with their partner. We also found that the riskiness of the character influenced the gap choices of participants. This study demonstrates the potential for using large-screen virtual environments to study how people interact with CG characters when performing whole-body joint actions.