A UMPC Based Mixed Reality System Replacing a Tour Guide

Abstract

A ubiquitous mixed reality system based on ldquoexperience contentsrdquo is presented. The 3D contents provided for users are associated with Korean ancient military weapons such as the turtle ship and the fire wagon, and overlaid on the real images captured by a UMPC camera while looking at the particular weapon displayed in the science museum. For an exact registration of the virtually modeled objects with the captured real images, userpsilas position and pose are continuously tracked using the hybrid method using ultrasonic signal and vision algorithm. Also an interaction method useful in a mobile environment and the content authoring tool making mixed reality content with multimedia resources are developed to improve userpsilas experience.