AR costumes: automatically augmenting watertight costumes from a single RGB image

Abstract

We describe a method to automatically augment a watertight digital costume onto a person's body from a monocular RGB image. When overlaying a digital costume onto a body using pose matching, several parts of the person's cloth or skin remain visible due to differences in shape and proportions. In this paper, we present a practical solution to these artifacts which requires minimal costume parameterization work, and a straightforward inpainting approach. To our knowledge, our approach is the first to deliver plausible watertight costumes from RGB imagery only, and is compatible with mobile devices. We show successful results at high resolution in our video and project web page, as well as defects in the discussion section of paper, which can serve as comparison for future improvements.