Perception-based interactive sound synthesis of morphing solids' interactions

Abstract

This brief introduces a novel framework for the interactive and real-time synthesis of solids' interaction sounds driven by a game engine. The sound synthesizer used in this work relies on an action-object paradigm, itself based on the notion of perceptual invariants. An intuitive control strategy, based on those invariants and inspired by physics, was developed. The action and the object can be controlled independently, simultaneously, and continuously. This allows the synthesis of sounds for solids' interactions whose nature evolves continuously over time (e.g. from rolling to slipping) and/or where the objects' properties (shape, size and material) vary continuously in time.