Image pattern perception by interactive sound presentation

Abstract

This paper presents a result of basic research with an interactive sound presentation system to aim at making human perceive color image patterns as a goal. The system has the following characteristics. (1) Operators can interactively input positions of interest to be heard through pen-tablet interfaces. (2) The system presents local colored patterns by the form of concatenated syllables, i.e., a kind of "color pattern verbal words". (3) An effect of learning is studied on correct perceptual rate. (4) The positional assignments of syllables to the color pattern verbal words are examined, considering human perceptual characteristics.