Sensory Technolinguistics: On Mechanisms of Transmitting Multimodal Messages in Perceptual-Cognitive Interfaces

Abstract

An approach to implementing perceptual-cognitive interfaces (PCIs) is presented in the context of the synchronous transmission of speech messages with perceptual semantics via technologically available and relevant sensory channels (visual, auditory, tactile, olfactory, and motor). The architecture of interfaces, implementation of the language model, and limitations imposed by the PCI model are considered. The introduction of the term “sensory technolinguistics” is justified, and possible areas of using perceptual-cognitive interfaces are described.