Intoxication detection from speech using representations learned from self-supervised pre-training

Abstract

Alcohol intoxication is one of the leading causes of death around the globe. Existing approaches to prevent Driving Under the Influence (DUI) are expensive, intrusive, or require external apparatus such as breathalyzers, which the drinker may not possess. Speech is a viable modality for detecting intoxication from changes in vocal patterns. Intoxicated speech is slower, has lower amplitude, and is more prone to errors at the sentence, word, and phonological levels than sober speech. However, intoxication detection from speech is challenging due to high inter- and intra-user variability and the confounding effects of other factors such as fatigue, which may also impair speech. This paper investigates Wav2Vec 2.0, a self-supervised neural network architecture, for intoxication classification from audio. Wav2Vec 2.0 is a Transformer-based model that has demonstrated remarkable performance in various speech-related tasks. It analyzes raw audio directly by applying a multi-head attention mechanism to latent audio representations and was pre-trained on the Librispeech, Libri-Light and EmoDB datasets. The proposed model achieved an unweighted average recall of 73.3%, outperforming state-of-the-art models, highlighting its potential for accurate DUI detection to prevent alcohol-related incidents.