Szymon Zaporowski, Joanna Gołębiewska, B. Kostek, Julia Piltz
{"title":"Audio-visual aspect of the Lombard effect and comparison with recordings depicting emotional states","authors":"Szymon Zaporowski, Joanna Gołębiewska, B. Kostek, Julia Piltz","doi":"10.23919/SPA.2018.8563395","DOIUrl":null,"url":null,"abstract":"In this paper an analysis of audio-visual recordings of the Lombard effect is shown. First, audio signal is analyzed indicating the presence of this phenomenon in the recorded sessions. The principal aim, however, was to discuss problems related to extracting differences caused by the Lombard effect, present in the video, i.e. visible as tension and work of facial muscles aligned to an increase in the intensity of the articulated speech signal. Also the database of recordings, available on the internet, depicting emotional states was analyzed in order to compare and find a visual similarity between the Lombard effect and sentiment contained in speech. The results presented are discussed and further plans are depicted.","PeriodicalId":265587,"journal":{"name":"2018 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23919/SPA.2018.8563395","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
In this paper an analysis of audio-visual recordings of the Lombard effect is shown. First, audio signal is analyzed indicating the presence of this phenomenon in the recorded sessions. The principal aim, however, was to discuss problems related to extracting differences caused by the Lombard effect, present in the video, i.e. visible as tension and work of facial muscles aligned to an increase in the intensity of the articulated speech signal. Also the database of recordings, available on the internet, depicting emotional states was analyzed in order to compare and find a visual similarity between the Lombard effect and sentiment contained in speech. The results presented are discussed and further plans are depicted.