Motion detection of articulatory movement with paralinguistic information using real-time MRI movie

2019 22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA) Pub Date : 2019-10-01 DOI:10.1109/O-COCOSDA46868.2019.9060850

Takuya Asai, H. Kikuchi, K. Maekawa

{"title":"Motion detection of articulatory movement with paralinguistic information using real-time MRI movie","authors":"Takuya Asai, H. Kikuchi, K. Maekawa","doi":"10.1109/O-COCOSDA46868.2019.9060850","DOIUrl":null,"url":null,"abstract":"The goal of this study is to establish the analytical method of articulatory movement by real-time magnetic resonance images (rtMRI) without estimation of articulatory contours. We present the result of motion detection using a background subtraction method. As a result of applying the background subtraction method to the rtMRI data of one speaker, some motions were detected in tongue, lip, and lower jaw which are important places for speech generation. By the experiments with the movies of multiple speakers, we confirmed that it is possible to detect the motion of the basic articulatory movement, and some movements were different for each speaker. Furthermore, we adapted the proposed method for motion detection to the utterances aiming at the transmission of paralinguistic information. As a result, some similar movements to the previous research were observed.","PeriodicalId":263209,"journal":{"name":"2019 22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA)","volume":"61 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/O-COCOSDA46868.2019.9060850","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 1

Abstract

The goal of this study is to establish the analytical method of articulatory movement by real-time magnetic resonance images (rtMRI) without estimation of articulatory contours. We present the result of motion detection using a background subtraction method. As a result of applying the background subtraction method to the rtMRI data of one speaker, some motions were detected in tongue, lip, and lower jaw which are important places for speech generation. By the experiments with the movies of multiple speakers, we confirmed that it is possible to detect the motion of the basic articulatory movement, and some movements were different for each speaker. Furthermore, we adapted the proposed method for motion detection to the utterances aiming at the transmission of paralinguistic information. As a result, some similar movements to the previous research were observed.

查看原文本刊更多论文

基于实时MRI影像的辅助语言信息的发音运动检测

本研究的目的是建立一种不需要估计关节轮廓的实时磁共振图像(rtMRI)分析关节运动的方法。我们给出了使用背景减法的运动检测结果。将背景减法应用于一个说话人的rtMRI数据，在舌头、嘴唇和下颌这些重要的语音生成部位检测到一些运动。通过对多个说话者的视频进行实验，我们证实了可以检测到基本发音运动的运动，并且每个说话者的一些运动是不同的。此外，我们将所提出的运动检测方法应用于以副语言信息传递为目的的话语。结果，观察到一些与先前研究相似的运动。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

2019 22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA)

自引率

0.00%

发文量