Parallel Recognition of Mandarin Tones and Focus from continuous F0

Yue Chen, Yi Xu
{"title":"Parallel Recognition of Mandarin Tones and Focus from continuous F0","authors":"Yue Chen, Yi Xu","doi":"10.21437/tai.2021-35","DOIUrl":null,"url":null,"abstract":"In tonal languages not only lexical tones but also prosodic focus can be encoded by generating F 0 contours. Such concurrent encoding of tone and intonation in speech production can be computationally simulated by speech synthesis models. It is yet unclear, however, how exactly both tone and focus can be decoded in perception from a single stream of surface F 0 contours. In this study, we applied the support vector machine (SVM) model to recognize tone and focus from F 0 trajectories in an experimental Mandarin corpus to indirectly answer the question. Three sub-experiments were run to compare the recognition strategies: recognizing tones only, recognizing focus only, and recognizing tones and focus at the same time. The recognition rate of the four tones regardless of focus was 88.3%. The recognition rate for focus regardless of tone was 77.5%. The overall recognition rates for tone-focus combinations were similar to the previous two experiments, while the breakdown of the accuracies showed that the recognition rate varied extensively across both focus conditions and tone conditions. Those results showed that the perception of tone and focus from continuous speech is likely dependent on each other, and tone and focus could be recognized in parallel.","PeriodicalId":145363,"journal":{"name":"1st International Conference on Tone and Intonation (TAI)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"1st International Conference on Tone and Intonation (TAI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.21437/tai.2021-35","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

In tonal languages not only lexical tones but also prosodic focus can be encoded by generating F 0 contours. Such concurrent encoding of tone and intonation in speech production can be computationally simulated by speech synthesis models. It is yet unclear, however, how exactly both tone and focus can be decoded in perception from a single stream of surface F 0 contours. In this study, we applied the support vector machine (SVM) model to recognize tone and focus from F 0 trajectories in an experimental Mandarin corpus to indirectly answer the question. Three sub-experiments were run to compare the recognition strategies: recognizing tones only, recognizing focus only, and recognizing tones and focus at the same time. The recognition rate of the four tones regardless of focus was 88.3%. The recognition rate for focus regardless of tone was 77.5%. The overall recognition rates for tone-focus combinations were similar to the previous two experiments, while the breakdown of the accuracies showed that the recognition rate varied extensively across both focus conditions and tone conditions. Those results showed that the perception of tone and focus from continuous speech is likely dependent on each other, and tone and focus could be recognized in parallel.
从连续F0看普通话声调与焦点的平行识别
在声调语言中,通过生成f0轮廓,不仅可以对词汇音调进行编码,还可以对韵律焦点进行编码。语音生成过程中声调和语调的并发编码可以通过语音合成模型进行计算模拟。然而,目前尚不清楚的是,如何准确地从单一的f0表面轮廓流中解码音调和焦点。在这项研究中,我们应用支持向量机(SVM)模型从实验语料库中的f0轨迹中识别音调和焦点,以间接回答这个问题。通过三个子实验比较了仅识别音调、仅识别焦点和同时识别音调和焦点的识别策略。无论焦点如何,四种音调的识别率为88.3%。焦点与音调无关的识别率为77.5%。音调-焦点组合的总体识别率与前两个实验相似,而准确率的细分表明,在焦点条件和音调条件下,识别率变化很大。这些结果表明,连续语音对语调和焦点的感知可能是相互依赖的,语调和焦点可以并行识别。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信