11th ISCA Speech Synthesis Workshop (SSW 11)最新文献

Comparing acoustic and textual representations of previous linguistic context for improving Text-to-Speech 比较先前语言语境的声学和文本表征，以提高文本到语音的转换

11th ISCA Speech Synthesis Workshop (SSW 11) Pub Date : 2021-08-26 DOI: 10.21437/ssw.2021-36

Pilar Oplustil-Gallegos, Johannah O'Mahony, Simon King

引用次数: 8

Methods of slowing down speech 放慢语速的方法

11th ISCA Speech Synthesis Workshop (SSW 11) Pub Date : 2021-08-26 DOI: 10.21437/ssw.2021-8

Christina Tånnander, Jens Edlund

{"title":"Methods of slowing down speech","authors":"Christina Tånnander, Jens Edlund","doi":"10.21437/ssw.2021-8","DOIUrl":"https://doi.org/10.21437/ssw.2021-8","url":null,"abstract":"A slower speaking rate of human or synthetic speech is often requested by for example language learners or people with aphasia or dementia. Slow speech produced by human speakers typically contain a larger number of pauses, and both pauses and speech have longer segment durations than speech produced at a standard or fast speaking rate. This paper presents several methods of prolonging speech. Two speech chunks of about 30 seconds each, read by a professional voice talent at a very slow speaking rate, were used as reference. Seven pairs of stimuli containing the same word sequences were produced, one by the same professional, reading at her standard speaking rate and six by a moderately slow synthetic voice trained on the same human voice. Different combinations of pause insertions and stretching were used to match the total length of the corresponding reference stimulus. Stretching was applied in different proportions to speech and non-speech, and pauses were inserted at punctuations, at certain phrase boundaries, between each word, or by copying the pause locations of the reference reading. 128 crowdsourced listeners evaluated the 16 stimuli. The results show that all manipulated readings are less consistent with expectations of slow speech than the reference, but that the synthesised readings are comparable to stretched human speech. Key factors are the relation between speech and silence and the duration of talkspurts.","PeriodicalId":106906,"journal":{"name":"11th ISCA Speech Synthesis Workshop (SSW 11)","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130935694","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Impact of Segmentation and Annotation in French end-to-end Synthesis 法语端到端合成中切分和注释的影响

11th ISCA Speech Synthesis Workshop (SSW 11) Pub Date : 2021-08-26 DOI: 10.21437/ssw.2021-3

Martin Lenglet, O. Perrotin, G. Bailly

{"title":"Impact of Segmentation and Annotation in French end-to-end Synthesis","authors":"Martin Lenglet, O. Perrotin, G. Bailly","doi":"10.21437/ssw.2021-3","DOIUrl":"https://doi.org/10.21437/ssw.2021-3","url":null,"abstract":"Audio books are commonly used to train text-to-speech models (TTS), as they offer large phonetic content with rather expressive pronunciation, but number and sizes of publicly available audio books corpora differ between languages. More-over, the quality and accuracy of the available utterance segmentations are debatable. Yet, the impact of segmentation on the output synthesis is not well established. Additionally, utterances are generally used individually, without taking advantage of text level structuring information, even though they inﬂuence speaker reading. In this paper, we conduct a multidimensional evaluation of Tacotron2 trained on different segmentations and text level annotations of the same French corpus. We show that both spectrum accuracy and expressiveness depend on the segmentation used. In particular, a shorter segmentation, in addition with the annotation of paragraphs, beneﬁts to spectrum reconstruction at the detriment of phrasing. Multidimensional analysis of mean opinion scores obtained with a MUSHRA-experiment revealed that phrasing was relatively more important than spectrum accuracy in perceptual judgement. This work serves as evidence that particular attention must be given to models evaluation, as well as how to use the training corpus to maximize synthesis characteristics of interest.","PeriodicalId":106906,"journal":{"name":"11th ISCA Speech Synthesis Workshop (SSW 11)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132181310","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Identifying the vocal cues of likeability, friendliness and skilfulness in synthetic speech 识别合成语音中讨人喜欢、友好和熟练的声音线索

11th ISCA Speech Synthesis Workshop (SSW 11) Pub Date : 2021-08-26 DOI: 10.21437/ssw.2021-1

S. Rallabandi, Babak Naderi, Sebastian Möller

{"title":"Identifying the vocal cues of likeability, friendliness and skilfulness in synthetic speech","authors":"S. Rallabandi, Babak Naderi, Sebastian Möller","doi":"10.21437/ssw.2021-1","DOIUrl":"https://doi.org/10.21437/ssw.2021-1","url":null,"abstract":"The advent of neural Text-to-Speech (TTS) synthesizers has enhanced the expressivity of synthetic speech in the recent past. However, there is very little work on understanding the acoustic correlates of paralinguistic traits, emotions, speaker attributes and characteristics from synthetic speech. This paper investi-gates the acoustic correlates of the speaker attributes: likeability, friendliness, and skillfulness. Our study was carried out on the voices derived from the two commercial TTS systems, Amazon Polly (9 voices) and Google TTS engine (10 voices). In our previous study, we performed a crowd-sourcing-based evaluation to collect the subjective ratings for the desired speaker attributes. In this work, we perform the acoustic feature prediction using the backward elimination algorithm. We show that the level of loudness, spectral ﬂux, fundamental frequency, its formant frequencies, and their combinations contribute to the desired speaker attributes. We further combine the ratings of friendliness and likeability to investigate the characteristic, warmth in synthetic speech and correspondingly, skilfullness represents the characteristic, competence.","PeriodicalId":106906,"journal":{"name":"11th ISCA Speech Synthesis Workshop (SSW 11)","volume":"04 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131319395","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Homograph disambiguation with contextual word embeddings for TTS systems 基于上下文词嵌入的TTS系统同形消歧

11th ISCA Speech Synthesis Workshop (SSW 11) Pub Date : 2021-08-26 DOI: 10.21437/ssw.2021-39

M. Nicolis, V. Klimkov

引用次数: 5

Accent Modeling of Low-Resourced Dialect in Pitch Accent Language Using Variational Autoencoder 基于变分自编码器的低资源重音语言重音建模

11th ISCA Speech Synthesis Workshop (SSW 11) Pub Date : 2021-08-26 DOI: 10.21437/ssw.2021-33

Kazuya Yufune, Tomoki Koriyama, Shinnosuke Takamichi, H. Saruwatari

{"title":"Accent Modeling of Low-Resourced Dialect in Pitch Accent Language Using Variational Autoencoder","authors":"Kazuya Yufune, Tomoki Koriyama, Shinnosuke Takamichi, H. Saruwatari","doi":"10.21437/ssw.2021-33","DOIUrl":"https://doi.org/10.21437/ssw.2021-33","url":null,"abstract":"Realizing text-to-speech (TTS) system of dialects is useful for personalizing TTS systems. However, TTS for many dialects of pitch accent languages is not realized because of lowresourced problem. Among many dialects of pitch accent languages, this paper focuses on Osaka dialect of Japanese, one of the most challenging pitch accent languages. For Japanese TTS system, accent labels are known to be necessary as input to synthesize natural speech. In rich-resourced dialect, humanresourced approaches and dictionary-based approaches are often used to annotate accent labels for training and inference, but such approaches are unfeasible and time-consuming for lowresourced dialects. In this paper, we propose accent extraction model that utilizes vector quantized variational autoencoder (VQ-VAE) to prepare accent information from speech, and accent prediction models that utilize decision tree and deep learning techniques to predict accent information from the input text. The models were examined with corpus of Osaka dialect, whose accent labels do not exist. The results showed that accent extraction model succeeded in extracting accent information of Osaka dialect from speech utterances as latent variable. It also showed that the accent of synthesized speech by accent prediction models were not better than baseline, but it had advantages such as interpretability.","PeriodicalId":106906,"journal":{"name":"11th ISCA Speech Synthesis Workshop (SSW 11)","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131089841","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Mind your p’s and k’s -- Comparing obstruents across TTS voices of the Blizzard Challenge 2013 注意你的p 's和k 's——比较2013暴雪挑战赛TTS声音中的障碍物

11th ISCA Speech Synthesis Workshop (SSW 11) Pub Date : 2021-08-26 DOI: 10.21437/ssw.2021-29

Ayushi Pandey, Sébastien Le Maguer, Julie Berndsen, N. Harte

{"title":"Mind your p’s and k’s -- Comparing obstruents across TTS voices of the Blizzard Challenge 2013","authors":"Ayushi Pandey, Sébastien Le Maguer, Julie Berndsen, N. Harte","doi":"10.21437/ssw.2021-29","DOIUrl":"https://doi.org/10.21437/ssw.2021-29","url":null,"abstract":"Obstruent consonants have been investigated in speech quality assessment studies of natural speech, where enhancing their perception has improved overall speech quality. This paper presents a comparative analysis of acoustic-phonetic features of obstruent consonants in synthetic speech. Features for obstruent consonants are identified where TTS systems differ significantly from a natural human voice, as a function of quality. The synthetic speech voices from the Blizzard Challenge of 2013 are used for this investigation. TTS systems were first assigned groups based on their MOS rating (quality) and shared TTS technique (family). Then, acoustic-phonetic features characteristic of contrastive properties in obstruents, were extracted from all systems. While quality differences between low-rated systems and high-rated systems were observed in a large number of features, we report those where statistically significant differences (p-val < 0.001) were observed between the systems. Where quality effects were not found, we investigated whether systems of the same family exhibit similar behaviour. Finally, individual systems within a group were examined for their differing influence on the acoustic-phonetic feature set of obstruents. Here, we found that HMM systems with similar MOS ratings do not differ in their acoustic realization of obstruents, while Unit Selection systems showed stronger individual system variability. A comparative analysis of obstruent consonants across TTS systems applies techniques from the domain of corpusphonetics to the task of speech synthesis evaluation. Identifying phonologically relevant acoustic features, may indicate the underlying articulatory process compromised in those systems, that correlates with the distorted acoustics.","PeriodicalId":106906,"journal":{"name":"11th ISCA Speech Synthesis Workshop (SSW 11)","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122540474","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Personality in the mix - investigating the contribution of fillers and speaking style to the perception of spontaneous speech synthesis 混合中的个性——调查填充物和说话风格对自发语音合成感知的贡献

11th ISCA Speech Synthesis Workshop (SSW 11) Pub Date : 2021-08-26 DOI: 10.21437/ssw.2021-9

Joakim Gustafson, J. Beskow, Éva Székely

引用次数: 12

Audiobook Speech Synthesis Conditioned by Cross-Sentence Context-Aware Word Embeddings 基于跨句语境感知词嵌入的有声读物语音合成

11th ISCA Speech Synthesis Workshop (SSW 11) Pub Date : 2021-08-26 DOI: 10.21437/ssw.2021-37

Wataru Nakata, Tomoki Koriyama, Shinnosuke Takamichi, Naoko Tanji, Yusuke Ijima, Ryo Masumura, H. Saruwatari

引用次数: 9

Improving Emotional TTS with an Emotion Intensity Input from Unsupervised Extraction 基于无监督提取的情绪强度输入改进情绪TTS

11th ISCA Speech Synthesis Workshop (SSW 11) Pub Date : 2021-08-26 DOI: 10.21437/ssw.2021-11

Bastian Schnell, Philip N. Garner

引用次数: 8