12th ISCA Speech Synthesis Workshop (SSW2023)最新文献_第3页

Federated Learning for Human-in-the-Loop Many-to-Many Voice Conversion 人在循环中多对多语音转换的联邦学习

12th ISCA Speech Synthesis Workshop (SSW2023) Pub Date : 2023-08-26 DOI: 10.21437/ssw.2023-15

Ryunosuke Hirai, Yuki Saito, H. Saruwatari

引用次数: 0

Lightweight End-to-end Text-to-speech Synthesis for low resource on-device applications 用于低资源设备上应用程序的轻量级端到端文本到语音合成

12th ISCA Speech Synthesis Workshop (SSW2023) Pub Date : 2023-08-26 DOI: 10.21437/ssw.2023-35

Biel Tura Vecino, Adam Gabrys, Daniel Matwicki, Andrzej Pomirski, Tom Iddon, Marius Cotescu, Jaime Lorenzo-Trueba

{"title":"Lightweight End-to-end Text-to-speech Synthesis for low resource on-device applications","authors":"Biel Tura Vecino, Adam Gabrys, Daniel Matwicki, Andrzej Pomirski, Tom Iddon, Marius Cotescu, Jaime Lorenzo-Trueba","doi":"10.21437/ssw.2023-35","DOIUrl":"https://doi.org/10.21437/ssw.2023-35","url":null,"abstract":"Recent works have shown that modelling raw waveform directly from text in an end-to-end (E2E) fashion produces more natural-sounding speech than traditional neural text-to-speech (TTS) systems based on a cascade or two-stage approach. However, current E2E state-of-the-art models are computationally complex and memory-consuming, making them unsuitable for real-time offline on-device applications in low-resource scenarios. To address this issue, we propose a Lightweight E2E-TTS (LE2E) model that generates high-quality speech requiring minimal computational resources. We evaluate the proposed model on the LJSpeech dataset and show that it achieves state-of-the-art performance while being up to 90% smaller in terms of model parameters and 10 × faster in real-time-factor. Furthermore, we demonstrate that the proposed E2E training paradigm achieves better quality compared to an equivalent architecture trained in a two-stage approach. Our results suggest that LE2E is a promising approach for developing real-time, high quality, low-resource TTS applications for on-device applications.","PeriodicalId":346639,"journal":{"name":"12th ISCA Speech Synthesis Workshop (SSW2023)","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128172769","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

MooseNet: A Trainable Metric for Synthesized Speech with a PLDA Module MooseNet:基于PLDA模块的可训练合成语音度量

12th ISCA Speech Synthesis Workshop (SSW2023) Pub Date : 2023-01-17 DOI: 10.21437/ssw.2023-8

Ondvrej Pl'atek, Ondrej Dusek

引用次数: 1

Improving the quality of neural TTS using long-form content and multi-speaker multi-style modeling 利用长内容和多说话人多风格建模提高神经TTS的质量

12th ISCA Speech Synthesis Workshop (SSW2023) Pub Date : 2022-12-20 DOI: 10.21437/ssw.2023-23

T. Raitio, Javier Latorre, Andrea Davis, Tuuli H. Morrill, L. Golipour

引用次数: 0

Improving robustness of spontaneous speech synthesis with linguistic speech regularization and pseudo-filled-pause insertion 用语言语音正则化和伪填充停顿插入提高自发语音合成的鲁棒性

12th ISCA Speech Synthesis Workshop (SSW2023) Pub Date : 2022-10-18 DOI: 10.21437/ssw.2023-10

Yuta Matsunaga, Takaaki Saeki, Shinnosuke Takamichi, H. Saruwatari

引用次数: 0