{"title":"Research on speech synthesis technology based on Tibetan rhythmic features","authors":"Kuntharrgyal Khysru , Yangzom , Wenjie Tang , Jianguo Wei","doi":"10.1016/j.eswa.2025.127181","DOIUrl":null,"url":null,"abstract":"<div><div>Text-to-speech(TTS) synthesis technology is one of the core technologies in the field of human–computer interaction, playing an important role in this area. This article starts from the theory of Tibetan grammar and the phonetic characteristics of Tibetan language, and designs a rhythm boundary automatic annotation method for Tibetan text and acoustic features based on the phonetic characteristics of Tibetan language. By predicting the rhythm structure hierarchy through a rhythm prediction model, and after modeling Tibetan rhythm on the acoustic model, the Tibetan synthesis model based on the improved Tacotron2 is constructed to obtain the final synthetic Tibetan speech. Experimental results show that the deep model for Tibetan speech synthesis, which utilizes Tibetan rhythm features, can further improve the naturalness and comprehensibility of the synthesized speech.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"277 ","pages":"Article 127181"},"PeriodicalIF":7.5000,"publicationDate":"2025-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417425008036","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Text-to-speech(TTS) synthesis technology is one of the core technologies in the field of human–computer interaction, playing an important role in this area. This article starts from the theory of Tibetan grammar and the phonetic characteristics of Tibetan language, and designs a rhythm boundary automatic annotation method for Tibetan text and acoustic features based on the phonetic characteristics of Tibetan language. By predicting the rhythm structure hierarchy through a rhythm prediction model, and after modeling Tibetan rhythm on the acoustic model, the Tibetan synthesis model based on the improved Tacotron2 is constructed to obtain the final synthetic Tibetan speech. Experimental results show that the deep model for Tibetan speech synthesis, which utilizes Tibetan rhythm features, can further improve the naturalness and comprehensibility of the synthesized speech.
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.