... IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops最新文献

筛选

英文中文

ANALYSIS OF SELF-SUPERVISED SPEECH MODELS ON CHILDREN'S SPEECH AND INFANT VOCALIZATIONS. 儿童言语和婴儿发声的自监督言语模型分析。

... IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops Pub Date : 2024-04-01 Epub Date: 2024-08-15 DOI: 10.1109/ICASSPW62465.2024.10626416

Jialu Li, Mark Hasegawa-Johnson, Nancy L McElwain

{"title":"ANALYSIS OF SELF-SUPERVISED SPEECH MODELS ON CHILDREN'S SPEECH AND INFANT VOCALIZATIONS.","authors":"Jialu Li, Mark Hasegawa-Johnson, Nancy L McElwain","doi":"10.1109/ICASSPW62465.2024.10626416","DOIUrl":"10.1109/ICASSPW62465.2024.10626416","url":null,"abstract":"<p><p>To understand why self-supervised learning (SSL) models have empirically achieved strong performances on several speech-processing downstream tasks, numerous studies have focused on analyzing the encoded information of the SSL layer representations in adult speech. Limited work has investigated how pre-training and fine-tuning affect SSL models encoding children's speech and vocalizations. In this study, we aim to bridge this gap by probing SSL models on two relevant downstream tasks: (1) phoneme recognition (PR) on the speech of adults, older children (8-10 years old), and younger children (1-4 years old), and (2) vocalization classification (VC) distinguishing cry, fuss, and babble for infants under 14 months old. For younger children's PR, the superiority of fine-tuned SSL models is largely due to their ability to learn features that represent older children's speech and then adapt those features to the speech of younger children. For infant VC, SSL models pre-trained on large-scale home recordings learn to leverage phonetic representations at middle layers, and thereby enhance the performance of this task.</p>","PeriodicalId":520867,"journal":{"name":"... IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops","volume":"2024 ","pages":"550-554"},"PeriodicalIF":0.0,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12126097/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144201375","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0