Identifying gesture onsets with high-order derivatives of articulatory trajectories

Dan Cameron Burgdorf
{"title":"Identifying gesture onsets with high-order derivatives of articulatory trajectories","authors":"Dan Cameron Burgdorf","doi":"10.1121/2.0001460","DOIUrl":null,"url":null,"abstract":"Articulatory trajectories are useful for measuring speech properties, but come with complications: a given trajectory may be influenced by multiple articulators and/or multiple overlapping gestures. Standard procedure is to identify landmarks from the trajectory and its velocity. Here, an alternative procedure is presented: higher order derivatives can be used to identify gesture onsets. High-order derivatives are generally associated with signal noise and not considered to be meaningful, but more broadly, they reflect rapid changes in acceleration, which can derive from sources other than random noise. It’s demonstrated that such high-order activity at gesture onsets is both predicted by the Task Dynamic Model of speech production (Saltzman & Munhall 1989) and observed in real electromagnetic articulography (EMA) data. Articulator trajectories generated with the Task Dynamics Application (TADA) Matlab implementation of this model (Nam & Goldstein 2004) show a pattern of increasing activity around changes in gestural activation and decreasing activity elsewhere as successive derivatives are taken. This was confirmed in EMA data on glides, demonstrating not only that the effect is real, but that it can be measurable above other noise. This activation noise can be isolated with targeted filtering, and may yield further insights into speech motor control.","PeriodicalId":394589,"journal":{"name":"179th Meeting of the Acoustical Society of America","volume":"9 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"179th Meeting of the Acoustical Society of America","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1121/2.0001460","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Articulatory trajectories are useful for measuring speech properties, but come with complications: a given trajectory may be influenced by multiple articulators and/or multiple overlapping gestures. Standard procedure is to identify landmarks from the trajectory and its velocity. Here, an alternative procedure is presented: higher order derivatives can be used to identify gesture onsets. High-order derivatives are generally associated with signal noise and not considered to be meaningful, but more broadly, they reflect rapid changes in acceleration, which can derive from sources other than random noise. It’s demonstrated that such high-order activity at gesture onsets is both predicted by the Task Dynamic Model of speech production (Saltzman & Munhall 1989) and observed in real electromagnetic articulography (EMA) data. Articulator trajectories generated with the Task Dynamics Application (TADA) Matlab implementation of this model (Nam & Goldstein 2004) show a pattern of increasing activity around changes in gestural activation and decreasing activity elsewhere as successive derivatives are taken. This was confirmed in EMA data on glides, demonstrating not only that the effect is real, but that it can be measurable above other noise. This activation noise can be isolated with targeted filtering, and may yield further insights into speech motor control.
用关节轨迹的高阶导数识别手势动作
发音轨迹对测量语音特性很有用,但也有一些复杂性:一个给定的轨迹可能会受到多个发音器和/或多个重叠手势的影响。标准程序是根据轨迹和速度来确定地标。在这里,提出了一个替代程序:高阶导数可以用来识别手势的开始。高阶导数通常与信号噪声联系在一起,不被认为是有意义的,但更广泛地说,它们反映了加速度的快速变化,这些变化可能来自随机噪声以外的来源。研究表明,手势开始时的这种高阶活动既可以由语音产生的任务动态模型(Saltzman & Munhall 1989)预测,也可以在真实的电磁发音学(EMA)数据中观察到。该模型的任务动态应用(TADA) Matlab实现生成的关节器轨迹(Nam & Goldstein 2004)显示出一种模式,即在手势激活的变化周围活动增加,而在其他地方活动随着连续导数而减少。这在滑翔机的EMA数据中得到了证实,不仅证明了这种影响是真实的,而且它可以比其他噪音更可测量。这种激活噪声可以通过有针对性的过滤来隔离,并可能对语音运动控制产生进一步的见解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信