SD-T2LM: Long-Sequence Human Motion Generation Based on Dynamic SLERP Interpolation and Dynamic Mask Mechanism

IF 3.4 4区 计算机科学 Q4 COMPUTER SCIENCE, SOFTWARE ENGINEERING
Fengsen Jin, Guang Li, Jianjun Li, Chongyang Ding
{"title":"SD-T2LM: Long-Sequence Human Motion Generation Based on Dynamic SLERP Interpolation and Dynamic Mask Mechanism","authors":"Fengsen Jin,&nbsp;Guang Li,&nbsp;Jianjun Li,&nbsp;Chongyang Ding","doi":"10.1002/cav.70078","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>Text-driven human motion generation aims to synthesize coherent, natural human actions from natural-language descriptions. While current techniques are effective for short sequences, they often suffer from abrupt transitions, detail loss, and temporal misalignment when extended to long sequences. We present SD-T2LM, a unified framework that couples transition optimization, detail enhancement, and temporal alignment to produce natural, detail-rich long motion sequences. First, a dynamic SLERP interpolation selects transition length conditioned on start/end pose similarity to suppress discontinuities while preserving physical plausibility. Second, a dynamic masking mechanism progressively reduces the mask ratio from 60% to 30% during training, enabling staged learning-global structure early, fine-grained details later. Third, a Temporal Flexible Alignment loss based on Soft-DTW aligns generated and ground-truth rhythms without enforcing point-wise synchrony. On the HumanML3D dataset and KIT-ML dataset, SD-T2LM showed significant improvements in FID and diversity compared to the baseline model, while reducing transition distance and jerk.</p>\n </div>","PeriodicalId":50645,"journal":{"name":"Computer Animation and Virtual Worlds","volume":"36 6","pages":""},"PeriodicalIF":3.4000,"publicationDate":"2025-12-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Animation and Virtual Worlds","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/cav.70078","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}
引用次数: 0

Abstract

Text-driven human motion generation aims to synthesize coherent, natural human actions from natural-language descriptions. While current techniques are effective for short sequences, they often suffer from abrupt transitions, detail loss, and temporal misalignment when extended to long sequences. We present SD-T2LM, a unified framework that couples transition optimization, detail enhancement, and temporal alignment to produce natural, detail-rich long motion sequences. First, a dynamic SLERP interpolation selects transition length conditioned on start/end pose similarity to suppress discontinuities while preserving physical plausibility. Second, a dynamic masking mechanism progressively reduces the mask ratio from 60% to 30% during training, enabling staged learning-global structure early, fine-grained details later. Third, a Temporal Flexible Alignment loss based on Soft-DTW aligns generated and ground-truth rhythms without enforcing point-wise synchrony. On the HumanML3D dataset and KIT-ML dataset, SD-T2LM showed significant improvements in FID and diversity compared to the baseline model, while reducing transition distance and jerk.

SD-T2LM:基于动态SLERP插值和动态掩模机制的长序列人体运动生成
文本驱动的人类动作生成旨在从自然语言描述中合成连贯、自然的人类动作。虽然目前的技术对短序列是有效的,但当扩展到长序列时,它们经常遭受突变,细节丢失和时间错位。我们提出了SD-T2LM,这是一个统一的框架,结合了过渡优化,细节增强和时间对齐,以产生自然的,细节丰富的长运动序列。首先,动态SLERP插值选择以起始/结束位姿相似性为条件的过渡长度,在保持物理合理性的同时抑制不连续。其次,动态掩蔽机制在训练过程中逐步将掩蔽率从60%降低到30%,从而实现早期的分阶段学习-全局结构,后期的细粒度细节。第三,基于Soft-DTW的时间柔性对齐损失在不强制逐点同步的情况下对齐生成的和真实的节奏。在HumanML3D数据集和KIT-ML数据集上,与基线模型相比,SD-T2LM在FID和多样性方面表现出显著改善,同时减少了过渡距离和抖动。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computer Animation and Virtual Worlds
Computer Animation and Virtual Worlds 工程技术-计算机:软件工程
CiteScore
2.20
自引率
0.00%
发文量
90
审稿时长
6-12 weeks
期刊介绍: With the advent of very powerful PCs and high-end graphics cards, there has been an incredible development in Virtual Worlds, real-time computer animation and simulation, games. But at the same time, new and cheaper Virtual Reality devices have appeared allowing an interaction with these real-time Virtual Worlds and even with real worlds through Augmented Reality. Three-dimensional characters, especially Virtual Humans are now of an exceptional quality, which allows to use them in the movie industry. But this is only a beginning, as with the development of Artificial Intelligence and Agent technology, these characters will become more and more autonomous and even intelligent. They will inhabit the Virtual Worlds in a Virtual Life together with animals and plants.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书