Spatio-temporal Attention Transformer Model for Future Trajectory Forecast

Zhiqiang Geng, Te Zhang, Yongming Han
{"title":"Spatio-temporal Attention Transformer Model for Future Trajectory Forecast","authors":"Zhiqiang Geng, Te Zhang, Yongming Han","doi":"10.1109/DDCLS55054.2022.9858377","DOIUrl":null,"url":null,"abstract":"Human trajectory prediction is very important for people's safety. And human motion is essentially a multimodal motion, which brings great challenges to the trajectory prediction. Meanwhile, most sequence-to-sequence models only consider one of the temporal and spatial characteristics of pedestrian motion and ignore other. Therefore, based on the temporal and spatial attention mechanism and the transformer model, we fuse the temporal and spatial characteristics of the imputation, and propose a deep learning prediction model based on the spatial-temporal attention transformer mechanism (STATM). Our model designs a temporal attention module based on multi-head attention, a spatial attention module based on GAT, and finally maps spatial-temporal features to trajectory destinations through a transformer-decoder-like module. Compared with other methods, our model achieves better results on ETH and UCY public datasets.","PeriodicalId":412672,"journal":{"name":"2022 IEEE 11th Data Driven Control and Learning Systems Conference (DDCLS)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE 11th Data Driven Control and Learning Systems Conference (DDCLS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DDCLS55054.2022.9858377","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Human trajectory prediction is very important for people's safety. And human motion is essentially a multimodal motion, which brings great challenges to the trajectory prediction. Meanwhile, most sequence-to-sequence models only consider one of the temporal and spatial characteristics of pedestrian motion and ignore other. Therefore, based on the temporal and spatial attention mechanism and the transformer model, we fuse the temporal and spatial characteristics of the imputation, and propose a deep learning prediction model based on the spatial-temporal attention transformer mechanism (STATM). Our model designs a temporal attention module based on multi-head attention, a spatial attention module based on GAT, and finally maps spatial-temporal features to trajectory destinations through a transformer-decoder-like module. Compared with other methods, our model achieves better results on ETH and UCY public datasets.
未来轨迹预测的时空注意力转换模型
人体轨迹预测对人体安全至关重要。人体运动本质上是一个多模态运动,这给轨迹预测带来了很大的挑战。同时,大多数序列到序列模型只考虑行人运动的一个时空特征,而忽略了其他特征。因此,基于时空注意机制和变形模型,融合输入的时空特征,提出了基于时空注意变形机制(STATM)的深度学习预测模型。我们的模型设计了一个基于多头注意的时间注意模块和一个基于GAT的空间注意模块,最后通过一个类似于转换器-解码器的模块将时空特征映射到轨迹目的地。与其他方法相比,我们的模型在ETH和UCY公共数据集上取得了更好的结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书