Spatial-Temporal Multi-Head Attention Networks for Traffic Flow Forecasting

Zhao Zhang, Ming Liu, Wenquan Xu
{"title":"Spatial-Temporal Multi-Head Attention Networks for Traffic Flow Forecasting","authors":"Zhao Zhang, Ming Liu, Wenquan Xu","doi":"10.1145/3487075.3487102","DOIUrl":null,"url":null,"abstract":"Traffic flow forecasting plays an important role in the intelligent traffic system, which is the basis for traffic control and traffic management. However, due to the complex spatial-temporal dependence, traffic flow forecasting has always been a difficulty in the field of intelligent traffic. In order to select a suitable spatial-temporal forecasting method and solve the problem that recurrent neural architecture is not conducive to parallel computing, we construct a spatial-temporal forecasting model by using multi-head attention models. Use graph attention networks with multi-head attention mechanism to capture spatial features, and use the scaled dot product attention with positional encoding like Transformer to capture temporal features. Experimental results on two real-world datasets demonstrate that the forecasting error of our method is lower than baseline methods.","PeriodicalId":354966,"journal":{"name":"Proceedings of the 5th International Conference on Computer Science and Application Engineering","volume":"31 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 5th International Conference on Computer Science and Application Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3487075.3487102","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

Abstract

Traffic flow forecasting plays an important role in the intelligent traffic system, which is the basis for traffic control and traffic management. However, due to the complex spatial-temporal dependence, traffic flow forecasting has always been a difficulty in the field of intelligent traffic. In order to select a suitable spatial-temporal forecasting method and solve the problem that recurrent neural architecture is not conducive to parallel computing, we construct a spatial-temporal forecasting model by using multi-head attention models. Use graph attention networks with multi-head attention mechanism to capture spatial features, and use the scaled dot product attention with positional encoding like Transformer to capture temporal features. Experimental results on two real-world datasets demonstrate that the forecasting error of our method is lower than baseline methods.
交通流预测的时空多头注意网络
交通流预测在智能交通系统中起着重要的作用,是交通控制和交通管理的基础。然而,由于复杂的时空依赖性,交通流预测一直是智能交通领域的一个难点。为了选择合适的时空预测方法,解决递归神经结构不利于并行计算的问题,利用多头注意模型构建了一个时空预测模型。使用带有多头注意机制的图注意网络捕获空间特征,使用带有位置编码(如Transformer)的缩放点积注意捕获时间特征。在两个实际数据集上的实验结果表明,该方法的预测误差低于基线方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信