MAST-LLM: A large language model-driven multimodal adaptive spatio-temporal framework for air traffic complexity prediction

IF 3.5 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Rui Cheng, Jianping Fan, Chao Zhang, Meiqin Wu, Ruixin Chen, Mingxuan Chai, Anna Wang
{"title":"MAST-LLM: A large language model-driven multimodal adaptive spatio-temporal framework for air traffic complexity prediction","authors":"Rui Cheng,&nbsp;Jianping Fan,&nbsp;Chao Zhang,&nbsp;Meiqin Wu,&nbsp;Ruixin Chen,&nbsp;Mingxuan Chai,&nbsp;Anna Wang","doi":"10.1007/s10489-026-07469-7","DOIUrl":null,"url":null,"abstract":"<div><p>Airspace complexity prediction remains challenging due to intertwined spatial, temporal, and modeling factors. Spatially, airspace sectors exhibit heterogeneous dependencies from both geographical adjacency and dynamic traffic flows. Temporally, complexity evolves through multi-scale dynamics with long-range dependencies. Modeling-wise, existing spatio-temporal frameworks rely on static graphs and shallow temporal alignment, limiting their capacity for joint spatio-temporal reasoning, particularly under high-complexity and long-horizon scenarios. To overcome these challenges, this study proposes MAST-LLM, a Multimodal Adaptive Spatio-Temporal framework enhanced by Large Language Models (LLMs). First, a Mixture-of-Experts (MoE)-based temporal alignment phase is introduced to capture heterogeneous temporal patterns and align domain-specific air traffic sequences with pre-trained LLM representations. Second, a full spatio-temporal fine-tuning phase is developed, integrating adaptive multimodal spatial representations, multi-scale temporal features, and a Bidirectional Spatio-Temporal Attention (BSTA) mechanism for joint spatial–temporal interaction modeling. Finally, by leveraging the global reasoning and long-range dependency modeling abilities of LLMs, MAST-LLM establishes a unified representation that captures both local dynamics and global contextual dependencies. Extensive experiments demonstrate that MAST-LLM achieves superior performance at short- and medium-term forecasting horizons and remains competitive at longer horizons, with improvements of up to 9.5 percentage points in accuracy and 12.9 percentage points in macro F1-score. Furthermore, comprehensive ablation, factor importance, sensitivity and visualization analyses verify the effectiveness and robustness of each core component.</p></div>","PeriodicalId":8041,"journal":{"name":"Applied Intelligence","volume":"56 15","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2026-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Intelligence","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s10489-026-07469-7","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Airspace complexity prediction remains challenging due to intertwined spatial, temporal, and modeling factors. Spatially, airspace sectors exhibit heterogeneous dependencies from both geographical adjacency and dynamic traffic flows. Temporally, complexity evolves through multi-scale dynamics with long-range dependencies. Modeling-wise, existing spatio-temporal frameworks rely on static graphs and shallow temporal alignment, limiting their capacity for joint spatio-temporal reasoning, particularly under high-complexity and long-horizon scenarios. To overcome these challenges, this study proposes MAST-LLM, a Multimodal Adaptive Spatio-Temporal framework enhanced by Large Language Models (LLMs). First, a Mixture-of-Experts (MoE)-based temporal alignment phase is introduced to capture heterogeneous temporal patterns and align domain-specific air traffic sequences with pre-trained LLM representations. Second, a full spatio-temporal fine-tuning phase is developed, integrating adaptive multimodal spatial representations, multi-scale temporal features, and a Bidirectional Spatio-Temporal Attention (BSTA) mechanism for joint spatial–temporal interaction modeling. Finally, by leveraging the global reasoning and long-range dependency modeling abilities of LLMs, MAST-LLM establishes a unified representation that captures both local dynamics and global contextual dependencies. Extensive experiments demonstrate that MAST-LLM achieves superior performance at short- and medium-term forecasting horizons and remains competitive at longer horizons, with improvements of up to 9.5 percentage points in accuracy and 12.9 percentage points in macro F1-score. Furthermore, comprehensive ablation, factor importance, sensitivity and visualization analyses verify the effectiveness and robustness of each core component.

一个大型语言模型驱动的多模态自适应时空框架,用于空中交通复杂性预测
由于交织在一起的空间、时间和建模因素,空域复杂性预测仍然具有挑战性。空间上,空域部门表现出地理邻接性和动态交通流量的异质性依赖关系。在时间上,复杂性通过具有长期依赖关系的多尺度动态演变。在建模方面,现有的时空框架依赖于静态图形和浅时间对齐,限制了它们联合时空推理的能力,特别是在高复杂性和长视界场景下。为了克服这些挑战,本研究提出了mat - llm,一个由大型语言模型(llm)增强的多模态自适应时空框架。首先,引入基于混合专家(MoE)的时间对齐阶段来捕获异构时间模式,并将特定领域的空中交通序列与预训练的LLM表示对齐。其次,开发了完整的时空微调阶段,将自适应多模态空间表征、多尺度时间特征和双向时空注意(BSTA)机制整合到时空联合交互建模中。最后,通过利用llm的全局推理和远程依赖关系建模能力,MAST-LLM建立了一个统一的表示,可以捕获本地动态和全局上下文依赖关系。大量实验表明,MAST-LLM在中短期预测范围内表现优异,在长期预测范围内仍具有竞争力,准确率提高了9.5个百分点,宏观F1-score提高了12.9个百分点。此外,综合消融、因子重要性、敏感性和可视化分析验证了每个核心组件的有效性和鲁棒性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Applied Intelligence
Applied Intelligence 工程技术-计算机:人工智能
CiteScore
6.60
自引率
20.80%
发文量
1361
审稿时长
5.9 months
期刊介绍: With a focus on research in artificial intelligence and neural networks, this journal addresses issues involving solutions of real-life manufacturing, defense, management, government and industrial problems which are too complex to be solved through conventional approaches and require the simulation of intelligent thought processes, heuristics, applications of knowledge, and distributed and parallel processing. The integration of these multiple approaches in solving complex problems is of particular importance. The journal presents new and original research and technological developments, addressing real and complex issues applicable to difficult problems. It provides a medium for exchanging scientific research and technological achievements accomplished by the international community.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书