Rui Cheng, Jianping Fan, Chao Zhang, Meiqin Wu, Ruixin Chen, Mingxuan Chai, Anna Wang
{"title":"MAST-LLM: A large language model-driven multimodal adaptive spatio-temporal framework for air traffic complexity prediction","authors":"Rui Cheng, Jianping Fan, Chao Zhang, Meiqin Wu, Ruixin Chen, Mingxuan Chai, Anna Wang","doi":"10.1007/s10489-026-07469-7","DOIUrl":null,"url":null,"abstract":"<div><p>Airspace complexity prediction remains challenging due to intertwined spatial, temporal, and modeling factors. Spatially, airspace sectors exhibit heterogeneous dependencies from both geographical adjacency and dynamic traffic flows. Temporally, complexity evolves through multi-scale dynamics with long-range dependencies. Modeling-wise, existing spatio-temporal frameworks rely on static graphs and shallow temporal alignment, limiting their capacity for joint spatio-temporal reasoning, particularly under high-complexity and long-horizon scenarios. To overcome these challenges, this study proposes MAST-LLM, a Multimodal Adaptive Spatio-Temporal framework enhanced by Large Language Models (LLMs). First, a Mixture-of-Experts (MoE)-based temporal alignment phase is introduced to capture heterogeneous temporal patterns and align domain-specific air traffic sequences with pre-trained LLM representations. Second, a full spatio-temporal fine-tuning phase is developed, integrating adaptive multimodal spatial representations, multi-scale temporal features, and a Bidirectional Spatio-Temporal Attention (BSTA) mechanism for joint spatial–temporal interaction modeling. Finally, by leveraging the global reasoning and long-range dependency modeling abilities of LLMs, MAST-LLM establishes a unified representation that captures both local dynamics and global contextual dependencies. Extensive experiments demonstrate that MAST-LLM achieves superior performance at short- and medium-term forecasting horizons and remains competitive at longer horizons, with improvements of up to 9.5 percentage points in accuracy and 12.9 percentage points in macro F1-score. Furthermore, comprehensive ablation, factor importance, sensitivity and visualization analyses verify the effectiveness and robustness of each core component.</p></div>","PeriodicalId":8041,"journal":{"name":"Applied Intelligence","volume":"56 15","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2026-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Intelligence","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s10489-026-07469-7","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Airspace complexity prediction remains challenging due to intertwined spatial, temporal, and modeling factors. Spatially, airspace sectors exhibit heterogeneous dependencies from both geographical adjacency and dynamic traffic flows. Temporally, complexity evolves through multi-scale dynamics with long-range dependencies. Modeling-wise, existing spatio-temporal frameworks rely on static graphs and shallow temporal alignment, limiting their capacity for joint spatio-temporal reasoning, particularly under high-complexity and long-horizon scenarios. To overcome these challenges, this study proposes MAST-LLM, a Multimodal Adaptive Spatio-Temporal framework enhanced by Large Language Models (LLMs). First, a Mixture-of-Experts (MoE)-based temporal alignment phase is introduced to capture heterogeneous temporal patterns and align domain-specific air traffic sequences with pre-trained LLM representations. Second, a full spatio-temporal fine-tuning phase is developed, integrating adaptive multimodal spatial representations, multi-scale temporal features, and a Bidirectional Spatio-Temporal Attention (BSTA) mechanism for joint spatial–temporal interaction modeling. Finally, by leveraging the global reasoning and long-range dependency modeling abilities of LLMs, MAST-LLM establishes a unified representation that captures both local dynamics and global contextual dependencies. Extensive experiments demonstrate that MAST-LLM achieves superior performance at short- and medium-term forecasting horizons and remains competitive at longer horizons, with improvements of up to 9.5 percentage points in accuracy and 12.9 percentage points in macro F1-score. Furthermore, comprehensive ablation, factor importance, sensitivity and visualization analyses verify the effectiveness and robustness of each core component.
期刊介绍:
With a focus on research in artificial intelligence and neural networks, this journal addresses issues involving solutions of real-life manufacturing, defense, management, government and industrial problems which are too complex to be solved through conventional approaches and require the simulation of intelligent thought processes, heuristics, applications of knowledge, and distributed and parallel processing. The integration of these multiple approaches in solving complex problems is of particular importance.
The journal presents new and original research and technological developments, addressing real and complex issues applicable to difficult problems. It provides a medium for exchanging scientific research and technological achievements accomplished by the international community.