Runjiao Bao;Yongkang Xu;Chenhao Wang;Tianwei Niu;Junzheng Wang;Shoukun Wang
{"title":"STGN:一种实时广义轨迹规划的时空图网络","authors":"Runjiao Bao;Yongkang Xu;Chenhao Wang;Tianwei Niu;Junzheng Wang;Shoukun Wang","doi":"10.1109/TASE.2025.3614472","DOIUrl":null,"url":null,"abstract":"In dynamic and unstructured environments, mobile robots need to generate safe and efficient trajectories in real time, which poses significant challenges due to the uncertainty of surrounding obstacles. To address this, this article presents a real-time obstacle avoidance trajectory planning method, built upon a spatio-temporal graph network that integrates temporal modeling with graph attention mechanisms. The proposed network captures both temporal dynamics and spatial structural dependencies in dynamic environments by integrating a temporal information module based on long short-term memory (LSTM) and a spatial module based on relational graph attention networks (RGAT). On the whole, the approach follows a two-phase pipeline. In the offline phase, a high-quality trajectory dataset is constructed to represent the heterogeneous state graph of the robot and surrounding obstacles. Then the dataset is used to train the spatio-temporal network, which learns to map environment-state graphs to optimal control commands. In the online phase, the trained network is deployed on the robot to perform real-time perception, decision-making, and control, forming a closed-loop trajectory optimization process. Extensive experiments in both simulated and real-world scenarios demonstrate that the proposed method achieves high-quality trajectory planning, robust obstacle avoidance, and fast generalization under multi-obstacle and sudden disturbance conditions, while maintaining low computational overhead. Note to Practitioners—This article addresses the generalization challenges commonly encountered in traditional supervised learning-based obstacle avoidance methods. We propose a trajectory planning framework that leverages a spatiotemporal graph network to model dynamic interactions between a robot and its surrounding obstacles. This approach enables robust and adaptable behavior in complex, changing environments by explicitly capturing both spatial and temporal dependencies. The system is implemented on a four-wheel steering (4WS) robot for experimental validation. However, its modular design ensures straightforward transferability to a wide range of mobility platforms. The proposed method requires only basic obstacle position information, readily available from standard onboard sensors such as LiDAR or radar, and does not depend on raw sensor inputs or semantic maps, making it highly suitable for real-world deployment. It can be easily integrated into existing perception–planning–control pipelines, and future extensions may focus on incorporating richer semantic information and expanding to more diverse obstacle types.","PeriodicalId":51060,"journal":{"name":"IEEE Transactions on Automation Science and Engineering","volume":"22 ","pages":"21897-21912"},"PeriodicalIF":6.4000,"publicationDate":"2025-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"STGN: A Spatio-Temporal Graph Network for Real-Time and Generalizable Trajectory Planning\",\"authors\":\"Runjiao Bao;Yongkang Xu;Chenhao Wang;Tianwei Niu;Junzheng Wang;Shoukun Wang\",\"doi\":\"10.1109/TASE.2025.3614472\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In dynamic and unstructured environments, mobile robots need to generate safe and efficient trajectories in real time, which poses significant challenges due to the uncertainty of surrounding obstacles. To address this, this article presents a real-time obstacle avoidance trajectory planning method, built upon a spatio-temporal graph network that integrates temporal modeling with graph attention mechanisms. The proposed network captures both temporal dynamics and spatial structural dependencies in dynamic environments by integrating a temporal information module based on long short-term memory (LSTM) and a spatial module based on relational graph attention networks (RGAT). On the whole, the approach follows a two-phase pipeline. In the offline phase, a high-quality trajectory dataset is constructed to represent the heterogeneous state graph of the robot and surrounding obstacles. Then the dataset is used to train the spatio-temporal network, which learns to map environment-state graphs to optimal control commands. In the online phase, the trained network is deployed on the robot to perform real-time perception, decision-making, and control, forming a closed-loop trajectory optimization process. Extensive experiments in both simulated and real-world scenarios demonstrate that the proposed method achieves high-quality trajectory planning, robust obstacle avoidance, and fast generalization under multi-obstacle and sudden disturbance conditions, while maintaining low computational overhead. Note to Practitioners—This article addresses the generalization challenges commonly encountered in traditional supervised learning-based obstacle avoidance methods. We propose a trajectory planning framework that leverages a spatiotemporal graph network to model dynamic interactions between a robot and its surrounding obstacles. This approach enables robust and adaptable behavior in complex, changing environments by explicitly capturing both spatial and temporal dependencies. The system is implemented on a four-wheel steering (4WS) robot for experimental validation. However, its modular design ensures straightforward transferability to a wide range of mobility platforms. The proposed method requires only basic obstacle position information, readily available from standard onboard sensors such as LiDAR or radar, and does not depend on raw sensor inputs or semantic maps, making it highly suitable for real-world deployment. It can be easily integrated into existing perception–planning–control pipelines, and future extensions may focus on incorporating richer semantic information and expanding to more diverse obstacle types.\",\"PeriodicalId\":51060,\"journal\":{\"name\":\"IEEE Transactions on Automation Science and Engineering\",\"volume\":\"22 \",\"pages\":\"21897-21912\"},\"PeriodicalIF\":6.4000,\"publicationDate\":\"2025-09-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Automation Science and Engineering\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11180012/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Automation Science and Engineering","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11180012/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
STGN: A Spatio-Temporal Graph Network for Real-Time and Generalizable Trajectory Planning
In dynamic and unstructured environments, mobile robots need to generate safe and efficient trajectories in real time, which poses significant challenges due to the uncertainty of surrounding obstacles. To address this, this article presents a real-time obstacle avoidance trajectory planning method, built upon a spatio-temporal graph network that integrates temporal modeling with graph attention mechanisms. The proposed network captures both temporal dynamics and spatial structural dependencies in dynamic environments by integrating a temporal information module based on long short-term memory (LSTM) and a spatial module based on relational graph attention networks (RGAT). On the whole, the approach follows a two-phase pipeline. In the offline phase, a high-quality trajectory dataset is constructed to represent the heterogeneous state graph of the robot and surrounding obstacles. Then the dataset is used to train the spatio-temporal network, which learns to map environment-state graphs to optimal control commands. In the online phase, the trained network is deployed on the robot to perform real-time perception, decision-making, and control, forming a closed-loop trajectory optimization process. Extensive experiments in both simulated and real-world scenarios demonstrate that the proposed method achieves high-quality trajectory planning, robust obstacle avoidance, and fast generalization under multi-obstacle and sudden disturbance conditions, while maintaining low computational overhead. Note to Practitioners—This article addresses the generalization challenges commonly encountered in traditional supervised learning-based obstacle avoidance methods. We propose a trajectory planning framework that leverages a spatiotemporal graph network to model dynamic interactions between a robot and its surrounding obstacles. This approach enables robust and adaptable behavior in complex, changing environments by explicitly capturing both spatial and temporal dependencies. The system is implemented on a four-wheel steering (4WS) robot for experimental validation. However, its modular design ensures straightforward transferability to a wide range of mobility platforms. The proposed method requires only basic obstacle position information, readily available from standard onboard sensors such as LiDAR or radar, and does not depend on raw sensor inputs or semantic maps, making it highly suitable for real-world deployment. It can be easily integrated into existing perception–planning–control pipelines, and future extensions may focus on incorporating richer semantic information and expanding to more diverse obstacle types.
期刊介绍:
The IEEE Transactions on Automation Science and Engineering (T-ASE) publishes fundamental papers on Automation, emphasizing scientific results that advance efficiency, quality, productivity, and reliability. T-ASE encourages interdisciplinary approaches from computer science, control systems, electrical engineering, mathematics, mechanical engineering, operations research, and other fields. T-ASE welcomes results relevant to industries such as agriculture, biotechnology, healthcare, home automation, maintenance, manufacturing, pharmaceuticals, retail, security, service, supply chains, and transportation. T-ASE addresses a research community willing to integrate knowledge across disciplines and industries. For this purpose, each paper includes a Note to Practitioners that summarizes how its results can be applied or how they might be extended to apply in practice.