{"title":"评估室内行人空间的人群流量预测算法:使用合成数据集的基准","authors":"Weiming Mai;Dorine Duives;Panchamy Krishnakumari;Serge Hoogendoorn","doi":"10.1109/TITS.2025.3559353","DOIUrl":null,"url":null,"abstract":"Crowd management plays a vital role in urban planning and emergency response. Accurate crowd prediction is important for venue operators to respond effectively to adverse crowd dynamics during large gatherings. Although many studies have tried to predict crowd densities or movement dynamics with data-driven predictive models, their validation is often limited to data within the same scenario. As a result, the predictability of the data-driven model in unseen scenarios, such as evacuation scenarios, remains unknown due to the challenges of collecting out-of-distribution data regarding emergency conditions. To address this problem, we present an evaluation pipeline to evaluate different kinds of data-driven models. A method is proposed to generate realistic scenarios by simulation and collect synthetic data from these scenarios to acquire a comprehensive dataset. With these synthetic data, we evaluated different predictive models, from traditional machine learning methods to deep learning time-series prediction models, to explore their generalizability. Furthermore, we propose a weighted average metric, which is better suited to determine the performance of forecasting algorithms under adverse conditions. Through extensive experimentation, we showcase the heterogeneity and diversity of the simulation dataset. The evaluation results also revealed that all the data-driven models performed poorly in unseen scenarios, highlighting the urgent need to develop a robust and generalizable model for predicting crowd flow in indoor spaces.","PeriodicalId":13416,"journal":{"name":"IEEE Transactions on Intelligent Transportation Systems","volume":"26 6","pages":"7953-7968"},"PeriodicalIF":8.4000,"publicationDate":"2025-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Evaluating Crowd Flow Forecasting Algorithms for Indoor Pedestrian Spaces: A Benchmark Using a Synthetic Dataset\",\"authors\":\"Weiming Mai;Dorine Duives;Panchamy Krishnakumari;Serge Hoogendoorn\",\"doi\":\"10.1109/TITS.2025.3559353\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Crowd management plays a vital role in urban planning and emergency response. Accurate crowd prediction is important for venue operators to respond effectively to adverse crowd dynamics during large gatherings. Although many studies have tried to predict crowd densities or movement dynamics with data-driven predictive models, their validation is often limited to data within the same scenario. As a result, the predictability of the data-driven model in unseen scenarios, such as evacuation scenarios, remains unknown due to the challenges of collecting out-of-distribution data regarding emergency conditions. To address this problem, we present an evaluation pipeline to evaluate different kinds of data-driven models. A method is proposed to generate realistic scenarios by simulation and collect synthetic data from these scenarios to acquire a comprehensive dataset. With these synthetic data, we evaluated different predictive models, from traditional machine learning methods to deep learning time-series prediction models, to explore their generalizability. Furthermore, we propose a weighted average metric, which is better suited to determine the performance of forecasting algorithms under adverse conditions. Through extensive experimentation, we showcase the heterogeneity and diversity of the simulation dataset. The evaluation results also revealed that all the data-driven models performed poorly in unseen scenarios, highlighting the urgent need to develop a robust and generalizable model for predicting crowd flow in indoor spaces.\",\"PeriodicalId\":13416,\"journal\":{\"name\":\"IEEE Transactions on Intelligent Transportation Systems\",\"volume\":\"26 6\",\"pages\":\"7953-7968\"},\"PeriodicalIF\":8.4000,\"publicationDate\":\"2025-04-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Intelligent Transportation Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10967041/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, CIVIL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Intelligent Transportation Systems","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10967041/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
Evaluating Crowd Flow Forecasting Algorithms for Indoor Pedestrian Spaces: A Benchmark Using a Synthetic Dataset
Crowd management plays a vital role in urban planning and emergency response. Accurate crowd prediction is important for venue operators to respond effectively to adverse crowd dynamics during large gatherings. Although many studies have tried to predict crowd densities or movement dynamics with data-driven predictive models, their validation is often limited to data within the same scenario. As a result, the predictability of the data-driven model in unseen scenarios, such as evacuation scenarios, remains unknown due to the challenges of collecting out-of-distribution data regarding emergency conditions. To address this problem, we present an evaluation pipeline to evaluate different kinds of data-driven models. A method is proposed to generate realistic scenarios by simulation and collect synthetic data from these scenarios to acquire a comprehensive dataset. With these synthetic data, we evaluated different predictive models, from traditional machine learning methods to deep learning time-series prediction models, to explore their generalizability. Furthermore, we propose a weighted average metric, which is better suited to determine the performance of forecasting algorithms under adverse conditions. Through extensive experimentation, we showcase the heterogeneity and diversity of the simulation dataset. The evaluation results also revealed that all the data-driven models performed poorly in unseen scenarios, highlighting the urgent need to develop a robust and generalizable model for predicting crowd flow in indoor spaces.
期刊介绍:
The theoretical, experimental and operational aspects of electrical and electronics engineering and information technologies as applied to Intelligent Transportation Systems (ITS). Intelligent Transportation Systems are defined as those systems utilizing synergistic technologies and systems engineering concepts to develop and improve transportation systems of all kinds. The scope of this interdisciplinary activity includes the promotion, consolidation and coordination of ITS technical activities among IEEE entities, and providing a focus for cooperative activities, both internally and externally.