A Functional Data Approach to Outlier Detection and Imputation for Traffic Density Data on Urban Arterial Roads

IF 0.8 4区工程技术 Q4 TRANSPORTATION SCIENCE & TECHNOLOGY

Promet-Traffic & Transportation Pub Date : 2022-09-30 DOI:10.7307/ptt.v34i5.4069

Bing Tang, Yao Hu, Huang Chen

{"title":"A Functional Data Approach to Outlier Detection and Imputation for Traffic Density Data on Urban Arterial Roads","authors":"Bing Tang, Yao Hu, Huang Chen","doi":"10.7307/ptt.v34i5.4069","DOIUrl":null,"url":null,"abstract":"In traffic monitoring data analysis, the magnitude of traffic density plays an important role in determining the level of traffic congestion. This study proposes a data imputation method for spatio-functional principal component analysis (s-FPCA) and unifies anomaly curve detection, outlier confirmation and imputation of traffic density at target intersections. Firstly, the detection of anomalous curves is performed based on the binary principal component scores obtained from the functional data analysis, followed by the determination of the presence of outliers through threshold method. Secondly, an improved method for missing traffic data estimation based on upstream and downstream is proposed. Finally, a numerical study of the actual traffic density data is carried out, and the accuracy of s-FPCA for imputation is improved by 8.28%, 8.91% and 7.48%, respectively, when comparing to functional principal component analysis (FPCA) with daily traffic density data missing rates of 5%, 10% and 20%, proving the superiority of the method. This method can also be applied to the detection of outliers in traffic flow, imputation and other longitudinal data analysis with periodic fluctuations.","PeriodicalId":54546,"journal":{"name":"Promet-Traffic & Transportation","volume":"72 1 1","pages":""},"PeriodicalIF":0.8000,"publicationDate":"2022-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Promet-Traffic & Transportation","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.7307/ptt.v34i5.4069","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"TRANSPORTATION SCIENCE & TECHNOLOGY","Score":null,"Total":0}

引用次数: 0

Abstract

In traffic monitoring data analysis, the magnitude of traffic density plays an important role in determining the level of traffic congestion. This study proposes a data imputation method for spatio-functional principal component analysis (s-FPCA) and unifies anomaly curve detection, outlier confirmation and imputation of traffic density at target intersections. Firstly, the detection of anomalous curves is performed based on the binary principal component scores obtained from the functional data analysis, followed by the determination of the presence of outliers through threshold method. Secondly, an improved method for missing traffic data estimation based on upstream and downstream is proposed. Finally, a numerical study of the actual traffic density data is carried out, and the accuracy of s-FPCA for imputation is improved by 8.28%, 8.91% and 7.48%, respectively, when comparing to functional principal component analysis (FPCA) with daily traffic density data missing rates of 5%, 10% and 20%, proving the superiority of the method. This method can also be applied to the detection of outliers in traffic flow, imputation and other longitudinal data analysis with periodic fluctuations.

查看原文本刊更多论文

城市主干道交通密度数据离群值检测与归算的功能数据方法

在交通监测数据分析中，交通密度的大小是决定交通拥堵程度的重要因素。本研究提出了一种空间功能主成分分析(s-FPCA)数据输入方法，将目标交叉口交通密度异常曲线检测、离群值确认和数据输入统一起来。首先根据函数数据分析得到的二元主成分分数检测异常曲线，然后通过阈值法判断异常点是否存在。其次，提出了一种改进的基于上下游的交通缺失数据估计方法。最后，对实际交通密度数据进行了数值研究，与日交通密度数据缺失率分别为5%、10%和20%的功能主成分分析(FPCA)方法相比，s-FPCA方法的插值精度分别提高了8.28%、8.91%和7.48%，证明了该方法的优越性。该方法也可应用于交通流异常点的检测、插值等具有周期性波动的纵向数据分析。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Promet-Traffic & Transportation 工程技术-运输科技

CiteScore

1.90

自引率

20.00%

发文量

审稿时长

3 months

期刊介绍： This scientific journal publishes scientific papers in the area of technical sciences, field of transport and traffic technology. The basic guidelines of the journal, which support the mission - promotion of transport science, are: relevancy of published papers and reviewer competency, established identity in the print and publishing profile, as well as other formal and informal details. The journal organisation consists of the Editorial Board, Editors, Reviewer Selection Committee and the Scientific Advisory Committee. The received papers are subject to peer review in accordance with the recommendations for international scientific journals. The papers published in the journal are placed in sections which explain their focus in more detail. The sections are: transportation economy, information and communication technology, intelligent transport systems, human-transport interaction, intermodal transport, education in traffic and transport, traffic planning, traffic and environment (ecology), traffic on motorways, traffic in the cities, transport and sustainable development, traffic and space, traffic infrastructure, traffic policy, transport engineering, transport law, safety and security in traffic, transport logistics, transport technology, transport telematics, internal transport, traffic management, science in traffic and transport, traffic engineering, transport in emergency situations, swarm intelligence in transportation engineering. The Journal also publishes information not subject to review, and classified under the following headings: book and other reviews, symposia, conferences and exhibitions, scientific cooperation, anniversaries, portraits, bibliographies, publisher information, news, etc.