Dudu Guo, Jizhao Wang, Yang An, Yiwen Zhang, Danyang Liu
{"title":"Research on Pre-processing Method of Travel Data Based on Mobile GPS: Three-step Data Pre-processing Method","authors":"Dudu Guo, Jizhao Wang, Yang An, Yiwen Zhang, Danyang Liu","doi":"10.1145/3424978.3425100","DOIUrl":null,"url":null,"abstract":"The collected travel data are accompanied by noise data and missing data. They seriously affect the analysis and use in transportation. Data processing is the foundation of data analysis and the most difficult step in data utilization. In order to realize the noise reduction and interpolation of the data, we creatively adopt the three-step method of data segmentation and deductive reasoning, the verification of Spearman's correlation coefficient and the discrimination of the distance of triangle bottom to height, which effectively repairs the abnormal data in this article. Through the processing of 78 travel data, the transfer point extraction, data interpolation and drift correction are realized. The results have high reliability. This method can be programmed and used for batch data processing, which will save considerable investment in the field of transportation survey.","PeriodicalId":178822,"journal":{"name":"Proceedings of the 4th International Conference on Computer Science and Application Engineering","volume":"87 1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 4th International Conference on Computer Science and Application Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3424978.3425100","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
Abstract
The collected travel data are accompanied by noise data and missing data. They seriously affect the analysis and use in transportation. Data processing is the foundation of data analysis and the most difficult step in data utilization. In order to realize the noise reduction and interpolation of the data, we creatively adopt the three-step method of data segmentation and deductive reasoning, the verification of Spearman's correlation coefficient and the discrimination of the distance of triangle bottom to height, which effectively repairs the abnormal data in this article. Through the processing of 78 travel data, the transfer point extraction, data interpolation and drift correction are realized. The results have high reliability. This method can be programmed and used for batch data processing, which will save considerable investment in the field of transportation survey.