A Storage Method of Ship Trajectory Data Based on ClickHouse Database

Abstract

At present, many maritime applications, such as ship traffic statistics, require fast spatiotemporal query of ship traj ectory data. The existing research is weak in supporting the trajectory spatiotemporal query, and can only realize the spatiotemporal query based on circular and rectangular regions. Moreover, complex spatial indexes and computer clusters are usually required to achieve efficient spatiotemporal query, which undoubtedly increases the storage cost. To solve above problems, this article designs the storage structure and partition strategy of ship trajectory data, and builds attributes multilevel index and H3 spatial index on ship traj ectory data based on ClickHouse database, which not only achieves spatiotemporal query based on the oval, round, and arbitrary polygon area, and improve the efficiency of the spatiotemporal query; At the same time, the data storage space is reduced, so that a common server can manage 10 billion ship trajectory data. The empirical study on a large number of data shows that the storage scheme designed in this paper not only enhances the ability of spatiotemporal query, improves the efficiency of data storage and spatiotemporal query, but also reduces the cost of data storage to a large extent.