Benchmark on the accuracy and efficiency of several neural network based phase pickers using datasets from China Seismic Network

Abstract

Seismic phase pickers based on deep neural networks have been extensively used recently, demonstrating their advantages on both performance and efficiency. However, these pickers are trained with and applied to different data. A comprehensive benchmark based on a single dataset is therefore lacking. Here, using the recently released DiTing dataset, we analyzed performances of seven phase pickers with different network structures, the efficiencies are also evaluated using both CPU and GPU devices. Evaluations based on F₁-scores reveal that the recurrent neural network (RNN) and EQTransformer exhibit the best performance, likely owing to their large receptive fields. Similar performances are observed among PhaseNet (UNet), UNet++, and the lightweight phase picking network (LPPN). However, the LPPN models are the most efficient. The RNN and EQTransformer have similar speeds, which are slower than those of the LPPN and PhaseNet. UNet++ requires the most computational effort among the pickers. As all of the pickers perform well after being trained with a large-scale dataset, users may choose the one suitable for their applications. For beginners, we provide a tutorial on training and validating the pickers using the DiTing dataset. We also provide two sets of models trained using datasets with both 50 Hz and 100 Hz sampling rates for direct application by end-users. All of our models are open-source and publicly accessible.