Benchmarking seismic phase associators: Insights from synthetic scenarios

Abstract

Reliable seismicity catalogs are essential for seismology. Following phase picking, phase association groups arrivals into sets with consistent origins (i.e., events), determines event counts, and identifies outlier picks. To handle the substantial increase in the quantity of seismic phase picks from improved picking methods and larger deployments, several novel phase associators have recently been proposed. This study presents a detailed benchmark analysis of five seismic phase associators, including classical and machine learning-based approaches: PhaseLink, REAL, GaMMA, GENIE, and PyOcto. We use synthetic datasets mimicking real seismicity characteristics in crustal and subduction zone scenarios. We evaluate performance for different conditions, including low- and high-noise environments, out-of-network events, very high event rates, and variable station density. The results reveal notable differences in precision, recall, and computational efficiency. GENIE and PyOcto demonstrate robust performance, with almost perfect performance for most scenarios. Only for the most challenging conditions with high noise levels and event rates, performance drops but still maintains F1 scores above 0.8. PhaseLink's performance declines with noise and event density, particularly in subduction zones, dropping to near zero in the most complex cases. GaMMA outperforms PhaseLink but struggles with accuracy and scalability in high-noise, high-density scenarios. REAL performs reasonably but loses recall under extreme conditions. PyOcto and PhaseLink show the quickest runtimes for smaller-scale datasets, while REAL and GENIE are more than an order of magnitude slower for these cases. At the highest pick rates, GENIE's runtime disadvantage diminishes, matching PyOcto and scaling effectively. Our results can guide practitioners compiling seismicity catalogs and developers designing novel associators.