Insights into binary neutron star merger simulations: a multi-code comparison

Gravitational Wave (GW) signals from binary neutron star (BNS) mergers provide critical insights into the properties of matter under extreme conditions. Due to the scarcity of observational data, numerical relativity (NR) simulations are indispensable for exploring these phenomena, without replacing the need for observational confirmation. However, simulating BNS mergers is a formidable challenge, and ensuring the consistency, reliability or convergence, especially in the post-merger, remains a work in progress. In this paper we assess the performance of current BNS merger simulations by analyzing open-source GW waveforms from five leading NR codes – SACRA, BAM, THC, Whisky, and SpEC. We focus on the accuracy of these simulations and on the effect of the equation of state on waveform predictions. We first check if different codes give similar results for similar initial data, then apply two methods to calculate convergence and quantify discretization errors. Lastly, we perform a thorough investigation into the effect of tidal interactions on key frequencies in the GW spectrum. We introduce a novel quasi-universal relation for the transient post-merger time, enhancing our understanding of remnant dynamics in this region. This detailed analysis clarifies agreements and discrepancies between these leading NR codes, and highlights necessary improvements for the advanced accuracy requirements of future GW detectors.