When the stars don't align: Investigating inconsistencies in binary black hole formation across population synthesis codes
Binary population synthesis (BPS) codes are valuable tools for investigating the end-to-end lives of binary stars as well as a myriad of observed astrophysical phenomena. Many ``rapid" BPS codes rely on semi-analytical single-star evolutionary tracks and disjointed prescriptions for binary physics. Updated ``hybrid" or ``detailed" BPS codes incorporate improved methodologies, but at a steeper computational cost that may limit broad exploration of physical uncertainties. Given the widespread use of BPS in modern astrophysical research, it is imperative to systematically compare BPS codes across the spectrum of computational efficiency, flexibility, and physical realism to gauge their consistency and robustness. In this work, we perform BPS on three single-metallicity populations of identical initial binaries using three modern codes --- the rapid code $\texttt{COSMIC}$, the hybrid code $\texttt{METISSE}$ integrated into $\texttt{COSMIC}$, and the detailed code $\texttt{POSYDON}$ --- ensuring consistent physical parameterizations where possible. We find stark differences in the properties, formation pathways, and progenitors of binary black hole (BBH) merger populations across the three codes. In a population of one million binaries at $0.01 Z_\odot$, each code results in $\sim 5,000\mbox{--}9,000$ BBHs that merge within a Hubble time. However, $\lesssim 14\%$ of progenitors overlap between two codes, and only $\textit{one}$ initial binary becomes a BBH merger across all three codes. Identical progenitors often follow different evolutionary pathways in each code and result in inconsistent BBH properties. Our results highlight the need for a deeper understanding of physical and computational differences between BPS codes and caution against over-interpreting results from any individual BPS code.