arXiv · 2412.07867
Bumblebee: Foundation Model for Particle Physics Discovery
Abstract
Bumblebee is a foundation model for particle physics discovery, inspired by BERT. By removing positional encodings and embedding particle 4-vectors, Bumblebee captures both generator- and reconstruction-level information while ensuring sequence-order invariance. Pre-trained on a masked task, it improves dileptonic top quark reconstruction resolution by 10-20% and excels in downstream tasks, including toponium discrimination (AUROC 0.877) and initial state classification (AUROC 0.625). The flexibility of Bumblebee makes it suitable for a wide range of particle physics applications, especially the discovery of new particles.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Andrew J. Wildridge, Jack P. Rodgers, Ethan M. Colbert, Yao yao, Andreas W. Jung, Miaoyuan Liu. 2024-12-10. Bumblebee: Foundation Model for Particle Physics Discovery. https://arxiv.org/abs/2412.07867
Cite the original work for its findings. Save a collection to share your selection of sources.