arXiv · 2601.21255
Hypersolid: Emergent Vision Representations via Short-Range Repulsion
Abstract
A central problem in self-supervised learning is preventing representation collapse. Most methods avoid it through global mechanisms, such as contrastive expansion, variance constraints, decorrelating dimensions, or enforcing certain output distributions. In this work, we study a different design: short-range repulsion. We introduce Hypersolid, a self-supervised objective that combines view alignment with local collision avoidance. Our method induces a latent geometry of compact, semantically aligned neighborhoods with low anisotropy. This geometry is especially effective for unsupervised clustering and fine-grained separation, although it comes at the cost of weaker transferability.
Explore related subjects
Keep this discovery
Esteban Rodríguez-Betancourt, Edgar Casasola-Murillo. 2026-01-29. Hypersolid: Emergent Vision Representations via Short-Range Repulsion. https://arxiv.org/abs/2601.21255
Cite the original work for its findings. Save a collection to share your selection of sources.
Discover connections
Connections use source metadata and explicit phrase matches, not verified experimental comparisons.