Fast approximate Bayesian multidimensional scaling with consistency guarantees

Abstract

Bayesian multidimensional scaling (BMDS) embeds $n$ objects in a low-dimensional space to approximately preserve an observed dissimilarity matrix. Compared to classic MDS, BMDS is more robust to model misspecification and supports posterior uncertainty quantification and joint estimation within hierarchical models. However, standard BMDS inference is computationally prohibitive, requiring $O(n^2)$ operations per MCMC iteration to evaluate the likelihood. We propose Barnes--Hut BMDS (BH-BMDS), which uses a tree-based approximation to the likelihood and a Gibbs sampler that leverages this structure, remaining compatible with hierarchical extensions. BH-BMDS reduces computational complexity to $O(n \log n)$ while preserving the geometric fidelity of the embedding. We further establish consistency for the stationary measure of BH-BMDS, proving that it concentrates around the true latent configuration even as the total error of the surrogate likelihood diverges. Notably, this consistency holds in the infinite-dimensional limit. We evaluate the approximation on datasets with diverse structure, including air traffic networks, arXiv abstracts, MNIST images and neural activity recordings from mouse models of tau pathology. Across all settings, BH-BMDS closely matches BMDS while achieving substantial computational gains, with approximately 10-fold speedups at $n=1{,}000$ and 70-fold speedups at $n=10{,}000$. These gains increase with $n$, demonstrating strong empirical scalability.