Iterative Exploration-Driven Sparse SDP Clustering via Thompson Sampling
High-dimensional sparse clustering is a challenging combinatorial problem due to the tight coupling between cluster assignment and variable selection. We demonstrate that semidefinite programming (SDP) relaxation of K-means is robust to variable over-selection by establishing minimax separation bounds. Leveraging this robustness, we offer a twist on the recent trend of using exogenous randomness to evaluate feature importance and control false discovery by partially shifting the objective toward active feature exploration. We propose a randomized alternating block-coordinate framework that alternates between SDP clustering and feature selection. Here, feature selection is formulated as a multi-armed bandit problem, solved via Thompson Sampling with stochastic rewards generated by clustering and robust permutation tests. This approach introduces adaptive memory by aggregating historical variable-selection outcomes into posterior distributions, and selects features via posterior sampling, enabling stochastic exploration that promotes the inclusion of underexplored features and facilitates escape from local maxima. We establish uniform exact-recovery guarantees for adaptively selected feature sets. We extend the method to settings with unknown covariance through a scalable estimation procedure. Synthetic experiments and a real-data application in document clustering show that the proposed memory-driven randomized approach outperforms state-of-the-art sparse clustering methods across the studied settings.