arXiv Science⌕ Search

arXiv subjects

Justin Shao

Publications and source records attributed to Justin Shao.

3 recordsLinked to original sources

Bregman primal-dual methods for conic linear optimization via exact-penalty and self-dual formulations

We study Bregman primal--dual proximal methods for conic linear programs (LPs). For problems involving non-polyhedral cones, Bregman distances lead to generalized projections that are often simpler than Euclidean projections. In this paper, we reformulate conic LPs as equivalent exact-penalty problems over truncated cones, and use self-dual embeddings to construct such formulations systematically. This approach yields Bregman proximal methods with simpler subproblems and convergence guarantees over bounded domains. We also study line searches for the Bregman primal--dual hybrid gradient and extragradient methods applied to self-dual problems. For logarithmically homogeneous kernels, the Bregman distances from the starting points are unbounded on the truncated cone, and the classical ergodic bounds do not apply. For these kernels, we derive convergence rates for the exact-penalty objective at the averaged iterates of both methods. Numerical experiments with nonnegative trigonometric polynomial optimization and sparse semidefinite optimization indicate the potential of this framework as a general-purpose approach for incorporating efficient Bregman projections in conic linear optimization.

math.OC↗

Discrete Diffusion Playground: A 2D Benchmark for Discrete Generative Models

Discrete diffusion is a promising framework for categorical generative modeling, but current evaluation protocols often fail to reveal whether models have actually learned the target distribution. We introduce the Discrete Diffusion Playground, a diagnostic benchmark that converts known 2D continuous distributions into binary token sequences through an exact discretized bijection. This creates a rare setting in which models are trained on discrete sequences, but generated samples can be decoded back into 2D and compared directly against a known ground-truth distribution. The benchmark spans smooth Gaussian mixtures and tilted checkerboards with sharp boundaries, disconnected support, and coordinate-dependent structure, allowing it to expose failures that are invisible in standard proxy metrics. It supports exact grid divergences, Wasserstein distances, density visualizations, and nonparametric two-sample tests, providing both quantitative evaluation and interpretable failure diagnosis. Using this testbed, we show that masked diffusion models can learn meaningful adaptive reveal orders but remain less stable than autoregressive baselines on smooth targets and largely fail on tilted checkerboards, where autoregressive models preserve the target geometry. Control experiments with reversed and interleaved token orderings show that autoregressive performance is not explained by favorable bit order alone. The Playground provides a simple but stringent benchmark for stress-testing discrete generative models and for developing evaluation metrics that detect real distributional mismatch rather than proxy performance. Our code is available at https://github.com/shaojus/DiscreteDiffusionPlayground .

cs.LG↗

MENDR: Manifold Explainable Neural Data Representations

Foundation models for electroencephalography (EEG) signals have recently demonstrated success in learning generalized representations of EEGs, outperforming specialized models in various downstream tasks. However, many of these models lack transparency in their pretraining dynamics and offer limited insight into how well EEG information is preserved within their embeddings. For successful clinical integration, EEG foundation models must ensure transparency in pretraining, downstream fine-tuning, and the interpretability of learned representations. Current approaches primarily operate in the temporal domain, overlooking advancements in digital signal processing that enable the extraction of deterministic and traceable features, such as wavelet-based representations. We propose MENDR (Manifold Explainable Neural Data Representations), a filter bank-based EEG foundation model built on a novel Riemannian Manifold Transformer architecture to resolve these issues. MENDR learns symmetric positive definite matrix embeddings of EEG signals and is pretrained on a large corpus comprising over 4,000 hours of EEG data, decomposed via discrete wavelet packet transforms into multi-resolution coefficients. MENDR significantly enhances interpretability by visualizing symmetric positive definite embeddings as geometric ellipsoids and supports accurate reconstruction of EEG signals from learned embeddings. Evaluations across multiple clinical EEG tasks demonstrate that MENDR achieves near state-of-the-art performance with substantially fewer parameters, underscoring its potential for efficient, interpretable, and clinically applicable EEG analysis.

cs.LG↗