arXiv subjects

Yuchen Xin

Publications and source records attributed to Yuchen Xin.

7 recordsLinked to original sources

arXiv2026

Poisson-Corrector Complexity Bounds for Moreau--Yosida Unadjusted Langevin Sampling

We study the classical Moreau--Yosida unadjusted Langevin algorithm (MYULA) for $π(\,\mathrm{d} x)\propto e^{-f(x)-g(x)}\,\mathrm{d} x$, where $f\in C^2(\mathbb{R}^d)$ is $m$-strongly convex with $L_f$-Lipschitz gradient and $g:\mathbb{R}^d\to\mathbb{R}$ is convex and globally $G$-Lipschitz. For the Moreau-smoothed target $π_λ$ and the MYULA invariant law $\widehatπ_{λ,h}$, we prove \[ \sqrt m\,W_2(π_λ,\widehatπ_{λ,h}) =O(h)+\widetilde O(h^{3/4}) \] under $0<h(L_f+λ^{-1})\le c$, with only logarithmic dependence on $λ^{-1}$ in the error coefficients. Combining this estimate with the Moreau approximation bias yields $\widetilde O(\varepsilon^{-4/3})$ iterations to achieve $\sqrt m\,W_2(μ_N,π)\le\varepsilon$, for fixed model parameters and initialization. The proof combines a discrete Poisson corrector with active-trace estimates and a shared-noise bound for the exact--Euler two-point curvature.

cs.LG↗

arXiv2026

Rényi Tracking Bounds for Langevin Dynamics with Moving Targets

We study Langevin diffusion and Langevin Monte Carlo (LMC) when the target distribution changes over time. Under a log-Sobolev inequality (LSI), we derive non-asymptotic Rényi-divergence guarantees for tracking the current target. The framework covers continuous-time Langevin diffusion and its discretizations. We then apply the results to nonsmooth sampling based on successive Moreau envelopes. For this scheme, we give explicit choices of the smoothing parameters and step sizes, together with corresponding complexity bounds. To our knowledge, these are the first non-asymptotic Rényi-divergence tracking bounds for Langevin dynamics with discrete target updates.

stat.ML↗

arXiv2026

Matrix Moment and Concentration Inequalities for Martingales and Ergodic Markov Chains with Applications in Statistical Learning

In this paper, we study moment and concentration inequalities for the spectral norm of sums of dependent random matrices. We establish novel Rosenthal-Burkholder inequalities for the spectral norm of discrete-time matrix local martingales, Burkholder-Davis-Gundy inequality for the spectral norm of continuous matrix local martingales, as well as matrix Rosenthal, Hoeffding, and Bernstein inequalities under the spectral norm for ergodic Markov chains. Compared with previous work on matrix concentration inequalities for Markov chains, which assume a non-zero absolute $L^2$-spectral gap or the stronger $ψ$-mixing condition, our results assume geometric ergodicity, a condition commonly used in statistical applications. Furthermore, our results have leading terms that match the Markov chain central limit theorem, rather than relying on suboptimal variance proxies. We also give dimension-free versions of the inequalities, which are independent of the ambient dimension $d$ and relies on the effective rank instead. This enables the generalization of our results to linear operators in infinite-dimensional Hilbert spaces. Our results have extensive applications in statistics and machine learning; in particular, we obtain improved bounds in covariance estimation and principal component analysis on Markovian data.

math.PR↗

arXiv2026

Conditionally Resampled Sliding-Window Count Kernels: Spectral-Gap Bounds and Poincaré Inequalities

We study the conditionally resampled sliding-window count kernel associated with the empirical counts of length-$n$ windows from a stationary finite-state reversible Markov chain. Although the resulting count process is generally not Markov, its stationary one-step conditional law defines a genuine Markov kernel. For every fixed strictly positive reversible kernel $P$ on a finite state space, we present a Poincaré inequality for the induced count kernel $\tP_n$ of length $n$. In other words, we derive the lower bound of the spectral gap $\Gap(\tP_n)$ of $\tP_n$ as \[ \Gap(\tP_n)\ge \frac{c(P)}{n}, \] where $c(P)>0$ depends only on $P$. The proof combines a martingale oscillation inequality for the stationary path law with a direct comparison of coordinate oscillations to the Dirichlet form of the count kernel. A linear statistic of the count vector gives the matching $O(1/n)$ upper bound, so for every fixed strictly positive reversible $P$ one has $\Gap(\tP_n)=Θ_P(1/n)$. The resulting count-space Poincaré inequality yields a local-to-global variance bound for finite-window count statistics and, together with a general matrix-concentration principle, operator-norm concentration for matrix-valued empirical averages.

math.ST↗

arXiv2026

Active-Trace Complexity Bounds for Moreau--Yosida Unadjusted Langevin Sampling

We study the Moreau--Yosida unadjusted Langevin algorithm (MYULA) for the nonsmooth composite target \[ π(dx)\propto \exp\{-f(x)-g(x)\}\,dx, \qquad x\in\mathbb R^d, \] where $f$ is $m$-strongly convex with $L_f$-Lipschitz gradient and $g$ is convex and $G$-Lipschitz. Let $g_λ$ be the Moreau envelope of $g$, $π_λ$ the corresponding smoothed target, and $a_λ=\operatorname{tr}H_λ$, where $H_λ$ is the a.e./weak Hessian of $g_λ$. We show that the leading MYULA discretization error is controlled by the reference active trace $B_{\mathrm{ref}}$, the average of $a_λ$ along the heat substep of one MYULA update started from $π_λ$, rather than by the global curvature bound $d/λ$. If $M_λ$ is an a.e. upper bound for $a_λ$, then, up to logarithmic factors, \[ N \lesssim \frac{1}{m} \left[ L_f + \frac{ τ_f+G^2+B_{\mathrm{ref}} }{ \varepsilon_{\mathrm{alg}}^2 } + \frac{M_λ}{\varepsilon_{\mathrm{alg}}} \right], \qquad τ_f:= \sup_x\operatorname{tr}\nabla^2 f(x), \] iterations suffice to ensure $\sqrt m\,W_2(μ_N,π_λ)\leq\varepsilon_{\mathrm{alg}}$, where $μ_N$ is the law of the $N$-th iterate and $W_2$ is the quadratic Wasserstein distance. We also prove the Moreau-bias bound \[ \sqrt m\,W_2(π_λ,π) \leq \frac{G^2λ}{4}. \] Thus, choosing $λ\asymp\varepsilon/G^2$ gives an end-to-end guarantee for $π$. The universal estimate $B_{\mathrm{ref}}\leq d/λ$ yields $\widetilde O(\varepsilon^{-3})$ accuracy dependence. For the structured piecewise-linear, lasso-type, group, and total-variation penalties considered here, curvature--tube estimates make $B_{\mathrm{ref}}$ independent of $λ$, yielding $\widetilde O(\varepsilon^{-2})$ for the same classical MYULA kernel.

cs.LG↗

arXiv2025

Follow-the-Perturbed-Leader Approaches Best-of-Both-Worlds for the m-Set Semi-Bandit Problems

We consider a common case of the combinatorial semi-bandit problem, the $m$-set semi-bandit, where the learner exactly selects $m$ arms from the total $d$ arms. In the adversarial setting, the best regret bound, known to be $\mathcal{O}(\sqrt{nmd})$ for time horizon $n$, is achieved by the well-known Follow-the-Regularized-Leader (FTRL) policy. However, this requires to explicitly compute the arm-selection probabilities via optimizing problems at each time step and sample according to them. This problem can be avoided by the Follow-the-Perturbed-Leader (FTPL) policy, which simply pulls the $m$ arms that rank among the $m$ smallest (estimated) loss with random perturbation. In this paper, we show that FTPL with a Fréchet perturbation also enjoys the near optimal regret bound $\mathcal{O}(\sqrt{nm}(\sqrt{d\log(d)}+m^{5/6}))$ in the adversarial setting and approaches best-of-both-world regret bounds, i.e., achieves a logarithmic regret for the stochastic setting. Moreover, our lower bounds show that the extra factors are unavoidable with our approach; any improvement would require a fundamentally different and more challenging method.

cs.LG↗

arXiv2025

A Regularized Online Newton Method for Stochastic Convex Bandits with Linear Vanishing Noise

We study a stochastic convex bandit problem where the subgaussian noise parameter is assumed to decrease linearly as the learner selects actions closer and closer to the minimizer of the convex loss function. Accordingly, we propose a Regularized Online Newton Method (RONM) for solving the problem, based on the Online Newton Method (ONM) of arXiv:2406.06506. Our RONM reaches a polylogarithmic regret in the time horizon $n$ when the loss function grows quadratically in the constraint set, which recovers the results of arXiv:2402.12042 in linear bandits. Our analyses rely on the growth rate of the precision matrix $Σ_t^{-1}$ in ONM and we find that linear growth solves the question exactly. These analyses also help us obtain better convergence rates when the loss function grows faster. We also study and analyze two new bandit models: stochastic convex bandits with noise scaled to a subgaussian parameter function and convex bandits with stochastic multiplicative noise.

math.OC↗