arXiv Science⌕ Search

arXiv subjects

Yizhe Zhu

Publications and source records attributed to Yizhe Zhu.

At least 19 recordsLinked to original sources

Community detection with the Bethe-Hessian

The Bethe-Hessian matrix, introduced by Saade, Krzakala, and Zdeborová (2014), is a Hermitian matrix designed for applying spectral clustering algorithms to sparse networks. Rather than employing a non-symmetric and high-dimensional non-backtracking operator, a spectral method based on the Bethe-Hessian matrix is conjectured to also reach the Kesten-Stigum detection threshold in the sparse stochastic block model (SBM). We provide the first rigorous analysis of the Bethe-Hessian spectral method in the SBM under both the bounded expected degree and the growing degree regimes. Specifically, we demonstrate that: (i) When the expected degree $d\geq 2$, the number of negative outliers of the Bethe-Hessian matrix can consistently estimate the number of blocks above the Kesten-Stigum threshold, thus confirming a conjecture from Saade, Krzakala, and Zdeborová (2014) for $d\geq 2$. (ii) For sufficiently large $d$, its eigenvectors can be used to achieve weak recovery. (iii) As $d\to\infty$, we establish the concentration of the locations of its negative outlier eigenvalues, and weak consistency can be achieved via a spectral method based on the Bethe-Hessian matrix.

math.ST↗

Concentration of bounded sparse chaoses and sparse Khatri--Rao embeddings

We prove moment and mixed-tail inequalities for decoupled homogeneous chaoses of arbitrary fixed order generated by independent, centered, bounded random variables with coordinate-dependent second-moment bounds. The estimates hold for arbitrary real rectangular coefficient tensors and are expressed through weighted slice and partition norms. A Bennett-type logarithmic correction sharpens the contribution of the largest coefficient to these bounds. The proof combines a comparison with sums of sparse exponential variables with an elementary replication argument. We also extend the results to diagonal-free non-decoupled chaoses and sparse sub-exponential inputs. As an application, we establish conditions under which sparse Khatri--Rao random projections approximately preserve norms and inner products for finite collections of tensors. For a sparse random relation containing a planted dense block, we prove matching upper and lower bounds on the required projection dimension, demonstrating the sharpness of the logarithmic correction.

math.PR↗

A second eigenvalue lower bound for the directed configuration model

We prove a high-probability lower bound for the second eigenvalue in modulus of the transition matrix of the simple random walk on a directed configuration model with minimal out-degree at least two and maximal degree not too large. The lower bound matches the upper bound found by Coste (2021) on the same model. Our proof bypasses the need to establish convergence of the empirical eigenvalue distribution. Instead, it reduces the spectral lower bound to a central limit theorem for the trace of the transition matrix at powers much larger than the logarithmic scale, a range that previous results failed to reach. Both the general strategy and the central limit theorem might be of independent interest.

math.PR↗

Differentially Private Synthetic Data via Generalized Moment Matching

We study $(\varepsilon,δ)$-differentially private synthetic data for arbitrary databases of $n$ records in $[-1,1]^d$ under a specified integral probability metric (IPM). We introduce generalized moment matching, which estimates moments privately, fits a probability measure, and samples synthetic records. A general error theorem applies when moment error controls the target IPM. This framework extends Chebyshev moment matching for $1$-Wasserstein distance and smooth queries. We apply the framework to maximum mean discrepancy with Matern and Laplace kernels and a two-layer ReLU neural tangent kernel. We also obtain guarantees for sliced Wasserstein-$1$ and the IPM induced by norm-bounded ReLU networks. With sufficiently many synthetic records,these rates are minimax optimal up to logarithmic factors for fixed dimension.

stat.ML↗

Sharp spectral norm concentration and regularization of sparse random tensors

We prove sharp spectral-norm bounds and construct a mean-fitting regularization procedure for sparse random tensors of fixed order $k$. For an $n\times\cdots\times n$ tensor with independentBernoulli$(p)$ entries, the centered norm is $O(\sqrt{np})$ with polynomially high probability whenever $np\ge c\log n$. This removes the logarithmic loss in Zhou and Zhu (2021). We also determine the expected centered norm at every sparsity level: for every $0<p\le1/2$, it has order $\min\{n^kp,\sqrt{d_{\mathrm{eff}}}\}$, where $d_{\mathrm{eff}}$ is an effective degree accounting for unusually large fiber counts. The upper bounds extend to tensors with deterministic entrywise weights and unequal sampling probabilities. Analogous two-sided bounds hold for the Friedman--Wigderson model at every degree; its expected centered norm has order $\sqrt{d_{\mathrm{eff}}}$. We also give an all-sparsity regularization procedure for independent Bernoulli tensors with unknown, possibly unequal means in $[0,p]$. Our light-fitting regularization estimates the original mean with minimax expected spectral-norm error of order $\min\{\sqrt{np},pn^{k/2}\}$ for every known $0\le p\le1$. The procedure fits light multilinear residuals under an entrywise constraint on the candidate mean, rather than deleting high-degree fibers.

math.PR↗

The Great Picard theorem for quasiregular values

We prove a version of Rickman's Great Picard theorem in the theory of quasiregular values. The version of the theorem that we prove is in fact stated in terms of omitted quasiregular values, unlike the previously known Little Picard theorem of the theory that is based on quasiregular values in the boundary of the image set. As a byproduct of the proof, we also prove a Riemann removability theorem in our setting, which ends up strengthening the conclusion of the previously resolved question of Astala, Iwaniec and Martin.

math.CV↗

Non-backtracking eigenvalues and eigenvectors of random regular graphs and hypergraphs

The non-backtracking operator of a graph is a powerful tool in spectral graph theory and random matrix theory. Most existing results for the non-backtracking operator of a random graph concern only eigenvalues or top eigenvectors. In this paper, we take the first step in analyzing its bulk eigenvector behaviors. We demonstrate that for the non-backtracking operator $B$ of a random $d$-regular graph, its eigenvectors corresponding to nontrivial eigenvalues are completely delocalized with high probability. Additionally, we show complete delocalization for a reduced $2n \times 2n$ non-backtracking matrix $\tilde{B}$. By projecting all eigenvalues of $\tilde{B}$ onto the real line, we obtain an empirical measure that converges weakly in probability to the Kesten-McKay law for fixed $d\geq 3$ and to a semicircle law as $d \to\infty$ with $n \to\infty$. We extend our analysis to random regular hypergraphs, including the limiting measure of the real part of the spectrum for $\tilde{B}$, $\ell_{\infty}$-norm bounds for the eigenvectors of $\tilde{B}$ and $B$, and a deterministic relation between eigenvectors of $B$ and the eigenvectors of the adjacency matrix. As an application, we analyze the non-backtracking spectrum of the regular stochastic block model (RSBM) and provide a spectral method based on eigenvectors of $\tilde{B}$ to recover the community structure exactly. We also show that there exists an isolated real eigenvalue with an informative eigenvector inside the circle of radius $\sqrt{d_1+d_2-1}$ in the spectrum of $B$, analogous to the "eigenvalue insider" phenomenon for the Erdős-Rényi stochastic block model conjectured in Dall'Amico et al. (2019).

math.PR↗

The spectral edge of sparse directed Erdös-Rényi graphs

Let $d>1$ be fixed and let $A_n$ be an $n\times n$ matrix with independent $\Ber(d/n)$ entries. For every $0<r<\sqrt d$, we prove that, with high probability, a positive proportion of the eigenvalues of $A_n$ have modulus larger than $r$. Together with the known upper bound, this implies that the modulus of the second largest eigenvalue converges in probability to $\sqrt d$. Our proof works with the Brown measure $μ_d$ of the adjacency operator of the directed Poisson--Galton--Watson tree. The convergence theorem of Sah, Sahasrabudhe, and Sawhney, together with the Brown-measure identification following it, gives weak convergence of the empirical spectral measure of $A_n$ to $μ_d$ in probability. We prove that the outer radius of its support is $\sqrt d$, using a resolvent recursion on Poisson--Galton--Watson trees.

math.PR↗

A semicircle law for the normalized Laplacian of sparse random graphs

We study the limiting spectral distribution of the normalized Laplacian $\mathcal L$ of an Erdős-Rényi graph $G(n,p)$. To account for the presence of isolated vertices in the sparse regime, we define $\mathcal L$ using the Moore-Penrose pseudoinverse of the degree matrix. Under this convention, we show that the empirical spectral distribution of a suitably normalized $\mathcal L$ converges weakly in probability to the semicircle law whenever $np\to\infty$, thereby providing a rigorous justification of a prediction made in (Akara-pipattana and Evnin, 2023). Moreover, if $np>\log n+ω(1)$, so that $G(n,p)$ has no isolated vertices with high probability, the same conclusion holds for the standard definition of $\mathcal L$. We further strengthen this result to almost sure convergence when $np=Ω(\log n)$. Finally, we extend our approach to the Chung-Lu random graph model, where we establish a semicircle law for $\mathcal L$ itself, improving upon (Chung, Lu, and Vu 2003), which obtained the semicircle law only for a proxy matrix.

math.PR↗

Dissecting Embodied Abilities in Multimodal Language Models through Skill-level Evaluation and Diagnosis

Understanding the capability bottlenecks of embodied multimodal large language models (MLLMs) is crucial for improving embodied agents. However, existing embodied benchmarks mainly focus on task-level evaluation and fail to provide actionable insights into the underlying causes of model failures. To address this limitation, we introduce BEAR, a benchmark that decomposes embodied tasks into 14 atomic skills for fine-grained skill-level evaluation. BEAR comprises 4,469 interleaved image-video-text samples spanning 14 skills across 6 categories, ranging from low-level perception to high-level planning. We evaluate 20 MLLMs on BEAR under a hierarchical skill-level diagnosis framework and uncover two key findings: (1) perceptual capabilities are major bottlenecks behind reasoning failures, and (2) current models suffer from unstable spatiotemporal modeling that remains largely unexposed in prior benchmarks. Motivated by these findings, we further propose BEAR-Agent, a multimodal conversational agent that augments MLLMs with visual and spatial reasoning tools. BEAR-Agent substantially improves performance across embodied skills, achieving a relative improvement of 17.5% on GPT-5 over the base model on BEAR, while also outperforming strong baselines in both simulation and real-world robotic experiments. Project page: https://bear-official66.github.io/

cs.CV↗

Wedge Sampling: Efficient Tensor Completion with Nearly-Linear Sample Complexity

We introduce Wedge Sampling, a new non-adaptive sampling scheme for low-rank tensor completion. We study recovery of an order-$k$ low-rank tensor of dimension $n\times\cdots\times n$ from structured observations of its entries. Unlike the standard uniform entry model (i.e., i.i.d. samples from $[n]^k$), wedge sampling allocates observations to structured length-two patterns (wedges) in an associated bipartite sampling graph. By directly promoting these length-two connections, the sampling design strengthens the spectral signal that underlies efficient initialization, in regimes where uniform sampling is too sparse to generate enough informative correlations. Our main result shows that this change in sampling paradigm enables polynomial-time algorithms to achieve both weak and exact recovery with nearly linear sample complexity in $n$. The approach is also plug-and-play: wedge-sampling-based spectral initialization can be combined with existing refinement procedures (e.g., spectral or gradient-based methods) using only an additional $\tilde O(n)$ uniformly sampled entries, substantially improving over the $\tilde O(n^{k/2})$ sample complexity typically required under uniform entry sampling for efficient methods. We also formulate a noisy wedge-sampling extension for additive Gaussian observations and analyze both the spectral and gradient-descent procedures under suitable signal-to-noise conditions. Thus, the computational barrier in tensor completion is sensitive to the observation model: while it persists under uniform entry sampling, it can be bypassed by non-adaptive structured designs that provide a stronger initialization.

stat.ML↗

Spectral Concentration and Recovery in Sparse High-Dimensional Random Geometric Graphs

We study sparse threshold random geometric graphs generated by high-dimensional spherical or Gaussian latent vectors. Although each edge has marginal probability $p$, shared latent variables make the adjacency entries dependent. At the connectivity scale $np=Ω(\log n)$, the spherical adjacency matrix satisfies, with high probability,$\|A-\mathbb E A\|_{\mathrm{op}}=O\left(\sqrt{np\log n}+npτ\right)$, where $τ$ is the cap threshold; an analogous estimate holds for Gaussian vectors after controlling radial fluctuations. This sharpens the spectral bound in Liu, Mohanty, Schramm, and Yang (2023) under weaker assumptions and strengthens the global-synchronization guarantee of Abdalla, Bandeira, and Invernizzi (2024) for the homogeneous Kuramoto model. The leading eigenspace also estimates the latent geometry. When $np\gg\log n$, vector and relative Gram-matrix errors vanish for$\log(1/p)\ll d\ll np\log(1/p)/\log n$ in the spherical model and $\log^2(1/p)\log n\ll d\ll np\log(1/p)/\log n$ in the Gaussian model, improving the recovery conditions of Li and Schramm (2023). For the Gaussian mixture block model introduced there, a polynomial-time semidefinite program gives, to our knowledge, the first exact-recovery guarantee at the connectivity scale in a moderate-separation regime. At much larger separation, fixed edge density creates isolated vertices and makes exact recovery impossible. Our reusable decoupling and matrix concentration framework avoids trace-moment methods and applies broadly to random graph models with latent vectors.

stat.ML↗

Spectra of high-dimensional sparse random geometric graphs

We determine the limiting empirical spectral distribution of sparse high-dimensional random geometric graphs. The vertices are independent uniform points on the unit sphere $S^{d-1}$, and two vertices are joined when their inner product exceeds a threshold chosen to give edge density $p$. The edges therefore have the same marginal probabilities as in an Erdős--Rényi graph, but the latent geometry introduces dependence among them. We show that these correlations are asymptotically invisible to the global spectrum in two sparse regimes. If $p\to0$, $np\to\infty$, and $d=Ω(np\log(1/p))$, then the empirical spectral distribution of $A/\sqrt{np}$ converges in probability to the semicircle law. If $p=α/n$ for a fixed $α>0$ and $d=ω(\log n)$, then the empirical spectral distribution of $A/\sqrtα$ converges in probability to the limiting spectral distribution of $\mathcal G(n,α/n)$. The proof combines the moment method with a cluster expansion that decomposes geometric dependence into weak local interactions, allowing us to control every fixed walk pattern in the moment calculation.

math.PR↗

Minimax optimal differentially private synthetic data for smooth queries

Differentially private synthetic data enables the sharing and analysis of sensitive datasets while providing rigorous privacy guarantees for individual contributors. A central challenge is to achieve strong utility guarantees for meaningful downstream analysis. Many existing methods ensure uniform accuracy over broad query classes, such as all Lipschitz functions, but this level of generality often leads to suboptimal rates for statistics of practical interest. Since many common data analysis queries exhibit smoothness beyond what worst-case Lipschitz bounds capture, we ask whether exploiting this additional structure can yield improved utility. We study the problem of generating $(\varepsilon,δ)$-differentially private synthetic data from a dataset of size $n$ supported on the hypercube $[-1,1]^d$, with utility guarantees uniformly for all smooth queries having bounded derivatives up to order $k$. We propose a polynomial-time algorithm that achieves a minimax error rate of $O_{k,d}(n^{-\min \{1, \frac{k}{d}\}})$, up to a $\log(n)$ factor. This characterization uncovers a phase transition at $k=d$. Our results generalize the Chebyshev moment matching framework of (Musco et al., 2025; Wang et al., 2016) and strictly improve the error rates for $k$-smooth queries established in \citep{wang2016differentially}. Moreover, we establish the first minimax lower bound for the utility of $(\varepsilon,δ)$-differentially private synthetic data with respect to $k$-smooth queries, extending the Wasserstein lower bound for $\varepsilon$-differential privacy in (Boedihardjo et al., 2024).

math.ST↗

Partial recovery and weak consistency in the non-uniform hypergraph Stochastic Block Model

We consider the community detection problem in sparse random hypergraphs under the non-uniform hypergraph stochastic block model (HSBM), a general model of random networks with community structure and higher-order interactions. When the random hypergraph has bounded expected degrees, we provide a spectral algorithm that outputs a partition with at least a $γ$ fraction of the vertices classified correctly, where $γ\in (0.5,1)$ depends on the signal-to-noise ratio (SNR) of the model. When the SNR grows slowly as the number of vertices goes to infinity, our algorithm achieves weak consistency, which improves the previous results in Ghoshdastidar and Dukkipati (2017) for non-uniform HSBMs. Our spectral algorithm consists of three major steps: (1) Hyperedge selection: select hyperedges of certain sizes to provide the maximal signal-to-noise ratio for the induced sub-hypergraph; (2) Spectral partition: construct a regularized adjacency matrix and obtain an approximate partition based on singular vectors; (3) Correction and merging: incorporate the hyperedge information from adjacency tensors to upgrade the error rate guarantee. The theoretical analysis of our algorithm relies on the concentration and regularization of the adjacency matrix for sparse non-uniform random hypergraphs, which can be of independent interest.

math.ST↗

Values of finite distortion: Reshetnyak's theorem, the Liouville theorem, and the Lusin (N) -property

Let $Ω\subset \mathbb{R}^n$ be a domain and $f \in W^{1,n}_{\text{loc}} (Ω,\mathbb{R}^n)$. We say that $f$ has a value of finite distortion at $y_0 \in \mathbb{R}^n$ if there exist measurable functions $K \colon Ω\to [0,\infty)$ and $Σ\in L^1_{\text{loc}} (Ω)$ such that \[ \lvert Df(x) \rvert^n \le K(x) \det Df (x) + Σ(x) \lvert f(x)-y_0 \rvert^n \quad \text{for a.e. } x \in Ω. \] This notion unifies the classical theory of mappings of finite distortion with the recently introduced theory of quasiregular values. Under sharp integrability assumptions on $K$ and $Σ$, we establish single-value analogues of Reshetnyak's theorem and the Liouville theorem. We also prove that mappings satisfying a more general distortion inequality with defect preserve sets of Lebesgue measure zero.

math.CV↗

Achieving the Kesten-Stigum bound in the non-uniform hypergraph stochastic block model

We study the community detection problem in the non-uniform hypergraph stochastic block model (HSBM), where hyperedges of varying sizes coexist. This setting captures higher-order and multi-view interactions and raises a fundamental question: can multiple uniform hypergraph layers below the detection threshold be combined to enable weak recovery? We answer this question by establishing a Kesten--Stigum-type bound for weak recovery in a general class of non-uniform HSBMs with $r$ blocks, generated according to multiple symmetric probability tensors. In the case $r=2$, we show that weak recovery is possible whenever the sum of the signal-to-noise ratios across all uniform hypergraph layers exceeds one, thereby confirming the positive part of a conjecture in (Chodrow et al., 2023). Moreover, we provide a polynomial-time spectral algorithm that achieves this threshold via an optimally weighted non-backtracking operator. For the unweighted non-backtracking matrix, our spectral method attains a different algorithmic threshold, also conjectured in (Chodrow et al., 2023). Our approach develops a spectral theory for weighted non-backtracking operators on non-uniform hypergraphs, including a precise characterization of outlier eigenvalues and eigenvector overlaps. We introduce a novel Ihara--Bass formula tailored to weighted non-uniform hypergraphs, which yields an efficient low-dimensional representation and leads to a provable spectral reconstruction algorithm. Taken together, these results provide a principled and computationally efficient approach to clustering in non-uniform hypergraphs, and highlight the role of optimal weighting in aggregating heterogeneous higher-order interactions.

stat.ML↗

SMAL-pets: SMAL Based Avatars of Pets from Single Image

Creating high-fidelity, animatable 3D dog avatars remains a formidable challenge in computer vision. Unlike human digital doubles, animal reconstruction faces a critical shortage of large-scale, annotated datasets for specialized applications. Furthermore, the immense morphological diversity across species, breeds, and crosses, which varies significantly in size, proportions, and features, complicates the generalization of existing models. Current reconstruction methods often struggle to capture realistic fur textures. Additionally, ensuring these avatars are fully editable and capable of performing complex, naturalistic movements typically necessitates labor-intensive manual mesh manipulation and expert rigging. This paper introduces SMAL-pets, a comprehensive framework that generates high-quality, editable animal avatars from a single input image. Our approach bridges the gap between reconstruction and generative modeling by leveraging a hybrid architecture. Our method integrates 3D Gaussian Splatting with the SMAL parametric model to provide a representation that is both visually high-fidelity and anatomically grounded. We introduce a multimodal editing suite that enables users to refine the avatar's appearance and execute complex animations through direct textual prompts. By allowing users to control both the aesthetic and behavioral aspects of the model via natural language, SMAL-pets provides a flexible, robust tool for animation and virtual reality.

cs.CV↗