arXiv subjects

ZeYu Li

Publications and source records attributed to ZeYu Li.

6 recordsLinked to original sources

arXiv2026

Efficient Approximation to Analytic and $L^p$ functions by Height-Augmented ReLU Networks

This work addresses two fundamental limitations in neural network approximation theory. We demonstrate that a three-dimensional network architecture enables a significantly more efficient representation of sawtooth functions, which serves as the cornerstone in the approximation of analytic and $L^p$ functions. First, we establish substantially improved exponential approximation rates for several important classes of analytic functions and offer a parameter-efficient network design. Second, for the first time, we derive a quantitative and non-asymptotic approximation of high orders for general $L^p$ functions. Our techniques advance the theoretical understanding of the neural network approximation in fundamental function spaces and offer a theoretically grounded pathway for designing more parameter-efficient networks.

stat.ML↗

arXiv2026

An Improved Boosted DC Algorithm for Nonsmooth Functions with Applications in Image Recovery

We propose a new approach to perform the boosted difference of convex functions algorithm (BDCA) on non-smooth and non-convex problems involving the difference of convex (DC) functions. The recently proposed BDCA uses an extrapolation step from the point computed by the classical DC algorithm (DCA) via a line search procedure in a descent direction to get an additional decrease of the objective function and accelerate the convergence of DCA. However, when the first function in DC decomposition is non-smooth, the direction computed by BDCA can be ascent and a monotone line search cannot be performed. In this work, we proposed a monotone improved boosted difference of convex functions algorithm (IBDCA) for certain types of non-smooth DC programs, namely those that can be formulated as the difference of a possibly non-smooth function and a smooth one. We show that any cluster point of the sequence generated by IBDCA is a critical point of the problem under consideration and that the corresponding objective value is monotonically decreasing and convergent. We also present the global convergence and the convergent rate under the Kurdyka-Lojasiewicz property. The applications of IBDCA in image recovery show the effectiveness of our proposed method. The corresponding numerical experiments demonstrate that our IBDCA outperforms DCA and other state-of-the-art DC methods in both computational time and number of iterations.

math.OC↗

arXiv2026

Neural Network Approximation: A View from Polytope Decomposition

Universal approximation theory offers a foundational framework to verify neural network expressiveness, enabling principled utilization in real-world applications. However, most existing theoretical constructions are established by uniformly dividing the input space into tiny hypercubes without considering the local regularity of the target function. In this work, we investigate the universal approximation capabilities of ReLU networks from a view of polytope decomposition, which offers a more realistic and task-oriented approach compared to current methods. To achieve this, we develop an explicit kernel polynomial method to derive an universal approximation of continuous functions, which is characterized not only by the refined Totik-Ditzian-type modulus of continuity, but also by polytopical domain decomposition. Then, a ReLU network is constructed to approximate the kernel polynomial in each subdomain separately. Furthermore, we find that polytope decomposition makes our approximation more efficient and flexible than existing methods in many cases, especially near singular points of the objective function. Lastly, we extend our approach to analytic functions to reach a higher approximation rate.

cs.LG↗

arXiv2025

Few-Round Distributed Principal Component Analysis: Closing the Statistical Efficiency Gap by Consensus

Distributed algorithms and theories are called for in this era of big data. Under weaker local signal-to-noise ratios, we improve upon the celebrated one-round distributed principal component analysis (PCA) algorithm designed in the spirit of divide-and-conquer, by introducing a few additional communication rounds of consensus. The proposed shifted subspace iteration algorithm is able to close the local phase transition gap, reduce the asymptotic variance, and also alleviate the potential bias. Our estimation procedure is easy to implement and tuning-free. The resulting estimator is shown to be statistically efficient after an acceptable number of iterations. We also discuss extensions to distributed elliptical PCA for heavy-tailed data. Empirical experiments on synthetic and benchmark datasets demonstrate our method's statistical advantage over the divide-and-conquer approach.

stat.ME↗

arXiv2024

Impact of Thermal Effects on the Current-Tunable Electrical Transport in the Ferrimagnetic Semiconductor Mn$_3$Si$_2$Te$_6$

In the ferrimagnetic semiconductor Mn$_3$Si$_2$Te$_6$, a colossal magnetoresistance (CMR) is observed only when a magnetic field is applied along the magnetic hard axis ($\mathbf{H}\parallel c$). This phenomenon suggests an unconventional CMR mechanism potentially driven by the interplay between magnetism, topological band structure, and/or chiral orbital currents (COC). By comparing electrical resistance measurements using continuous direct currents and pulse currents, we found that the current-induced insulator-metal transition, supporting the COC-driven CMR mechanism, is likely a consequence of Joule heating effects. First-principles calculations reveal a pronounced band gap reduction upon tilting the magnetic moments toward the $c$-axis, accompanied by increased carrier concentration and Fermi velocity. Combining spin orientation-dependent electronic structure with Boltzmann transport theory, the calculated electrical resistance closely reproduces the CMR observed experimentally. These findings suggest that the CMR in Mn$_3$Si$_2$Te$_6$ stems primarily from band gap reduction induced by partial polarization of magnetic moments along the magnetic hard axis.

cond-mat.mtrl-sci↗

arXiv2022

Manifold Principle Component Analysis for Large-Dimensional Matrix Elliptical Factor Model

Matrix factor model has been growing popular in scientific fields such as econometrics, which serves as a two-way dimension reduction tool for matrix sequences. In this article, we for the first time propose the matrix elliptical factor model, which can better depict the possible heavy-tailed property of matrix-valued data especially in finance. Manifold Principle Component Analysis (MPCA) is for the first time introduced to estimate the row/column loading spaces. MPCA first performs Singular Value Decomposition (SVD)for each "local" matrix observation and then averages the local estimated spaces across all observations, while the existing ones such as 2-dimensional PCA first integrates data across observations and then does eigenvalue decomposition of the sample covariance matrices. We propose two versions of MPCA algorithms to estimate the factor loading matrices robustly, without any moment constraints on the factors and the idiosyncratic errors. Theoretical convergence rates of the corresponding estimators of the factor loading matrices, factor score matrices and common components matrices are derived under mild conditions. We also propose robust estimators of the row/column factor numbers based on the eigenvalue-ratio idea, which are proven to be consistent. Numerical studies and real example on financial returns data check the flexibility of our model and the validity of our MPCA methods.

stat.ME↗