Parameter Bounds and Inverse Approximation for Linearized ReLU$^k$ Networks on the Sphere

Abstract

We study direct and inverse approximation for linearized shallow ReLU$^k$ networks on $\mathbb S^d$ with quasi-uniform hidden parameters. For $0<α<\frac{d+2k+1}{2d}$, under the coefficient growth condition $\bigl(n\sum_{j=1}^na_{j,n}^2\bigr)^{\frac{1}{2}}\leq n^αM$, we prove that approximation at the order $n^{-\frac{d+2k+1}{2d}+α}$ is equivalent to membership in the parity-compatible Besov space $\mathcal B_{2,\infty,*}^{\frac{d+2k+1}{2}-αd}(\mathbb S^d)$. Mere convergence under the same coefficient budget does not imply this regularity. For unconstrained approximation along a nested parameter sequence, a single ridge function gives a counterexample when $α<\frac{1}{2}$, whereas for $α>\frac{1}{2}$ the endpoint Besov inverse conclusion follows from a Bernstein inequality under antipodal quasi-uniformity. The inverse conclusion is also recovered when the prescribed rate holds for two quasi-uniform parameter sequences whose union is antipodally separated.