arXiv · 2611.19798
Barron Approximation and locally optimal weight densities for shallow neural networks
Abstract
Mean field theories provide optimization results for shallow neural networks by analyzing the weight distribution in infinite width limits. Corresponding results for finite sized networks are obtained by particle approximations, for which sharp quantitative bounds are still an open problem. In this paper, we consider a modified mean field loss, which allows a more fine grained control over finite sized networks. We prove convexity and equidistribution properties, which directly lead to Barron type approximation results for networks sampled from local loss minimizers. We demonstrate that particle approximations of the new loss function naturally lead to gradient descent methods with dropout type regularization.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
G. Welper. 2026-11-15. Barron Approximation and locally optimal weight densities for shallow neural networks. https://arxiv.science/abs/2611.19798
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.