arXiv · 2611.19909
Variance Stable Gaussian Smoothing Estimator for Arbitrary High-order Derivatives
Abstract
Computing high-order partial derivatives in high dimensions by automatic differentiation can be costly in both computation and memory. Stein's identity offers an alternative through Gaussian smoothing, but the variance of the resulting estimators can diverge as the step size tends to zero, even with antithetic sampling. We propose a variance stabilization technique that extends antithetic sampling from a reflection pair to $n$ equally spaced points on a circle in the complex plane. Under local analyticity, we prove that, when $n$ is at least the derivative order, the bias is of order $O(σ^n)$ and the variance remains bounded as the smoothing step size $σ$ tends to zero. Numerical experiments support these predictions and demonstrate the effectiveness of the estimator in physics-informed neural networks (PINNs) for polyharmonic and Cahn--Hilliard equations. The technique mitigates the bias-variance trade-off in smoothing-based derivative estimation and is useful for PINNs solving high-order partial differential equations.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Shuixin Fang, Xuerui Wang, Hang Zeng, Tao Zhou. 2026-11-15. Variance Stable Gaussian Smoothing Estimator for Arbitrary High-order Derivatives. https://arxiv.science/abs/2611.19909
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.