arXiv Science⌕ Search

arXiv subjects

Paul Navas

Publications and source records attributed to Paul Navas.

3 recordsLinked to original sources

Characterizing M-estimators using canonical divergences from information geometry

On Euclidean space, the losses that produce consistent M-estimators of a functional are its strictly consistent scoring functions (Dimitriadis, Fissler and Ziegel, 2024), and Osband's principle characterizes these through identification functions, which define method-of-moments estimators. We extend this characterization to the probability simplex. We define the residual, which on Euclidean space is a subtraction, as the inverse exponential map of an affine connection. It identifies the exponential barycenter of the connection: the arithmetic, normalized geometric and Fréchet means for the mixture, exponential and Levi-Civita connections. Its integral along geodesics is the canonical divergence of Ay and Amari (2015). A geometric form of Osband's principle decides which losses each connection admits. For the flat connections every strictly convex generator yields a consistent Bregman loss. For the curved $α$-connections, half the squared Fisher-Rao distance is (up to scale) the only consistent loss for the Fréchet mean, and for $α\notin \{-1, 0, 1\}$ no such loss exists and only the method of moments remains. The residual is integrable only at $α= 0$, sharpening the integrability claim of Ay and Amari. The characterization yields the estimating equations of regression on the simplex and the calibration decomposition of compositional forecasts.

math.ST↗

The information geometry of the Sinkhorn divergence on a Hilbert manifold

The Sinkhorn divergence, the debiased entropic optimal transport cost, determines a metric tensor on probability measures defined along curves, due to Lavenant et al. We construct a real-analytic Hilbert manifold of measures, the smooth stratum, on which this tensor is a weak Riemannian metric, and we continue Eguchi's construction of a geometry from a divergence to the third order. The stratum consists of the measures with a positive Sobolev density on a closed Riemannian manifold, and the strata form a scale whose intersection is the Fréchet manifold of smooth positive densities of Ay. Following it, we characterize the metric through the gradients of mean values: its cotangent form is a spectral reweighting of the Dirichlet form of a Markov chain, so the metric is of the same kind as the Fisher-Rao and the Otto metric, and on the stratum it is bounded by a multiple of the Fisher-Rao metric (but not conversely). At third order, the Sinkhorn divergence is self-dual: both connection forms of Eguchi's construction coincide with the Levi-Civita form of the metric, and the cubic tensor vanishes, as a consequence of the transposition symmetry of the transport problem. On every stratum, the Levi-Civita form is represented, so the stratum has a real-analytic Levi-Civita connection, which on the Fréchet manifold is the connection of Ay and Schwachhöfer.

math.ST↗

Estimators from Convex Geometries of the Simplex

We unify several geometries of the probability simplex under one principle, their generation by a potential: convex potentials produce the Bregman divergences and dually flat structures of information geometry, and the exponentially concave potentials of Pal and Wong produce the logarithmic divergences and their projectively flat structures. Each structure carries a duality between maximum entropy and minimum divergence and, with it, a projection principle for estimation: the U-estimators of Eguchi, Komori and Ohara in the first case, the λ-deformed estimators of Wong and Zhang in the second, both governed by a Pythagorean relation and reducing to maximum likelihood in the undeformed limit. We complete the picture with estimators drawn from the third connection the divergence defines, the Levi-Civita one, by minimizing geodesic distance: existence, uniqueness and influence are then controlled by curvature and diameter rather than by flatness. Along the way the Aitchison geometry appears as the logarithmic-barrier instance of the construction at its critical weight, and the symmetrization of the Pal-Wong transport cost, a smoothing of the Hilbert projective metric, is shown to lose the dual pair and to support instead a Huber-type robust center with bounded influence in a geometry of infinite diameter.

math.ST↗