Oldemar Rodríguez | arXiv Science

arXiv2026

Riemannian Regression

Classical linear regression assumes that the relevant geometry of the predictor space is Euclidean and that all centered observations contribute to the least-squares fit in the same geometric scale. This paper proposes \emph{Riemannian Regression}, a regression framework in which the usual vector differences are replaced by locally weighted differences induced by a data-dependent similarity structure. We introduce a generalized framework, termed {\em Riemannian Regression}, extending classic regression to any data endowed with a local distance structure. By equipping data tables with local metrics, we adapt regression model to incorporate manifold geometry. Given a similarity matrix $S=(S_{ij})$, obtained from UMAP, ISOMAP, or DBSCAN \cite{mcinnes,isomap,dbscan}, we define the dissimilarity coefficient $ρ_{ij}=1-S_{ij}$ and the induced subtraction $ x_i\ominus x_j=ρ_{ij}(x_i-x_j). $ A Riemannian center $g=x_λ$ is selected as a discrete Fréchet mean, and regression is performed on the Riemannian-centered variables $X_R=W X_{c,λ}$ and $y_R=W y_{c,λ}$, where $W=\operatorname{diag}(ρ_{1λ},\ldots,ρ_{nλ})$. The resulting estimator has the weighted least-squares form $ \widehatβ_R=(X_{c,λ}^{t}W^2X_{c,λ})^{-1}X_{c,λ}^{t}W^2y_{c,λ}. $ The proposed approach preserves the linear form of the regression model while changing the geometry of the fit. The paper develops three ways to construct the local metric: UMAP-based fuzzy similarities, ISOMAP-based normalized geodesic distances, and DBSCAN-based density similarities. Simulated examples and the Abalone data set illustrate how Riemannian Regression can reduce the influence of locally anomalous observations and adapt to regions with different local densities.

math.ST↗

arXiv2025

Riemannian Principal Component Analysis

This paper proposes an innovative extension of Principal Component Analysis (PCA) that transcends the traditional assumption of data lying in Euclidean space, enabling its application to data on Riemannian manifolds. The primary challenge addressed is the lack of vector space operations on such manifolds. Fletcher et al., in their work {\em Principal Geodesic Analysis for the Study of Nonlinear Statistics of Shape}, proposed Principal Geodesic Analysis (PGA) as a geometric approach to analyze data on Riemannian manifolds, particularly effective for structured datasets like medical images, where the manifold's intrinsic structure is apparent. However, PGA's applicability is limited when dealing with general datasets that lack an implicit local distance notion. In this work, we introduce a generalized framework, termed {\em Riemannian Principal Component Analysis (R-PCA)}, to extend PGA for any data endowed with a local distance structure. Specifically, we adapt the PCA methodology to Riemannian manifolds by equipping data tables with local metrics, enabling the incorporation of manifold geometry. This framework provides a unified approach for dimensionality reduction and statistical analysis directly on manifolds, opening new possibilities for datasets with region-specific or part-specific distance notions, ensuring respect for their intrinsic geometric properties.

stat.ML↗