Chuanping Yu | arXiv Science

arXiv2019

Optimal Projections in the Distance-Based Statistical Methods

This paper introduces a new way to calculate distance-based statistics, particularly when the data are multivariate. The main idea is to pre-calculate the optimal projection directions given the variable dimension, and to project multidimensional variables onto these pre-specified projection directions; by subsequently utilizing the fast algorithm that is developed in Huo and Sz\'ekely [2016] for the univariate variables, the computational complexity can be improved from $O(m^2)$ to $O(n m \cdot \mbox{log}(m))$, where $n$ is the number of projection directions and $m$ is the sample size. When $n \ll m/\log(m)$, computational savings can be achieved. The key challenge is how to find the optimal pre-specified projection directions. This can be obtained by minimizing the worse-case difference between the true distance and the approximated distance, which can be formulated as a nonconvex optimization problem in a general setting. In this paper, we show that the exact solution of the nonconvex optimization problem can be derived in two special cases: the dimension of the data is equal to either $2$ or the number of projection directions. In the generic settings, we propose an algorithm to find some approximate solutions. Simulations confirm the advantage of our method, in comparison with the pure Monte Carlo approach, in which the directions are randomly selected rather than pre-calculated.

stat.CO↗

arXiv2019

Sequential and Simultaneous Distance-based Dimension Reduction

This paper introduces a method called Sequential and Simultaneous Distance-based Dimension Reduction ($S^2D^2R$) that performs simultaneous dimension reduction for a pair of random vectors based on Distance Covariance (dCov). Compared with Sufficient Dimension Reduction (SDR) and Canonical Correlation Analysis (CCA)-based approaches, $S^2D^2R$ is a model-free approach that does not impose dimensional or distributional restrictions on variables and is more sensitive to nonlinear relationships. Theoretically, we establish a non-asymptotic error bound to guarantee the performance of $S^2D^2R$. Numerically, $S^2D^2R$ performs comparable to or better than other state-of-the-art algorithms and is computationally faster. All codes of our $S^2D^2R$ method can be found on Github, including an R package named S2D2R.

stat.ME↗