arXiv ScienceSearch

arXiv subjects

Marc Potters

Publications and source records attributed to Marc Potters.

At least 19 recordsLinked to original sources

Finite-rank multiplicative perturbations of rotationally invariant non-Hermitian random matrices

We study finite-rank multiplicative deformations of rotationally invariant non-Hermitian random matrices. More precisely, we consider models of the form $\mathbf{A}(\mathbf{I}+\mathbf{T})$, where $\mathbf{A}$ is a large rotationally invariant non-Hermitian random matrix, $\mathbf{T}$ is a finite-rank normal perturbation, and $\mathbf{I}$ denotes the identity matrix. We characterize the emergence of outlier eigenvalues, their fluctuations, and the associated eigenvector overlaps. Our results provide a multiplicative non-Hermitian counterpart to the classical Baik--Ben Arous--P\'ech\'e framework.

cond-mat.dis-nn

Spectral properties of deterministic matrices multiplied by rotationally invariant random non-Hermitian ensembles

In this paper, we study spectral properties of multiplicative deformations of non-Hermitian random matrices. We consider matrices of the form $\mathbf{A}\mathbf{B}$, where $\mathbf{A}$ is a deterministic $N\times N$ matrix (not necessarily Hermitian) and $\mathbf{B}$ is a rotationally invariant random matrix. We show that, as $N\to\infty$, the boundary of the complex eigenvalue distribution of $\mathbf{A}\mathbf{B}$ is governed by simple equations involving the $\mathcal{R}_1$ and $\mathcal{R}_2$ transforms of $\mathbf{B}$.

cond-mat.dis-nn

Spectral boundaries of deterministic matrices deformed by rotationally invariant random non-Hermitian ensembles

One of the great miracles of random matrix theory is that, in the $N \to \infty$ limit, many otherwise intractable matrix problems with horrendously complicated finite-$N$ expressions admit remarkably simple and elegant asymptotic solutions. In this paper, we illustrate this phenomenon in the context of spectral boundaries (or spectral edges) for deformed random matrices. Specifically, we consider matrices of the form $\mathbf{A} + \mathbf{B}$, where $\mathbf{A}$ is a deterministic $N\times N$ matrix (not necessarily Hermitian) and $\mathbf{B}$ is a rotationally invariant random matrix. In the large-$N$ limit, we show that the complex eigenvalue distribution of $\mathbf{A} + \mathbf{B}$ satisfies remarkably simple boundary equations that depend on the $\mathcal{R}_1$ and $\mathcal{R}_2$ transforms of $\mathbf{B}$. We illustrate our results on several explicit random matrix ensembles and support them with numerical simulations.

cond-mat.dis-nn

The eigenvalues and eigenvectors of finite-rank normal perturbations of large rotationally invariant non-Hermitian matrices

We study finite-rank normal deformations of rotationally invariant non-Hermitian random matrices. Extending the classical Baik-Ben Arous-P\'ech\'e (BBP) framework, we characterize the emergence and fluctuations of outlier eigenvalues in models of the form $\mathbf{A} + \mathbf{T}$, where $\mathbf{A}$ is a large rotationally invariant non-Hermitian random matrix and $\mathbf{T}$ is a finite-rank normal perturbation. We also describe the corresponding eigenvector behavior. Our results provide a unified framework encompassing both Hermitian and non-Hermitian settings, thereby generalizing several known cases.

cond-mat.dis-nn

R-transforms for non-Hermitian matrices: a spherical integral approach

In this paper, we establish a connection between the formalism of $\mathcal{R}$-transforms for non-Hermitian random matrices and the framework of spherical integrals, using the replica method. This connection was previously proved in the Hermitian setting and in the case of bi-invariant random matrices. We show that the $\mathcal{R}$-transforms used in the non-Hermitian context in fact originate from a single scalar function of two variables. This provides a new and transparent way to compute $\mathcal{R}$-transforms, which until now had been known only in restricted cases such as bi-invariant, Hermitian, or elliptic ensembles.

cond-mat.dis-nn

Optimal Data Splitting for Holdout Cross-Validation in Large Covariance Matrix Estimation

Cross-validation is a statistical tool that can be used to improve large covariance matrix estimation. Although its efficiency is observed in practical applications and a convergence result towards the error of the non linear shrinkage is available in the high-dimensional regime, formal proofs that take into account the finite sample size effects are currently lacking. To carry on analytical analysis, we focus on the holdout method, a single iteration of cross-validation, rather than the traditional $k$-fold approach. We derive a closed-form expression for the expected estimation error when the population matrix follows a white inverse Wishart distribution, and we observe the optimal train-test split scales as the square root of the matrix dimension. For general population matrices, we connected the error to the variance of eigenvalues distribution, but approximations are necessary. In this framework and in the high-dimensional asymptotic regime, both the holdout and $k$-fold cross-validation methods converge to the optimal estimator when the train-test ratio scales with the square root of the matrix dimension which is coherent with the existing theory.

math.ST

Distribution of the Diagonal Entries of the Resolvent of a Complex Ginibre Matrix

The study of eigenvalue distributions in random matrix theory is often conducted by analyzing the resolvent matrix $ \mathbf{G}_{\mathbf{M}}^N(z) = (z \mathbf{1} - \mathbf{M})^{-1} $. The normalized trace of the resolvent, known as the Stieltjes transform $ \mathfrak{g}_{\mathbf{M}}^N(z) $, converges to a limit $ \mathfrak{g}_{\mathbf{M}}(z) $ as the matrix dimension $ N $ grows, which provides the eigenvalue density $ \rho_{\mathbf{M}} $ in the large-$ N $ limit. In the Hermitian case, the distribution of $ \mathfrak{g}_{\mathbf{M}}^N(z) $, now regarded as a random variable, is explicitly known when $ z $ lies within the limiting spectrum, and it coincides with the distribution of any diagonal entry of $ \mathbf{G}_{\mathbf{M}}^N(z) $. In this paper, we investigate what becomes of these results when $ \mathbf{M} $ is non-Hermitian. Our main result is the exact computation of the diagonal elements of $ \mathbf{G}_{\mathbf{M}}^N(z) $ when $ \mathbf{M} $ is a Ginibre matrix of size $ N $, as well as the high-dimensional limit for different regimes of $ z $, revealing a tail behavior connected to the statistics of the left and right eigenvectors. Interestingly, the limit distribution is stable under inversion, a property previously observed in the symmetric case. We then propose two general conjectures regarding the distribution of the diagonal elements of the resolvent and its normalized trace in the non-Hermitian case, both of which reveal a symmetry under inversion.

math-ph

Spectral Initialization for High-Dimensional Phase Retrieval with Biased Spatial Directions

We explore a spectral initialization method that plays a central role in contemporary research on signal estimation in nonconvex scenarios. In a noiseless phase retrieval framework, we precisely analyze the method's performance in the high-dimensional limit when sensing vectors follow a multivariate Gaussian distribution for two rotationally invariant models of the covariance matrix C. In the first model C is a projector on a lower dimensional space while in the second it is a Wishart matrix. Our analytical results extend the well-established case when C is the identity matrix. Our examination shows that the introduction of biased spatial directions leads to a substantial improvement in the spectral method's effectiveness, particularly when the number of measurements is less than the signal's dimension. This extension also consistently reveals a phase transition phenomenon dependent on the ratio between sample size and signal dimension. Surprisingly, both of these models share the same threshold value.

cond-mat.dis-nn

Excess Out-of-Sample Risk and Fleeting Modes

Using Random Matrix Theory, we propose a universal and versatile tool to reveal the existence of "fleeting modes", i.e. portfolios that carry statistically significant excess risk, signalling ex-post a change in the correlation structure in the underlying asset space. Our proposed test is furthermore independent of the "true" (but unknown) underlying correlation structure. We show empirically that such fleeting modes exist both in futures markets and in equity markets. We proposed a metric to quantify the alignment between known factors and fleeting modes and identify momentum as a source of excess risk in the equity space.

q-fin.PM

Right large deviation principle for the top eigenvalue of the sum or product of invariant random matrices

In this note we study the right large deviation of the top eigenvalue (or singular value) of the sum or product of two random matrices $\mathbf{A}$ and $\mathbf{B}$ as their dimensions goes to infinity. The matrices $\mathbf{A}$ and $\mathbf{B}$ are each assumed to be taken from an invariant (or bi-invariant) ensemble with a confining potential with a possible \emph{wall} beyond which no eigenvalues/singular values are allowed. The introduction of this wall puts different models in a very generic framework. In particular, the case where the wall is exactly at the right edge of the limiting spectral density is equivalent, from the point of view of large deviations, to considering a fixed diagonal matrices, as studied previously in Ref. \cite{GuionnetMaida20}. We show that that the tilting method introduced in Ref. \cite{GuionnetMaida20} can be extended to our general setting and is equivalent to the study of a spherical spin glass model specific to the operation - sum of symmetric matrices / product of symmetric matrices / sum of rectangular matrices - we are considering.

math-ph

Rank one HCIZ at high temperature: interpolating between classical and free convolutions

We study the rank one Harish-Chandra-Itzykson-Zuber integral in the limit where $\frac{N \beta}{2} \to c $, called the high temperature regime and show that it can be used to construct a promising one-parameter interpolation, with parameter $c$ between the classical and the free convolution. This $c$-convolution has a simple interpretation in terms of another associated family of distribution indexed by $c$, called the Markov-Krein transform: the $c$-convolution of two distributions corresponds to the classical convolution of their Markov-Krein transforms. We derive first cumulants-moments relations, a central limit theorem, a Poisson limit theorem and shows several numerical examples of $c$-convoluted distributions.

cond-mat.stat-mech

On a Generalisation of the Marcenko-Pastur Problem

We study the spectrum of generalized Wishart matrices, defined as $\mathbf{F}=( X Y^\top + Y X^\top)/2T$, where $X$ and $Y$ are $N \times T$ matrices with zero mean, unit variance IID entries and such that $\mathbb{E}[X_{it} Y_{jt}]=c \delta_{i,j}$. The limit $c=1$ corresponds to the Marcenko-Pastur problem. For a general $c$, we show that the Stietjes transform of $\mathbf{F}$ is the solution of a cubic equation. In the limit $c=0$, $T \gg N$ the density of eigenvalues converges to the Wigner semi-circle.

cond-mat.dis-nn

Asymptotic behavior of the multiplicative counterpart of the Harish-Chandra integral and the $S$-transform

In this note, we study the asymptotic of spherical integrals, which are analytical extension in index of the normalized Schur polynomials for $\beta =2$ , and of Jack symmetric polynomials otherwise. Such integrals are the multiplicative counterparts of the Harish-Chandra-Itzykson-Zuber (HCIZ) integrals, whose asymptotic are given by the so-called $R$-transform when one of the matrix is of rank one. We argue by a saddle-point analysis that a similar result holds for all $\beta >0$ in the multiplicative case, where the asymptotic is governed by the logarithm of the $S$-transform. As a consequence of this result one can calculate the asymptotic behavior of complete homogeneous symmetric polynomials.

math-ph

Optimal cleaning for singular values of cross-covariance matrices

We give a new algorithm for the estimation of the cross-covariance matrix $\mathbb{E} XY'$ of two large dimensional signals $X\in\mathbb{R}^n$, $Y\in \mathbb{R}^p$ in the context where the number $T$ of observations of the pair $(X,Y)$ is large but $n/T$ and $p/T$ are not supposed to be small. In the asymptotic regime where $n,p,T$ are large, with high probability, this algorithm is optimal for the Frobenius norm among rotationally invariant estimators, i.e. estimators derived from the empirical estimator by cleaning the singular values, while letting singular vectors unchanged.

math.ST

Agnostic Risk Parity: Taming Known and Unknown-Unknowns

Markowitz' celebrated optimal portfolio theory generally fails to deliver out-of-sample diversification. In this note, we propose a new portfolio construction strategy based on symmetry arguments only, leading to "Eigenrisk Parity" portfolios that achieve equal realized risk on all the principal components of the covariance matrix. This holds true for any other definition of uncorrelated factors. We then specialize our general formula to the most agnostic case where the indicators of future returns are assumed to be uncorrelated and of equal variance. This "Agnostic Risk Parity" (AGP) portfolio minimizes unknown-unknown risks generated by over-optimistic hedging of the different bets. AGP is shown to fare quite well when applied to standard technical strategies such as trend following.

q-fin.PM

Cleaning large correlation matrices: tools from random matrix theory

This review covers recent results concerning the estimation of large covariance matrices using tools from Random Matrix Theory (RMT). We introduce several RMT methods and analytical techniques, such as the Replica formalism and Free Probability, with an emphasis on the Marchenko-Pastur equation that provides information on the resolvent of multiplicatively corrupted noisy matrices. Special care is devoted to the statistics of the eigenvectors of the empirical correlation matrix, which turn out to be crucial for many applications. We show in particular how these results can be used to build consistent "Rotationally Invariant" estimators (RIE) for large correlation matrices when there is no prior on the structure of the underlying process. The last part of this review is dedicated to some real-world applications within financial markets as a case in point. We establish empirically the efficacy of the RIE framework, which is found to be superior in this case to all previously proposed methods. The case of additively (rather than multiplicatively) corrupted noisy matrices is also dealt with in a special Appendix. Several open problems and interesting technical developments are discussed throughout the paper.

cond-mat.stat-mech

Tail protection for long investors: Trend convexity at work

The performance of trend following strategies can be ascribed to the difference between long-term and short-term realized variance. We revisit this general result and show that it holds for various definitions of trend strategies. This explains the positive convexity of the aggregate performance of Commodity Trading Advisors (CTAs) which -- when adequately measured -- turns out to be much stronger than anticipated. We also highlight interesting connections with so-called Risk Parity portfolios. Finally, we propose a new portfolio of strangle options that provides a pure exposure to the long-term variance of the underlying, offering yet another viewpoint on the link between trend and volatility.

q-fin.GN

On the overlaps between eigenvectors of correlated random matrices

We obtain general, exact formulas for the overlaps between the eigenvectors of large correlated random matrices, with additive or multiplicative noise. These results have potential applications in many different contexts, from quantum thermalisation to high dimensional statistics. We find that the overlaps only depend on measurable quantities, and do not require the knowledge of the underlying "true" (noiseless) matrices. We apply our results to the case of empirical correlation matrices, that allow us to estimate reliably the width of the spectrum of the true correlation matrix, even when the latter is very close to the identity. We illustrate our results on the example of stock returns correlations, that clearly reveal a non trivial structure for the bulk eigenvalues. We also apply our results to the problem of matrix denoising in high dimension.

cond-mat.stat-mech