arXiv Science⌕ Search

arXiv subjects

Thomas Stark

Publications and source records attributed to Thomas Stark.

7 recordsLinked to original sources

Beyond weak convergence of signed spectral measures: Eigenvector overlaps and high-dimensional prediction risk

Many results in random matrix theory and high-dimensional statistics depend on weak convergence of spectral measures, which is usually established via pointwise convergence of Stieltjes transforms. This approach has recently been applied to signed measures. However, for signed measures, pointwise convergence of Stieltjes transforms alone no longer characterizes weak convergence. While this is unproblematic in many cases, in the high-dimensional regression setting, recently considered by Green and Romanov (2025), the underlying signed eigenvector-overlap measures can fail to converge weakly, despite pointwise convergence of their Stieltjes transforms. Using a novel approach to risk analysis, we show that weak convergence can be replaced by a simple convergence result for bilinear forms. This allows us to establish convergence of the prediction risk for estimators based on arbitrary continuous spectral filters, including (regularized) gradient descent and ridge regression, even when the underlying signed measures fail to converge weakly. Under additional regularity conditions, we construct an explicit finite signed measure yielding an integral representation of the asymptotic prediction risk. This representation provides necessary and sufficient conditions for minimum-norm interpolation and optimally tuned ridge regression to attain the smallest asymptotic prediction risk among estimators with continuous spectral filters. Moreover, we provide characterizations of weak and vague convergence of finite signed measures in terms of pointwise convergence of their Stieltjes transforms.

math.ST↗

Quantitative Resolvent Calculus for Sample Covariance Matrices

In this work, we develop a quantitative resolvent calculus for sample covariance matrices tailored to applications in high-dimensional statistics. We treat single resolvents, their derivatives, and products of two resolvents with different spectral parameters in the proportional-dimensional regime. Our bounds hold uniformly over compact subsets of $\mathbb C\setminus\mathbb R_{\geq0}$ with approximation errors of order $O_{\mathbb P}(\|Θ_n\|_F/\sqrt n)$ for deterministic test matrices $Θ_n$. These bounds require only uniformly bounded fourth moments and a uniformly bounded population covariance operator norm. Neither regular spectral edges nor convergence of the population spectral distribution is required. As a key technical ingredient, we develop an averaging argument for centered quadratic forms involving one or two leave-one-out resolvents. Applications of our results include precision-matrix shrinkage, prediction risk in ridge regression, and generalized cross-validation. For these problems, we obtain quantitative guarantees for estimation and data-driven parameter selection.

math.ST↗

Comparing regularisation paths of (conjugate) gradient estimators in ridge regression

We consider standard gradient descent, gradient flow and conjugate gradients as iterative algorithms for minimising a penalised ridge criterion in linear regression. While it is well known that conjugate gradients exhibit fast numerical convergence, the statistical properties of their iterates are more difficult to assess due to inherent non-linearities and dependencies. On the other hand, standard gradient flow is a linear method with well-known regularising properties when stopped early. By an explicit non-standard error decomposition we are able to bound the prediction error for conjugate gradient iterates by a corresponding prediction error of gradient flow at transformed iteration indices. This way, the risk along the entire regularisation path of conjugate gradient iterations can be compared to that for regularisation paths of standard linear methods like gradient flow and ridge regression. In particular, the oracle conjugate gradient iterate shares the optimality properties of the gradient flow and ridge regression oracles up to a constant factor. Numerical examples show the similarity of the regularisation paths in practice.

stat.ML↗

Implicit vs. explicit regularization for high-dimensional gradient descent

In this paper we investigate the generalization error of gradient descent (GD) applied to an $\ell_2$-regularized OLS objective function in the linear model. Based on our analysis we develop new methodology for computationally tractable and statistically efficient linear prediction in a high-dimensional and massive data scenario (large-$n$, large-$p$). Our results are based on the surprising observation that the generalization error of optimally tuned regularized gradient descent approaches that of an optimal benchmark procedure $monotonically$ in the iteration number $t$. On the other hand standard GD for OLS (without explicit regularization) can achieve the benchmark only in degenerate cases. This shows that (optimal) explicit regularization can be nearly statistically efficient (for large $t$) whereas implicit regularization by (optimal) early stopping can not. To complete our methodology, we provide a fully data driven and computationally tractable choice of the $\ell_2$ regularization parameter $λ$ that is computationally cheaper than cross-validation. On this way, we follow and extend ideas of Dicker (2014) to the non-gaussian case, which requires new results on high-dimensional sample covariance matrices that might be of independent interest.

math.ST↗

Robust Signal Recovery in Hadamard Spaces

We analyze the stability of (strong) laws of large numbers in Hadamard spaces with respect to distributional perturbations. For the inductive means of a sequence of independent, but not necessarily identically distributed random variables, we provide a concentration inequality in quadratic mean, as well as a strong law of large numbers, generalizing a classical result of K.-T. Sturm. For the Fréchet mean, we generalize H. Ziezold's law of large numbers in Hadamard spaces. In this case, we neither require our data to be independent, nor identically distributed; reasonably mild conditions on the first two moments of our sample are enough. Additionally, we look at data contamination via a model inspired by Huber's $\varepsilon$-contamination model, in which we replace a random portion of the data with noise. In the most general setup, we do neither require the data, nor the noise to be i.i.d., nor do we require the noise to be independent of the data. To analyze the stability of the (non-symmetric) inductive mean with respect to data loss, data permutation, and noise, a resampling scheme is introduced, and sufficient conditions for its convergence are provided. These results suggest that means in Hadamard spaces are as robust as in Euclidean spaces. This is underlined by a small simulation study, in which we compare the robustness of means on the manifold of positive definite matrices, with means on open books.

math.ST↗

The Role of Molecular Arrangement on the Dispersion in Strongly Coupled Metal-Organic Hybrid Structures

Metal-organic hybrid structures have been demonstrated a versatile platform to study primary aspects of light-matter interaction by means of emerging states comprising excitonic and plasmonic properties. Here we are studying the wave-vector dependent photo-excitations in gold layers covered by molecular films of zinc-phthalocyanine and its fluorinated derivatives (FnZnPc, with n = 0,4,8,16). These layered metal-organic samples show up to four anti-crossings in their dispersions correlating in energy with the respective degree of ZnPc fluorination. By means of complementary structural and theoretical data, we attribute the observed anti-crossings to three main scenarios of surface plasmon coupling: i) to aggregated $α$-phase regions within the FnZnPc layers at 1.75 eV and 1.85 eV , ii) to a coexisting F16ZnPc $β$-polymorph at 1.51 eV, and iii) to monomers, preferentially located at the metal interface, at 2.15 eV. Whereas energy and splitting of the monomer anti-crossings depend on strength and average tilting of the molecular dipole moments, the aggregate related anti-crossings show a distinct variation with degree of fluorination. These observations can be consistently explained by a change in FnZnPc dipole density induced by an increased lattice spacing due to the larger molecular van der Waals radii upon fluorination. The reported results prove Au/FnZnPc bilayers a model system to demonstrate the high sensitivity of exciton-plasmon coupling on the molecular alignment at microscopic length scales.

physics.optics↗

High speed control of electro-mechanical transduction Advanced Drive Techniques for Optimized Step-and-Settle Response of MEMS Micromirrors

Micro/Nano Electro Mechanical Systems (MEMS/NEMS) provide the engineer with a powerful set of solutions to a wide variety of technical challenges. However, because they are mechanical systems, response times can be a limitation. In some situations, advanced engineered drive techniques can improve response times by as much as a thousand, significantly opening up the application space for MEMS/NEMS solutions.

physics.ins-det↗