arXiv ScienceSearch

arXiv subjects

Dan Cheng

Publications and source records attributed to Dan Cheng.

At least 19 recordsLinked to original sources

Cluster size distributions of discrete random fields

We study discrete random fields $\{X_t: t\in \mathbb{Z}^d\}$ parameterized on the $d$-dimensional integer lattice $\mathbb{Z}^d$. For a fixed threshold $u$, the excursion set $\{t \in \mathbb{Z}^d : X_t > u\}$ decomposes into connected components or clusters, whose size, defined as the number of lattice points they contain, are random. This paper investigates the probability distribution of these cluster sizes. For stationary random fields, we derive exact expressions for the cluster size distribution. To address nonstationary settings, we introduce a peak-based cluster size distribution, which characterizes the distribution of cluster sizes conditional on the presence of a local maximum above $u$. This formulation provides a tractable alternative when exact cluster size distributions are analytically inaccessible. The proposed framework applies broadly to Gaussian and non-Gaussian random fields, relying only on their joint dependence structure. Our results provide a theoretical foundation for quantifying spatial extent in discretely sampled data, with applications to medical imaging, geoscience, environmental monitoring, and other scientific areas where thresholded random fields naturally arise.

math.ST

Microbial correlation: a semi-parametric model for investigating microbial co-metabolism

The gut microbiome plays a crucial role in human health, yet the mechanisms underlying host-microbiome interactions remain unclear, limiting its translational potential. Recent microbiome multiomics studies, particularly paired microbiome-metabolome studies (PM2S), provide valuable insights into gut metabolism as a key mediator of these interactions. Our preliminary data reveal strong correlations among certain gut metabolites, suggesting shared metabolic pathways and microbial co-metabolism. However, these findings are confounded by various factors, underscoring the need for a more rigorous statistical approach. Thus, we introduce microbial correlation, a novel metric that quantifies how two metabolites are co-regulated by the same gut microbes while accounting for confounders. Statistically, it is based on a partially linear model that isolates microbial-driven associations, and a consistent estimator is established based on semi-parametric theory. To improve efficiency, we develop a calibrated estimator with a parametric rate, maximizing the use of large external metagenomic datasets without paired metabolomic profiles. This calibrated estimator also enables efficient p-value calculation for identifying significant microbial co-metabolism signals. Through extensive numerical analysis, our method identifies important microbial co-metabolism patterns for healthy individuals, serving as a benchmark for future studies in diseased populations.

stat.ME

On the peak height distribution of non-stationary Gaussian random fields: 1D general covariance and scale space

We study the peak height distribution of certain non-stationary Gaussian random fields. The explicit peak height distribution of smooth, non-stationary Gaussian processes in 1D with general covariance is derived. The formula is determined by two parameters, each of which has a clear statistical meaning. For multidimensional non-stationary Gaussian random fields, we generalize these results to the setting of scale space fields, which play an important role in peak detection by helping to handle peaks of different spatial extents. We demonstrate that these properties not only offer a better interpretation of the scale space field but also simplify the computation of the peak height distribution. Finally, two efficient numerical algorithms are proposed as a general solution for computing the peak height distribution of smooth multidimensional Gaussian random fields in applications.

stat.ME

The expected Euler characteristic approximation to excursion probabilities of smooth Gaussian random fields with general variance functions

Consider a centered smooth Gaussian random field $\{X(t), t\in T \}$ with a general (nonconstant) variance function. In this work, we demonstrate that as $u \to \infty$, the excursion probability $\mathbb{P}\{\sup_{t\in T} X(t) \geq u\}$ can be accurately approximated by $\mathbb{E}\{\chi(A_u)\}$ such that the error decays at a super-exponential rate. Here, $A_u = \{t\in T: X(t)\geq u\}$ represents the excursion set above $u$, and $\mathbb{E}\{\chi(A_u)\}$ is the expectation of its Euler characteristic $\chi(A_u)$. This result substantiates the expected Euler characteristic heuristic for a broad class of smooth Gaussian random fields with diverse covariance structures. In addition, we employ the Laplace method to derive explicit approximations to the excursion probabilities.

math.PR

Multiple Testing of Local Extrema for Detection of Structural Breaks in Piecewise Linear Models

In this paper, we propose a new generic method for detecting the number and locations of structural breaks or change points in piecewise linear models under stationary Gaussian noise. Our method transforms the change point detection problem into identifying local extrema (local maxima and local minima) through kernel smoothing and differentiation of the data sequence. By computing p-values for all local extrema based on peak height distributions of smooth Gaussian processes, we utilize the Benjamini-Hochberg procedure to identify significant local extrema as the detected change points. Our method can distinguish between two types of change points: continuous breaks (Type I) and jumps (Type II). We study three scenarios of piecewise linear signals, namely pure Type I, pure Type II and a mixture of Type I and Type II change points. The results demonstrate that our proposed method ensures asymptotic control of the False Discover Rate (FDR) and power consistency, as sequence length, slope changes, and jump size increase. Furthermore, compared to traditional change point detection methods based on recursive segmentation, our approach only requires a single test for all candidate local extrema, thereby achieving the smallest computational complexity proportionate to the data sequence length. Additionally, numerical studies illustrate that our method maintains FDR control and power consistency, even in non-asymptotic cases when the size of slope changes or jumps is not large. We have implemented our method in the R package "dSTEM" (available from https://cran.r-project.org/web/packages/dSTEM).

stat.ME

Network Inference Using the Hub Model and Variants

Statistical network analysis primarily focuses on inferring the parameters of an observed network. In many applications, especially in the social sciences, the observed data is the groups formed by individual subjects. In these applications, the network is itself a parameter of a statistical model. Zhao and Weko (2019) propose a model-based approach, called the hub model, to infer implicit networks from grouping behavior. The hub model assumes that each member of the group is brought together by a member of the group called the hub. The set of members which can serve as a hub is called the hub set. The hub model belongs to the family of Bernoulli mixture models. Identifiability of Bernoulli mixture model parameters is a notoriously difficult problem. This paper proves identifiability of the hub model parameters and estimation consistency under mild conditions. Furthermore, this paper generalizes the hub model by introducing a model component that allows hubless groups in which individual nodes spontaneously appear independent of any other individual. We refer to this additional component as the null component. The new model bridges the gap between the hub model and the degenerate case of the mixture model -- the Bernoulli product. Identifiability and consistency are also proved for the new model. In addition, a penalized likelihood approach is proposed to estimate the hub set when it is unknown.

stat.ME

On local maxima of smooth Gaussian nonstationary processes and stationary planar fields with trends

We present exact formulas for both the expected number and the height distribution of local maxima (peaks) in two distinct categories of smooth, non-centered Gaussian fields: (i) nonstationary Gaussian processes and (ii) stationary planar Gaussian fields. For case (i), we introduce a novel parameter related to conditional correlation that significantly simplifies the computation of these formulas. Notably, the peak height distribution is solely dependent on this single parameter. In case (ii), traditional methods involving GOE random matrices are ineffective for non-isotropic fields with mean functions. To address this, we apply specific transformations that enable the derivation of formulas using generalized chi-squared density functions. These derived results provide essential tools for calculating p-values and power in applications of signal and change point detection within environments characterized by non-isotropic Gaussian noise.

math.PR

Smooth Mat\'ern Gaussian Random Fields: Euler Characteristic, Expected Number and Height Distribution of Critical Points

This paper studies Gaussian random fields with Mat\'ern covariance functions with smooth parameter $\nu>2$. Two cases of parameter spaces, the Euclidean space and $N$-dimensional sphere, are considered. For such smooth Gaussian fields, we have derived the explicit formulae for the expected Euler characteristic of the excursion set, the expected number and height distribution of critical points. The results are valuable for approximating the excursion probability in family-wise error control and for computing p-values in peak inference.

math.PR

MQXFA Series Magnet Production Specification

The purpose of this document is to define the specifications for the structure fabrication and assembly of MQXFA series magnets to be used by the US High-Luminosity LHC Accelerator Upgrade Project (AUP). Magnets fabricated according to these specifications are expected to allow MQXFA magnets to meet the MQXFA Functional Requirements Specification. These specifications for the fabrication of MQXFA series magnets are based on the R&D performed by the US LHC Accelerator Research Program (LARP) and the development performed by AUP, in collaboration with CERN, through fabrication and test of pre-series coils and magnets.

physics.acc-ph

The expected Euler characteristic approximation to excursion probabilities of Gaussian vector fields

Let $\{(X(t), Y(s)): t\in T, s\in S\}$ be an $\mathbb{R}^2$-valued, centered, unit-variance smooth Gaussian vector field, where $T$ and $S$ are compact rectangles in $\mathbb{R}^N$. It is shown that, as $u\to \infty$, the joint excursion probability $\mathbb{P} \{\sup_{t\in T} X(t) \geq u, \sup_{s\in S} Y(s) \geq u \}$ can be approximated by $\mathbb{E}\{\chi(A_u)\}$, the expected Euler characteristic of the excursion set $A_u=\{(t,s)\in T\times S: X(t) \ge u, Y(s) \ge u\}$, such that the error is super-exponentially small. This verifies the expected Euler characteristic heuristic (cf. Taylor, Takemura and Alder (2005), Alder and Taylor (2007)) for a large class of smooth Gaussian vector fields.

math.PR

An approximation to peak detection power using Gaussian random field theory

We study power approximation formulas for peak detection using Gaussian random field theory. The approximation, based on the expected number of local maxima above the threshold $u$, $\mathbb{E}[M_u]$, is proved to work well under three asymptotic scenarios: small domain, large threshold, and sharp signal. An adjusted version of $\mathbb{E}[M_u]$ is also proposed to improve accuracy when the expected number of local maxima $\mathbb{E}[M_{-\infty}]$ exceeds 1. Cheng and Schwartzman (2018) developed explicit formulas for $\mathbb{E}[M_u]$ of smooth isotropic Gaussian random fields with zero mean. In this paper, these formulas are extended to allow for rotational symmetric mean functions, so that they are suitable for power calculations. We also apply our formulas to 2D and 3D simulated datasets, and the 3D data is induced by a group analysis of fMRI data from the Human Connectome Project to measure performance in a realistic setting.

stat.ME

Ultrashort Pulse Generation in Modeless Laser Cavity

We demonstrate experimentally that random phase modulation of an erbium-doped fiber ring-laser by an intra-cavity electro-optic phase modulator did not inhibit ultrashort-pulse operation. Stable and self-starting ultrashort-pulse operation with a single pulse circulating in the cavity was achieved even when the phase modulator was driven with random sequences sufficiently fast and strong to render the laser cavity modeless, in the sense that heterodyning of the laser output did not show any spectral lines corresponding to a mode spectrum. No significant change in measured pulse characteristics was observed, compared to conventional mode-locking in the unmodulated cavity. The insensitivity to the random phase modulation is expected, given the lack of phase-sensitive elements in the cavity.

physics.optics

On critical points of Gaussian random fields under diffeomorphic transformations

Let $\{X(t), t\in M\}$ and $\{Z(t'), t'\in M'\}$ be smooth Gaussian random fields parameterized on Riemannian manifolds $M$ and $M'$, respectively, such that $X(t) = Z(f(t))$, where $f: M \to M'$ is a diffeomorphic transformation. We study the expected number and height distribution of the critical points of $X$ in connection with those of $Z$. As an important case, when $X$ is an anisotropic Gaussian random field, then we show that its expected number of critical points becomes proportional to that of an isotropic field $Z$, while the height distribution remains the same as that of $Z$.

math.PR

Estimation of Expected Euler Characteristic Curves of Nonstationary Smooth Gaussian Random Fields

The expected Euler characteristic (EEC) curve of excursion sets of a Gaussian random field is used to approximate the distribution of its supremum for high thresholds. Viewed as a function of the excursion threshold, the EEC is expressed by the Gaussian kinematic formula (GKF) as a linear function of the Lipschitz-Killing curvatures (LKCs) of the field, which solely depend on the domain and covariance function of the field. So far its use for non-stationary Gaussian fields over non-trivial domains has been limited because in this case the LKCs are difficult to estimate. In this paper, consistent estimators of the LKCs are proposed as linear projections of "pinned" observed Euler characteristic curves and a linear parametric estimator of the EEC curve is obtained, which is more efficient than its nonparametric counterpart for repeated observations. A multiplier bootstrap modification reduces the variance of the estimator, and allows estimation of LKCs and EEC of the limiting field of non-Gaussian fields satisfying a functional CLT. The proposed methods are evaluated using simulations of 2D fields and illustrated in thresholding of 3D fMRI brain activation maps and cosmological simulations on the 2-sphere.

math.ST

Extremes of Spherical Fractional Brownian Motion

Let $\{B_\beta (x), x \in \mathbb{S}^N\}$ be a fractional Brownian motion on the $N$-dimensional unit sphere $\mathbb{S}^N$ with Hurst index $\beta$. We study the excursion probability $\mathbb{P}\{\sup_{x\in T} B_\beta(x) > u \}$ and obtain the asymptotics as $u\to \infty$, where $T$ can be the entire sphere $\mathbb{S}^N$ or a geodesic disc on $\mathbb{S}^N$.

math.PR

Multiple testing of local maxima for detection of peaks on the (celestial) sphere

We present a topological multiple testing scheme for detecting peaks on the sphere under isotropic Gaussian noise, where tests are performed at local maxima of the observed field filtered by the spherical needlet transform. Our setting is different from the standard Euclidean/large same asymptotic framework, yet highly relevant to realistic experimental circumstances for some important areas of application in astronomy. More precisely, we focus on cases where a single realization of a smooth isotropic Gaussian random field on the sphere is observed, and a number of well-localized signals are superimposed on such background field. The proposed algorithms, combined with the Benjamini-Hochberg procedure for thresholding p-values, provide asymptotic strong control of the False Discovery Rate (FDR) and power consistency as the signal strength and the frequency of the needlet transform get large. This novel multiple testing method is illustrated in a simulation of point-source detection in Cosmic Microwave Background radiation (CMB) data.

math.ST

Expected Number and Height Distribution of Critical Points of Smooth Isotropic Gaussian Random Fields

We obtain formulae for the expected number and height distribution of critical points of smooth isotropic Gaussian random fields parameterized on Euclidean space or spheres of arbitrary dimension. The results hold in general in the sense that there are no restrictions on the covariance function of the field except for smoothness and isotropy. The results are based on a characterization of the distribution of the Hessian of the Gaussian field by means of the family of Gaussian orthogonally invariant (GOI) matrices, of which the Gaussian orthogonal ensemble (GOE) is a special case. The obtained formulae depend on the covariance function only through a single parameter (Euclidean space) or two parameters (sphere), and include the special boundary case of random Laplacian eigenfunctions.

math.PR

Excursion Probabilities of Isotropic and Locally Isotropic Gaussian Random Fields on Manifolds

Let $X= \{X(p), p\in M\}$ be a centered Gaussian random field, where $M$ is a smooth Riemannian manifold. For a suitable compact subset $D\subset M$, we obtain the approximations to excursion probability $\mathbb{P}\{\sup_{p\in D} X(p) \ge u \}$, as $u\to \infty$, for two cases: (i) $X$ is smooth and isotropic; (ii) $X$ is non-smooth and locally isotropic. For case (i), the expected Euler characteristic approximation is formulated explicitly; while for case (ii), it is shown that the asymptotics is similar to Pickands' approximation on Euclidean space which involves Pickands' constant and the volume of $D$. These extend the results in \citep{Cheng:2014} from sphere to general Riemannian manifolds.

math.PR