arXiv Science⌕ Search

arXiv · 0704.0923

When the Cramer-Rao Inequality provides no information

Abstract

We investigate a one-parameter family of probability densities (related to the Pareto distribution, which describes many natural phenomena) where the Cramer-Rao inequality provides no information.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Steven J. Miller. 2007-04-06. When the Cramer-Rao Inequality provides no information. https://arxiv.org/abs/0704.0923

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Third and Fourth Moment Phenomena for Monochromatic Edges and Applications to Graph-Based Two-Sample Tests

Given a graph sequence $\{G_n\}_{n\in\mathbb{N}}$, denote by $T_n$ the number of monochromatic edges when the vertices of $G_n$ are independently colored red or blue with probabilities $p$ and $1-p$, respectively. We characterize the asymptotic normality of $T_n$, after centering and scaling to unit variance, in terms of subgraph (motif) counts and standardized moments. One of the highlights of our results is a {\it third moment phenomenon}: for every fixed $p\in(0,1)\backslash\{\frac12\}$, asymptotic normality holds if and only if the standardized third moment converges to zero. The more familiar {\it fourth moment condition}, which requires the standardized fourth moment to converge to $3$, gives an equivalent characterization except at the two exceptional probabilities $p=\frac{1\pm1/\sqrt3}{2}$. At these values, the standardized fourth moment converges to $3$ for every graph sequence with a diverging number of edges, even when Gaussian convergence fails. In contrast, in the balanced case $p=\frac12$, the fourth moment condition characterizes asymptotic normality, while the third moment condition is insufficient. These results identify three distinct regimes for moment characterizations of Gaussian convergence, determined by the coloring probability. We further show that the third moment condition remains sufficient in the sparse regime, where $p=p_n \to 0$. As an application, we derive the limiting null distribution of two-sample statistics based on undirected $K$-nearest-neighbor graphs in the Poissonized setting, identifying sharp growth conditions on $K$ for asymptotic normality.

math.ST↗

Time-Uniform Dependent Central Limit Theory

We establish a near-optimal almost sure invariance principle for nonstationary time series under the functional dependence measure (FDM) framework. This result yields a universal time-uniform dependent central limit theorem, which serves as the basis for anytime-valid inference. In particular, we instantiate the theorem through asymptotic confidence sequences (AsympCSs), time-uniform counterparts of asymptotic confidence intervals obtained via central limit theorems, extending those originally proposed in Waudby-Smith et al. (2024) to time series with serial dependence. We further refine their definition because, as we show, it can admit AsympCSs that fail to achieve the desired asymptotic time-uniform coverage for a broad class of data-generating processes, including independent and identically distributed cases. We address this issue by adding a simple eventual-inclusion condition, which in turn permits more flexible variance estimation, particularly useful in time-series settings. For feasible implementation of AsympCSs, we establish strong consistency of HAC variance estimators under the FDM framework, accommodating a wider range of commonly used bandwidth choices than existing results under mixing conditions. As illustrations, we construct AsympCSs for algorithms with Markovian structure and time-series-based causal estimands.

math.ST↗

Detection Is Harder Than Estimation in Certain Regimes: Inference for Moment and Cumulant Tensors

We study estimation and detection of high-order cumulant tensors from $n$ i.i.d. observations of a $p$-dimensional random vector, with performance measured in the tensor spectral norm. Under sub-Gaussianity, we show that the minimax rate for estimating the order-$d$ cumulant tensor is $\sqrt{p/n}\wedge 1$. In contrast to covariance estimation, the natural plug-in estimator obtained by replacing population moments in the moment--cumulant formula with sample moments, which we call the sample cumulant tensor, is generally not rate-optimal for $d\ge 3$, and we construct an estimator that attains the minimax rate. On the computational side, we study testing whether the $d$-th order cumulant tensor vanishes after whitening. We provide evidence, under a model-specific low-degree conjecture, that detection is computationally hard when $n\ll p^{d/2}$. At the same time, we identify a regime in which an efficiently computable estimator achieves error smaller than the separation at which polynomial-time tests can reliably distinguish the null from the alternative under the same conjecture. This reveals an unusual reverse detection--estimation gap: computationally efficient detection can be harder than computationally efficient estimation. The underlying reason is that the relevant loss, tensor spectral norm, is itself NP-hard to compute, creating a new form of computational--statistical gap.

math.ST↗