Singularities of Multidimensional Item Response Models and the Rank of the Fisher Information Matrix

Joe Suzuki

Home/Archive/arXiv

arXiv · 2610.26144

Singularities of Multidimensional Item Response Models and the Rank of the Fisher Information Matrix

Joe Suzuki

View original source ↗Read source document ↗Export metadata ↓

Abstract

Statistical models in item response theory are known to be singular. This singularity manifests itself as a loss of rank in the Fisher information matrix, and the usual theories underlying AIC and BIC, which assume regularity, cannot be applied without further justification. Chen and colleagues analyzed this degeneracy and nonregular likelihood ratio tests, but their analysis does not identify all the directions that produce degeneracy or their dimensions. In this study, we analyze the entire kernel of the Fisher information matrix as a linear space for multidimensional item response models, separating the degeneracy due to rotations from that due to an over-specified latent dimension without double counting. We determine the dimension of each component and the exact rank of the information matrix, and prove a formula for computing, from the item parameters, the dimension of the degeneracy that remains after these components are removed. These results go beyond establishing the existence of singularity to identifying its causes and extent, providing a foundation for inference and model comparison in IRT.

Explore related subjects

math.ST math.SP stat.TH

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Joe Suzuki. 2026-10-19. Singularities of Multidimensional Item Response Models and the Rank of the Fisher Information Matrix. https://arxiv.org/abs/2610.26144

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Axioms for validity: e-values, p-values and data-dependent levels

The emerging literature on hypothesis testing with data-dependent significance levels relies on a particular extension of the Type-I error. Existing arguments for this extension are heuristic. We show it is uniquely characterized by three axioms: law-invariance, agreement with classical testing on constant levels, and the preservation of (in)validity under independent selection of the level. We find that three analogous axioms characterize the e-value as a multi-decision generalization of a test in a decision-theoretic framework. We recover the p-value by dropping the invalidity half of the independent selection axiom, showing that e-values correspond to those p-values for which a data-independent choice between two invalid p-values cannot produce a valid p-value. Our main technical contribution is to show how e-values emerge in every decision problem with a notion of validity that satisfies law invariance, the independent selection axiom, and an axiom stating that a procedure that selects an invalid procedure with arbitrarily high probability must itself be invalid. In an application to post-hoc decision-making, we justify expectation-based error rates in multiple testing and recover the 'e-closure principle' as a special case.

math.ST↗

arXiv2026

Optimal Community Recovery by Spectrally Initialized Variational EM in General Stochastic Block Models

We prove a Chernoff-exponent guarantee for the output of spectrally initialized batch variational EM after a prescribed iteration budget, without assuming global maximization of its variational objective. The iteration repeatedly estimates the entire block probability matrix and community proportions from the same sparse graph. We consider a fixed number of communities with proportions bounded away from zero and fixed, positive, distinct connectivity profiles; neither assortativity nor full rank is required. The algorithm uses simultaneous softmax updates without sample splitting or posterior thresholding. Its analysis must control the feedback between estimated parameters, soft labels and reused edges at an exponentially small risk scale. We establish a uniform one-step bound over data-dependent soft assignments whose random remainder has exponentially small expectation. Combined with an exponentially reliable regularized spectral initializer, this yields an unconditional expected misclassification rate bounded by $\exp\{-(1-o(1))J_n\}$ throughout the sparse, diverging-degree regime, where $J_n$ is the minimum nodewise Chernoff information. Matching lower bounds establish first-order logarithmic minimax optimality on local parameter spaces allowing unknown connectivity and varying community counts. The algorithm also attains the sharp first-order exact-recovery threshold. Numerical experiments illustrate refinement gains and sensitivity to initialization and imbalance.

math.ST↗

arXiv2026

Optimal Priors for Betting Tests with Bounded Payoffs: An Exact Efficiency Characterization

Testing by betting is a powerful framework that recasts hypothesis testing as a betting game. A popular approach uses an $F$-weighted portfolio with a predefined prior $F$. For suitable priors, this approach has recently been shown to achieve the optimal expected rejection time as the error probability goes to zero at a fixed alternative. Yet, the prior $F$ changes how the portfolio test behaves near the null. This motivates the question: Which prior should we use in testing-by-betting algorithms? We study bounded scalar payoffs and introduce an efficiency measure that allows the error probability and alternative to vary jointly. Under mild assumptions, we prove that efficiency equals a logarithmic decay index of the prior near zero. This gives a necessary and sufficient condition for optimality: Beta priors have infinite efficiency, whereas suitable Robbins-type priors attain efficiency 1. As an application, we consider testing a specified mean of a bounded random variable and describe an implementation of the portfolio algorithm with almost-linear computational complexity.

math.ST↗