arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2610.09951

Overlapped We Stand, Separated We Fall: Software Approaches to Diagnosing Separation Phenomena in Categorical Response Models

Thomas Rusch·Lukas Sablica·Kurt Hornik
View original source ↗Read source document ↗Export metadata ↓

Abstract

In statistical models for categorical responses, including binary, nominal and ordinal responses, a phenomenon called ``separation'' may occur which can render maximum likelihood estimate nonexistent and/or nonunique. Based on Sablica et al. (2026)'s general characterization of separation phenomena via structure vectors, in this article we discuss computational, numerical and practical aspects of separation phenomena in different software packages, including consequences, remedies and ways of diagnosing them. We further introduce the R package divoRce which provides the most comprehensive software suite to diagnose separation in existence. It allows to check for separation, to distinguish between types of separation, characterize the recession cone and identify variables and observations contributing to separation for almost any categorical response model in the literature, including models with baseline-category link, cumulative link, adjacent-category link and sequential link specifications. Diagnostics are based on methods for computational geometry and linear programming and can be done in floating-point or rational arithmetic with different solvers. The functionality is easily extendible by wrappers and S3 methods to accommodate implementations in third-party packages or of new categorical response models. We discuss our implementation in detail and show our software in action in a wide range of applications. We recommend to incorporate our checks for separation and existence of the MLE as a diagnostic routine in every categorical data analysis both in third-party software implementations and as part of a standard model diagnostic workflow.

Explore related subjects

stat.COstat.AP

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Thomas Rusch, Lukas Sablica, Kurt Hornik. 2026-10-20. Overlapped We Stand, Separated We Fall: Software Approaches to Diagnosing Separation Phenomena in Categorical Response Models. https://arxiv.org/abs/2610.09951

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Direct Inversion for Chi-Square Sampling, the Squared Bessel Process, and Applications

In this paper we derive a new direct inversion method to simulate squared Bessel processes. Since the transition probability of these processes can be represented by a non-central chi-square distribution, we construct an efficient and accurate algorithm to simulate non-central chi-square variables. In this method, the dimension of the squared Bessel process, equivalently the degrees of freedom of the chi-square distribution, is treated as a variable. We therefore use a two-dimensional Chebyshev expansion to approximate the inverse function of the central chi-square distribution with one variable being the degrees of freedom. The method is accurate and efficient for any value of degrees of freedom including the computationally challenging case of small values. One advantage of the method is that noncentral chi-square samples can be generated for a whole range of values of degrees of freedom using the same Chebyshev coefficients. This property is especially useful in model calibration. The squared Bessel process is a building block for the well-known Cox-Ingersoll-Ross (CIR) processes, which can be generated from squared Bessel processes through time change and linear transformation. Our direct inversion method thus allows the efficient and accurate simulation of these processes, which are used as models in a wide variety of applications.

stat.CO↗
arXiv2026

Neural Posterior Estimation for Spatial Individual-Level Epidemic Models

Spatial individual-level models (ILMs) provide a flexible framework for modeling infectious disease transmission across populations with known locations. Bayesian inference for these models relies on Markov chain Monte Carlo (MCMC), which requires repeated likelihood evaluation and, when parts of the epidemic trajectory are unobserved, data-augmented sampling over high-dimensional latent variables. This computational cost limits the applicability of MCMC to large populations and to settings requiring inference across multiple outbreaks. We propose using neural posterior estimation (NPE) for amortized Bayesian inference in spatial ILMs. NPE trains a conditional normalizing flow on simulated data to approximate the posterior directly, bypassing likelihood evaluation at inference time. We compare two embedding architectures: a convolutional neural network (CNN) operating on the population-level incidence curve and a graph neural network (GNN) operating on individual-level infection and location data. In a simulation study under full observation, stochastic removals, and partial observation, both variants achieve empirical coverage close to the nominal level, with the GNN embedding yielding lower error and narrower credible intervals for the spatial transmission parameters. Data-augmented MCMC is the most accurate when its chains converge, and GNN-NPE is closer to MCMC than CNN-NPE at a small fraction of the per-epidemic cost of MCMC. We apply the framework to the observed 2001 UK foot-and-mouth disease outbreak on 1,177 farms, where MCMC with the exact likelihood provides a reference posterior. Both NPE variants recover the reproduction number estimated by MCMC. GNN-NPE gives a narrower posterior for the spatial decay of transmission than CNN-NPE but is shifted relative to the MCMC reference.

stat.CO↗
arXiv2026

Beyond exponential tilting: sharp asymptotics and improved importance sampling for rare events

A classical approach for importance sampling (IS) of a rare event is to tilt the measure using its large deviation minimizer, thereby shifting the proposal mean towards the event set. While this tilt is log-efficient, we show that the coefficient of variation of the resulting estimator still grows like $\varepsilon^{-1/4}$ in the small-noise limit $\varepsilon\downarrow0$. Motivated by sharp large deviation asymptotics and the local geometry of the event set at the minimizer, we propose improvements using a control variate or an anisotropic, non-Gaussian proposal. We prove, up to truncations that hold with high probability, and confirm empirically in high-dimensional examples, that the former bounds the coefficient of variation and the latter makes it vanish, so that a bounded number of samples suffices. Our analysis addresses both the coefficient of variation of the different proposals and their necessary and sufficient sample size based on the Kullback--Leibler divergence of the IS target from the proposal; both yield the same rates in $\varepsilon$. We demonstrate the resulting samplers, including a variant that blends the classical and the new proposal across noise levels, for a stochastic Korteweg--de Vries equation with thousands of random inputs.

stat.CO↗