arXiv Science⌕ Search

arXiv · 2610.40252

Conformal Annotation with Randomized Expert Review: Application to Online Cell-Type Labeling

Abstract

Artificial intelligence (AI) models can accelerate cell-type annotation in digital pathology, but safely scaling their use requires determining, with error control, which model-generated labels can be accepted without expert review. This is challenging in evolving workflows because cell morphology and type composition may change across tissue regions and slides, making one-time calibration unreliable. We propose Conformal Annotation with Randomized Expert review under Distribution shift (CARED), a distribution-free framework that leverages randomized expert audit to achieve long-run error control for AI-assisted annotation under distribution shift. For each incoming batch, CARED uniformly selects a subset of cases for expert review and uses the acquired labels to calibrate later decisions. Among unreviewed cases, CARED determines a subset of them to safely skip expert labeling, while suggesting candidate labels for the others for downstream resolution. We prove that this workflow provides long-run control of cumulative error over both the full stream and the cells outside of the audit sample, without stationarity or exchangeability assumptions. We further enhance the framework by introducing class-conditional guarantees to ensure error control within important but rare cell types, together with a utility module to target more automatic resolutions, smaller candidate sets, and greater biological coherence, without compromising validity. Experiments on pancreas, lung, and ovary annotation streams, together with a stream constructed from real expert annotations, show that CARED controls the cumulative errors while a substantial fraction of cells (up to 70%) bypass expert review.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Xuhe Zhang, Zhi Huang, Ying Jin. 2026-10-29. Conformal Annotation with Randomized Expert Review: Application to Online Cell-Type Labeling. https://arxiv.org/abs/2610.40252

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Optimal Forecast Reconciliation with Uncertainty Quantification

We propose to estimate the weight matrix used for forecast reconciliation as parameters in a general linear model in order to quantify its uncertainty. This implies that forecast reconciliation can be formulated as an orthogonal projection from the space of base-forecast errors into a coherent linear subspace. We use variance decomposition together with the Wishart distribution to derive the central estimator for the forecast-error covariance matrix. In addition, we prove that distance-reducing properties apply to the reconciled forecasts at all levels of the hierarchy as well as to the forecast-error covariance. A covariance matrix for the reconciliation weight matrix is derived, which leads to improved estimates of the forecast-error covariance matrix. We show how shrinkage can be introduced in the formulated model by imposing specific priors on the weight matrix and the forecast-error covariance matrix. The method is illustrated in a simulation study that shows consistent improvements in the log-score. Finally, standard errors for the weight matrix and the variance-separation formula are illustrated using a case study of forecasting electricity load in Sweden.

stat.ME↗

postcard: An R Package for Marginal Effect Estimation with or without Prognostic Score Adjustment

Covariate adjustment is a widely used technique in randomized clinical trials (RCTs) for improving the efficiency of treatment effect estimators. By adjusting for predictive baseline covariates, variance can be reduced, enhancing statistical precision and study power. Rosenblum and van der Laan [2010] use the framework of generalized linear models (GLMs) in a plug-in analysis to show efficiency gains using covariate adjustment for marginal effect estimation. Recently the use of prognostic scores as adjustment covariates has gained popularity. Schuler et al. [2022] introduce and validate the method for continuous endpoints using linear models. Building on this work Højbjerre-Frandsen et al. [2025] extends the method proposed by Schuler et al. [2022] to be used in combination with the GLM plug-in procedure [Rosenblum and van der Laan, 2010]. This method achieves semi-parametric efficiency under assumptions of additive treatment effects on the link scale. Additionally, Højbjerre-Frandsen et al. [2025] provide a formula for power approximation which is valid even under model misspecification, enabling realistic sample size estimation. This article introduces an R package, which implements the GLM plug-in method with or without PrOgnoSTic CovARiate aDjustment, postcard. The package has two core features: (1) estimating marginal effects and the variance hereof (with or without prognostic adjustment) and (2) approximating statistical power. Functionalities also include integration of the Discrete Super Learner for constructing prognostic scores and simulation capabilities for exploring the methods in practice. Through examples and simulations, we demonstrate postcard as a practical toolkit for statisticians.

stat.ME↗

Multi-layer dissolution exponential-family models for weighted signed networks

Understanding the structure of signed weighted networks is essential for analysing complex systems in which relationships between nodes vary both in sign and strength. Despite significant advances in statistical network analysis, there is still a lack of models that can account for both the sign and the strength of interactions in networks. We introduce a multi-layer dissolution exponential random graph modelling framework that enables systematic assessment of structural balance effects. We adopt a fully-probabilistic hierarchical approach that partially pools information across layers, with parameters estimated via an adaptive approximate exchange algorithm. A simulation study shows that the algorithm recovers the layer-specific parameters with small bias. We demonstrate the flexibility and explanatory power of the proposed methodology through an application to the gene interaction network associated with dilated cardiomyopathy, in which a multi-layer signed structure is constructed by progressively thresholding interaction confidence scores, with edge signs derived from pairwise co-expression. The analysis shows that positive co-expression edges embedded in positive triangles are more likely to persist at higher confidence levels, while negative edges whose endpoints share positive partners, which form unbalanced triangles, are preferentially dissolved as the confidence threshold increases.

stat.ME↗