arXiv Science⌕ Search

arXiv subjects

Nurzhan Sapargali

Publications and source records attributed to Nurzhan Sapargali.

3 recordsLinked to original sources

The Truncation Blind Spot: How Decoding Strategies Systematically Exclude Human-Like Token Choices

Why does machine-generated text remain detectable? We investigate a mechanistic explanation at the decoding stage: standard strategies such as top-$k$ and nucleus sampling restrict generation to high-probability tokens, while human writers routinely choose contextually appropriate words from deeper in the model's probability distribution. Truncation makes a measurable share of these choices unreachable; we call this the \emph{truncation blind spot}. Across five open models and three domains, 8--18\% of human-selected tokens fall outside common truncation boundaries. Linguistic analysis further reveals disproportionate exclusion of content-word tokens. In a benchmark comprising 1.8 million machine generations, classifiers using only predictability and lexical diversity achieve mean AUC-ROC near 0.97, with substantial variation across decoding settings and strong transfer across generators. Probability-floor samplers substantially narrow the blind spot, demonstrating that the choice of truncation criterion matters for retaining human-used tokens. Together, these findings characterize a source of human--machine distributional mismatch and motivate decoding methods that preserve contextually appropriate low-probability choices while maintaining generation quality. Code and data are available at https://github.com/EstebanGarces/human_vs_machine.

cs.CL↗

Maximum Likelihood Estimation for Network Models with Latent Geometry under Snowball Sampling

Snowball sampling is a widely used design for collecting network data from large or hard-to-reach populations, yet naive inference that ignores the sampling mechanism produces systematically biased parameter estimates. We derive the exact likelihood of a multi-wave snowball sample for the class of continuous latent space (CLS) models, in which edges form independently conditional on latent vertex-level quantities, and show that conditional edge independence reduces the marginalization over unobserved network configurations to a closed-form expression portable across the entire CLS class. We develop a stochastic Expectation-Maximization algorithm for the Euclidean latent distance model as a concrete implementation, and apply the framework to the large-scale co-inventor network of German semiconductor patent applicants by drawing multiple snowball samples. We find that the naive procedure severely underestimates latent space variance, produces networks with nearly twice the observed edge count, and achieves a spectral goodness-of-fit nine times worse than the corrected model, which directly affects the quantitative interpretation of covariate effects.

stat.ME↗

Exact Likelihood Inference for Snowball-Sampled Erdős-Rényi Networks

Network data obtained through link-tracing designs, such as snowball sampling, are collected through a mechanism that depends on the very structure the analysis seeks to estimate. Ignoring this dependence and treating the observed sample as though it were itself a complete network can lead to substantially biased inference. While the resulting selection problem is intractable in general, we show that it admits an exact solution for $r$-wave snowball samples, with full-neighbourhood recruitment, drawn from an Erdős--Rényi population. We derive the exact likelihood of such a sample and show that it defines a curved exponential family in the edge probability $π$, with a low-dimensional sufficient statistic. Building on this result, we obtain the maximum likelihood estimator of $π$ that correctly accounts for the sampling design and, as a function of the minimal sufficient statistic, makes full use of the information in the sample. Simulation studies show that this correction substantially reduces bias relative to the naive estimator, remaining effectively unbiased even when the sample covers as little as 0.1\% of the network. We further construct valid confidence intervals for $π$ by inverting a test built on the exact sampling distribution, approximated via Monte Carlo simulation. Simulation studies confirm that these confidence intervals attain the nominal coverage level within Monte Carlo error across a range of edge probabilities and numbers of waves.

stat.ME↗