arXiv subjects

Qing Cui

Publications and source records attributed to Qing Cui.

At least 19 recordsLinked to original sources

arXiv2026

CausalMix: Data Mixture as Causal Inference for Language Model Training

In Large Language Model (LLM) training, data mixing plays a pivotal role in determining model performance. Recent methods optimize mixture weights via proxy models, but they rely on the assumption of static data distributions. As a result, when the underlying data pool shifts, these methods require costly retraining from scratch. This limitation restricts their ability to scale seamlessly from small settings to larger data pools and model sizes. In this paper, we propose CausalMix to address this limitation by casting data mixture optimization as a causal inference problem. We formulate the statistical features of the data pool as covariates and the domain mixture as the treatment. After fitting a causal model on 512 runs of Qwen2.5-0.5B to estimate the Conditional Average Treatment Effect (CATE), we extrapolate the optimal mixture for an 800K data pool and apply it to train a 7B model. Furthermore, we successfully generalize the framework to long chain-of-thought data on Qwen3-4B-Base. By leveraging causal modeling to isolate confounding biases, CausalMix infers state-dependent data mixtures offline, with the selected mixture fixed during each training run. Extensive experiments show that the mixture guided by CausalMix achieves competitive performance across downstream tasks compared with other baselines. The CATE Interpreter visualizes the learned mixing strategy. Overall, CausalMix offers a causal and interpretable framework for optimizing LLM data mixtures.

cs.LG↗

arXiv2026

The Plane-Saturation Ratio of Planar Graphs

For a planar graph $G$, a plane subgraph $H$ is plane-saturated with respect to $G$ if adding any edge to the fixed drawing of $H$, possibly together with new vertices, either creates a crossing or results in a graph that is not a subgraph of $G$. The plane-saturation ratio $\psr(G)$ is the minimum of $e(H)/e(G)$ over all plane-saturated subgraphs $H$ of $G$. For nonnegative integers $k_1$ and $k_2$, let $\cG_{k_1,k_2}$ denote the class of planar graphs in which, for each $i\in\{1,2\}$, at most $k_i$ vertices of degree $i$ have any prescribed neighborhood, where $k_i=0$ means that vertices of degree $i$ are forbidden. We prove that every $G\in\cG_{k_1,k_2}$ with at least one edge satisfies $\psr(G)>\frac{1}{9+k_1+6k_2}.$ This settles two conjectures of Clifton and Salia.

math.CO↗

arXiv2026

OACap: Caption-Guided Active Observation for Detailed Video Captioning

Unlike question answering, where a query specifies a perceptual target, open-ended detailed captioning must determine what evidence to acquire and how to integrate it into a coherent global description. We propose Observation-Adaptive Video Captioner (OACap), a caption-centered agent that turns unsupported or missing information into targeted observation requests, uses spatiotemporal tools to acquire evidence, and iteratively verifies and revises the caption. OACap captions consistently improve performance across general video-understanding benchmarks using a fixed text-only reader. To better diagnose the information they preserve, we introduce Factual-Semantic Captioning Bench (FSCap-Bench). Its Core-Support Factuality Score (CSFS) combines claim precision with importance-aware fact coverage and responds as expected to four controlled perturbation types on 93.0-98.3% of valid caption pairs. Its Cross-Modal Semantic Round-Trip Score (CSRS) measures semantic preservation through a video-caption-video-caption round trip by matching atomic facts from source and recovered captions. Together, they connect downstream textual-memory utility with factual and semantic preservation.

cs.CV↗

arXiv2026

The chromatic number of $\{\mathrm{ISK}_4, \textup{diamond}\}$-free graphs

An $\mathrm{ISK}_4$ is a graph that is isomorphic to a subdivision of $K_4$; a \textit{diamond} is $K_4$ minus one edge; and a \textit{bowtie} consists of two triangles sharing exactly one vertex. Lévêque, Maffray, and Trotignon~(2012) conjectured that every $\mathrm{ISK}_4$-free graph is $4$-colorable. Chen, Chen, Cui, Feng, and Liu~(2021) proved this for $\{\textup{diamond},\textup{bowtie}\}$-free graphs. We prove this conjecture for diamond-free graphs. Moreover, the bound is optimal.

math.CO↗

arXiv2026

ZoomCap: Evidence-Routed Visual Zooming for Recoverable Visual Information Transfer

Detailed captions transfer visual information into vision-language model supervision, but quality is easily conflated with length: long single-pass outputs still miss small objects, text, and spatial relations or promote uncertain observations into confident claims. We formulate fine-grained captioning as recoverable visual information transfer, in which a teacher acquires missing evidence under a finite observation budget and converts it into reusable supervision. ZoomCap uses a draft caption to route conditional knowledge retrieval, OCR-sensitive reading, coverage-gap recovery, and adaptive visual zooming, allocating deeper crops only to the most complex eligible region, deriving spatial relations from grounded geometry, and fusing non-duplicate evidence. We also introduce FactCycle, which scores caption-derived atomic claims on two blind anchors--source image (truthfulness) and reconstruction (realizability)--separating fabrication from generator loss claim by claim; human and multi-judge comparisons complement this fact-level view. Against Qwen3.5-397B-A17B captions, ZoomCap achieves an 81.9% human tie-adjusted preference score with a teacher over 10x smaller, and FactCycle counts 52.4 transferred claims per image vs. 31.5 for ScaleCap. The evidence also transfers: in continual pre-training, ZoomCap-450K improves the 11-benchmark average by 1.31-2.38 points over the strongest competing corpus and Ling-Tiny-VL-v3 gains 1.4 points on a production document/OCR monitor suite (1.5 on perception) at 60B tokens; in medical pre-training, 2.64M ZoomCap-captioned images improve five VQA benchmarks by 3.04 points (vs. 1.76 for same-image Gemini-3.1-Pro captions).

cs.CV↗

arXiv2026

A topological sphere theorem for pinched Legendrian submanifolds

Let $M^n$ be a closed simply connected Legendrian submanifold of $\mathbb S^{2n+1}$, where $n\geq5$, and let $\mathbf{B}$ and $\mathbf{H}=\operatorname{tr}\mathbf{B}$ denote its second fundamental form and mean-curvature vector. We prove that $M$ is homeomorphic to $\mathbb S^n$ if \begin{equation*} |\mathbf{B}|^2\leq \frac{(n-1)(n+2)}n+\frac{n^2+3n-2}{2n^2}|\mathbf{H}|^2-\frac{(n-1)(n-2)}{2n^2}|\mathbf{H}|\sqrt{|\mathbf{H}|^2+4n}. \end{equation*} The equality can be attained by the Calabi products, so simple connectivity cannot be omitted. For $n\geq4$, we also prove a sphere theorem under an explicit bound and the weaker assumption $b_1(M;\mathbb R)=0$. The proof combines phase-rotated Lawson--Simons variations with a systolic inequality for finite two-complexes. We also give local constructions showing that the pinching condition allows negative isotropic curvature at a point.

math.DG↗

arXiv2026

OmniTable: A Unified Wide-Table System for Petabyte-Scale LLM Data Curation and Exploration

Data curation is a critical bottleneck in industrial-grade LLM development, where petabyte-scale unstructured corpora are scattered across hundreds of physical tables, feature engineering relies on manual, table-centric pipeline orchestration, and data lineage is largely absent. We present OmniTable as an architecture blueprint for a unified wide-table layer built on Logical Unification, Physical Separation, targeting petabyte-scale LLM data curation and exploration. OmniTable makes four contributions: (1) a unified wide-table abstraction that consolidates multi-source heterogeneous data and thousands of derived features under a single logical schema via logical-physical mapping; (2) declarative feature lifecycle management that automates dependency resolution, execution planning, operator fusion, and lineage tracking, replacing manual pipeline orchestration with a "declare-and-execute" paradigm; (3) an adaptive execution engine with autonomous governance that achieves stable PB-scale feature backfill through heterogeneous compute routing (CPU/GPU), adaptive tuning, UDF-level fault tolerance, and automated storage layout optimization; and (4) hybrid-accelerated data exploration combining a global ID index, transparent OLAP offloading, and background materialized views to deliver second-level point lookups and filtered exports exceeding 20 TB/hour. In production, OmniTable manages over 35 PB of training data across web, code, PDF, and SFT domains, reducing the human-in-the-loop curation cycle from approximately 14 days to approximately 2.5 days (5.6x over the pre-OmniTable production workflow), with consistent feature versioning, auditable lineage, and minimal manual intervention.

cs.DB↗

arXiv2026

Tracking the Moving Frontier: Long-Short Term Advantage Estimator

Group-based RLVR methods estimate advantages by repeatedly sampling multiple trajectories for each prompt, making long-horizon agent training expensive and discarding useful experience accumulated across iterations. We ask whether historical experience can replace these repeated within-iteration comparisons without directly optimizing on stale trajectories. We introduce Long-Short Term Advantage Estimator (LSTAE), a single-stream RL algorithm that uses history for advantage estimation while updating the policy only with the current rollout. LSTAE maintains a persistent tracker for each task anchor. At the trajectory level (long term), a drift-aware historical baseline tracks the anchor's moving success frontier and measures the relative contribution of each new trajectory. At the step level (short term), a recent state-experience buffer exploits recurrent states to estimate localized action advantages. This two-timescale design converts accumulated experience into multi-granular credit signals, requiring only one rollout per anchor. Across agentic and mathematical reasoning benchmarks, LSTAE matches or improves upon strong group-based baselines while substantially reducing rollout cost.

cs.LG↗

arXiv2026

Robust Code RL via Faulty-Code-Driven Test case Synthesis and Dense Reward Shaping

Reinforcement Learning from Verifiable Rewards (RLVR) is pivotal for enhancing LLM code generation, yet its efficacy is often hindered by insufficient test case coverage, leading to reward hacking and policy degradation. To address this, we propose RobustTests, a framework featuring a faulty-code-driven test case synthesis strategy. By leveraging "near-correct" faulty codes, RobustTests captures latent logical discrepancies and employs validator agents with behavioral feature clustering to filter invalid or redundant test cases. Additionally, a stepwise dense reward function based on pass rates is introduced to mitigate false negatives and enhance training robustness. Using this pipeline, we construct an augmented version of the CodeContests+ dataset with superior diagnostic utility. Experimental results show that RL fine-tuning of Qwen3-32B via RobustTests achieves a 3% absolute gain on LiveCodeBench, demonstrating its effectiveness in advancing LLM code generation proficiency. Codes and data are available at https://huggingface.co/datasets/sid6/RobustTests.

cs.AI↗

arXiv2026

On the saturation number of the kite graph

For a fixed graph $H$, a graph $G$ is $H$-saturated if $G$ does not contain a copy of $H$, but adding any edge $e \in E(\overline{G})$ to $G$ creates a copy of $H$. The saturation number $\mathrm{sat}(n,H)$ is the minimum number of edges in an $H$-saturated graph on $n$ vertices. Let $K$ be the kite graph, formed by removing one edge from $ K_4$ and then attaching a pendant edge to a vertex of degree two in the resulting graph.In this paper, we first establish a relationship between connectivity and $K$-saturated graphs, and subsequently determine the saturation number of the kite graph $K$. Moreover, we completely characterize all extremal graphs.Our result provides a partial answer to a problem raised by Hua and Peng [Discrete Math. 349 (2026) 114674].

math.CO↗

arXiv2026

A strict upper volume bound for minimal graphs in the unit ball

Let $u$ be a solution of the minimal surface equation on a domain containing the closed unit ball $\overline{B^n}\subset\mathbb R^n$. A classical calibration argument gives $|Graph_u\cap B^{n+1}| \leq \frac12 |\mathbb S^n|.$ A basic question is whether this half-sphere bound is sharp for minimal graphs. We show that it is not. More precisely, for every $n\geq2$, there exists an explicit constant $δ_n>0$, depending only on $n$, such that $ | Graph_u\cap B^{n+1}|\leq \frac12 |\mathbb S^n|-δ_n$. The proof combines calibration with a canonical spherical filling associated with the subgraph and a quantitative incompatibility between near equality in the calibration estimate and the divergence-free structure of the minimal surface equation. We also give an improved explicit gap and formulate the corresponding sharp extremal problem.

math.DG↗

arXiv2026

A curvature characterization of the Cartan minimal hypersurface in $\mathbb S^5$

Lawson showed that a non-totally geodesic Einstein minimal hypersurface in $\mathbb S^5$ is congruent to the Clifford hypersurface $\mathbb S^2(1/\sqrt2)\times \mathbb S^2(1/\sqrt2).$ It is also known, by work of Cartan and Ôtsuki, that a non-totally geodesic locally conformally flat minimal hypersurface in $\mathbb S^5$ is of Ôtsuki type, including the Clifford hypersurface $\mathbb S^1(1/2)\times \mathbb S^3(\sqrt3/2).$ In this paper we study closed minimal hypersurfaces $M$ in $\mathbb S^5$ satisfying $|W|^2=2|\mathring{\operatorname{Ric}}|^2,$ where $W$ is the Weyl tensor and $\mathring{\operatorname{Ric}}$ is the trace-free Ricci tensor. We call this the Euler-balanced condition. We prove that such a hypersurface is either totally geodesic or congruent to the Cartan minimal hypersurface.

math.DG↗

arXiv2026

Improving Cross-Format Robustness in Language Models with Multi-Format Training

Large language models often remain sensitive to answer format: a question solved correctly in one form may fail in another semantically equivalent form. To study this gap, we define cross-format robustness as the extent to which a model answers the same underlying question consistently across formats. We then compare full-format training with FormatMix, which expands only a subset of training items into multiple equivalent formats using either random or targeted selection. Across GLM4 and Llama-3.1, multi-format supervision consistently improves both task performance and cross-format robustness, whereas Multiple-choice question (MCQ)-only supervision alone brings little benefit and can even reduce robustness. We further find that expanding only about 30% of the training set into multiple formats often recovers most of the gain from full-format training, and this effect appears across the model families and sizes we study. These results suggest that format diversity, rather than additional supervision alone, is the key driver of robustness. That lightweight multi-format augmentation is a practical way to make LLMs less sensitive to answer format without changing the base model.

cs.CL↗

arXiv2026

What Really Improves Mathematical Reasoning: Structured Reasoning Signals Beyond Pure Code

Code has become a standard component of modern foundation language model (LM) training, yet its role beyond programming remains unclear. We revisit the claim that code improves reasoning through controlled pretraining experiments on a 10T-token corpus with fine-grained domain separation. Our findings are threefold. First, when code is restricted to standalone executable programs and Code-NL data are controlled for, code substantially improves programming ability but does not act as a general reasoning enhancer; instead, it competes with knowledge-intensive tasks, especially complex mathematical reasoning. Second, the reasoning gains often attributed to code are better explained by cross-domain structured reasoning traces, such as code-text and math-text mixtures, rather than by executable code alone. Third, increasing the density of structured math-domain samples within a fixed math budget yields substantial gains on difficult mathematical reasoning while largely preserving programming performance, suggesting that cognitive scaffolds offer a targeted way to mitigate cross-domain trade-offs. Finally, routing analyses show that data-composition effects are reflected in expert-activation patterns, providing mechanism-level evidence for competitive and synergistic interactions across domains. Our results clarify which data characteristics transfer across capability dimensions and point to more precise data-centric optimization strategies.

cs.AI↗

arXiv2026

DiffScore: Text Evaluation Beyond Autoregressive Likelihood

Autoregressive language models are widely used for text evaluation, however, their left-to-right factorization introduces positional bias, i.e., early tokens are scored with only leftward context, conflating architectural asymmetry with true text quality. We propose masked reconstruction as an alternative paradigm, where every token is scored using full bidirectional context. We introduce DiffScore, an evaluation framework built on Masked Large Diffusion Language Models. By measuring text recoverability across continuous masking rates, DiffScore eliminates positional bias and naturally establishes an evaluation hierarchy from local fluency to global coherence. We further provide diagnostic tools unavailable to autoregressive frameworks: multi-timestep quality profiles that decompose scores across masking rates, and bidirectional PMI decomposition that disentangles fluency from faithfulness. Experiments across ten benchmarks show that DiffScore consistently outperforms autoregressive baselines in both zero-shot and fine-tuned settings. The code is released at: https://github.com/wenlai-lavine/DiffScore.

cs.CL↗

arXiv2026

On Representation Redundancy in Large-Scale Instruction Tuning Data Selection

Data quality is a crucial factor in large language models training. While prior work has shown that models trained on smaller, high-quality datasets can outperform those trained on much larger but noisy or low-quality corpora, systematic methods for industrial-scale data selection in instruction tuning remain underexplored. In this work, we study instruction-tuning data selection through the lens of semantic representation similarity and identify a key limitation of state-of-the-art LLM encoders: they produce highly redundant semantic embeddings. To mitigate this redundancy, we propose Compressed Representation Data Selection (CRDS), a novel framework with two variants. CRDS-R applies Rademacher random projection followed by concatenation of transformer hidden-layer representations, while CRDS-W employs whitening-based dimensionality reduction to improve representational quality. Experimental results demonstrate that both variants substantially enhance data quality and consistently outperform state-of-the-art representation-based selection methods. Notably, CRDS-W achieves strong performance using only 3.5% of the data, surpassing the full-data baseline by an average of 0.71% across four datasets. Our code is available at https://github.com/tdano1/CRDS.

cs.LG↗

arXiv2026

GRIP: Geometric Refinement and Adaptive Information Potential for Data Efficiency

The performance of Large Language Models (LLMs) is increasingly governed by data efficiency rather than raw scaling volume. However, existing selection methods often decouple global distribution balancing from local instance selection, compromising the hierarchical integrity of the training set. We introduce \textbf{GRIP} (Geometric Refinement and Adaptive Information Potential), a framework that unifies these dimensions by modeling the corpus as an information-dense geometric space. GRIP employs a \textbf{Rapid Adaptation Probe (RAP)} to quantify the information potential of semantic clusters, dynamically re-allocating the sampling budget to regions with the highest representation deficits. Subsequently, we perform Intra-Cluster Selection using a \textbf{length-rectified geometric prior} to counteract embedding density artifacts and preserve long-tail logical sequences. Extensive evaluations on Mixture-of-Experts (MoE) models up to 300B tokens demonstrate that GRIP consistently outperforms state-of-the-art baselines, \textbf{surpassing the performance of models trained on $3\times$ larger uncurated datasets}. Our work establishes a robust geometric foundation for adaptive data curation in large-scale pre-training.

cs.CL↗

arXiv2026

UniGeM: Unifying Data Mixing and Selection via Geometric Exploration and Mining

The scaling of Large Language Models (LLMs) is increasingly limited by data quality. Most methods handle data mixing and sample selection separately, which can break the structure in code corpora. We introduce \textbf{UniGeM}, a framework that unifies mixing and selection by treating data curation as a \textit{manifold approximation} problem without training proxy models or relying on external reference datasets. UniGeM operates hierarchically: \textbf{Macro-Exploration} learns mixing weights with stability-based clustering; \textbf{Micro-Mining} filters high-quality instances by their geometric distribution to ensure logical consistency. Validated by training 8B and 16B MoE models on 100B tokens, UniGeM achieves \textbf{2.0$\times$ data efficiency} over a random baseline and further improves overall performance compared to SOTA methods in reasoning-heavy evaluations and multilingual generalization.

cs.LG↗