arXiv subjects

Jungang Li

Publications and source records attributed to Jungang Li.

At least 19 recordsLinked to original sources

arXiv2026

HiLo-RD: Cross-Budget Self-Distillation for Masked Diffusion Language Models

We propose HiLo-RD (High-to-Low Budget Representation Distillation) to improve masked diffusion language models (MDLMs) under a limited generation budget. Unlike autoregressive models, MDLMs choose both what to generate and where to commit it. This creates two coupled challenges: predicting useful content before reasoning is complete, and deciding when to fix answer tokens that shape later predictions. We identify budget-induced premature commitment: even when a correct solution fits, the model can fix answer fragments near the window boundary before resolving intermediate steps. These fragments become context for later predictions and redirect subsequent reasoning. Existing post-training methods do not directly transfer the stronger trajectories that the same model follows with a larger window. HiLo-RD addresses this gap by (1) pairing large-window teacher states with cropped small-window views and (2) matching their hidden representations at committed positions. This supervision guides both token prediction and commitment order without an external teacher. Across mathematics benchmarks, HiLo-RD improves low-budget accuracy and shortens responses; these gains extend to code generation without code-domain training. On GSM8K, accuracy rises by 9.4 percentage points as mean readable length falls by about 25%. Attention diagnostics and fixed-budget order interventions support the proposed mechanism. Together, these results show that large-window reasoning can improve small-window decoding.

cs.LG↗

arXiv2026

KnowMT-Bench: Benchmarking Knowledge-Intensive Long-Form Question Answering in Multi-Turn Dialogues

Multi-Turn Long-Form Question Answering (MT-LFQA) is a key application paradigm of Large Language Models (LLMs) in knowledge-intensive domains. However, existing benchmarks are limited to single-turn dialogue, while multi-turn dialogue benchmarks typically assess other orthogonal capabilities rather than knowledge-intensive factuality. To bridge this critical gap, we introduce \textbf{KnowMT-Bench}, a new benchmark designed to systematically evaluate MT-LFQA for LLMs across knowledge-intensive fields, including medicine, finance, and law. To faithfully assess the model's real-world performance, KnowMT-Bench employs a dynamic evaluation setting where models generate their own multi-turn dialogue histories given logically progressive question sequences. Our experiments on a diverse suite of LLMs show a clear degradation in both factual capability and information delivery efficiency in multi-turn dialogue. We further probe the underlying causes and investigate mitigation strategies spanning domain-specific finetuning, active context denoising, and RAG. The results show domain-dependent gains from finetuning, while active context denoising and RAG more consistently mitigate these issues, with RAG notably reversing this performance degradation. These findings underscore the importance of our benchmark for evaluating LLMs' conversational factual capabilities in real-world applications. Code and data are publicly available.\footnote{\href{https://github.com/Sven-LI-sankyuu/KnowMT-Bench}{\texttt{https://github.com/Sven-LI-sankyuu/KnowMT-Bench}}}

cs.CL↗

arXiv2026

Diagnosing Personalization Failures in Mobile GUI Agents

Unlike conventional GUI agents, personalized GUI agents require user preferences to guide sequential execution over changing GUI states. This raises two challenges: determining HOW each preference should alter execution strategy and WHEN it should take effect along the interaction trajectory. Existing benchmarks primarily evaluate overall task success, offering limited insight into these questions. We introduce PrefDiag-Bench with two components: (1) a categorization of preferences into five types, characterizing HOW they affect execution; and (2) a stage-wise diagnostic framework with 1,664 probes, tracing WHEN preferences should take effect and where failures occur. We evaluate eleven GUI agent systems, including end-to-end agents and agentic workflows, under two forms of user context: explicit user profiles and behavioral memory logs. Although existing agents achieve relatively high completion rates on non-personalized tasks, performance is substantially lower on preference-personalized tasks. Even the best-performing model, Seed-2.0-Pro, achieves only 47.17% on Process preferences under explicit user profiles. Agents struggle particularly with Ranking and Process preferences. Further analysis reveals two key capability bottlenecks: selecting relevant evidence from user history and recognizing when preferences should take effect during execution. Controlled interventions that explicitly provide relevant evidence improve end-to-end task success by up to 7.06%. PrefDiag-Bench offers a more systematic evaluation of GUI agents' personalization capabilities beyond overall task success. Code and data are available at https://github.com/Zhixin-L/PrefDiag-Bench.

cs.AI↗

arXiv2026

When Can LLM Reasoning Reliably Reuse Intermediate Results?

Sampling complete solutions gives large language models more chances to solve a problem, but each attempt starts again. For tasks with several subproblems, all required answers must be correct in the same attempt. Retaining intermediate results can avoid repeating correct work, but errors in those results may affect later attempts. We study when this reuse is reliable and how much computation it requires. For local retries that stop when no candidate passes within the retry budget, we give conditions for correct completion and bound the average number of attempts. We also show how checking cost and the chance of passing a check affect total computation. Experiments across eight reasoning models examine composite mathematics and arithmetic. Across four DeepSeek models, average success on the second subproblem is 36.2 percent without first-subproblem context, 57.2 percent with its answer, and 58.3 percent with its reasoning and answer. These scores measure second-subproblem coverage and include continuations made when selection fails. Arithmetic experiments show that similar first-attempt accuracies can lead to very different coverage after repeated attempts. Code is available at https://github.com/SempraETY/Intermediate-State-Reuse.

cs.AI↗

arXiv2026

A dual variational principle for the Moser-Trudinger inequality: existence, uniqueness and stability of extremals

For $p>1$, with $p'=p/(p-1)$, we prove the sharp dual inequality $$ \int_0^1-\log\left(1-\frac{\left|\int_0^xf(y) dy\right|^{p'}}{x}\right) dx\leq\mathsf{K}_p, \qquad \|f\|_{L^p(0,1)}\leq1, $$ where $\mathsf{K}_p$ is the logarithm of the optimal value in Moser's one-dimensional formulation of the Moser-Trudinger inequality. The dual functional follows from the Gibbs variational principle, monotone transport and the Legendre transform. Its supremum is attained, giving a dual proof of the existence theorems of Carleson-Chang (1986) and Hudson-Leckband (2002); the classical concentration threshold is realized by equality cases in Hoelder's inequality. For $p=2$ we prove, with rigorous computer-assisted estimates, that the nonnegative dual maximizer is unique and nondegenerate. Hence the extremal of the Moser-Trudinger inequality on a disk $D$ is unique up to sign, confirming conjectures of Adimurthi-Karthik-Giacomoni (2016) and of Chen-Lu-Xue-Zhu (2026). The positive extremal $u_*$ is nondegenerate, and, writing $\mathcal{M}_D(u)=|D|^{-1}\int_De^{4πu^2} dx$, we obtain $$ \mathcal{M}_D(u_*)-\mathcal{M}_D(u) \geq c \min_{\pm}\|\nabla(u\mp u_*)\|_{L^2(D)}^2 $$ for all $u\in H_0^1(D)$ with $\|\nabla u\|_{L^2(D)}\leq1$. Here $c>0$, and the exponent two is optimal, giving a quantitative stability theorem of Bianchi-Egnell type.

math.AP↗

arXiv2026

Nonconvex Carnot Limit Shapes for Branching Random Walks on the Heisenberg Group

We study a supercritical branching random walk on the discrete Heisenberg group driven by the four standard horizontal generators. Horizontal position has scale $n$, whereas the central coordinate records discrete area and has scale $n^2$. On the Galton-Watson survival event, we prove almost sure Hausdorff convergence, under Carnot scaling, of both the rescaled particle positions and the collections of enhanced ancestral paths. The path limit consists of area lifts of horizontal paths $ω$ satisfying $J_t(ω)\le t\logρ$ for every $t\in[0,1]$, where $ρ$ is the offspring mean. In contrast to the classical Euclidean case, the deterministic limit shape is nonconvex for every $ρ>1$. We identify its horizontal projection and interval vertical fibers, determine the saturated shape for $ρ\ge4$, and characterize the origin fiber below saturation by Wulff duality. A hyperbolic representation gives an elliptic integral formula for the Wulff area. The maximal central coordinate $Γ_ρ$ is nondecreasing and concave in $ρ$, equals $1/4$ for $ρ\ge4$, and satisfies $Γ_ρ=(\logρ)/π-(\logρ)^2/(4π) +O((\logρ)^3)$ as $ρ\downarrow1$. For fixed $1<ρ<4$, we obtain $M_n^Z=Γ_ρn^2+O(n^{3/2}\sqrt{\log n})$ almost surely. Above saturation the first correction is a random linear term; at $ρ=4$, under a finite second moment assumption, the deficit $Γ_4n^2-M_n^Z$ has order $n\log\log n$ in probability.

math.PR↗

arXiv2026

GACC-Bench: Benchmarking Goal-Adaptive Context Compression Ability across Large Language Models

Context compression in long-running applications of large language models (LLMs) must preserve goal-relevant information, often before specific downstream questions are known. We introduce GACC-Bench, a benchmark for Goal-Adaptive Context Compression that evaluates how reliably LLMs adapt information retention to specified high-level goals. For each source context, we derive one or more high-level goals by grouping source-grounded questions according to shared downstream objectives. The benchmark contains 500 goals and 2,571 questions over 281 document and agent-trace contexts from seven collections spanning diverse domains, with all instances reviewed by human experts. The compressor receives a source context, a goal, and a context-length budget, with the associated evaluation questions withheld. A fixed reader answers these questions individually using the same compressed context. Our evaluation of ten LLM compressors reveals substantial gaps to full-context performance even for the best-performing model, particularly in supporting correct answers to every question associated with a goal. Compared with goal-agnostic compression, target-goal conditioning consistently improves accuracy, whereas mismatched-goal conditioning reduces it. GACC-Bench is available at https://github.com/weiting24/GACC-Bench.

cs.IR↗

arXiv2026

UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generation

Dense visual text requires image generators to reproduce long strings across multiple regions with correct placement and legibility. As short-string rendering improves, evaluation must test sustained performance across more demanding scenes. We introduce UltraText Bench, a bilingual benchmark for prompt-only generation of dense visual text. It contains 432 prompts spanning 24 real-world scene categories and three difficulty levels, split equally between English and Chinese. Each human-reviewed prompt supplies exact strings for four to twelve text regions, paired with structured references for their content, placement, and visual attributes. We use the Q-Judger vision-language model to assess each image against the complete reference, reporting text fidelity, text clarity, spatial quality, and scene quality. Across 24 model configurations, these dimensions reveal different strengths: Z-Image-Turbo gains 3.81 clarity points over Z-Image-Base while losing 14.76 fidelity points under the reported settings. Performance also varies with workload; Qwen-Image-2512's English composite falls from 86.50 at L1 to 42.86 at L3. Ten participants took part in human evaluation of the automatic scores. Repository: https://github.com/LINs-lab/UltraText_Bench.

cs.CV↗

arXiv2026

VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generation

Recent video generation models can produce highly realistic videos from natural language instructions, with visual quality approaching cinematic standards. Existing evaluation benchmarks, however, predominantly assess visual quality, aesthetic appeal and physical plausibility, while paying limited attention to text, an essential medium for conveying information in everyday scenes. A generated video may appear visually compelling and feature lifelike subjects, yet still render the text within the scene incorrectly. To address this overlooked dimension, we introduce \textbf{VTR-Bench}, a systematic benchmark for evaluating the \textbf{V}isual \textbf{T}ext \textbf{R}endering capabilities of video generation models. VTR-Bench situates text within concrete application scenarios, such as advertisements and scientific videos, with 300 carefully constructed prompts spanning five scenario categories. We develop an automated evaluation pipeline with human alignments that separately assesses text fidelity through carrier-specific transcription and scene and motion requirements through a prompt-specific chain of query. Beyond evaluation, we introduce a \textbf{Keyframe-Guided Agentic Framework} in which a Director agent coordinates image and video generation with visual evaluation, guiding iterative refinement and candidate selection through visual feedback. Experiments on 11 state-of-the-art models reveal widespread difficulties in accurately rendering scene text, with the best-performing model recording an overall word error rate (WER) of 0.250. We further analyze text rendering failures to characterize the challenges faced by current video generation models. These findings highlight visual text rendering as a key challenge for video generation and demonstrate a practical path toward improvement. Code is available at https://github.com/hardenyu21/VTR-Bench.

cs.CV↗

arXiv2026

CM-EVS: Sparse Panoramic RGB-D-Pose Data for Complete Scene Coverage

Modern 3D visual learning relies on observations sampled from metric 3D assets, yet existing scans, meshes, point clouds, simulations, and reconstructions do not directly provide a sparse, comparable, and geometry-consistent panoramic training interface. Dense trajectories duplicate nearby views, source-specific rendering policies yield heterogeneous annotations, and sparse heuristics may miss important regions or introduce depth-inconsistent observations. We study how to convert 3D assets into sparse panoramic RGB-D-pose data that preserves complete scene coverage with low redundancy and auditable provenance. We propose COVER (Coverage-Oriented Viewpoint curation with ERP Range-depth warping), a training-free ERP viewpoint curator that projects geometry observed from selected views into candidate ERP probes, scores incremental coverage, and penalizes depth conflicts. Under bounded proxy error, its greedy coverage proxy preserves the standard coverage-style approximation behavior up to an additive error term. Using COVER, we build CM-EVS (Coverage-curated Metric ERP View Set), a panoramic RGB-D-pose dataset with 36,373 curated ERP frames from 1,275 indoor scenes across Blender indoor, HM3D, and ScanNet++, complemented by outdoor panoramas from TartanGround and OB3D re-encoded into the same schema. Each frame provides full-sphere RGB, metric range depth, calibrated pose; COVER-produced indoor frames include per-step provenance logs. With a median of only 25 frames per indoor scene, CM-EVS covers all 13 unified room types while maintaining compact scene-level coverage. Experiments show that COVER improves the coverage-conflict trade-off, making CM-EVS a sparse, compact, and auditable RGB-D-pose resource for geometry-consistent panoramic 3D learning.

cs.CV↗

arXiv2026

InterTab: Interleaved Visual-Structure Alignment for Multi-Modal Table Reasoning

Table images preserve structural information that are often lost in text serialization, and reasoning over them requires locating relevant rows, columns, and cells step by step. Current multimodal large language models (MLLMs) encode the whole image once before reasoning, so they cannot pick up row-, column-, and cell-level evidence as the question unfolds. Encoder-side table structure and generic interleaved visual chain-of-thought still do not bind each reasoning step to that structure. We propose \textbf{InterTab}, an \textbf{Inter}leaved structure-aware framework for CoT reasoning over \textbf{Tab}le images, interleaves chain-of-thought with tool calls that crop structure-aligned table regions. First, we build InterTab-22K, includes reasoning trajectories in which each step is tied to both a structural location and a bounding box. InterTab is trained in two stages: supervised structure-aware alignment (SSA) on InterTab-22K teaches the model to interleave reasoning with structure-aligned crops, and active localization optimization (ALO) further optimizes answer correctness, localization IoU, and output format, while penalizing missing or excessive tool calls. Experiments on nine table benchmarks show that InterTab improves the average accuracy of its backbone from 68.28% to 73.17% and achieves the best average performance among all compared methods. Code and data will be released soon.

cs.CV↗

arXiv2026

Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation

We present Vidu S2, which comprises Vidu S2-Avatar, a real-time interactive digital-character model, and Vidu S2-Editing, a real-time video editing model. Moreover, we explore the feasibility of real-time spatial video generation for both Vidu S2-Avatar and Vidu S2-Editing. Compared with Vidu S1, Vidu S2-Avatar supports real-time 720p video generation, generation with dynamic references that can be updated at any moment, and stronger instruction following, such as dancing. Vidu S2-Editing supports editing a video stream in real time, including style rendering, clothing replacement, character replacement, and background replacement. Experiments show that Vidu S2 outperforms all baselines. A playable online demo is available at https://vidu.com/vidu-stream.

cs.CV↗

arXiv2026

Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrieval

With the rapid proliferation of multimodal information, Visual Document Retrieval (VDR) has emerged as a critical frontier in bridging the gap between unstructured visually rich data and precise information acquisition. Unlike traditional natural image retrieval, visual documents exhibit unique characteristics defined by dense textual content, intricate layouts, and fine-grained semantic dependencies. This paper surveys the VDR landscape as a retrieval problem in its own right, rather than as the front end of a generation pipeline, and does so specifically through the lens of the Multimodal Large Language Model (MLLM) era. We begin by examining the benchmark landscape, including the recent turn toward reasoning-intensive evaluation, and then dive into the methodological evolution along two orthogonal axes: what a retriever is, spanning multimodal embedding models and reranker models, and how it is deployed, from single-stage retrieval through Retrieval-Augmented Generation (RAG) to Agentic systems. Cutting across both, we analyse the representation--efficiency trade-off that late interaction imposes. We ground these categories in leaderboard evidence on where the empirical frontier actually lies, and close by identifying persistent challenges and outlining promising future directions for multimodal document intelligence.

cs.CL↗

arXiv2026

Classification of positive entire solutions of the CR Yamabe equation on the Heisenberg group

We prove that, for every $n\ge 2$, every positive entire solution of the critical CR Yamabe equation $4Δ_b u = n^2 u^{(Q+2)/(Q-2)}$, $Q=2n+2$, on the Heisenberg group $\mathbb H^n$ is a Jerison-Lee bubble. No integrability, decay, boundedness, or symmetry is assumed. Together with the theorem of Catino, Li, Monticelli, and Roncoroni in $\mathbb H^1$, this classifies the positive entire solutions in every dimension. Both Euclidean routes to such a statement lose their starting configuration here. Hyperplane reflections are not CR automorphisms, and a CR inversion preserves its Koranyi sphere only setwise, so the difference between a solution and its Kelvin transform need not vanish on the sphere one inverts in. Nor is there a substitute a priori bound to fall back on: the only scale-invariant estimate available for every positive solution is a critical Morrey bound, which concentration saturates and which yields neither decay nor a small-mass regularity principle. We proceed instead from two exact consequences of the Green representation, which every positive solution is shown to satisfy. Reciprocity with a bubble $U$ converts the distance from $U$ into a nonnegative convex deficit, so that no information about the sign of a linearized quadratic form is required; differentiating the same reciprocity along the conformal orbit of $U$ gives a nonlinear barycentre identity, which forbids that deficit from concentrating at a single point of the CR sphere. Together these isolate the bubble manifold in a class carrying no energy bound. Quantizing the Jerison-Lee tensor defect against this isolation, and alternating the resulting budget with the Morrey bound, drives the energy-growth exponent into the range where the defect must vanish. Both identities use only conformal covariance and an exact positive Green representation.

math.AP↗

arXiv2026

Unveiling Language Routing Isolation in Multilingual MoE Models for Interpretable Subnetwork Adaptation

Mixture-of-Experts (MoE) models exhibit striking performance disparities across languages, yet the internal mechanisms driving these gaps remain poorly understood. In this work, we conduct a systematic analysis of expert routing patterns in MoE models, revealing a phenomenon we term Language Routing Isolation, in which high- and low-resource languages tend to activate largely disjoint expert sets. Through layer-stratified analysis, we further show that routing patterns exhibit a layer-wise convergence-divergence pattern across model depth. Building on these findings, we propose RISE (Routing Isolation-guided Subnetwork Enhancement), a framework that exploits routing isolation to identify and adapt language-specific expert subnetworks. RISE applies a tripartite selection strategy, using specificity scores to identify language-specific experts in shallow and deep layers and overlap scores to select universal experts in middle layers. By training only the selected subnetwork while freezing all other parameters, RISE substantially improves low-resource language performance while preserving capabilities in other languages. Experiments on 10 languages demonstrate that RISE achieves target-language F1 gains of up to 10.85% with minimal cross-lingual degradation.

cs.CL↗

arXiv2026

Two-channel global compactness and existence for critical GJMS equations on hyperbolic space

Let $P_m$ be the GJMS operator of order $2m$ on real hyperbolic space, $n>2m$. For the critical equation \[ P_m u+a(x)u=|u|^{4m/(n-2m)}u \quad\text{on }\HH^n, \] where $0\leq a\in L^{n/(2m)}(\HH^n)$, we prove a global compactness theorem for arbitrary, possibly sign-changing Palais--Smale sequences. Every such sequence decomposes into a solution of the equation, finitely many Euclidean profiles concentrating at vanishing scales, finitely many solutions of the limiting GJMS equation transported to infinity by divergent hyperbolic isometries, and a remainder converging strongly in the energy space. The quadratic form, the $L^{2n/(n-2m)}$ norm and the energy split along this decomposition. The main new point is the treatment of the half-space profiles arising at the conformal boundary of the Poincaré ball. After conformal lifting, they are precisely finite-energy solutions on $\HH^n$ escaping at a fixed hyperbolic scale; hence they do not form a third type of profile. For sign-changing sequences, Moreau's polar-cone decomposition and positivity of the limiting Green operators give a sharp two-quantum energy bound and a compactness range below the two-bubble level. As an application, we obtain one solution for sufficiently concentrated nonnegative potentials and, under an additional smallness condition, a second solution.

math.AP↗

arXiv2026

Critical Geller Equations on Complex Hyperbolic Space: Sharp Stability, Ground-State Symmetry, and Global Compactness

For integers $n,\ell\geq1$, set $Q_\ell=2(n+\ell)+2$ and $q_\ell=2Q_\ell/(Q_\ell-2)$. On the Siegel domain $\Ucal=\Heis^n\times(0,\infty)$, we study \[ -Δ_{\Heis^n}v -4ρ\bigl(v_{ρρ}+T^2v\bigr)-4\ell v_ρ =|v|^{q_\ell-2}v. \] For its Dirichlet form $E_\ell$, we determine the sharp Sobolev constant and all extremals, prove \[ S_\ell\|v\|_{q_\ell}^2\leq E_\ell(v),\qquad E_\ell(v)-S_\ell\|v\|_{q_\ell}^2 \geqκ_{n,\ell} \operatorname{dist}_{\dot S^1_\ell} \bigl(v,\mathfrak M_\ell^{\R}\bigr)^2, \] where $\mathfrak M_\ell^{\R}$ is the extremal cone. We classify nonnegative finite-energy solutions and establish the linearized kernel, profile decomposition, and attainment of the optimal stability quotient. Cayley conjugation yields ground-state symmetry and nondegeneracy, global Palais--Smale compactness, and perturbative existence for critical equations on $\CHyp^{n+1}$. The mechanism is the radial lift $v^\uparrow(z,w,t)=v(z,t,|w|^2)$, which reverses the interior-to-boundary construction by realizing the Siegel domain as a symmetry-reduced slice of a larger Heisenberg group. The completed-space reduction resolves the degenerate axis, hidden auxiliary concentration, and the mismatch of extremal cones. Together with the Cayley transform, this supplies the missing nonlinear layer---classification, stability, bubbling, and variational compactness---on complex hyperbolic space and provides a blueprint for other rank-one symmetric spaces.

math.AP↗

arXiv2026

Debias in Text, Believe Your Eyes: Text-Anchored Cross-Modal Transfer for Visual Counter-Commonsense Reasoning

The visual reasoning ability of multimodal large language models (MLLMs) is crucial for downstream applications, particularly counter-commonsense reasoning, which requires models to reason beyond common assumptions. Recent studies mainly improve visual counter-commonsense reasoning by enhancing visual inputs, following the assumption that failures originate from insufficient visual grounding. However, our empirical analysis reveals that the bottleneck is not visual perception. MLLMs already capture the relevant visual evidence, and the correct answer exists in their decoding space. Instead, the shared language decoder resolves prior--evidence conflicts by favoring dominant language priors, especially for low-frequency factual scenarios. Motivated by this, we first propose a text-anchored data construction pipeline, whose core component, Fact-Frequency Distillation (FFD), estimates the prior strength of commonsense facts and distills verified counter-commonsense scenarios into a high-quality text corpus. Building upon this corpus, we introduce TACT, a text-anchored post-training framework that debiases the shared language decoder without requiring any visual training data. TACT routes evidence-following and prior-driven reasoning trajectories into different optimization stages, enabling the decoder to resolve prior--evidence conflicts. Across counter-commonsense visual benchmarks, TACT substantially improves visual reasoning while preserving general capabilities, demonstrating effective text-to-vision cross-modal transfer.

cs.CV↗