arXiv Science⌕ Search

arXiv subjects

Yanyang Li

Publications and source records attributed to Yanyang Li.

At least 19 recordsLinked to original sources
arXiv2026

SinkPruner: Sink-Free Visual Token Pruning for Multimodal Large Language Models

Despite their strong multimodal understanding ability, multimodal large language models (MLLMs) incur substantial computational overhead when processing long visual token sequences. To reduce inference costs, recent studies have explored visual token pruning through vision-centric or text-guided strategies. However, these methods often overlook high-norm outlier tokens, i.e., tokens with abnormally large feature norms, leading to suboptimal pruning decisions. In this work, we show that such high-norm outlier tokens are highly redundant in both feature and spatial dimensions, yet are often mistakenly preserved as informative cues by existing methods. Motivated by this observation, we propose SinkPruner, a training-free visual token pruning framework for efficient MLLM inference. SinkPruner follows a coarse-to-fine design with two key modules: a visual sanitizer that filters high-norm redundancies and alleviates attention sink and attention dispersion, and a text-guided pruner that further retains tokens semantically aligned with the text query. Extensive experiments on twelve image-language and four video-language benchmarks demonstrate the effectiveness, efficiency, and generalizability of our framework. Notably, SinkPruner preserves 96.5% (91.8%) of the original performance of LLaVA-1.5 (Qwen2.5-VL) under an 89% token reduction. Experiments further indicate that our visual sanitizer exhibits promising transferability in enhancing the performance of existing pruning methods. Our code is available at https://github.com/LaVi-Lab/SinkPruner.

cs.CV↗
arXiv2026

Three omitted values and non-Blaschke point divisors in half-planes

We construct a real meromorphic function $F$ on $\mathbb C$ such that $F^{-1}(\{0,1,\infty\})\subset\mathbb R$, while $F$ is not of bounded type in either half-plane. More strongly, for every $a\in\widehat{\mathbb C}\setminus\{0,1,\infty\}$, the $a$-point divisor in either half-plane fails the Blaschke condition. Thus the construction provides an independent negative answer to a question going back to Nevanlinna's 1925 work that had remained open for over a century. Postcomposition gives the analogous counterexample for any prescribed triple of distinct values in the Riemann sphere. The core construction and proof were generated during an autonomous run of GPT-5.6 Sol Ultra.

math.CV↗
arXiv2026

The Ashbaugh--Benguria reciprocal-gap conjecture for Dirichlet eigenvalues

We prove the Ashbaugh--Benguria reciprocal-gap conjecture for the Dirichlet Laplacian in every dimension $N\ge2$. Specifically, if $\Omega\subset\mathbb R^N$ is a bounded domain and $$ 0<\lambda_1(\Omega)<\lambda_2(\Omega)\le\lambda_3(\Omega)\le\cdots $$ are its Dirichlet eigenvalues, then $$ \sum_{i=1}^{N} \frac{\lambda_1(\Omega)} {\lambda_{i+1}(\Omega)-\lambda_1(\Omega)} \ge \frac{N}{j_{N/2,1}^2/j_{N/2-1,1}^2-1}, $$ where $j_{\mu,1}$ denotes the first positive zero of the Bessel function $J_\mu$ of the first kind of order $\mu$. We also characterize the equality case: equality holds precisely when $\Omega$ agrees with a Euclidean ball up to a set of Sobolev $H^1$-capacity zero. In particular, among bounded Lipschitz domains, equality holds if and only if $\Omega$ is a Euclidean ball.

math.AP↗
arXiv2026

VideoLatent: Video-Language Learning via Latent Self-Forcing

Recent advancements in chain-of-thought (CoT) reasoning have shown promise in enhancing video understanding and reasoning capabilities of multimodal large language models (MLLMs). However, existing CoT-based MLLMs require labor-intensive CoT annotations and incur substantial training and inference overhead. While visual latent reasoning has emerged as a more efficient alternative, existing methods primarily focus on image tasks and heavily rely on additional supervision signals for visual latent generation (e.g., CoT traces, auxiliary images, or fine-grained annotations), limiting their scalability and transferability to video tasks. To bridge this gap, we introduce VideoLatent, a novel MLLM equipped with a latent injection module tailored for video understanding and reasoning. Specifically, VideoLatent learns to perform visual latent reasoning using a new latent self-forcing training paradigm, which comprises latent alignment and latent diversity objectives, and relies solely on standard video-question-answer triplets. Extensive experiments across 14 benchmarks demonstrate that our model consistently outperforms existing standard and latent MLLMs on general video understanding and complex video reasoning. Compared with Video-R1, our VideoLatent achieves superior computational efficiency, reducing training/inference overhead by $\sim$6$\times$/$\sim$68$\times$. Moreover, experiments demonstrate that our method has strong generalizability to different MLLM backbones and different model scales.

cs.CV↗
arXiv2026

A sharp fixed-volume product inequality for the first $N$ nonzero Steklov eigenvalues

We prove a sharp fixed-volume product inequality for the first $N$ nonzero Steklov eigenvalues of bounded Lipschitz domains in $\mathbb R^N$. More precisely, if $N\ge2$ and $\Omega\subset\mathbb R^N$ is a bounded Lipschitz domain, then $$ \prod_{j=1}^N \sigma_j(\Omega)\le \frac{\omega_N}{|\Omega|}, $$ where $0=\sigma_0(\Omega)<\sigma_1(\Omega)\le\sigma_2(\Omega)\le\cdots$ are the Steklov eigenvalues of $\Omega$, and $\omega_N$ denotes the volume of the unit ball in $\mathbb R^N$. This extends the convex-domain theorem of Henrot, Philippin, and Safoui to arbitrary bounded Lipschitz domains, and in particular settles the remaining higher-dimensional case of a problem posed by Henrot.

math.AP↗
arXiv2026

Primitive sets and von Mangoldt chains: Erd\H{o}s Problem #1196 and beyond

A set of integers is primitive if no number in the set divides another. We introduce a new method for bounding Erd\H{o}s sums of primitive sets, suggested from output of GPT-5.4 Pro, based on Markov chains with von Mangoldt weights. The method leads to a host of applications, yet seems to have been overlooked by the prior literature since Erd\H{o}s's seminal 1935 paper. As applications, we prove two 1966 conjectures of Erd\H{o}s-S\'ark\"ozy-Szemer\'edi, on primitive sets of large numbers (#1196) and on divisibility chains (#1217). The method also provides a short proof of the Erd\H{o}s Primitive Set Conjecture (#164), as well as the related claim that 2 is an ''Erd\H{o}s-strong'' prime. Moreover, the method resolves a revised form of the Banks-Martin conjecture, which has long been viewed as a unifying `master theorem' for the area.

math.NT↗
arXiv2026

Optimal bounds for an Erd\H{o}s problem on matching integers to distinct multiples

Let $f(m)$ be the largest integer such that for every set $A = \{a_1 < \cdots < a_m\}$ of $m$ positive integers and every open interval $I$ of length $2a_m$, there exist at least $f(m)$ disjoint pairs $(a, b)$ with $a \in A$ dividing $b \in I$. Solving a problem of Erd\H{o}s, we determine $f(m)$ exactly, and show $$ f(m)=\min\bigl(m,\lceil 2\sqrt{m}\,\rceil\bigr) $$ for all $m$. The proof was obtained through an AI-assisted workflow: the proof strategy was first proposed by ChatGPT, and the detailed argument was subsequently made fully rigorous and formally verified in Lean by Aristotle. The exposition and final proofs presented here are entirely human-written. [This paper solves Problem #650 on Bloom's website "Erd\H{o}s problems".]

math.CO↗
arXiv2026

GenSpan: Generation-Calibrated Motion Span Priors for Multi-Verb Video Corpus Moment Retrieval

Video Corpus Moment Retrieval (VCMR) aims to retrieve both the correct video and its temporal segment corresponding to a natural-language query, a task that is especially challenging for multi-verb queries where temporal action ordering is critical. Existing approaches often rely solely on text or static images and struggle to capture implicit motion dynamics, leading to retrieval errors and temporal misalignment. We propose GenSpan, a generation-calibrated VCMR framework that constructs short auxiliary videos from LLM-selected subtitle cues and decomposed sub-events, using these as temporal priors rather than direct retrieval targets. A token selector filters candidate-video features aligned with generated motion, and a bidirectional state-space model efficiently predicts video-moment tuples. Experiments on TVR and ActivityNet-Captions demonstrate that GenSpan improves corpus-level retrieval and moment localization, particularly for complex multi-action queries, while reducing computational cost compared to state-of-the-art multimodal baselines.

cs.CV↗
arXiv2026

Membership Inference on LLMs in the Wild

Membership Inference Attacks (MIAs) act as a crucial auditing tool for the opaque training data of Large Language Models (LLMs). However, existing techniques predominantly rely on inaccessible model internals (e.g., logits) or suffer from poor generalization across domains in strict black-box settings where only generated text is available. In this work, we propose SimMIA, a robust MIA framework tailored for this text-only regime by leveraging an advanced sampling strategy and scoring mechanism. Furthermore, we present WikiMIA-25, a new benchmark curated to evaluate MIA performance on modern proprietary LLMs. Experiments demonstrate that SimMIA achieves state-of-the-art results in the black-box setting, rivaling baselines that exploit internal model information.

cs.CL↗
arXiv2025

Efficient-VLN: A Simple yet Strong Baseline for Efficient Vision-Language Navigation

While Multimodal Large Language Models (MLLMs) have demonstrated significant promise in Vision-Language Navigation (VLN), existing agents remain heavily constrained by systemic bottlenecks across inference, training, and data collection. Specifically, they suffer from prohibitive latency due to visual history reprocessing, action leakage during sequence-packed training, and suboptimal exploration in self-correction data collection. To overcome these intertwined challenges, we present Efficient-VLN, a highly efficient and robust baseline that systematically resolves these issues through three simple-yet-effective mechanisms. (1) Inference: We introduce KV-cache reuse with contiguous RoPE, enabling the model to process only the newly observed frame at each step for real-time inference. (2) Training: We propose packed training with an action-isolating mask to accelerate throughput while effectively bridging the training-inference gap by preventing action leakage. (3) Data Collection: We employ an Adaptive DAgger to dynamically balance autonomous exploration and oracle guidance, enhancing error-recovery capability without escalating computational costs. Extensive evaluations show that Efficient-VLN significantly advances the state-of-the-art across the R2R-CE (73.2% SR) and RxR-CE (75.6% SR) benchmarks. Meanwhile, it yields a 28% latency reduction compared to the previous state-of-the-art StreamVLN, establishing a new paradigm for streaming MLLM-based navigation.

cs.CV↗
arXiv2025

NeMo: Needle in a Montage for Video-Language Understanding

Recent advances in video large language models (VideoLLMs) call for new evaluation protocols and benchmarks for video-language understanding. Inspired by the needle in a haystack test widely used by LLMs, we introduce a novel task of Needle in a Montage (NeMo), which is designed to assess the temporal understanding capabilities of advanced VideoLLMs. Specifically, the proposed task focuses on two fundamental abilities critical for temporal understanding, i.e., retrieval-style long-context recall and temporal grounding. To generate video question answering data for our task, we develop a scalable automated data generation pipeline that facilitates high-quality data synthesis. Built upon the proposed pipeline, we present NeMoBench, a video-language benchmark centered on our task. Specifically, our full set of NeMoBench features 31,378 automatically generated question-answer (QA) pairs from 13,486 videos with various durations ranging from seconds to hours. Experiments demonstrate that our pipeline can reliably and automatically generate high-quality evaluation data, enabling NeMoBench to be continuously updated with the latest videos. We evaluate 20 state-of-the-art models on our benchmark, providing extensive results and key insights into their capabilities and limitations. Our project page is available at: https://lavi-lab.github.io/NeMoBench.

cs.CV↗
arXiv2025

Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priors

Previous research has investigated the application of Multimodal Large Language Models (MLLMs) in understanding 3D scenes by interpreting them as videos. These approaches generally depend on comprehensive 3D data inputs, such as point clouds or reconstructed Bird's-Eye View (BEV) maps. In our research, we advance this field by enhancing the capability of MLLMs to understand and reason in 3D spaces directly from video data, without the need for additional 3D input. We propose a novel and efficient method called the Video-3D Geometry Large Language Model (VG LLM). Our approach utilizes a 3D visual geometry encoder to extract 3D prior information from video sequences. This information is then integrated with visual tokens and input into the MLLM. Extensive experiments have shown that our method has achieved substantial improvements in various tasks related to 3D scene understanding and spatial reasoning, all directly learned from video sources. Impressively, our 4B model, which does not rely on explicit 3D data inputs, achieves competitive results compared to existing state-of-the-art methods, and even surpasses the Gemini-1.5-Pro in the VSI-Bench evaluations.

cs.CV↗
arXiv2025

Learning to Reason from Feedback at Test-Time

Solving complex tasks in a single attempt is challenging for large language models (LLMs). Iterative interaction with the environment and feedback is often required to achieve success, making effective feedback utilization a critical topic. Existing approaches either struggle with length generalization or rely on naive retries without leveraging prior information. In this paper, we introduce FTTT, a novel paradigm that formulates feedback utilization as an optimization problem at test time. Additionally, we propose a learnable test-time optimizer, OpTune, to effectively exploit feedback. Experiments on two LLMs across four reasoning datasets demonstrate that FTTT and OpTune achieve superior scalability and performance.

cs.LG↗
arXiv2024

C$^2$LEVA: Toward Comprehensive and Contamination-Free Language Model Evaluation

Recent advances in large language models (LLMs) have shown significant promise, yet their evaluation raises concerns, particularly regarding data contamination due to the lack of access to proprietary training data. To address this issue, we present C$^2$LEVA, a comprehensive bilingual benchmark featuring systematic contamination prevention. C$^2$LEVA firstly offers a holistic evaluation encompassing 22 tasks, each targeting a specific application or ability of LLMs, and secondly a trustworthy assessment due to our contamination-free tasks, ensured by a systematic contamination prevention strategy that fully automates test data renewal and enforces data protection during benchmark data release. Our large-scale evaluation of 15 open-source and proprietary models demonstrates the effectiveness of C$^2$LEVA.

cs.CL↗
arXiv2024

Making Long-Context Language Models Better Multi-Hop Reasoners

Recent advancements in long-context modeling have enhanced language models (LMs) for complex tasks across multiple NLP applications. Despite this progress, we find that these models struggle with multi-hop reasoning and exhibit decreased performance in the presence of noisy contexts. In this paper, we introduce Reasoning with Attributions, a novel approach that prompts LMs to supply attributions for each assertion during their reasoning. We validate our approach through experiments on three multi-hop datasets, employing both proprietary and open-source models, and demonstrate its efficacy and resilience. Furthermore, we explore methods to augment reasoning capabilities via fine-tuning and offer an attribution-annotated dataset and a specialized training strategy. Our fine-tuned model achieves competitive performance on multi-hop reasoning benchmarks, closely paralleling proprietary LMs such as ChatGPT and Claude-instant.

cs.CL↗