arXiv Science⌕ Search

arXiv subjects

Xinru Jiang

Publications and source records attributed to Xinru Jiang.

9 recordsLinked to original sources

Exact Ehrhart Series of Birkhoff Polytopes via Constant Terms and Finite-Field Evaluation

The Ehrhart series of the $n$th Birkhoff polytope is $\sum_{r\geq0}H_n(r)z^r$, where $H_n(r)$ counts nonnegative integer $n\times n$ matrices whose row and column sums all equal $r$. We present an exact method for computing this series using constant terms and finite fields. A root filter expresses $H_n(r)$ as a weighted sum of the values $h_r(M)^n$, where $h_r$ is the complete homogeneous symmetric polynomial and $M$ ranges over multisets of $m$th roots of unity with $m=r+1$. Constant-term cancellation reduces the evaluation of $h_r(M)$ to a sum over repeated elements $a$ of $M$. For a particular $a$ of multiplicity $μ_a$, the computation uses a generalized Todd coefficient of degree $μ_a-2$. Sums of $h_r(M)^n$ over selected multiplicity classes are handled using symmetric function techniques. Together with the remaining individual evaluations, this gives $O_n(m^{n-5}+m^4)$ field operations for each admissible prime and fixed $n\geq5$. An explicit bound and the Chinese remainder theorem recover the integer counts, and Ehrhart symmetry determines the full series. The same method applies to the World Cup problem, which counts the same matrices with diagonal entries required to be $0$. We prove correctness and compute complete series for both families through order $13$. The Birkhoff series for orders $10$--$13$ and the World Cup series for orders $9$--$13$ are tabulated in the appendices.

math.CO↗

LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perception

Hour-scale audio-visual question answering is constrained by a context dilemma: dense whole-recording encoding rapidly exhausts context limits, whereas uniform temporal compression severely dilutes fine-grained acoustic and visual evidence. We introduce LEAP, a framework where the model retrieves its own evidence without placing the whole recording in one context. LEAP divides a recording into fixed-duration blocks, applying a lightweight localization pass to each block to score short candidate windows. The highest-ranked windows are pooled and re-encoded in a single bounded answer pass. Consequently, the answer input and peak context remain independent of the recording duration. By decoupling evidence localization from reasoning, our framework can localize candidate temporal windows over pre-computed transcripts without decoding media frames, while preserving fine-grained visual and non-speech evidence by routing the final answering pass over raw audio-visual streams. LEAP trains both stages: a localization LoRA improves the selected windows, and an answer LoRA improves the answers read from the same windows. The block grid natively supports causal queries, enabling LEAP to support streaming inference without streaming-specific training. Across several AVQA benchmarks, LEAP improves over the Qwen3-Omni-30B-A3B baseline by 4.5-16.8%, and transfers to a second omni-modal backbone, MiniCPM-o 4.5, surpassing its published results by 3.1-13.0%.

cs.CL↗

Posterior Flow Matching

Flow matching learns how to transport noise toward data, but its mean prediction does not directly report the endpoint uncertainty remaining at an intermediate state. This paper introduces Posterior Flow Matching (PFM), a general generative modeling framework that learns conditional velocity means and componentwise variances with a Gaussian posterior model. The same model evaluation supplies both a transport prediction and endpoint uncertainty, making posterior diagnostics available throughout generation. These learned moments support a mean-driven ordinary differential equation (ODE) and a posterior-driven stochastic differential equation (SDE), whose local noise scales adapt to the predicted uncertainty. Across image, point-cloud, molecular, and action generation, PFM improves generation quality and provides endpoint-posterior readouts throughout generation.

cs.LG↗

Dynamic Hub-and-Spoke Memory for Streaming Video Understanding

Streaming video understanding requires answering questions at arbitrary times over a continuously growing visual stream. The central challenge is to compactly remember long-range history while effectively retrieving question-relevant evidence. We propose Dynamic Hub-and-Spoke Memory (D-HSM), a training-free framework that represents distant history as structured textual memory while preserving the recent frames as visual tokens for fine-grained perception. Specifically, D-HSM turns selected historical video chunks into typed textual observations and stores them in an entity-centered hub-and-spoke memory, with entities as hubs and related evidence as spokes. When answering a question, D-HSM dynamically retrieves a compact question-aware memory subset, expands it through hub-and-spoke links, and combines it with the recent visual window for frozen-VLM answer prediction. Extensive experiments on both streaming and long video benchmarks show that D-HSM consistently and substantially improves VLM backbones and outperforms other state-of-the-art online and offline video understanding baselines.

cs.CV↗

Transfer Matrices and Ehrhart Theory for Path and Cyclic Block Polytopes

We study block polytopes whose variables are divided into equal-size blocks and whose local inequalities bound the total contribution of adjacent blocks. For blocks arranged along a path, we develop a transfer-matrix enumeration in the length direction. We also carry out an Ehrhart-theoretic analysis in the dilation direction. The original transfer matrix admits a compression to a weighted height matrix, and the numerator and denominator of the length generating function are described by explicit recurrences and determinant formulas. We also study the cyclic analogue, where the length generating function is governed by the logarithmic derivative of the same determinant. On the Ehrhart side, the path polytopes with at least two blocks and the even cyclic polytopes are stable-set polytopes of perfect graphs; consequently they are Gorenstein of codegree $2a + 1$ (independent of the number of blocks $m \ge 2$), satisfy an explicit Ehrhart--Macdonald reciprocity, and have palindromic unimodal $h^*$-polynomials of degree $a(m-2)$. Odd cyclic polytopes have denominator exactly two, and their lattice-point enumerators are Ehrhart quasipolynomials of period dividing two. Further combinatorial interpretations and open problems are discussed.

math.CO↗

Alternating adjacent-sum polytopes: transfer matrices and Ehrhart series

We study a period-two family of adjacent-sum lattice polytopes whose consecutive-coordinate bounds alternate between $s$ and $s+1$. This provides a simple non-uniform deformation of the classical uniform model while retaining an explicit transfer-matrix structure. The lattice-point counts exhibit a parity split: the odd- and even-dimensional sequences have distinct rational generating functions with a common denominator. The odd-dimensional series satisfies a Möbius recurrence and admits an arctangent closed form, whereas the even-dimensional series obeys a coupled recurrence. Their common dominant pole determines the exponential growth in both parity classes. For the cyclic model obtained by adding a constraint between the first and last coordinates, the count becomes a matrix trace. The two cyclic parity classes again have rational generating functions with the same denominator; the even-dimensional numerator has a Jacobi-derivative form, while the odd-dimensional one is given by an explicit anti-diagonal cofactor expression. We also derive dimension-generating functions for fixed dilations, linear recurrences for lattice-point counts, rational volume-generating functions, and a bivariate identity for the coefficients of the $h^*$-polynomials. When $s=1$, every even-dimensional polytope decomposes into a Cartesian product of unimodular triangles, yielding explicit formulas and the Gorenstein property. For every $s\geq 2$, the Gorenstein property fails in some even dimension.

math.CO↗

HIERAMP: Coarse-to-Fine Autoregressive Amplification for Generative Dataset Distillation

Dataset distillation often prioritizes global semantic proximity when creating small surrogate datasets for original large-scale ones. However, object semantics are inherently hierarchical. For example, the position and appearance of a bird's eyes are constrained by the outline of its head. Global proximity alone fails to capture how object-relevant structures at different levels support recognition. In this work, we investigate the contributions of hierarchical semantics to effective distilled data. We leverage the vision autoregressive (VAR) model whose coarse-to-fine generation mirrors this hierarchy and propose HIERAMP to amplify semantics at different levels. At each VAR scale, we inject class tokens that dynamically identify salient regions and use their induced maps to guide amplification at that scale. This adds only marginal inference cost while steering synthesis toward discriminative parts and structures. Empirically, we find that semantic amplification leads to more diverse token choices in constructing coarse-scale object layouts. Conversely, at fine scales, the amplification concentrates token usage, increasing focus on object-related details. Across popular dataset distillation benchmarks, HIERAMP consistently improves validation performance without explicitly optimizing global proximity, demonstrating the importance of semantic amplification for effective dataset distillation.

cs.CV↗

Taming Diffusion for Dataset Distillation with High Representativeness

Recent deep learning models demand larger datasets, driving the need for dataset distillation to create compact, cost-efficient datasets while maintaining performance. Due to the powerful image generation capability of diffusion, it has been introduced to this field for generating distilled images. In this paper, we systematically investigate issues present in current diffusion-based dataset distillation methods, including inaccurate distribution matching, distribution deviation with random noise, and separate sampling. Building on this, we propose D^3HR, a novel diffusion-based framework to generate distilled datasets with high representativeness. Specifically, we adopt DDIM inversion to map the latents of the full dataset from a low-normality latent domain to a high-normality Gaussian domain, preserving information and ensuring structural consistency to generate representative latents for the distilled dataset. Furthermore, we propose an efficient sampling scheme to better align the representative latents with the high-normality Gaussian distribution. Our comprehensive experiments demonstrate that D^3HR can achieve higher accuracy across different model architectures compared with state-of-the-art baselines in dataset distillation. Source code: https://github.com/lin-zhao-resoLve/D3HR.

cs.CV↗

THInImg: Cross-modal Steganography for Presenting Talking Heads in Images

Cross-modal Steganography is the practice of concealing secret signals in publicly available cover signals (distinct from the modality of the secret signals) unobtrusively. While previous approaches primarily concentrated on concealing a relatively small amount of information, we propose THInImg, which manages to hide lengthy audio data (and subsequently decode talking head video) inside an identity image by leveraging the properties of human face, which can be effectively utilized for covert communication, transmission and copyright protection. THInImg consists of two parts: the encoder and decoder. Inside the encoder-decoder pipeline, we introduce a novel architecture that substantially increase the capacity of hiding audio in images. Moreover, our framework can be extended to iteratively hide multiple audio clips into an identity image, offering multiple levels of control over permissions. We conduct extensive experiments to prove the effectiveness of our method, demonstrating that THInImg can present up to 80 seconds of high quality talking-head video (including audio) in an identity image with 160x160 resolution.

cs.CV↗