arXiv ScienceSearch

arXiv subjects

Rong Chen

Publications and source records attributed to Rong Chen.

At least 19 recordsLinked to original sources

SMetric: Rethink LLM Scheduling for Serving Agents with Balanced Session-centric Scheduling

LLM scheduling is critical to serving, yet how well existing designs fit agentic serving--where agents, not humans, issue the requests--remains unclear. Agents shift the workload in two ways: they consume many more tokens than humans, so the cluster must provide high throughput (TPS) at low latency; and their requests reuse far more KV\$ than chat. Existing schedulers still trade off load balance against KV\$ reuse: cache-aware schedulers may crowd requests onto the few instances caching the KV\$, leaving the rest idle, while balanced schedulers may lose the opportunity for reuse, which is costly at a high reuse ratio. We thus present two key insights: (1) with a global-tier KV\$ store, pursuing load balance need not compromise KV\$ reuse, though the slower global tier must be used with care; and (2) given the agent's intra-session locality, routing requests by their sessions can balance the load with high KV\$ reuse. A key challenge in realizing session-centric scheduling is that the scheduler must identify a request's session statelessly, which is difficult for model providers serving arbitrary agents. SMetric addresses this with differential scheduling based on two indicators derived from the request itself, the session turn and the local KV\$ hit: it schedules first-turn requests for load balance, and sticks follow-ups to the instance with the highest local hit for high KV\$ reuse. As sessions differ widely in size, SMetric sticks a follow-up only if the instance can serve it within its SLO, and otherwise migrates the session to the least-loaded instance to prevent many long sessions from eventually imbalancing the load. Evaluated on real-world traces, SMetric improves the peak TPS by 9-15% under prefill-decode colocation with a provisioned global tier and the peak prefill TPS by 9% under disaggregation over state-of-the-art schedulers, also with lower latency.

cs.DC

Tree-partitions of graphs with bounded tree-depth

Wood~ recently showed that every graph $G$ of pathwidth $h$ and $Δ(G)\ge1$ admits a $T$-partition of width at most $4(h+1)^2Δ(G)$ for some tree $T$ with $pw(T)\leq2h+1$. In this paper, we establish an analogous result for tree-depth, which is a stronger parameter than pathwidth. We prove that every connected graph with tree-depth $h$ admits a $T$-partition of width at most $\mathrm{max}\{1, (4h-10)Δ(G)+1\}$ for some tree $T$ with $\operatorname{rad}(T)\leq h-1$.

math.CO

A Riemannian Factor Model for Manifold-Valued Time Series

We propose a Riemannian factor model (RFM), a novel framework for analyzing potentially high-dimensional time series data observed on Riemannian manifolds. Such time series are encountered in various applications, including economics, finance, medical imaging, and genomics and microbiome research. The proposed model is geometry-aware and accounts for the inherent nonlinearity in the data. In a high-dimensional asymptotic regime, where the manifold dimension is allowed to diverge with the sample size $n$, we establish convergence rates for the estimated loading space. In particular, under short-memory and strong factor conditions, we obtain a dimension-free $n^{-1/2}$ rate, which matches the convergence rate of the high-dimensional linear factor model. Finite-sample performance of the proposed RFM is demonstrated with simulated time series on the Bures--Wasserstein manifolds and products of spheres, as well as an application to monthly realized covariances of selected U.S. stock returns---modeled as time series in the Bures--Wasserstein manifold, where the RFM provides demonstrably interpretable factors and yields competitive predictive performance.

stat.ME

Efficient and High-Accuracy Ray Tracing in Discretized Ionospheric Models

High-frequency (HF) ray tracing in complex ionospheric media generally involves a fundamental trade-off between path accuracy and computational efficiency, which directly affects practical applications such as over-the-horizon radar, ionospheric monitoring, and HF skywave communication systems. This paper presents RTM-GD, a ray-tracing framework that combines Hamiltonian ray integration with a continuously differentiable Galerkin--Difference (GD) interpolation strategy. Under discretized ionospheric grid conditions, the electron density is reconstructed as a $C^1$-continuous function within each grid cell, yielding an everywhere differentiable electron-density field for stable numerical integration and improved propagation-path accuracy. Numerical simulations and validations using measured HF oblique sounding data are conducted under diverse conditions, including different ionospheric states, low- and high-elevation angles, multiple operating frequencies, and both ordinary (O) and extraordinary (X) wave modes. Results show that RTM-GD consistently achieves sub-kilometer RMSE in both group-path and ground-distance metrics and sub-0.01-degree azimuth deviation relative to Richardson extrapolation, while reducing computational time by 98\%. Compared with Catmull--Rom interpolation, RTM-GD reduces the RMSEs of ray parameters by approximately one order of magnitude with less than 4\% additional computational cost. Measured-data validation based on ionogram synthesis further shows that the mean relative group-path error remains within 7\%, confirming reliable reproduction of practical HF oblique propagation characteristics. Overall, RTM-GD provides an accurate and computationally efficient framework for HF ray tracing in discretized ionospheric environments.

physics.ao-ph

Transformation Formulae and Applications for Double Lambert Series

In this paper, we study a class of double Lambert series and establish several identities and transformation relations for them. These formulae provide useful tools for reducing certain double Lambert series to single Lambert series. As applications, we derive identities related to recent conjectures of Andrews, Dixit, Schultz, and Yee, and of Amdeberhan, Andrews, and Ballantine. We also propose a new proof of a result of Amdeberhan, Andrews, and Ballantine.

math.NT

Two-colored generalized Frobenius partitions and minimal-excludant sums over bipartitions

Let $\cpsi_{2,a}(n)$ denote the number of $(2,a)$-colored Frobenius partitions of weight $n$, where the two rows have prescribed length difference. We study the two cases $a=0$ and $a=1$ and connect them with minimal-excludant statistics on bipartitions. Let $σ\mex_2(n)$ be the sum of the Lin--Liu bipartition minimal excludants over all bipartitions of $n$, and let $E_2(n)$ be the number of bipartitions whose two component minimal excludants are equal. For all $n\geq 0$, we give a combinatorial proof of \[ \cpsi_{2,0}(n)=2σ\mex_2(n) \qquad\text{and}\qquad \cpsi_{2,1}(n)=2σ\mex_2(n)-E_2(n). \] These identities give direct combinatorial interpretations of two-colored Frobenius partition functions in terms of bipartition minimal-excludant sums.

math.CO

Simple is Better: Multiplication May Be All You Need for LLM Request Scheduling

High-quality LLM request scheduling requires meeting two key objectives: ensuring the routed instance has KVCache to accelerate request execution, and ensuring that the workload is balanced across instances. Achieving both objectives is challenging because pursuing one may compromise the other. Current approaches use various combinators (e.g., linear combinations) to compute a scheduling score that combines indicators for the two objectives. These approaches are complex: they either require significant workload-specific hyperparameter tuning or model-hardware-aware simulator development, yet could still lead to suboptimal performance. In this paper, we show that using a simple multiplication of two carefully chosen indicators: one KVCache-aware (new prefill tokens if routed to an instance) and one load-balancing-aware (current batch size of the instance), as the scheduling score (LMETRIC) can achieve both objectives simultaneously without any hyperparameter tuning. The key idea is that the simply multiplied score considers both objectives in a manner similar to a linear combination, but the original hyperparameters cancel out during comparison, so no tuning is needed to find the best parameters. The two indicators are chosen based on our analysis of LLM characteristics. Our extensive experiments show that this simple approach can reduce TTFT by 92% and 39%, and TPOT by 24% and 51%, compared to vLLM-v1 and an in-production scheduler on real-world workloads covering chatbots and coding agents. We also derive the mathematical conditions under which multiplication may fail, and find that such conditions are extremely rare in practice and can be detected (and mitigated) beforehand. LMETRIC has been deployed in production and canary release confirms its effectiveness

cs.DC

A Generalization of the Amdeberhan-Andrews-Ballantine Conjecture

In this paper, we prove a generalization of a conjecture of Amdeberhan, Andrews, and Ballantine on double Lambert series. Motivated by a question raised by Cui, Kumar, and Singh concerning the existence of a generalization of this conjecture, we establish an identity in which the coefficients are given by the generalized divisor function $σ_k(n)$. As a special case, our result includes the original conjecture.

math.NT

On tree decompositions whose trees are subgraphs

Fix $k \in \mathbb{N}$ and let $G$ be a connected graph with treewidth at most $k$. We say that $xy \notin E(G)$ is a {\em $k$-ghost-edge} of $G$ if for every tree decomposition $(T, \cB)$ of $G$ with width at most $k$, both $x$ and $y$ are contained in a bag of $(T, \cB)$. Moreover, if $G$ does not contain any $k$-ghost-edges, then $G$ is {\em $k$-ghost-free}. Hickingbotham proposed a conjecture that every connected $k$-ghost-free graph $G$ has a tree decomposition $(T, \cB)$ with width at most $k$ such that $T$ is a subgraph of $G$. In this paper, we prove that Hickingbotham's conjecture is false for all $k\geq3$.

math.CO

A conjecture of Radu and Sellers on congruences modulo powers of 2 for broken 3-diamond partitions

In 2007, Andrews and Paule introduced the family of functions $Δ_k(n)$, which enumerate the number of broken $k$-diamond partitions for a fixed positive integer $k$. In 2013, Radu and Sellers completely characterized the parity of $Δ_3(8n+r)$ for certain values of $r$ and proposed a conjecture on congruences modulo powers of $2$ for broken $3$-diamond partitions. In this paper, we employ an unconventional $U$-sequence to resolve the revised conjecture put forward by Radu and Sellers.

math.CO

Efficient Vector Search in the Wild: One Model for Multi-K Queries

Learned top-K search is a promising approach for serving vector queries with both high accuracy and performance. However, current models trained for a specific K value fail to generalize to real-world multi-K queries: they suffer from accuracy degradation (for larger Ks) and performance loss (for smaller Ks). Training the model to generalize on different Ks requires orders of magnitude more preprocessing time and is not suitable for serving vector queries in the wild. We present OMEGA, a K-generalizable learned top-K search method that simultaneously achieves high accuracy, high performance, and low preprocessing cost for multi-K vector queries. The key idea is that a base model properly trained on K=1 with our trajectory-based features can be used to accurately predict larger Ks with a dynamic refinement procedure and smaller Ks with minimal performance loss. To make our refinements efficient, we further leverage the statistical properties of top-K searches to reduce excessive model invocations. Extensive evaluations on multiple public and production datasets show that, under the same preprocessing budgets, OMEGA achieves 6-33% lower average latency compared to state-of-the-art learned search methods, while all systems achieve the same recall target. With only 16-30% of the preprocessing time, OMEGA attains 1.01-1.28x of the optimal average latency of these baselines.

cs.DB

Deformation mechanisms and compressive response of NbTaTiZr alloy via machine learning potentials

Refractory multi-principal element alloys (MPEAs) are key research focus for excellent high-temp properties and engineering potential. Deformation mechanisms/mechanical behaviors of quaternary NbTaTiZr MPEA under high strain rates/extreme temps remain unclear. We built a variable-composition ML potential for NbTaTiZr, combined with MD simulations to study effects of crystal orientation, strain rate, temp, composition on compressive mechanics. NbTaTiZr shows structural/mechanical anisotropy in compression [111] max yield strength, [110] min (prone to twinning), [100] via local disorder/dislocation slip (dominant 1/2<111> dislocations). At 10^10 s^-1, yield strength rises sharply, disordered structures increase; high strain rates suppress dislocations to promote disordering. Retains high strength at 2100 K. Higher Nb/Ta boosts yield strength, Ti/Zr reduce it. Reveals MPEA mechanical anisotropy and strain-rate-dependent disordering, guiding high-performance refractory alloy design.

cond-mat.mtrl-sci

PRECTR-V2:Unified Relevance-CTR Framework with Cross-User Preference Mining, Exposure Bias Correction, and LLM-Distilled Encoder Optimization

In search systems, effectively coordinating the two core objectives of search relevance matching and click-through rate (CTR) prediction is crucial for discovering users' interests and enhancing platform revenue. In our prior work PRECTR, we proposed a unified framework to integrate these two subtasks,thereby eliminating their inconsistency and leading to mutual benefit.However, our previous work still faces three main challenges. First, low-active users and new users have limited search behavioral data, making it difficult to achieve effective personalized relevance preference modeling. Second, training data for ranking models predominantly come from high-relevance exposures, creating a distribution mismatch with the broader candidate space in coarse-ranking, leading to generalization bias. Third, due to the latency constraint, the original model employs an Emb+MLP architecture with a frozen BERT encoder, which prevents joint optimization and creates misalignment between representation learning and CTR fine-tuning. To solve these issues, we further reinforce our method and propose PRECTR-V2. Specifically, we mitigate the low-activity users' sparse behavior problem by mining global relevance preferences under the specific query, which facilitates effective personalized relevance modeling for cold-start scenarios. Subsequently, we construct hard negative samples through embedding noise injection and relevance label reconstruction, and optimize their relative ranking against positive samples via pairwise loss, thereby correcting exposure bias. Finally, we pretrain a lightweight transformer-based encoder via knowledge distillation from LLM and SFT on the text relevance classification task. This encoder replaces the frozen BERT module, enabling better adaptation to CTR fine-tuning and advancing beyond the traditional Emb+MLP paradigm.

cs.IR

KVCache Cache in the Wild: Characterizing and Optimizing KVCache Cache at a Large Cloud Provider

Serving large language models (LLMs) is important for cloud providers, and caching intermediate results (KV\$) after processing each request substantially improves serving throughput and latency. However, there is limited understanding of how LLM serving benefits from KV\$ caching, where system design decisions like cache eviction policies are highly workload-dependent. In this paper, we present the first systematic characterization of the KV\$ workload patterns from one of the leading LLM service providers. We draw observations that were not covered by previous studies focusing on synthetic workloads, including: KV\$ reuses are skewed across requests, where reuses between single-turn requests are equally important as multi-turn requests; the reuse time and probability are diverse considering all requests, but for a specific request category, the pattern tends to be predictable; and the overall cache size required for an ideal cache hit ratio is moderate. Based on the characterization, we further propose a workload-aware cache eviction policy that improves the serving performance under real-world traces, especially with limited cache capacity.

cs.DC

Correspondence among congruence families for generalized Frobenius partitions via modular permutations

In 2024, Garvan, Sellers and Smoot discovered a remarkable symmetry in the families of congruences for generalized Frobenius partitions $cψ_{2,0}$ and $cψ_{2,1}$. They also emphasized that the considerations for the general case of $cψ_{k,β}$ are important for future work. In this paper, for each $k$ we construct a vector-valued modular form for the generating functions of $cψ_{k,β}$, and determine an equivalence relation among all $β$. Within each equivalence class, we can identify modular transformations relating the congruences of one $cψ_{k,β}$ to that of another $cψ_{k,β'}$. Furthermore, correspondences between different equivalence classes can also be obtained through linear combinations of modular transformations. As an example, with the aid of these correspondences, we prove a family of congruences of $cϕ_{3}$, the Andrews' $3$-colored Frobenius partition.

math.NT

A counterexample to Hickingbotham's conjecture about $k$-ghost-edges

Fix $k\in \mathbb{N}$ and let $G$ be a connected graph with $tw(G)\leq k$. We say that $xy\in E(G^c)$ is a {\em $k$-ghost-edge} of $G$ if for every tree decomposition $(T,\cB)$ of $G$ with width at most $k$, the set $\{x,y\}$ is contained in a bag of $(T,\cB)$. Although a $k$-ghost-edge of $G$ is not an edge of $G$, but it behaves like real edges with respect to tree decomposition of $G$ with width at most $k$. For any graph $G$ with treewidth $k$ and $xy\in E(G^c)$, when there are at least $k+1$ internally vertex disjoint $(x,y)$-paths, Hickingbotham proved that $xy$ is a $k$-ghost-edge of $G$; while when there are at most $k$ internally vertex disjoint $(x,y)$-paths, he conjectured that it is not a $k$-ghost-edge of $G$. In this paper, we prove that this conjecture is wrong.

math.CO

Towards Fully-fledged GPU Multitasking via Proactive Memory Scheduling

The limited HBM capacity has become the primary bottleneck for hosting an increasing number of larger-scale GPU tasks. While demand paging extends capacity via host DRAM, it incurs up to 78x slowdown due to the massive working sets and poor locality of GPU workloads. We observe, however, that GPU memory access patterns are inherently predictable via kernel launch arguments and their asynchronous execution nature. Leveraging this, we propose MSched, an OS-level scheduler that extends GPU context switching to include proactive working set preparation, thereby coalescing fragmented, eventual, and expensive page faults into a single efficient migration. MSched employs a template-based approach to predict working sets with near-perfect accuracy and proposes a co-design between task scheduler and memory manager to enforce a globally optimal page placement policy. Evaluation demonstrates that MSched outperforms demand paging by up to 11.05x for scientific and deep learning workloads, and 57.88x for LLM under memory oversubscription.

cs.OS

Fast LLM Post-training via Decoupled and Fastest-of-N Speculation

Rollout dominates the training time in large language model (LLM) post-training, where the trained model is used to generate tokens given a batch of prompts. This work, SpecActor, achieves fast rollout with speculative decoding that deploys a fast draft path to accelerate the unparallelizable generation, while the correctness is guaranteed by fast parallel verification of the outputs with the original model. SpecActor addresses two foundational challenges that hinder speculation efficiency: (1) a Decoupled speculation method that overcomes the computation inefficiency issue when executing speculative decoding with relative large per-worker batch size -- a common configuration in training but unfriendly to speculation, and (2) a Fastest-of-N speculation method that selects and combines different draft methods according to the rollout progress to approximate the optimal draft method even when the best one is unknown a priori. Extensive evaluations on production traces show that SpecActor accelerates mean rollout speed by 2.0--2.4x, with up to 2.7x speedup, over common post-training baselines. The results are consistent across both dense and MoE models and across different RL algorithms. Notably, SpecActor is 1.1--2.6x faster compared to vanilla speculative rollout in different traces. The accelerated rollout achieves 1.4--2.3x faster end-to-end training time.

cs.DC