arXiv subjects

Peter Li

Publications and source records attributed to Peter Li.

15 recordsLinked to original sources

arXiv2026

InferScale: GPU-Native KV Injection for Personalized LLM Serving

Large language models are increasingly deployed with persistent personalized context, such as accumulated memory profiles or long conversation histories, that is shared across a user's many requests. Production memory systems (e.g., Mem0, MemGPT, and Zep) retrieve a relevant subset of this memory and inject it into the prompt, forcing the serving engine to repeatedly prefill the same content. As the retrieval budget grows, time-to-first-token (TTFT) increases even though the underlying memory is reused across requests. We present InferScale, a GPU-native LLM memory system that replaces repeated prompt prefilling with reusable KV state. InferScale precomputes each memory fact's KV representation, stores it alongside a semantic embedding on the GPU, retrieves relevant facts at serving time, and injects their KV directly into vLLM's paged cache. To support dynamically assembled memories under rotary position embeddings, we introduce Chunked RoPE, which stores keys before rotation and applies their serving-time positions during injection. However, encoding memory facts independently omits the cross-fact context available during joint prefilling. We mitigate this with Context-Window Encoding, which encodes each memory fact together with a small window of preceding conversation context while caching only the target fact's KV. InferScale is implemented through vLLM's KV-connector interface, requiring neither engine modifications nor model fine-tuning. Across three open-weight models on LoCoMo, InferScale keeps TTFT nearly constant as the retrieval budget increases: at k=50 it reduces TTFT by 72-79% (3.6-4.8x), achieves 60.3% accuracy versus 63.3% for Mem0 without serving-time recomputation, and delivers 3.7-4.5x the throughput under concurrent load. Reusable KV state thus decouples memory-conditioned serving latency from retrieved-context size while preserving application quality.

cs.DC↗

arXiv2019

Deep Learning-Based Least Square Forward-Backward Stochastic Differential Equation Solver for High-Dimensional Derivative Pricing

We propose a new forward-backward stochastic differential equation solver for high-dimensional derivatives pricing problems by combining deep learning solver with least square regression technique widely used in the least square Monte Carlo method for the valuation of American options. Our numerical experiments demonstrate the efficiency and accuracy of our least square backward deep neural network solver and its capability to provide accurate prices for complex early exercise derivatives such as callable yield notes. Our method can serve as a generic numerical solver for pricing derivatives across various asset groups, in particular, as an efficient means for pricing high-dimensional derivatives with early exercises features.

q-fin.CP↗

arXiv2018

Random walks with local memory

We prove a quenched invariance principle for a class of random walks in random environment on $\mathbb{Z}^d$, where the walker alters its own environment. The environment consists of an outgoing edge from each vertex. The walker updates the edge $e$ at its current location to a new random edge $e'$ (whose law depends on $e$) and then steps to the other endpoint of $e'$. We show that a native environment for these walks (i.e., an environment that is stationary in time from the perspective of the walker) consists of the wired uniform spanning forest oriented toward the walker, plus an independent outgoing edge from the walker.

math.PR↗

arXiv2018

CREPE: A Convolutional Representation for Pitch Estimation

The task of estimating the fundamental frequency of a monophonic sound recording, also known as pitch tracking, is fundamental to audio processing with multiple applications in speech processing and music information retrieval. To date, the best performing techniques, such as the pYIN algorithm, are based on a combination of DSP pipelines and heuristics. While such techniques perform very well on average, there remain many cases in which they fail to correctly estimate the pitch. In this paper, we propose a data-driven pitch tracking algorithm, CREPE, which is based on a deep convolutional neural network that operates directly on the time-domain waveform. We show that the proposed model produces state-of-the-art results, performing equally or better than pYIN. Furthermore, we evaluate the model's generalizability in terms of noise robustness. A pre-trained version of CREPE is made freely available as an open-source Python module for easy application.

eess.AS↗

arXiv2017

Improvements to the APBS biomolecular solvation software suite

The Adaptive Poisson-Boltzmann Solver (APBS) software was developed to solve the equations of continuum electrostatics for large biomolecular assemblages that has provided impact in the study of a broad range of chemical, biological, and biomedical applications. APBS addresses three key technology challenges for understanding solvation and electrostatics in biomedical applications: accurate and efficient models for biomolecular solvation and electrostatics, robust and scalable software for applying those theories to biomolecular systems, and mechanisms for sharing and analyzing biomolecular electrostatics data in the scientific community. To address new research applications and advancing computational capabilities, we have continually updated APBS and its suite of accompanying software since its release in 2001. In this manuscript, we discuss the models and capabilities that have recently been implemented within the APBS software package including: a Poisson-Boltzmann analytical and a semi-analytical solver, an optimized boundary element solver, a geometry-based geometric flow solvation model, a graph theory based algorithm for determining p$K_a$ values, and an improved web-based visualization tool for viewing electrostatics.

q-bio.BM↗

arXiv2017

Superhuman Accuracy on the SNEMI3D Connectomics Challenge

For the past decade, convolutional networks have been used for 3D reconstruction of neurons from electron microscopic (EM) brain images. Recent years have seen great improvements in accuracy, as evidenced by submissions to the SNEMI3D benchmark challenge. Here we report the first submission to surpass the estimate of human accuracy provided by the SNEMI3D leaderboard. A variant of 3D U-Net is trained on a primary task of predicting affinities between nearest neighbor voxels, and an auxiliary task of predicting long-range affinities. The training data is augmented by simulated image defects. The nearest neighbor affinities are used to create an oversegmentation, and then supervoxels are greedily agglomerated based on mean affinity. The resulting SNEMI3D score exceeds the estimate of human accuracy by a large margin. While one should be cautious about extrapolating from the SNEMI3D benchmark to real-world accuracy of large-scale neural circuit reconstruction, our result inspires optimism that the goal of full automation may be realizable in the future.

cs.CV↗

arXiv2016

Flood-Filling Networks

State-of-the-art image segmentation algorithms generally consist of at least two successive and distinct computations: a boundary detection process that uses local image information to classify image locations as boundaries between objects, followed by a pixel grouping step such as watershed or connected components that clusters pixels into segments. Prior work has varied the complexity and approach employed in these two steps, including the incorporation of multi-layer neural networks to perform boundary prediction, and the use of global optimizations during pixel clustering. We propose a unified and end-to-end trainable machine learning approach, flood-filling networks, in which a recurrent 3d convolutional network directly produces individual segments from a raw image. The proposed approach robustly segments images with an unknown and variable number of objects as well as highly variable object sizes. We demonstrate the approach on a challenging 3d image segmentation task, connectomic reconstruction from volume electron microscopy data, on which flood-filling neural networks substantially improve accuracy over other state-of-the-art methods. The proposed approach can replace complex multi-step segmentation pipelines with a single neural network that is learned end-to-end.

cs.CV↗

arXiv2015

Automatic Instrument Recognition in Polyphonic Music Using Convolutional Neural Networks

Traditional methods to tackle many music information retrieval tasks typically follow a two-step architecture: feature engineering followed by a simple learning algorithm. In these "shallow" architectures, feature engineering and learning are typically disjoint and unrelated. Additionally, feature engineering is difficult, and typically depends on extensive domain expertise. In this paper, we present an application of convolutional neural networks for the task of automatic musical instrument identification. In this model, feature extraction and learning algorithms are trained together in an end-to-end fashion. We show that a convolutional neural network trained on raw audio can achieve performance surpassing traditional methods that rely on hand-crafted features.

cs.SD↗

arXiv2015

The Stan Math Library: Reverse-Mode Automatic Differentiation in C++

As computational challenges in optimization and statistical inference grow ever harder, algorithms that utilize derivatives are becoming increasingly more important. The implementation of the derivatives that make these algorithms so powerful, however, is a substantial user burden and the practicality of these algorithms depends critically on tools like automatic differentiation that remove the implementation burden entirely. The Stan Math Library is a C++, reverse-mode automatic differentiation library designed to be usable, extensive and extensible, efficient, scalable, stable, portable, and redistributable in order to facilitate the construction and utilization of such algorithms. Usability is achieved through a simple direct interface and a cleanly abstracted functional interface. The extensive built-in library includes functions for matrix operations, linear algebra, differential equation solving, and most common probability functions. Extensibility derives from a straightforward object-oriented framework for expressions, allowing users to easily create custom functions. Efficiency is achieved through a combination of custom memory management, subexpression caching, traits-based metaprogramming, and expression templates. Partial derivatives for compound functions are evaluated lazily for improved scalability. Stability is achieved by taking care with arithmetic precision in algebraic expressions and providing stable, compound functions where possible. For portability, the library is standards-compliant C++ (03) and has been tested for all major compilers for Windows, Mac OS X, and Linux.

cs.MS↗

arXiv2015

Combinatorial Energy Learning for Image Segmentation

We introduce a new machine learning approach for image segmentation that uses a neural network to model the conditional energy of a segmentation given an image. Our approach, combinatorial energy learning for image segmentation (CELIS) places a particular emphasis on modeling the inherent combinatorial nature of dense image segmentation problems. We propose efficient algorithms for learning deep neural networks to model the energy function, and for local optimization of this energy in the space of supervoxel agglomerations. We extensively evaluate our method on a publicly available 3-D microscopy dataset with 25 billion voxels of ground truth data. On an 11 billion voxel test set, we find that our method improves volumetric reconstruction accuracy by more than 20% as compared to two state-of-the-art baseline methods: graph-based segmentation of the output of a 3-D convolutional neural network trained to predict boundaries, as well as a random forest classifier trained to agglomerate supervoxels that were generated by a 3-D convolutional neural network.

cs.CV↗

arXiv2007

Spectrum of the Laplacian on Quaternionic Kahler Manifolds

Let $M^{4n}$ be a complete quaternionic K\"ahler manifold with scalar curvature bounded below by $-16n(n+2)$. We get a sharp estimate for the first eigenvalue $\lambda_1(M)$ of the Laplacian which is $\lambda_1(M)\le (2n+1)^2$. If the equality holds, then either $M$ has only one end, or $M$ is diffeomorphic to $\mathbb{R}\times N$ with N given by a compact manifold. Moreover, if $M$ is of bounded curvature, $M$ is covered by the quaterionic hyperbolic space $\mathbb{QH}^n$ and $N$ is a compact quotient of the generalized Heisenberg group. When $\lambda_1(M)\ge \frac{8(n+2)}3$, we also prove that $M$ must have only one end with infinite volume.

math.DG↗

arXiv2007

Weighted Poincaré inequality and rigidity of complete manifolds

We prove structure theorems for complete manifolds satisfying both the Ricci curvature lower bound and the weighted Poincaré inequality. In the process, a sharp decay estimate for the minimal positive Green's function is obtained. This estimate only depends on the weight function of the Poincaré inequality, and yields a criterion of parabolicity of connected components at infinity in terms of the weight function.

math.DG↗

arXiv2007

Connectedness at infinity of complete Kähler manifolds and locally symmetric spaces

One of the main purposes of this paper is to prove that on a complete Kähler manifold of dimension $m$, if the holomorphic bisectional curvature is bounded from below by -1 and the minimum spectrum $λ_1(M) \ge m^2$, then it must either be connected at infinity or diffeomorphic to $\Bbb R \times N$, where $N$ is a compact quotient of the Heisenberg group. Similar type results are also proven for irreducible, locally symmetric spaces of noncompact type. Generalizations to complete Kähler manifolds satisfying a weighted Poincaré inequality are also being considered

math.DG↗

arXiv2003

Differential geometry via harmonic functions

In this talk, I will discuss the use of harmonic functions to study the geometry and topology of complete manifolds. In my previous joint work with Luen-fai Tam, we discovered that the number of infinities of a complete manifold can be estimated by the dimension of a certain space of harmonic functions. Applying this to a complete manifold whose Ricci curvature is almost non-negative, we showed that the manifold must have finitely many ends. In my recent joint works with Jiaping Wang, we successfully applied this general method to two other classes of complete manifolds. The first class are manifolds with the lower bound of the spectrum $λ_1(M) >0$ and whose Ricci curvature is bounded by $$ Ric_M \ge -{m-2 \over m-1} λ_1(M). $$ The second class are stable minimal hypersurfaces in a complete manifold with non-negative sectional curvature. In both cases we proved some splitting type theorems and also some finiteness theorems.

math.DG↗

arXiv2000

Counting dimensions of L-harmonic functions

In this article, we will consider second order uniformly elliptic operators of divergence form defined on R^n with measurable coefficients. Mainly, we will give estimates on the dimension of space of solutions that grow at most polynomially of degree d. More precisely, in terms of a rectangular coordinate system {x_1,...,x_n}, a second order uniformly elliptic operator of divergence form, L, acting on a function f in H^1_loc(R^n) is given by Lf = sum_{ij} d/dx_i (a^{ij}(x) df/dx_j) where (a^{ij}(x)) is an n x n symmetric matrix satisfying the ellipticity bounds \lambda I <= (a^{ij}) <= Lambda I for some constants 0 < lambda <= Lambda < \infty. Other than the ellipticity bounds, we only assume that the coefficients (a_{ij}) are merely measurable functions.

math.AP↗