arXiv Science⌕ Search

arXiv subjects

Yifan Wang

Publications and source records attributed to Yifan Wang.

At least 91 records · Page 5Linked to original sources

SCOPE: A Generative Approach for LLM Prompt Compression

A big issue in modern LLM applications is they tend to feed long context to LLM, which results in high inference cost and latency, and may exceed the context limit. Prompt compression addresses this issue by reducing the length of input context with minimum loss of generation quality, i.e, the goal of prompt compression is to shorten the LLM input while maintaining a high generation quality. To overcome these limitations, we propose SCOPE, a training-free generative prompt compression framework based on chunk-level rewriting. Unlike the existing token removal methods, our method centers at a chunking-and-summarization mechanism. Specifically, SCOPE splits a prompt into semantically coherent chunks and rewrites the chunks to be more concise. Then the chunks are reconstructed into a meaningful prompt. Additionally, we design several optimization techniques for SCOPE, effectively preserving critical information and text coherence in compression, as well as providing finer-grained control of the compression ratio. We conduct extensive evaluation on typical LLM applications like question-answering and summarization. Results show that SCOPE consistently outperforms the evaluated selective compression baselines across most settings, with particularly strong gains at high compression ratios.

cs.CL↗

On the Absence of Identifiable Manifolds in Finite-Max Composite Optimization

In nonsmooth optimization, identifiable sets describe the local region eventually reached by sequences converging to a prescribed critical point. When such a set is a $C^2$ manifold on which the objective restricts to a $C^2$ function, it is called an identifiable manifold. Their appeal lies in what they enable: many first-order methods identify these manifolds in finitely many iterations, after which the iterates enter a region in which the problem is effectively smooth. Consequently, many powerful tools and guarantees from smooth optimization transplant naturally to the nonsmooth setting. Owing to these properties, much existing work has focused on characterizing conditions that guarantee their existence. In this work, we study a complementary question: under what conditions is a critical point devoid of any identifiable manifold? We answer this by developing a deterministic branching criterion for a broad class of finite-max composite optimization problems, characterizing when a critical point admits no identifiable manifold. This criterion is surprisingly mild in certain classes of problems: it holds with high probability for overparameterized robust low-rank recovery and almost surely at common interpolators of random minimax regression, suggesting that the absence of identifiable manifolds may be the rule rather than the exception in modern optimization.

math.OC↗

Data-Efficient and Interpretable Classification of Circulating Tumor Cell Phenotypes in Microfluidic Devices via Deep Learning

Accurate classification of circulating tumor cell (CTC) phenotypes can provide valuable information for assessing metastatic potential. Label free microfluidic devices provide a hydrodynamic obstacle course that transforms subtle biophysical characteristics of CTCs, including size and deformability, into distinct kinematic trajectories. However, the highly nonlinear fluid structure interactions governing these trajectories make the inverse problem of inferring cellular phenotype from trajectory data analytically intractable. While deep neural networks (DNNs) have emerged as a powerful approach for addressing this inverse problem, their effectiveness is constrained by the limited availability of trajectory data and the lack of physical interpretability. To address these challenges, we propose an interpretable and data efficient DNN framework for trajectory based CTC classification. To mitigate the scarcity of data, we develop Subsequence (SubSeq), a targeted augmentation strategy that randomly extracts informative local trajectory segments during training to promote learning from localized patterns. We further apply Gradient Weighted Class Activation Mapping to identify the trajectory features and physical regions of the microfluidic device that drive model predictions. Experimental results demonstrate that SubSeq improves classification accuracy over the evaluated baseline and augmentation methods. Furthermore, interpretability analysis suggests that localized trajectory segments contain substantial biophysical information relevant to accurate classification. This provides justification for SubSeq and also highlights the redundancy of full-length trajectories. More broadly, the proposed framework views microfluidic geometries as physical encoders of cellular mechanical properties, providing mechanistic insights that may inform the future design of diagnostic devices.

cs.LG↗

ResPCC: A Loss-Resilient Neural Point Cloud Codec over Lossy Networks

Point cloud compression (PCC) is critical for efficient storage and transmission of 3D data. While recent learning-based PCC methods achieve good rate-distortion (R-D) performance, they generally rely on ideal transmission conditions. In practice, packet loss is a common issue and can severely distort latent features, causing coordinate drift and geometric degradation. To address this challenge, we present ResPCC, the first end-to-end neural point cloud codec designed to offer intrinsic resilience against data loss. Our framework is loss-rate-aware and adapts to diverse packet loss conditions. At the encoder, we introduce a Condition-Adaptive Latent Modulation (CALM) module to adjust latent feature distributions according to the perceived loss rate, as well as a Spatial-Channel Interleaving (SCI) mechanism that transforms channel-wise data extinction into spatially scattered element-wise missing patterns. At the decoder, we develop a Mask-Aware Graph-based Latent Restoration (MGLR) module, followed by a Dictionary-based Refinement (DBR) stage to recover corrupted features and align them with canonical priors. Evaluations on ShapeNet and SemanticKITTI under 5\% to 30\% packet loss rates show that ResPCC consistently delivers superior stability and R-D performance over baselines. Our framework maintains high reconstruction fidelity under lossy conditions, providing a reliable solution for 3D data transmission over practical networks. Code is available at https://github.com/starrynight314/ResPCC.

eess.IV↗

Regularity Analysis and Tensor Neural Network Methods for Quasiperiodic Elliptic Equations

This paper investigates quasiperiodic elliptic equations using a well-established projection method, by which the original problem is reformulated as a degenerate periodic variational problem defined on a higher-dimensional torus. The main analytical difficulty lies in the degeneracy of the projected torus problem: the variational formulation is coercive in the projected Sobolev spaces induced by the projection matrix, but fails to be coercive with respect to the standard Sobolev norm. We establish the well-posedness and regularity estimates within these projected Sobolev spaces. However, such projected Sobolev regularity alone is insufficient for standard spectral approximation: we show that it may result in arbitrarily slow Fourier convergence. To overcome this limitation, under a Diophantine condition for the projection matrix, together with appropriate assumptions on the coefficients and source term, we derive improved Sobolev regularity of the solution in standard Sobolev spaces.This provides a systematic mechanism for justifying the Sobolev regularity required in Fourier spectral convergence analysis, rather than imposing it a priori. Consequently, the improved Sobolev regularity enables quantitative Fourier projection error estimates for quasiperiodic problems. Inspired by these analytical results, we propose an adaptive tensor neural network Galerkin method that is naturally tailored to this degenerate high-dimensional periodic problem. Thanks to its tensor-product structure, high-dimensional variational integrals can be fully decoupled into one-dimensional quadratures, avoiding Monte Carlo sampling and yielding accurate deterministic numerical results. Numerical experiments on several quasiperiodic elliptic problems demonstrate the accuracy and efficiency of the proposed method.

math.NA↗

Scale-to-Dialogue: Low-Burden Elicitation of Daily Premenstrual Symptom Ratings with Small Language Models

Prospective daily symptom tracking is central to premenstrual health assessment, but repeated ordinal forms impose substantial response burden. We formulate conversational administration as an ordinal label-recovery problem: the system actively elicits a small set of symptom clusters and maps each response to the original severity labels. We used 3,320 complete participant-days from the mcPHASES dataset, covering cramps, mood swing, fatigue, sleep issues, stress, and bloating on a six-level scale. Six participants were reserved for development and 36 for a frozen evaluation comprising 360 participant-days and 2,160 item labels. A ModernBERT evidence gate detected whether a symptom was expressed, and Qwen2.5-1.5B-Instruct produced deterministic structured severity scores. Fixed six-item questioning achieved a quadratic weighted kappa of 0.976, whereas three joint symptom-cluster questions achieved 0.913, 97.45% agreement within one severity level, and 80.94% recall for moderate-or-higher symptoms while reducing questions by 50%. Open-first adaptive policies required 3.92-5.98 questions and produced lower agreement than the corresponding fixed policies. Participant-cluster bootstrap analysis estimated a kappa difference of -0.062 (95% CI -0.076 to -0.048) between the three-cluster and six-item strategies. Active cluster-level elicitation provides a direct, local-model route from natural conversation to reusable daily symptom labels.

cs.AI↗

From Interpretation to Compilation: A Compilation-Based Execution Engine for Semantic Operator Systems

Semantic operators extend data processing with natural-language predicates. Existing semantic operator systems commonly execute these operators through interpretation-based execution: for every data item, an LLM interprets the operator predicate and directly produces the corresponding result. Although expressive, this design places expensive model invocations inside the data-processing loop, causing latency and monetary cost to scale with input cardinality. We present SemBaker, a compilation-based execution engine for semantic operator systems. SemBaker acts as an external plugin rather than replacing a backend's native execution. For selected semantic filters, maps, and joins, it invokes an LLM once to generate a deterministic Python function and executes that function locally without per-item LLM calls. A cost-based optimizer routes each operator to native or compiled execution, while compilation overlaps pipeline execution. SemBaker supports Palimpzest, LOTUS, Nirvana, and DocETL through thin adapters. Across three 200-query QA workloads, SemBaker achieves average speedups of 4.8 to 6.3 times and average cost reductions of 5.4 to 10.7 times, with competitive processing quality.

cs.DB↗

Connective Constants on Nested Fractal Graphs

We study self-avoiding walks on the canonical one-sided graphs of Lindstrom nested fractals. We prove that the connective constant $μ$ exists and identify $\logμ$ with the critical inverse temperature of a finite-dimensional boundary-state renormalization. If the boundary-state partition vectors are bounded at criticality, then the fixed-length counts $c_n$ satisfy two-sided polynomial bounds around $μ^n$. We also prove that $h$-flexibility implies $c_{n+h}/c_n\toμ^h$. For regular polygonal $N$-gaskets, we derive exact crossing recursions, determine the smallest flexibility step $h$, and obtain explicit algebraic connective constants for the $6$- and $9$-gaskets. The Vicsek graph has no flexibility step, and its successive ratios do not converge.

math.PR↗

Pursuing Optimal Stepsize in Adaptive Gradient-Based Quadratic Optimization

In this paper, we address the problem of achieving fast convergence in gradient descent for quadratic functions without relying on a priori knowledge of global function parameters. Inspired by adaptive stepsize algorithms for smooth convex functions, we propose a computationally lightweight strategy based on running estimates of minimal and maximal local curvatures. We prove that our proposed algorithm converges to the optimal constant stepsize which achieves the fastest convergence. Simulations show that the convergence rate achieved by our proposed algorithm is comparable or superior to recent adaptive approaches both in the quadratic case under consideration and in a preliminary test on logistic classification.

math.OC↗

Adaptive Stepsizes With Certified Convergence in Distributed Gradient Tracking With Quadratic Costs

In this work, we propose an adaptive stepsize rule with guaranteed convergence for Distributed Gradient Tracking applied to scalar quadratic problems with heterogeneous curvatures. Most distributed gradient-based algorithms require a suitable stepsize selection. Available theoretical bounds are often overly conservative, while practical implementations typically rely on empirically tuned heuristics. Online adaptive strategies have only recently emerged for general distributed convex optimization, but their properties and performance remain only partially understood. To gain analytical insight, we focus on the informative setting of scalar quadratic costs, which allows us to explicitly capture the interplay between network topology and curvature heterogeneity. We derive a convergence bound parameterized only by the essential spectral radius of the consensus matrix and the heterogeneity of the local cost curvatures, both computable online without any prior knowledge of the optimization problem. Optimizing this bound yields a computationally tractable surrogate for the convergence rate and the optimal constant stepsize. The resulting stepsize admits an analytical interpretation, guarantees convergence for arbitrary network topologies and curvature heterogeneity, and is provably tight for complete graphs and homogeneous curvatures. Finally, extensive numerical simulations demonstrate that the proposed distributed adaptive strategy significantly outperforms existing offline and online stepsize selection rules in the considered setting.

math.OC↗

SNAP-tFDP: Massively Scalable Graph Layouts via Sparse Negative Sampling

Force-Directed Placement (FDP) is a widely used approach for network visualization, yet scaling it to massive graphs while preserving clear community structures remains a major computational and visual challenge. Existing approximation methods often rely on auxiliary data structures (e.g., spatial trees), which introduce substantial memory overhead; furthermore, traditional power-function-based forces frequently fail to separate dense clusters effectively. In this paper, we present a negative sampling-based algorithm that achieves O(|E|) time complexity with a low memory footprint, without requiring complex multi-level representations. In a first step, we introduce a linearly normalized degree-weighting scheme, which, combined with short-range bounded $t$-distribution forces, effectively untangles dense structures and enhances visual cluster separation. To optimize for this formulation efficiently, we introduce an edge-centric negative sampling strategy that naturally reconstructs the global degree-weighted objective. Furthermore, we design a lock-free, bundle-based parallelization scheme that leverages the sparsity of stochastic updates to achieve significant speedups while mitigating access conflicts. Comprehensive evaluations on 12 large-scale graphs demonstrate that the proposed method outperforms state-of-the-art algorithms in neighborhood preservation and cluster separation. Compared to existing baselines, our method reduces memory consumption by 72% on average and leverages simple GPU parallelism to generate a high-quality layout for a graph with 4 million nodes and 34 million edges in below 10 seconds.

cs.GR↗

PMMC: Prospective Multimodal Memory Compilation for Long-Term LVLM Agents

Long-term memory is essential for LVLM agents to maintain consistency and integrate information across extended multimodal interactions. Existing agent memory systems, however, often reduce visual experiences into textual summaries or rely on static retrieve-then-reason pipelines, which are inefficient at query time and brittle when questions require image-text binding, temporal updates, or visual details. We propose Prospective Multimodal Memory Compilation, a framework that shifts part of the memory reasoning process from query time to memory consolidation time. Given accumulated multimodal interactions, a Questioner predicts future question candidates, a Planner compiles question-conditioned multimodal memory programs, and a Doubter verifies whether the planned evidence path can support the predicted answer. The verified question-program pairs form a structured question bank for efficient query-time routing and evidence retrieval. Experiments on multimodal long-term memory benchmarks show that our method improves answer quality and visual evidence recall while reducing query-time token and latency costs. Extensive ablations analyze the effects of self-feedback, dynamic planning, raw-image access, and question bank coverage.

cs.AI↗

Beyond Routing Weights: Faithful Response-Level Interpretation of Mixture-of-Experts Reward Models via Contribution Contrast

Reward models are central to learning from human preferences, yet identifying what drives their predictions remains challenging. Recent sparse Mixture-of-Experts (MoE) reward models seek to improve interpretability by routing prompts to specialized experts and characterizing experts through examples with high routing weights. However, routing weights only reveal which prompts an expert $\textit{receives}$, not how it $\textit{judges}$ responses, providing only a partial account of expert behavior. We therefore propose $\textbf{Co}$ntribution-$\textbf{Co}$ntrast ($\textbf{CoCo}$) response-level interpretation, which faithfully characterizes experts' roles using chosen-rejected response pairs with the largest contribution contrasts, jointly capturing routing and preference behavior. Across automatic and human evaluations, CoCo yields more coherent, faithful, and specialized interpretations than router-based, score-based, and sparse autoencoder-based alternatives while maintaining competitive reward modeling accuracy. To the best of our knowledge, this is the first systematic study of interpretation methods for MoE reward models.

cs.AI↗

Reinforcement Learning based DBMS Buffer Pool Auto-Tuning for Optimal Memory Utilization

Administering Database Management Systems (DBMS) instances requires Database Administrators (DBA) to balance performance in terms of Service Level Agreement (SLA) against resource usage, often prompting RAM over-allocation that wastes memory. We introduce MicroTune, an online RL-based buffer adjustment system that minimizes unnecessary memory allocation while ensuring SLA compliance. To identify the most effective RL core, we evaluate multiple algorithms under diverse benchmark workloads, training MicroTune on extensive traces of both external metrics (latency, throughput) and internal DBMS metrics (status variables and performance statistics). Experimental results demonstrate that MicroTune dynamically adapts buffer sizes to workload fluctuations, outperforming baselines by achieving significant memory savings with fewer SLA violations. These findings underscore the promise of reinforcement learning for adaptive resource management in DBMS environments.

cs.DB↗

Intraday Gas Fee Heterogeneity on Ethereum: Evidence from Operational Firms

Ethereum's EIP-1559 fee mechanism was designed under the assumption of homogeneous, myopic agents responding to a single congestion signal. We examine how this assumption interacts with the heterogeneous demand structure of real-world Ethereum users. Analyzing 62,142 confirmed transactions from seven operational firms across seven industries (January--March 2026), we document significant intraday gas-fee variation: fees peak at hour~12 UTC (7\,AM ET, $\hatβ_{12}=\$0.054$ above the U.S.\ evening baseline, $p<0.001$) and are associated with periods of elevated speculative-arbitrage activity. Operational firms exhibit heterogeneous scheduling responses moderated by transaction deferrability and gas intensity. Residual cost floors, i.e. the gap between observed expenditure and the counterfactual under perfect off-peak scheduling, range from 40.7\% to 92.5\% of actual expenditure, and persist even during the lowest-cost hours ($h\in\{20,21,22,23\}$ UTC, 3--6\,PM ET). We introduce an On-Chain Scheduling Matrix that maps firms to four scheduling regimes as a practical framework for managing gas-fee exposure under the current mechanism.

econ.EM↗

An on-chip programmable mechano-quantum transducer

Solid-state spin defects encode local perturbations as measurable shifts in spin-transition frequencies, but mechanical actuation and quantum readout remain physically separated, resulting in a discrete measurement setup. Integrating these functions requires an on-site mechano-quantum interface that programs the lattice state of a defect host and quantitatively maps it onto the spin Hamiltonian. Here we first report an on-chip programmable mechano-quantum transducer (OCPMQT) that integrates voltage-defined micromechanical actuation with in situ spin-frequency readout in a two-dimensional van der Waals quantum-defect host. Mechanically programmed lattice states are encoded as shifts in the axial zero-field splitting parameter and resolved by optically detected magnetic resonance (ODMR) spectroscopy. Within a chip volume of 2.05*10^-2 cm^3, the transducer accesses ODMR-inferred strains as low as 0.0080% and delivers a volumetric force density of approximately 2.6*10^4 N*m^-3. A micromechanical-to-spin-Hamiltonian framework links on-chip electromechanics, interfacial strain transfer, and strain-spin coupling, enabling the electrical control micromechanical input to be measured directly as spin-frequency response.

cond-mat.mes-hall↗

A statistical understanding of oxygen vacancies in distorted high-entropy oxides

High-entropy perovskite oxides have emerged as promising electrode materials for solid oxide electrolyzers. However, their compositional complexity makes the formation of oxygen vacancies, which influence properties such as oxygen ionic conductivity and thermal expansion, challenging to predict. Here, we experimentally measure changes in oxygen vacancy concentration for fourteen perovskite oxides with high and low-entropy A-site compositions, finding a dependence on cation size variance in addition to divalent cation fraction. Atomistic simulations using a machine-learned universal interatomic potential reveal cation size mismatches broaden a distribution of vacancy formation energies, shown through statistical thermodynamics to shift bulk formation thermodynamics. Treating oxygen vacancies statistically enables accurate predictions of oxygen vacancy formation compared to traditional models. Practically, increasing the size variance between A-site cations reduces the temperature sensitivity of oxygen vacancy concentrations, making it key for tuning critical properties. More broadly, this study demonstrates statistical treatment of oxygen vacancies is essential for understanding high-entropy perovskite oxides.

cond-mat.mtrl-sci↗

Test-Time Registers as Global Priors for Tokenized Image Generation

Attention-based models often develop attention sinks, where a small number of tokens repeatedly attract attention and accumulate unusually large activations. In vision transformers, these outliers are closely related to registers, which have been diagnostically linked to global, low-frequency image structure. Existing work has largely studied registers through interpretability analyses and linear probes, leaving open whether they can be operationalized as plug-and-play signals for generation without retraining. We revisit this question in tokenized image generation. Using OpenCLIP and DINOv2 on ImageNet, we find that test-time register features exhibit stronger low-frequency concentration than both [CLS] readouts and patch-mean features, and show a consistent (albeit moderate) correlation with pixel-space DCT low-frequency energy. Motivated by these diagnostics, we introduce RegToken, a training-free procedure that converts register structure into a small set of global prior tokens by (i) NFN-based layer localization, (ii) TokenRank-guided subspace extraction, and (iii) a projection-and-conservation update on the register subspace. Inserted into a frozen compact 1D token generation pipeline, RegToken improves ImageNet generation and alignment metrics (e.g., FID-5k 20.5 to 20.1, SigLIP 3.6 to 3.9) without modifying pretrained weights, and accelerates test-time optimization (Steps@$τ$ 74 to 52). Overall, our results suggest that structures often viewed as attention artifacts can be repurposed as lightweight global priors for tokenized generation.

cs.CV↗