arXiv subjects

Fei Liu

Publications and source records attributed to Fei Liu.

At least 19 recordsLinked to original sources

arXiv2026

Time-Varying Quantile VAR Models: Estimation and Inference

We study time-varying quantile VAR models in which the conditional quantile does not propagate linearly through the recursion, and develop a toolkit for impulse response analysis, which to the best of our knowledge has not been established elsewhere. For example, we establish Bahadur representation for quantile VAR regression, infer model parameters via smoothed check function, and define and investigate the best linear projection of the time-varying tau-quantile impulse response via local projections. An application to U.S. industrial production growth and credit spreads from 1919-2025 uncovers structural shifts in tail relationships, demonstrating downside asymmetry diminishes at longer forecast horizons.

econ.EM↗

arXiv2026

Measure of Maximal Entropy for Geodesic Flows on Noncompact Manifolds of Nonpositive Curvature

We establish the variational characterization of the measure of maximal entropy on noncompact manifolds of nonpositive sectional curvature. Assuming that the deck transformation group contains an axial isometry with a rank-one axis and has a finite critical exponent, we prove that the supremum of the entropies of invariant probabilities equals the critical exponent and is attained if and only if the Bowen-Margulis-Sullivan (BMS) measure is finite. In that case, the measure of maximal entropy is unique and equals the normalized BMS measure. The proof combines conditional-entropy rigidity on the regular set with an HTS-based entropy exclusion on the singular set, overcoming both non-compactness and the loss of uniform hyperbolicity due to zero curvature. We also obtain mixing under a non-arithmetic length-spectrum assumption. For nonpositively curved surfaces of genus at least two, the existence of a closed Jacobi rank-one geodesic and the non-arithmeticity of the axial length spectrum are automatic.

math.DS↗

arXiv2026

SkillQR: Agentic Skill Discovery for Reason-Intensive Query Rewriting

Dense retrievers provide grounded evidence that mitigates hallucinations in outputs from Large Language Models (LLMs). Real-world queries are often verbose, ambiguously framed, or require multi-step reasoning, introducing irrelevant details that weaken semantic matching for dense retrievers. Query rewriting is a widely adopted pre-retrieval technique that leverages LLMs to reformulate queries and bridge the semantic gap between such queries and the retrieval target. Existing rewriting approaches either rely on expensive proprietary models, substantial training data, or iterative retrieval and rewriting, while largely applying a uniform rewriting strategy regardless of the retrieval corpus. We observe that effective query rewriting instructions are not universal: the optimal strategy depends on the retrieval target, rather than the model alone. We introduce SkillQR, a query rewriting framework that automatically discovers reasoning strategy sets from the retrieval target and dynamically routes a query to the appropriate rewriting strategy at inference time. Without relying on training data, SkillQR achieves competitive performance compared to fine-tuned rewriting models on the BRIGHT and R2MED benchmarks, while also providing lower inference latency than iterative rewriting approaches.

cs.IR↗

arXiv2026

LapaFM: A Laparoscopic Foundation Model via Multi-Stage Continual Learning

Artificial intelligence-based analysis of intraoperative laparoscopic videos has the potential to improve surgical decision-making and precision. However, effective surgical assistance requires models that can generalize across diverse intraoperative tasks. Here we present LapaFM, a foundation model for laparoscopic surgery trained on more than 20,000 minutes of surgical videos using a multi-stage continual learning strategy that mitigates catastrophic forgetting and inter-task interference. LapaFM learns multimodal visual representations and supports multiple tasks, including smoke removal, surgical phase recognition, instrument and polyp segmentation, and lesion identification. The model was evaluated on 13 retrospective and two prospective cohorts collected from different imaging devices. LapaFM consistently outperformed task-specific models and existing foundation models across datasets, and also generalized to gastrointestinal endoscopy tasks, including polyp detection and classification. Notably, it recovered over 90% of smoke-obscured frames and achieved clinician-level or superior performance in lymph node metastasis prediction and prospective polyp classification.

cs.CV↗

arXiv2026

Directing to Diversify: Multi-Directional Search for Automatic Heuristic Design

Large language models (LLMs) have demonstrated strong potential to automate heuristic design for NP-hard combinatorial optimization (CO) tasks without human intervention. Recent methods predominantly rely on evolutionary computation (EC) frameworks, where heuristic diversification is mainly induced through EC-like operators or downstream selection, while the direction of heuristic transformation remains largely unharnessed. In this paper, we propose a multi-directional Perturbation-Rewrite Search (PRS) framework for automatic heuristic design that factorizes heuristic transformation through directional search primitives at the generation level. Specifically, PRS operates on heuristic ideas through three complementary directions: expansion toward richer and more expressive designs, compression toward simpler and less specialized designs, and steering for fine-grained refinement, together enabling broader and more sustained exploration of diverse regions in the heuristic design space. PRS further organizes candidate exploration within a breadth-first search-based process with adaptive operator control, which ensures thorough candidate utilization and sustained exploration, and maintains strong search dynamics while preventing premature convergence. Extensive empirical results across diverse CO tasks show that PRS consistently discovers high-quality heuristics, demonstrating the effectiveness and generality of explicitly directional exploration design.

cs.AI↗

arXiv2026

Not Every Rollout Needs Distillation: Correctness-Filtered On-Policy Self-Distillation

On-policy self-distillation (OPSD) supervises student-generated trajectories with a reference-conditioned version of the same base model. We ask whether every trajectory supplies distinct supervision that warrants its distillation cost. Gradient measurements on Qwen3-1.7B at initialization reveal that correct and incorrect responses have similar individual gradient magnitudes, but incorrect responses have approximately three times the coherent gradient share. Their estimated population-mean directions also largely overlap. A signal--noise model fitted at a small group size tracks alignment at larger group sizes without refitting. Motivated by these measurements, we introduce correctness-filtered OPSD (C-OPSD), which generates one response per problem and distills only a subset of incorrect responses. Removing unselected rows before both distillation forwards avoids their teacher/student forward and student backward work. Across Qwen3-1.7B, 4B, and 8B on AIME24, AIME25, and HMMT25, C-OPSD achieves on-par performance with full OPSD. In a measured micro-batch-size-four implementation, executed rows decrease by approximately 68%, and with retained rows packed into full micro-batches, training takes about 40% less time while rollout generation remains unchanged. Together, the measurements and training results connect outcome-conditioned supervision redundancy to more compute-efficient distillation.

cs.AI↗

arXiv2026

Asymptotic Lech Bounds and Bertini Flags

For a $d$-dimensional Noetherian local ring $(R,\mathfrak{m})$, with $d>0$, let $c_{\infty}(R)$ be the limit, as $N\to\infty$, of the suprema of $e_R(I)/(d!\ell_R(R/I))$ over ideals $I$ with $\sqrt{I}=\mathfrak{m}$ and $\ell_R(R/I)>N$. We prove that if $R$ is complete, reduced, equidimensional, and Cohen--Macaulay on the punctured spectrum, with $d\geq2$ and infinite residue field, then every nonzerodivisor $x\in\mathfrak{m}$ satisfies \[ c_{\infty}(R)\leq \max\left\{c_{\infty}(R/xR), \sup_{\mathfrak{p}\ne\mathfrak{m}}e(R_{\mathfrak{p}})\right\}. \] As an application, we prove the asymptotic Lech conjecture of Huneke, Ma, Quy, and Smirnov in arbitrary characteristic: $c_{\infty}(R)=1$ whenever $\widehat{R}$ has isolated singularities. This also settles the conjecture of Ma and Smirnov that the Lech--Mumford constant $c_{\mathrm{LM}}(R)$ is attained when $\widehat{R}$ has isolated singularities and $c_{\mathrm{LM}}(R)>1$. For reduced equidimensional Cohen--Macaulay standard graded algebras of dimension $\geq2$ over infinite perfect fields, we prove attainment and rationality of $c_{\mathrm{LM}}$ for the completed vertex local rings of sufficiently high Veronese subrings. In characteristic zero, a refinement of our method produces nonisolated klt affine cones in every dimension $d\geq3$, with $d-2$-dimensional singular loci, whose completed vertex local rings have $c_{\infty}=1$ and arbitrarily large $c_{\mathrm{LM}}$.

math.AC↗

arXiv2026

Analytic Liouville Integrable Geodesic Flow Has Zero Entropy

This paper studies the topological entropy of real-analytic Liouville integrable Hamiltonian systems. We prove that the Hamiltonian flow on a compact connected regular energy hypersurface has zero topological entropy whenever a complete family of commuting real-analytic first integrals is generically independent in a connected neighborhood of that hypersurface. The proof uses finite normal expansions along minimal analytic carriers and an ergodic version of Ziglin's leading-term argument to obtain independent invariant normal polynomials, whose Poisson geometry makes all tangent Lyapunov exponents of the carriers vanish. In particular, we prove that a real-analytic Liouville integrable geodesic flow on a closed real-analytic Riemannian manifold has zero topological entropy, giving a positive answer to the conjecture proposed by Paternain in 1992.

math.DS↗

arXiv2026

Sensitivity or Criterion? Measuring and Moving When Language Models Act

Before an agent acts, it must decide whether action is warranted. A single accuracy cannot distinguish failure to recognize a warranted action from reluctance to act. Signal-detection theory separates sensitivity from criterion, but criteria estimated from authored binary labels depend on each benchmark's example mix. We introduce FlipAct, a diagnostic of tool use in physical states. A rule over annotated tool properties computes each answer and a graded evidence score, fixing the Yes/No boundary at zero across models. Questions form 2-by-2 quads that hold required knowledge fixed while the state flips. The slope of the fitted Yes-rate curve measures sensitivity; its crossing at one half measures criterion. Across 44 open models, sensitivity rises with size within a family, and its ranking agrees with three of four external when-to-act benchmarks. Models respond to evidence sign rather than magnitude, accepting actions that leave the state no better about as often as helpful ones. When Yes means act, most models are conservative across rephrasings; in some, this partly reflects a preference for No. Criterion is not determined by size. Activation steering shifts criterion with weights fixed; distillation from a model's own steered copy puts the shift into its weights without a significant sensitivity change. The distilled shift transfers to six external benchmarks, including two without Yes/No answers, while criterion-free AUC is preserved on the five benchmarks where it is available. Accuracy improves where models start conservative and declines or remains within error where they start permissive. Project page: https://sixundong.com/projects/flipact

cs.CL↗

arXiv2026

Refine Where It Matters: Contact-Adaptive Meshing for Deformable Object Manipulation

Deformable-object manipulation requires accurate modeling of highly localized contact while maintaining simulation speeds suitable for interactive use. Uniformly fine tetrahedral meshes can resolve these interactions, but they introduce unnecessary degrees of freedom throughout the object. Coarse meshes are more efficient, yet they may under-resolve contact-induced deformation. We present a contact-adaptive mesh refinement framework that introduces spatial resolution only where it is most useful. The method uses geometric, elastic, and contact quantities already available from the deformable-body solver to score candidate edges. A fully GPU-parallel procedure then selects a conflict-free subset and updates both mesh topology and physical state directly within the simulation loop. We evaluate the approach on real deformable-object manipulation sequences. Adaptive refinement reduces simulation-to-real error, improves agreement with a fine-mesh reference, and remains substantially more efficient than uniformly fine simulation. These results show that local refinement can improve physical fidelity without incurring the cost of a globally fine discretization. The framework provides a practical basis for contact-rich simulation in interactive manipulation, sim-to-real modeling, and online physical digital twins.

cs.RO↗

arXiv2026

Observation-Referenced Tissue Deformation Forecasting with Tool-Driven and Residual Dynamics

Forecasting tissue deformation from future instrument motion could support predictive planning and increasingly autonomous surgical systems. We study this problem using a scene-specific differentiable surface model fitted to an observed tool-tissue interaction window. Rather than forecasting absolute simulated positions, we introduce an \textit{observation-referenced} formulation that anchors each tissue point to its last valid observation and adds only the deformation induced by the known, preplanned future tool trajectory. This reduces sensitivity to reconstruction, initialization, and persistent simulation offsets while preserving the predicted deformation response. The physical model uses differentiable, mesh-free position-based dynamics with scene-specific rigidity, attachment, region scale, and grasp coupling. We further introduce an optional \textit{observation-referenced residual model} combining graph-spectral spatial modes with periodic harmonic dynamics for structured motion not explained by the tool input. We evaluate the framework retrospectively on 12 surgical manipulation clips from three datasets. Observation referencing provides the largest gain, with a median within-clip error ratio of $0.598$ relative to the corresponding absolute simulation forecast. The optional periodic residual further improves forecasting when the remaining motion exhibits periodic structure. These results support observation-referenced deformation prediction as a practical building block for future surgical world models, digital twins, and generative simulators that must predict how tissue evolves under instrument actions.

cs.RO↗

arXiv2026

ProCut: Probabilistic Cutting Topology for Autonomous Electrosurgical Tissue Dissection

Accurately modeling and tracking the deformation of soft tissue is critical for a wide range of interventional and surgical procedures. However, current methods struggle in scenarios involving topological changes, such as cutting and dissection, due to the inherent non-linearity and discontinuity introduced by explicit changes in connectivity. In this work, we present a novel, fully differentiable framework that enables robust estimation and modeling of topological changes during deformable tracking. Our method introduces a continuous, sigmoid-based formulation to smooth the otherwise discrete event of tissue cutting, making it amenable to gradient-based optimization within a differentiable Position-Based Dynamics (PBD) simulation. To account for uncertainty and improve robustness in the presence of noisy visual data, we incorporate Stein Variational Gradient Descent (SVGD) for particle-based probabilistic inference, generating multiple hypotheses for topological state estimation. Building on this foundation, we develop an autonomous dissection algorithm for thin-shell tissues that leverages topological updates to guide closed-loop cutting trajectory control. We evaluate our approach in both simulated and real-world electrosurgical environments, demonstrating significant improvements in topological estimation accuracy and dissection precision over existing methods. Our results highlight the potential of this framework to advance automation in soft-tissue surgical procedures by enabling reliable perception and control in the presence of complex structural changes.

cs.RO↗

arXiv2026

Structure-aware Keypoint Localization for Videofluoroscopic Swallowing Study

Videofluoroscopic Swallowing Study (VFSS) is one of the gold standard for diagnosing swallowing disorders, providing dynamic X-ray imaging of the swallowing process. Automated kinematic analysis in VFSS relies fundamentally on precise anatomical keypoint localization. However, existing studies focus on limited keypoints (e.g., cervical vertebrae or the hyoid) and overlook critical regions such as the soft palate, while annotating only active swallowing segments and ignoring abundant non-swallowing data, resulting in poor data efficiency. Moreover, leveraging this unlabeled data via standard semi-supervised learning is suboptimal, as generic methods are prone to spatial bias. In medical X-rays with fixed layouts, models tend to memorize absolute coordinates rather than understanding anatomical structures. To tackle these challenges, we introduce VFSSKep, a novel dataset that extends annotations to the soft palate and incorporates large-scale unlabeled data. We further propose S$^3$KL, a Structure-aware Semi-Supervised Keypoint Localization framework designed to overcome spatial bias. It integrates a Structure-Aware Learning strategy to extract high-resolution structural cues for structure-aware representation learning, and a Structural Representation Consistency Learning strategy with block shuffling to enforce invariant structural recognition. Experiments show our method achieves state-of-the-art semi-supervised performance, even with unlabeled and 25% labeled data surpassing fully supervised learning with 100% labeled data. Code and data will be made publicly available at: https://github.com/kaai520/S3KL.

cs.CV↗

arXiv2026

The Ergodicity of Geodesic Flows on Rank One Manifolds of Nonpositive Curvature

In this paper, we study the ergodicity of geodesic flows on closed rank-one manifolds of nonpositive sectional curvature. We introduce the infinite-order vanishing set of the Gaussian curvature in dimension two and of the fiberwise second moment of the reduced Jacobi determinant in higher dimensions. We bound the Liouville measure of the singular set in terms of the volume of this subset and, for surfaces, obtain a corresponding Hausdorff dimension bound. In particular, if this subset has zero volume, then the singular set has zero Liouville measure, and the geodesic flow is ergodic. We also give a geometric criterion for finitely many exceptional regions whose fundamental groups have virtually Abelian images of rank smaller than the dimension of the manifold. Under strict negativity of sectional curvature outside these regions, we obtain a Hausdorff dimension bound for the singular set and prove that the geodesic flow is ergodic with respect to Liouville measure. By extending this method to real-analytic metrics, we characterize the singular set as the zero set of a nontrivial real-analytic determinant constructed from curvature operators, thereby establishing ergodicity in this setting without further assumptions.

math.DS↗

arXiv2026

AdaEva: Accelerating LLM-Driven Algorithm Design with Adaptive Partial Evaluation

Large Language Models (LLMs) are increasingly used for automated algorithm design. However the computational cost of evaluating the generated algorithms can be excessive. We consider the common LLM-driven automated algorithm design (LLM4AD) setting in which a candidate algorithm is evaluated by aggregating its performance over a shared set of training instances. This instance-wise structure raises a natural question: must every candidate be evaluated on the entire instance set before deciding whether it remains competitive? Taking inspiration from algorithm configuration, we introduce AdaEva, a drop-in adaptive partial-evaluation framework that progressively evaluates candidates on larger subsets of the same instance pool and eliminates unpromising candidates as evidence accumulates. Importantly, AdaEva leaves the underlying LLM4AD procedure and per-instance evaluator unchanged and requires no prior knowledge about instance difficulty. We instantiate this idea using successive halving (AdaEva-S) and statistical racing (AdaEva-R), and evaluate both mechanisms across three representative LLM4AD frameworks, multiple LLM backbones, and optimization domains spanning combinatorial and continuous black-box optimization. Under matched evaluation budgets, AdaEva more reliably balances evaluation effort across candidates than fixed partial-evaluation strategies, yielding strong search efficiency and anytime performance together with improved held-out generalization across the evaluated settings.

cs.LG↗

arXiv2026

GISTBench: Evaluating LLM User Understanding via Evidence-Based Interest Verification

We introduce GISTBench, a benchmark for evaluating Large Language Models' (LLMs) ability to understand users from their interaction histories in recommendation systems. Unlike traditional RecSys benchmarks that focus on item prediction accuracy, our benchmark evaluates how well LLMs can extract and verify user interests from engagement data. We propose two novel metric families: Interest Groundedness (IG), decomposed into precision and recall components to separately penalize hallucinated interest categories and reward coverage, and Interest Specificity (IS), which assesses the distinctiveness of verified LLM-predicted user profiles. We release a synthetic dataset constructed on real user interactions on a global short-form video platform. Our dataset contains both implicit and explicit engagement signals and rich textual descriptions. We validate our dataset fidelity against user surveys, and evaluate eight open-weight LLMs spanning 7B to 235B parameters, together with three proprietary frontier models (GPT-5, Claude 4.6, and Gemini 3.5 Flash). Our findings reveal performance bottlenecks in current LLMs, particularly their limited ability to accurately count and attribute engagement signals across heterogeneous interaction types.

cs.AI↗

arXiv2026

BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by retrieving relevant information from external knowledge bases to provide more accurate, contextually informed, and up-to-date responses. However, this reliance on external knowledge introduces significant security vulnerabilities, as many RAG systems (e.g., Google Search) rely on large and unsanitized data repositories (e.g., Reddit). In this paper, we unveil a novel threat in which attackers steer the RAG system's response by injecting malicious passages into its knowledge base. When a user's query contains attacker-specified trigger words, the RAG retrieves and refers to these malicious passages, enabling the attacker to steer the response without altering the user input or modifying the RAG weights. BadRAG operates in two phases: (i) malicious passages are optimized to be retrieved exclusively when trigger words appear in user queries; (ii) these passages are meticulously crafted to achieve adversarial generation objectives, including denial of service, sentiment manipulation, context leakage, and tool misuse. Our experiments show that injecting just 10 malicious passages (0.04\% of the external corpora) achieves a 98.2\% retrieval success rate and increases negative response rates from 0.22\% to 72\% for queries containing triggers.

cs.CR↗

arXiv2026

EvoMO-SR: Multiobjective LLM-based Evolution of Symbolic Expressions with substructure guidance

Symbolic Regression (SR) is a data-driven method for scientific discovery which searches for interpretable analytical relationships within data. Recently, Large Language Models (LLMs) have also had a significant impact on scientific discovery, enabling the automation of various stages of the process. For these reasons, the possibility of harnessing the embedded scientific knowledge and programming capabilities of LLMs to solve SR tasks has emerged, showing promising performance compared with traditional methods. We propose EvoMO-SR, a novel LLM-driven SR framework in which the LLM generates equation skeletons, with their coefficients fitted separately by an external optimizer. The framework includes a multi-objective survival selection which controls bloating by balancing accuracy and complexity, and a substructure guidance mechanism which mutates expressions with candidate reusable building blocks. EvoMO-SR achieves the best accuracy in seven of the eight in-domain and out-of-domain settings for LSR-Synth, using a small LLM model, i.e., Llama-3.1-8B-Instruct. We also evaluated structural recovery through two symbolic accuracy metrics based on canonicalized subtree overlap and term matching, showing that our method has a greater probability of recovering highly accurate symbolic structures.

cs.LG↗