arXiv Science⌕ Search

arXiv subjects

Ruijie Yang

Publications and source records attributed to Ruijie Yang.

At least 19 recordsLinked to original sources

CastWorld: Benchmarking Context-Aware Agentic Time Series Forecasting Beyond Predictive Accuracy

Agentic time series forecasting extends conventional approaches beyond one-shot numerical prediction toward autonomous, context-aware interaction. However, existing benchmarks offer limited integrated support for diverse contextual information, forecasting-specific adaptive interactions, and systematic evaluation of forecasting agents. In this paper, we introduce CastWorld, an agentic benchmark for context-aware time series forecasting. First, its context-rich dataset suite spans 8 domains and 25 real-world datasets, covering external variables, events, and historical cases under a unified context specification. Second, a lightweight, modular forecasting-native harness provides 49 core tools and a state-adaptive loop that tracks forecast versions and enables iterative evidence gathering and forecast revision. Intermediate forecasts can expose information gaps, while newly acquired evidence guides subsequent revisions and final version selection. Third, model-level evaluation assesses forecast quality, process execution, behavioral trustworthiness, and resource efficiency through decision trajectories and forecast-version histories. Also, systems-level evaluation compares predictive accuracy across forecasting systems. Experiments reveal distinct decision behaviors among agents with comparable accuracy. Additional interactions do not necessarily improve forecasts, and agents may fail to select their best previously generated predictions. Allowing evidence acquisition during forecast refinement improves task-aware forecast scores across all three evaluated models. CastWorld provides a reusable foundation for evaluating agentic time series forecasting under controlled conditions.

cs.LG↗

Filtrations on D-modules and multiplicities of roots of Bernstein-Sato polynomials

In this paper, we relate multiplicities of Bernstein--Sato-type polynomials with respect to a function f to several singularity invariants. First, we introduce certain ``mod'' b-functions and show that they characterize the weight filtration on the localization of a simple algebraic holonomic D-module along f, and we provide an algorithm to compute them. Second, we show that they can be approximated by the multiplicities of roots of power b-functions (i.e., the b-functions with respect to powers of f). Furthermore, we give a sharp upper bound for the Hodge level of elements given by a certain sum of such multiplicities. Next, we give an effective asymptotic solution to the Gelfand problem by determining an explicit threshold after which every integer shift of a root of b_f(s) is a pole of the Archimedean zeta function of f. We also show that the order of these poles is equal to the nilpotency index of the logarithmic monodromy operator, which we further express as the limit of the multiplicities of roots of power b-functions. We define several filtrations, relating them to the weight and Hodge filtrations, based upon which we leave some open questions that we address in the affirmative in the case when f has a homogeneous isolated singularity, or it is a hyperplane arrangement, or a semi-invariant on a spherical variety. We give several immediate applications to our results, including a solution to a question of Torrelli on whether 1/f lies in the intersection complex of the hypersurface of f if and only if -1 is a simple root of b_f(s).

math.AG↗

LSTMem: Hierarchical Long Short-Term Online Memory for Large Language Models

Large language models increasingly serve as long-horizon assistants and agents, where they must both accumulate information across interactions and make the relevant parts available when later requests depend on them. Existing compact online memories typically use a single persistent state both to accumulate history and to serve readout, so what the memory stores cannot be controlled separately from what it exposes to the current computation. We propose LSTMem, an LSTM-inspired online memory that instead equips each layer of a frozen LLM with two matrix-valued states: a cell state that accumulates history and a hidden state whose readouts correct the backbone's attention. Input and forget gates control what the cell stores, while an output gate separately controls what the cell exposes through the hidden state. LSTMem further connects memory across depth through forward hidden-state propagation and block-end feedback, and uses higher-layer reconstruction gradients to refine lower-layer cell states before rebuilding hidden states from shallow to deep layers. Across memory benchmarks on Qwen3-4B-Instruct, LSTMem consistently improves MemoryAgentBench, LoCoMo, and HotpotQA over the plain backbone. Comparisons further show that the LSTM-based memory formulation outperforms an associative-memory counterpart, while removing cross-layer hidden-memory propagation degrades performance. These results demonstrate the benefits of separating memory accumulation from memory expression and organizing memory hierarchically across model depth. The code is available at https://github.com/Longchentong/LSTMem.

cs.AI↗

Gaze responses to false-positive computer-aided detection prompts during colonoscopy: a paired-video and real-time eye-tracking study

False-positive computer-aided detection (CADe) prompts may divert endoscopists' attention during colonoscopy, yet the attentional impact of individual prompts remains unclear. We used event-locked eye tracking to quantify gaze attraction and attention occupation in complementary retrospective and prospective studies. In a retrospective paired-video experiment, 3 senior and 2 novice endoscopists viewed 60 colonoscopy videos with and without CADe. The prospective study recorded gaze during 42 real-time CADe-assisted colonoscopies performed by 9 senior endoscopists. Screened CADe prompts outside expert-annotated lesion windows were classified as false-positive artifact events. False-positive prompts attracted gaze in 48.6% (68/140) of retrospective observations and 65.2% (533/817) of prospective events. Among attraction events with complete recovery, median attention occupation lasted 1000 ms in the retrospective study and 1100 ms in the prospective study. Corresponding median prompt durations were 33 ms and 267 ms, with median time amplifications of 17.55-fold and 5.15-fold, respectively. In paired retrospective comparisons, visible artifact prompts drew gaze closer to the prompted region than did the same-coordinate unassisted reference. Secondary retrospective analyses showed high lesion gaze recognition without and with CADe (98.0% versus 99.0%). First gaze entry into lesion regions occurred 147.8 ms earlier with CADe. Across controlled and real-time clinical settings, false-positive CADe prompts frequently captured gaze, with attention persisting beyond prompt visibility. These findings support considering prompt-related attentional burden in CADe evaluation and design.

cs.AI↗

Multivariate V-filtrations and the Strong Monodromy Conjecture for hyperplane arrangements

In this work, we develop a new theory of multivariate V-filtration on D-modules along a simple normal crossing divisor and relate it with Sabbah's multi-filtration. We establish several new structural results and relate them with the Hodge filtration on free-monodromic local systems from geometric representation theory. As applications, we prove the Strong Monodromy Conjecture and its multivariate generalisation for hyperplane arrangements. Along the way, we confirm both the n/d-conjecture of Budur--Mustaţă--Teitler and its multivariate form due to Budur.

math.AG↗

Archimedean zeta functions, singularities, and Hodge theory

We use Hodge theory to relate poles of the Archimedean zeta function $Z_f$ of a holomorphic function $f$ with several invariants of singularities. First, we prove that the largest nontrivial pole of $Z_f$ is the negative of the minimal exponent of $f$, whose order is determined by the multiplicity of the corresponding root of the Bernstein--Sato polynomial $b_f(s)$, resolving in a strong sense a question of Mustaţă--Popa. On the other hand, we give an example of $f$ where a root of $b_f(s)$ is not a pole of $Z_f$, answering a question of Loeser from 1985 in the negative. As a byproduct, we give a positive answer to a question of Budur--Walther in the case of the minimal exponent. In general, we determine poles of $Z_f$ from the Hodge filtration on vanishing cycles, sharpening a result of Barlet. Finally, we obtain analytic descriptions of the $V$-filtration of Kashiwara and Malgrange, Hodge and higher multiplier ideals, addressing another question of Mustaţă--Popa. The proofs mainly rely on a positivity property of the polarization on the lowest piece of the Hodge filtration on a complex Hodge module in the sense of Sabbah--Schnell.

math.AG↗

From Generalist to Specialist: A Context-Fusion Framework for Endoscopic Polyp Reporting with a Frozen VLM

Reliable endoscopic polyp reporting requires integrating quantitative lesion sizing, standardized Paris classification, and clinically meaningful morphological description within a single record. General-purpose vision-language models (VLMs) offer a unified interface for image understanding and report generation. Existing specialization strategies, however, typically rely on task-specific models or model-weight adaptation, leaving unresolved how to introduce reliable specialist knowledge while preserving both this unified interface and the VLM's pretrained capabilities. We introduce a context-fusion framework that specializes a frozen general-purpose VLM through both implicit instruction context and explicit transduction context without modifying its pretrained weights. Specifically, a self-supervised polyp encoder retrieves related image-report pairs as explicit, query-specific evidence, while learned continuous specialist tokens provide implicit instruction context shared across cases. Experiments were conducted on 2,056 expert-annotated public endoscopic images. We compared the framework with general-purpose VLMs, task-specific predictors, and weight-adaptation methods to assess specialist performance, unified reporting, and adaptation efficiency. Across numerical, categorical, and report-generation metrics, the proposed framework substantially improved direct frozen-VLM inference and achieved the strongest overall performance among the evaluated methods. It added trainable parameters equal to only 0.006% of the frozen VLM's parameter count. When the top-1 retrieved case carried the correct target category, our framework corrected 70.5% of the errors made by a weight-adaptation baseline. These findings support the context-fusion framework as a lightweight and effective strategy for specialist adaptation of a frozen VLM.

cs.AI↗

A report-grounded vision-language foundation model for colonoscopy from 280000 routine reports

Vision-language models remain underused in colonoscopy despite the rich expert descriptions recorded in routine reports. These reports document lesion appearance, size and location but summarise entire procedures rather than caption individual frames, leaving clinical findings only weakly linked to the corresponding images. Here we develop EndoCLIP, a colonoscopy vision-language foundation model trained on 125,756 lesion-level image-text pairs progressively recovered from 280,476 routine colonoscopy records. Across lesion-level image-text retrieval, structured report generation and six multi-centre clinical classification tasks, EndoCLIP outperforms general-purpose and biomedical vision-language encoders in both zero-shot and linear-probe settings. On benign-versus-malignant classification, its linear probe approaches the performance of expert readers in a blinded study involving 12 endoscopists. These results suggest that recovering finding-to-frame correspondence can transform routine documentation into scalable supervision, enabling clinical targets to be specified in language rather than separately annotated for each task.

cs.AI↗

Filtrations of D-modules along semi-invariant functions

Given a smooth algebraic variety X with an action of a connected reductive linear algebraic group G, and an equivariant D-module M, we study the G-decompositions of the associated V-, Hodge, and weight filtrations. If M is the localization of a D-module S underlying a pure twistor D-module (e.g. when S is simple) along a semi-invariant function, we determine the weight level of any element in an irreducible isotypic component of M in terms of multiplicities of roots of b-functions. If S underlies a pure Hodge module, we show that the Hodge level is governed by the degrees of another class of polynomials, also expressible in terms of b-functions. As an application, if X is an affine spherical variety, we describe these filtrations representation-theoretically in terms of roots of b-functions, and compute all higher multiplier and Hodge ideals associated with semi-invariant functions. Examples include the spaces of general, skew-symmetric, and symmetric matrices, as well as the Freudenthal cubic on the fundamental representation of E_6.

math.AG↗

Higher multiplier ideals

We associate a family of ideal sheaves to any Q-effective divisor on a complex manifold, called higher multiplier ideals, using the theory of mixed Hodge modules and V-filtrations. This family is indexed by two parameters, an integer indicating the Hodge level and a rational number, and these ideals admit a weight filtration. When the Hodge level is zero, they recover the usual multiplier ideals. We study the local and global properties of higher multiplier ideals systematically. In particular, we prove vanishing theorems and restriction theorems, provide criteria for the nontriviality, and introduce the center of minimal exponent (generalizing the notion of minimal log canonical center). The main idea is to exploit the global structure of the V-filtration along an effective divisor using the notion of twisted Hodge modules. As applications, we prove new cases of conjectures by Debarre, Casalaina-Martin and Grushevsky on singularities of theta divisors on principally polarized abelian varieties.

math.AG↗

Development and multi-center evaluation of domain-adapted speech recognition for human-AI teaming in real-world gastrointestinal endoscopy

Automatic speech recognition (ASR) is a critical interface for human-AI interaction in gastrointestinal endoscopy, yet its reliability in real-world clinical settings is limited by domain-specific terminology and complex acoustic conditions. Here, we present EndoASR, a domain-adapted ASR system designed for real-time deployment in endoscopic workflows. We develop a two-stage adaptation strategy based on synthetic endoscopy reports, targeting domain-specific language modeling and noise robustness. In retrospective evaluation across six endoscopists, EndoASR substantially improves both transcription accuracy and clinical usability, reducing character error rate (CER) from 20.52% to 14.14% and increasing medical term accuracy (Med ACC) from 54.30% to 87.59%. In a prospective multi-center study spanning five independent endoscopy centers, EndoASR demonstrates consistent generalization under heterogeneous real-world conditions. Compared with the baseline Paraformer model, CER is reduced from 16.20% to 14.97%, while Med ACC is improved from 61.63% to 84.16%, confirming its robustness in practical deployment scenarios. Notably, EndoASR achieves a real-time factor (RTF) of 0.005, significantly faster than Whisper-large-v3 (RTF 0.055), while maintaining a compact model size of 220M parameters, enabling efficient edge deployment. Furthermore, integration with large language models demonstrates that improved ASR quality directly enhances downstream structured information extraction and clinician-AI interaction. These results demonstrate that domain-adapted ASR can serve as a reliable interface for human-AI teaming in gastrointestinal endoscopy, with consistent performance validated across multi-center real-world clinical settings.

cs.CL↗

On the Hodge and V-filtrations of mixed Hodge modules

In this paper, we prove a Beilinson-type formula for the V-filtration of Kashiwara and Malgrange on a complex mixed Hodge module, using Hodge filtrations on the localization. Our formula expresses the V-filtration as the filtered D-module underlying a pro-mixed Hodge module. We apply this to the theory of higher multiplier and Hodge ideals. Our first result shows that higher multiplier ideals can be obtained directly from Hodge ideals by taking a suitable limit. As a corollary, we deduce that Hodge ideals are left semi-continuous if and only if they coincide with higher multiplier ideals, thereby improving results of Saito and Mustaţă--Popa and resolving a folklore question. We further prove a birational transformation formula for higher multiplier ideals, generalising the classical formula for multiplier ideals and answering a question of Schnell and the second author. Finally, we provide very quick proofs of the main vanishing theorems for Hodge ideals, and strengthen a result of B. Chen.

math.AG↗

EndoFinder: Online Lesion Retrieval for Explainable Colorectal Polyp Diagnosis Leveraging Latent Scene Representations

Colorectal cancer (CRC) remains a leading cause of cancer-related mortality, underscoring the importance of timely polyp detection and diagnosis. While deep learning models have improved optical-assisted diagnostics, they often demand extensive labeled datasets and yield "black-box" outputs with limited interpretability. In this paper, we propose EndoFinder, an online polyp retrieval framework that leverages multi-view scene representations for explainable and scalable CRC diagnosis. First, we develop a Polyp-aware Image Encoder by combining contrastive learning and a reconstruction task, guided by polyp segmentation masks. This self-supervised approach captures robust features without relying on large-scale annotated data. Next, we treat each polyp as a three-dimensional "scene" and introduce a Scene Representation Transformer, which fuses multiple views of the polyp into a single latent representation. By discretizing this representation through a hashing layer, EndoFinder enables real-time retrieval from a compiled database of historical polyp cases, where diagnostic information serves as interpretable references for new queries. We evaluate EndoFinder on both public and newly collected polyp datasets for re-identification and pathology classification. Results show that EndoFinder outperforms existing methods in accuracy while providing transparent, retrieval-based insights for clinical decision-making. By contributing a novel dataset and a scalable, explainable framework, our work addresses key challenges in polyp diagnosis and offers a promising direction for more efficient AI-driven colonoscopy workflows. The source code is available at https://github.com/ku262/EndoFinder-Scene.

cs.IR↗

Endo-CLIP: Progressive Self-Supervised Pre-training on Raw Colonoscopy Records

Pre-training on image-text colonoscopy records offers substantial potential for improving endoscopic image analysis, but faces challenges including non-informative background images, complex medical terminology, and ambiguous multi-lesion descriptions. We introduce Endo-CLIP, a novel self-supervised framework that enhances Contrastive Language-Image Pre-training (CLIP) for this domain. Endo-CLIP's three-stage framework--cleansing, attunement, and unification--addresses these challenges by (1) removing background frames, (2) leveraging large language models to extract clinical attributes for fine-grained contrastive learning, and (3) employing patient-level cross-attention to resolve multi-polyp ambiguities. Extensive experiments demonstrate that Endo-CLIP significantly outperforms state-of-the-art pre-training methods in zero-shot and few-shot polyp detection and classification, paving the way for more accurate and clinically relevant endoscopic analysis.

cs.CV↗

Generating Editable Head Avatars with 3D Gaussian GANs

Generating animatable and editable 3D head avatars is essential for various applications in computer vision and graphics. Traditional 3D-aware generative adversarial networks (GANs), often using implicit fields like Neural Radiance Fields (NeRF), achieve photorealistic and view-consistent 3D head synthesis. However, these methods face limitations in deformation flexibility and editability, hindering the creation of lifelike and easily modifiable 3D heads. We propose a novel approach that enhances the editability and animation control of 3D head avatars by incorporating 3D Gaussian Splatting (3DGS) as an explicit 3D representation. This method enables easier illumination control and improved editability. Central to our approach is the Editable Gaussian Head (EG-Head) model, which combines a 3D Morphable Model (3DMM) with texture maps, allowing precise expression control and flexible texture editing for accurate animation while preserving identity. To capture complex non-facial geometries like hair, we use an auxiliary set of 3DGS and tri-plane features. Extensive experiments demonstrate that our approach delivers high-quality 3D-aware synthesis with state-of-the-art controllability. Our code and models are available at https://github.com/liguohao96/EGG3D.

cs.CV↗

AED-PADA:Improving Generalizability of Adversarial Example Detection via Principal Adversarial Domain Adaptation

Adversarial example detection, which can be conveniently applied in many scenarios, is important in the area of adversarial defense. Unfortunately, existing detection methods suffer from poor generalization performance, because their training process usually relies on the examples generated from a single known adversarial attack and there exists a large discrepancy between the training and unseen testing adversarial examples. To address this issue, we propose a novel method, named Adversarial Example Detection via Principal Adversarial Domain Adaptation (AED-PADA). Specifically, our approach identifies the Principal Adversarial Domains (PADs), i.e., a combination of features of the adversarial examples generated by different attacks, which possesses a large portion of the entire adversarial feature space. Subsequently, we pioneer to exploit Multi-source Unsupervised Domain Adaptation in adversarial example detection, with PADs as the source domains. Experimental results demonstrate the superior generalization ability of our proposed AED-PADA. Note that this superiority is particularly achieved in challenging scenarios characterized by employing the minimal magnitude constraint for the perturbations.

cs.CV↗

A log resolution for the theta divisor of a hyperelliptic curve

In this paper, we prove that the theta divisor of a smooth hyperelliptic curve has a natural and explicit embedded resolution of singularities using iterated blowups of Brill-Noether subvarieties. We also show that the Brill-Noether stratification of the hyperelliptic Jacobian is a Whitney stratification.

math.AG↗

Multi-modal Relation Distillation for Unified 3D Representation Learning

Recent advancements in multi-modal pre-training for 3D point clouds have demonstrated promising results by aligning heterogeneous features across 3D shapes and their corresponding 2D images and language descriptions. However, current straightforward solutions often overlook intricate structural relations among samples, potentially limiting the full capabilities of multi-modal learning. To address this issue, we introduce Multi-modal Relation Distillation (MRD), a tri-modal pre-training framework, which is designed to effectively distill reputable large Vision-Language Models (VLM) into 3D backbones. MRD aims to capture both intra-relations within each modality as well as cross-relations between different modalities and produce more discriminative 3D shape representations. Notably, MRD achieves significant improvements in downstream zero-shot classification tasks and cross-modality retrieval tasks, delivering new state-of-the-art performance.

cs.CV↗