arXiv subjects

Xiaoli Li

Publications and source records attributed to Xiaoli Li.

At least 19 recordsLinked to original sources

arXiv2026

Optimal Error Estimates With Polynomial Dependence on $ε^{-1}$ for Mixed Finite Element Methods of the Cahn-Hilliard-Navier-Stokes System

In this paper, we analyze a first-order convex-splitting mixed finite element scheme for the Cahn--Hilliard--Navier--Stokes system, tracking explicitly how the error constants depend on the interface width $ε$. Due to the strong nonlinear coupling inherent in the CHNS system and the singular dependence of the Cahn--Hilliard equation on $ε$, conventional energy-based analyzes often lead to severe dependence of the error constants on $ε^{-1}$, and may even result in exponential growth. Such dependence significantly limits the applicability of the resulting error estimates in the small-interfacial-thickness regime. To overcome this difficulty, we develop a robust parameter error analysis framework with respect to interfacial thickness $ε$. In particular, by introducing $H^{-1}$ approximation properties for the Ritz projection and the Ritz and Stokes quasi-projection operators, together with spectral-type estimates for the discrete perturbed Cahn--Hilliard operator, we effectively control the singular terms arising from the interfacial thickness parameter in the error analysis. Compared with the classical results, which address only the Allen-Cahn or Cahn-Hilliard equation, we adopt a three-term discrete Gagliardo-Nirenberg inequality analysis technique and achieve a substantial reduction in the degree of polynomial dependence for the coupled system. Numerical experiments are presented to verify the effectiveness of the theoretical results and to demonstrate the robustness of the method for different parameters of interfacial thickness.

math.NA↗

arXiv2026

Generative Semi-supervised Graph Anomaly Detection

This work considers a practical semi-supervised graph anomaly detection (GAD) scenario, where part of the nodes in a graph are known to be normal, contrasting to the extensively explored unsupervised setting with a fully unlabeled graph. We reveal that having access to the normal nodes, even just a small percentage of normal nodes, helps enhance the detection performance of existing unsupervised GAD methods when they are adapted to the semi-supervised setting. However, their utilization of these normal nodes is limited. In this paper, we propose a novel Generative GAD approach (namely GGAD) for the semi-supervised scenario to better exploit the normal nodes. The key idea is to generate pseudo anomaly nodes, referred to as 'outlier nodes', for providing effective negative node samples in training a discriminative one-class classifier. The main challenge here lies in the lack of ground truth information about real anomaly nodes. To address this challenge, GGAD is designed to leverage two important priors about the anomaly nodes -- asymmetric local affinity and egocentric closeness -- to generate reliable outlier nodes that assimilate anomaly nodes in both graph structure and feature representations. Comprehensive experiments on six real-world GAD datasets are performed to establish a benchmark for semi-supervised GAD and show that GGAD substantially outperforms state-of-the-art unsupervised and semi-supervised GAD methods with varying numbers of training normal nodes. Code will be made available at https://github.com/mala-lab/GGAD.

cs.LG↗

arXiv2026

Exact Tail Laws for Nonlinear SGD with Infinite-Variance Gradients

With infinite-variance gradient noise, SGD can have infinite expected excess objective even when most iterates are close to the optimum. We characterize its accuracy through exact first-order tail probabilities for the last iterate of nonlinear, constant-stepsize SGD. For regularly varying innovations of index $t\in(1,2)$, the leading measure transports one large gradient shock through the local Hessian flow. This is the same measure that governs the central stable Ornstein--Uhlenbeck limit; we prove its relative accuracy at shrinking tolerances above the central scale, with state-dependent noise and a growing observation horizon. The admissible window is nonempty for every available gradient moment $p>1$. The main technical step is a moment bound at the central fluctuation scale and a lower-moment control of the nonlinear error. The result yields explicit projection and excess-objective tails, extreme quantiles, and a factor $b^{1-t}$ for fixed batch size $b$. For affine population gradients, a sharper comparison gives the same law at fixed tolerances, including random sample Hessians. Coupled simulations in dimensions one to one hundred examine relative calibration, objective quantiles, batch effects, and the error due to random curvature.

math.ST↗

arXiv2026

A unified framework of energy-stable splitting exponential integrators for damped Hamiltonian systems

In this work, we study long-time numerical integration of Hamiltonian systems subject to linear perturbations. We assume the energy-compatible linear-damping condition, which ensures that the physical energy is nonincreasing along the linear damping subflow. Since the conservative and dissipative effects cannot always be merged into a single gradient-structured dissipation and classical energy-stable methods developed for gradient flows cannot directly extend to this setting, we propose a unified framework of two efficient and energy-stable splitting exponential integrators (SEI) to separately handle the dissipative and conservative parts: SEISAV (SEI based on the scalar auxiliary variable) and SEILM (SEI based on Lagrange multiplier). The SEISAV scheme composes the exact damping subflow with an exponential integrator based on the SAV update for the Hamiltonian subflow and requires solving only a scalar linear equation at each time step. We prove a discrete modified-energy dissipation law for SEISAV that mirrors the continuous energy-dissipation mechanism. To enforce decay of the original energy rather than a modified one, we further develop SEILM by incorporating a Lagrange-multiplier formulation within the splitting exponential framework, leading to solving only a scalar nonlinear equation at each time step. Numerical experiments on representative linearly damped Hamiltonian models confirm the designed second-order accuracy, energy stability, and competitive efficiency relative to state-of-the-art schemes, indicating that the proposed framework provides a simple and robust approach for simulating linearly perturbed Hamiltonian dynamics.

math.NA↗

arXiv2026

Moment-Accurate Gaussian Mixtures for Constant-Step Stochastic Approximation

Local Gaussian models of constant-step learning predict output variability and expected losses, but weak convergence alone does not justify these moment predictions. We establish moment-accurate Gaussian mixtures by matching stationary energy with local Ornstein--Uhlenbeck limits, ruling out quadratic tail mass invisible to weak convergence. For step size $a$, the second-order Wasserstein error is $o(\sqrt a)$, uniformly over invariant laws, using each law's actual root weights. The assumptions combine confinement, descent, finitely many hyperbolic equilibria and root continuity with finite-variance innovations. The result yields observable covariances, expected objective gaps and first-order mean shifts, while allowing singular covariances, compatible saddles and weights without a limit. For additive noise given by a fixed invertible transform of independent standardized Student $t_3$ coordinates, symmetry gives an order-sharp $\sqrt a$ smooth-test bound. Numerical transport calculations demonstrate the value of root-specific covariances; controlled SGD studies assess observable predictions across step sizes, batch sizes and model geometries.

stat.ML↗

arXiv2026

Gaussian Limits for SGD Without Stationary Moments

Temporal dependence can separate the Gaussian approximation of stochastic gradient descent from its stationary moments. For unmodified least-squares SGD, we construct a design with standard Gaussian marginals whose stationary error has every positive moment infinite. Independent observations with the same marginals instead give finite stationary variance. Both regimes retain a Gaussian small-step limit. Our general theory establishes pathwise contraction from a finite second design moment, then uses score cancellation and localization to obtain stationary Gaussian and Ornstein--Uhlenbeck limits. Independent Gaussian regression errors yield an exact conditional Gaussian law and total-variation convergence under the same design integrability. Stronger design conditions identify a positive first-order total-variation constant and a deterministic covariance correction with $o(a)$ error. A scalar coverage expansion translates this correction into its inference consequence. Experiments examine distributional error, coverage, and calibration with dependent scores. Together, these results establish precise probability-law approximation beyond moment-based stationary analysis.

stat.ML↗

arXiv2026

Several Accelerated and Stable Pseudo-Energy-Dissipative Lagrange Multiplier Methods based on Second-order Flow and Variable Splitting

Based on second-order inertial dynamics, we develop two accelerated Lagrange multiplier (LM)-based optimization methods: Linear LM-based second-order flow method and linear LM-based variable and operator splitting method for unconstrained non-convex optimization problems. Relaxed and adaptive variants of both methods are proposed to prevent degeneration of the Lagrange multiplier and to enable automatic adjustment of the time step size. Within the novel second-order LM-based optimization framework, the associated pseudo-energy functional is shown to dissipate monotonically along the iterative trajectory, and convergence of the generated iterates to stationary points is rigorously established. Extensive numerical experiments on function optimization and partial differential equation benchmark problems, including applications as optimizers for physics-informed neural networks (PINNs) and deep operator networks (DeepONets), demonstrate that the proposed methods effectively escape local minima, achieve high accuracy, and exhibit strong robustness with respect to the choice of the initial learning rate during neural network training.

math.OC↗

arXiv2026

HyperReCo: Retrieving and Connecting Evidence with Hypergraph Neural Networks for LLM Multi-hop Reasoning

Large language models (LLMs) have shown strong capabilities, with retrieval-augmented generation (RAG) supporting complex multi-hop reasoning by retrieving evidence distributed across documents. Graph-based approaches exploit connections among evidence, and hypergraph-based retrieval further preserves higher-order entity associations within documents and connects documents through shared entities. However, existing hypergraph retrievers often rely on predefined structural expansion or diffusion, which may miss query-dependent interactions needed to identify relevant evidence. They also leave connections among retrieved evidence implicit, requiring LLMs to reconstruct these connections before reasoning. Therefore, we propose HyperReCo, a framework for retrieving and connecting evidence with a hypergraph neural network (HyperGNN). We represent each document as a hyperedge over its extracted entities, with shared entities connecting the hyperedges. Through hypergraph message passing with joint supervision over documents and entities, the HyperGNN learns query-dependent interactions to retrieve complementary evidence. We further introduce Gradient-Guided Hyper-Path Decoding (GGHD), which uses gradient attribution to interpret the learned interactions and translate them into explicit hyper-paths that help LLMs combine complementary facts for multi-hop reasoning. Experiments on six benchmarks show that HyperReCo achieves the best retrieval performance among the compared methods on all three multi-hop QA datasets, together with strong downstream QA performance. Case studies and further analyses demonstrate the utility of decoded hyper-paths for connecting retrieved evidence.

cs.AI↗

arXiv2026

A linear mass-lumped finite element method for the Landau-Lifshitz-Gilbert equation: unconditional energy dissipation and length preservation

We develop a linear, unconditionally energy-dissipative, mass-lumped finite element method for the highly nonlinear Landau--Lifshitz--Gilbert (LLG) equation on quasi-uniform triangular meshes. The method is built on a projection strategy for enforcing the nonconvex pointwise constraint $|\mathbf{m}| = 1$, whose simultaneous preservation with unconditional energy stability remains challenging for standard finite element discretizations. The key innovation is a unified hybrid finite element-finite difference framework that underlies both the design and the analysis of the proposed method. In the scheme construction, we exploit the weak formulation and nodal structure of mass-lumped finite element method, while incorporating suitable interpolation operators and a node-wise length-preserving mechanism inspired by finite difference discretizations. This combination yields a linear scheme that preserves the node-wise unit-length constraint and satisfies a discrete energy dissipation law. The same hybrid framework also plays a central role in the error analysis, where the weak formulation and quasi-uniform mesh structure of finite elements are combined with interpolation-based and nodewise finite difference method to control the strongly nonlinear damping term and to establish an optimal-order error estimate. More importantly, the proposed method provides a unified framework that systematically integrates the geometric flexibility of finite element method with the pointwise constraint-preserving property of finite difference method, and thus offers a general strategy for designing and analyzing structure-preserving discretizations of constrained dissipative systems. Numerical experiments, including a classical blow-up simulation, confirm the predicted accuracy, energy dissipation, and robustness of the method.

math.NA↗

arXiv2026

Stability and error analysis of fully discrete original energy-dissipative and length-preserving scheme for the Landau-Lifshitz-Gilbert equation

The Landau-Lifshitz-Gilbert (LLG) equation, regarded as a gradient flow with manifold constraint, is the fundamental model describing magnetization dynamics in ferromagnetic materials. It is well known that the normalized tangent plane method is able to simultaneously achieve the non-convex manifold constraint and original energy dissipation. However, the associated computational cost of this numerical approach is exceedingly high. By contrast, the projection method is more straightforward to implement, while it often compromises the inherent energy dissipative property of the continuous model, and the error analysis turns out to be even more challenging. In this work, we first construct a linear and fully discrete finite difference numerical scheme, based on the projection method for the LLG equation, which is capable of simultaneously preserving the non-convex manifold constraint $|\mathbf{m}| = 1$ and an unconditional original energy dissipation. In the error analysis, the classical theoretical technique becomes ineffective, due to the presence of the nonlinear Laplacian term, which in turn poses a significant challenge. To overcome this subtle difficulty, we carefully rewrite the numerical method in an equivalent weak form, in which a point-wise length preserving feature of the numerical solution plays an essential role. As a result of these estimates in the reformulated weak form, an optimal convergence rate could be theoretically established. In our knowledge, this numerical method is the first linear algorithm that preserves the following combined theoretical properties: (i) point-wise length preservation, (ii) unconditional original energy dissipation, (iii) a theoretical justification of convergence analysis and optimal rate error estimate.

math.NA↗

arXiv2026

Beyond Factual Accuracy: Evaluating Global Reasoning Integrity in RAG Systems with LogicScore

Current evaluation methods for Retrieval Augmented Generation (RAG) suffer from \textit{factual myopia}: they relentlessly emphasize factual accuracy yet neglect global logical integrity in long-form answer generation. This drives models to force unnatural connections, producing factually grounded yet logically incoherent responses with unaddressed gaps, ambiguous links, or redundant premises. To mitigate this, we present \textsc{LogicScore}, shifting from local, fact-by-fact assessment to rigorous global reasoning scrutiny. Grounded in Horn Rules, our approach integrates a backward verification mechanism to systematically evaluate three key reasoning dimensions: \textit{Completeness} (logically sound deduction), \textit{Essentiality} (non-redundancy), and \textit{Determinateness} (consistent answer entailment). Extensive experiments across three multi-hop QA datasets (HotpotQA, MusiQue, and 2WikiMultiHopQA) and over 20 LLMs (including GPT-5, Gemini-3-Pro, LLaMA3, and task-specific tuned models) reveal a critical capability gap: leading models often achieve high factual accuracy (e.g., 92.85\% precision for Gemini-3 Pro) but struggle with global reasoning quality (e.g., 35.11\% Essentiality for Gemini-3 Pro). Our work establishes a robust standard for logical evaluation, highlighting the need to prioritize reasoning coherence alongside factual grounding in LLM development.

cs.CL↗

arXiv2026

RobustMAD: Evaluating Real-World Robustness of Multimodal Small Language Models for Deployable Anomaly Detection Assistants

Multimodal industrial anomaly inspection assistants are a critical component of next-generation smart factories, enabling interactive vision-language-based querying. However, multimodal large language models remain impractical for on-site deployment due to prohibitive computational demands and privacy risks from cloud-based inference. Compact multimodal small language models (MSLMs) offer a deployable alternative, yet progress is constrained by the lack of comprehensive robustness analyses and meaningfully challenging benchmarks that reflect real-world industrial conditions. To address this gap, we develop RobustMAD, the first deployment-motivated benchmark, designed to comprehensively evaluate model robustness through diverse open-ended queries spanning object understanding, anomaly detection, unanswerable problems, and visual quality degradations. Contrary to conventional assumptions, top-performing MSLMs exhibit promising capabilities, surprisingly outperforming even the larger GPT-5 Nano. However, they still fall short of safety-critical requirements, and RobustMAD reveals critical robustness gaps that pose operational risks. In particular, three recurring failure modes emerge: (i) fragile multimodal grounding under fine-grained distinctions or degraded visual conditions, (ii) insufficiently comprehensive responses, and (iii) weak logical grounding on unanswerable or ill-posed queries, leading to hallucinated outputs. Grounded in these insights, we provide actionable guidance for the design of next-generation multimodal industrial inspection assistants that leverage their promising competence. Code is available at https://github.com/en-research/RobustMAD.

cs.LG↗

arXiv2026

A Comprehensive Survey on World Models for Embodied AI

Embodied AI requires agents that perceive, act, and anticipate how actions reshape future world states. World models serve as internal simulators that capture environment dynamics, enabling forward and counterfactual rollouts to support perception, prediction, and decision making. This survey presents a unified framework for world models in embodied AI. Specifically, we formalize the problem setting and learning objectives, and propose a three-axis taxonomy encompassing: (1) Functionality, Decision-Coupled vs. General-Purpose; (2) Temporal Modeling, Sequential Simulation and Inference vs. Global Difference Prediction; (3) Spatial Representation, Global Latent Vector, Token Feature Sequence, Spatial Latent Grid, and Decomposed Rendering Representation. We systematize data resources and metrics across robotics, autonomous driving, and general video settings, covering pixel prediction quality, state-level understanding, and task performance. Furthermore, we offer a quantitative comparison of state-of-the-art models and distill key open challenges, including the scarcity of unified datasets and the need for evaluation metrics that assess physical consistency over pixel fidelity, the trade-off between model performance and the computational efficiency required for real-time control, and the core modeling difficulty of achieving long-horizon temporal consistency while mitigating error accumulation. Finally, we maintain a curated bibliography at https://github.com/Li-Zn-H/AwesomeWorldModels.

cs.CV↗

arXiv2026

A new class of efficient linear higher-order schemes for the Landau-Lifshitz-Gilbert equation with reduced restriction on the damping parameter

Classical high-order backward differentiation formula (BDF) methods for the Landau-Lifshitz-Gilbert (LLG) equation often suffer from restrictive stability constraints, requiring small time steps and imposing stringent lower bounds on the damping parameter. These limitations become particularly severe for schemes of order higher than three. In this paper, we develop a class of high-order generalized BDF (GBDF) schemes for the LLG equation, including both semi-implicit and fully explicit treatments of the gyromagnetic term. The proposed schemes significantly improve stability properties and substantially relax the damping parameter constraints, but introduce essential difficulty in its analysis compared to the classical BDF schemes. We construct a novel multiplier which enables us to carry out a energy-based error analysis. This approach yields optimal-order error estimates under considerably weaker assumptions on the damping parameter than those required for classical BDF schemes. Numerical experiments are presented to confirm the theoretical results, and demonstrate that the proposed GBDF schemes achieve higher accuracy, enhanced stability, and much wider admissible damping regimes compared to classical high-order BDF methods.

math.NA↗

arXiv2026

Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook

Temporal data, including time series and spatio-temporal data, are pervasive in real-world applications. Generated in massive volumes by physical and virtual sensors, they record dynamic system behaviors and enable a wide range of downstream tasks. Effectively analyzing such data is crucial to unlocking their rich information content. Recent advances in large language models and other foundation models have accelerated their use in time series and spatio-temporal data mining. These approaches not only improve pattern recognition and reasoning across diverse domains but also support progress toward artificial general intelligence that can understand and process temporal data. In this survey, we present a comprehensive, up-to-date review of large models tailored or adapted for time series and spatio-temporal data along four dimensions: data types, model categories, model scopes, and application areas/tasks. We organize existing work into two main groups: large models for time series analysis (LM4TS) and for spatio-temporal data mining (LM4STD), and further distinguish general-purpose from domain-specific models. We also curate related resources, including datasets, model implementations, and tools, organized by major application areas. Overall, this survey consolidates recent advances and highlights foundations, applications, resources, and open research opportunities in large model-centric temporal data analysis.

cs.LG↗

arXiv2026

InA-Probe: Instruction-Aware Active Probing for Time Series Forecasting with LLMs

Large Language Models (LLMs) have recently demonstrated impressive potential for time series forecasting. However, existing methods predominantly rely on passive modality alignment or static task reprogramming, which often fail to capture fine-grained, non-stationary temporal patterns or to adapt to nuanced task intents. In this paper, we propose Instruction-aware Active Probing (InA-Probe), which shifts the paradigm from passive alignment toward an active, instruction-driven probing mechanism. Specifically, we design a Multi-Level Instruction Injection mechanism that enriches the model with both global task objectives and fine-grained, patch-level semantic priors. Building on this, an Adaptive Query Generation module produces sample-specific probes that are dynamically modulated by the temporal context. These probes are then refined through a dual-stage attention process: they first internalize task-specific intents via Instruction-Aware Self-Attention, and subsequently interrogate the projected temporal representations through Temporal Cross-Attention to extract salient patterns. Comprehensive experiments on seven real-world benchmarks show that InA-Probe consistently outperforms state-of-the-art deep learning and LLM-based baselines, excelling in both one-for-all generalization and zero-shot transfer while reducing forecasting error by up to 37\% in challenging cross-domain scenarios. Ablation studies further confirm that the synergy between adaptive querying and fine-grained instructions is key to unlocking the reasoning power of LLMs for complex time series.

cs.AI↗

arXiv2026

Physically-Constrained Mamba-SDE for Remaining Useful Life Prediction under Irregular Observations

Accurate Remaining Useful Life prediction is critical for industrial predictive maintenance. However, real-world deployment is challenging due to the irregular nature of sensor observations, characterized by asynchronous sampling, burst missingness, and temporal jitter. Compounding this issue, purely data-driven models often generate physically implausible degradation trajectories that violate the irreversible nature of damage accumulation. To address this, we propose PC-MambaSDE, a unified continuous-time framework for robust RUL prediction under irregular observations. Specifically, we design a Mask-Aware Continuous Mamba Encoder that explicitly leverages observation masks to extract context-rich control signals. Furthermore, we introduce a Physics-Guided Latent SDE with parametrically rectified hybrid drift, superimposing a global physical bias to enforce monotonic degradation even amid severe observation gaps. Additionally, we formulate RUL prediction as a boundary value problem via a Terminal Degradation Penalty, which decouples a Health Index dimension and applies a penalty loss to guide trajectories toward the failure state. Theoretically, we prove that our variational objective is mathematically equivalent to minimizing the KL divergence via Girsanov's theorem, and we guarantee the global asymptotic stability of the learned dynamics through Lyapunov analysis. To enable rigorous evaluation, we develop a Hybrid Irregularity Generation Scheme that simulates realistic industrial imperfections. Extensive experiments on public benchmarks demonstrate that PC-MambaSDE significantly outperforms state-of-the-art methods, particularly under extreme observation scarcity, validating the efficacy of embedding physical priors into continuous-time latent dynamics.

cs.AI↗

arXiv2026

A unified framework of fully decoupled, bound-preserving and energy-dissipative schemes for two-phase flow in porous media

Developing high-order numerical schemes for two-phase flow in porous media that preserve key physical properties remains a significant challenge in numerical analysis. In this article, we propose a general framework to construct fully discrete first- and second-order numerical schemes for thermodynamically consistent model of incompressible and immiscible two-phase flow in porous media. The proposed schemes are rigorously proved to ensure five fundamental properties: (i) unique solvability; (ii) full decoupling; (iii) bound preservation for both phases; (iv) original energy dissipation; (v) local mass conservation for both phases. The key to ensure the unique solvability lies in guaranteeing the strict convexity of the discrete energy functionals associated with the constructed schemes. Departing from the coupled solution approach for the pressure and saturation variables, the proposed approach breaks traditional paradigm by subtracting the two-phase mass conservation equations to derive a fully decoupled system. In addition, the bound-preserving property for both phases is established by leveraging the singular nature of the logarithmic term around the limit values of $0$ and $1$. A rigorous error estimate for the first-order scheme, in the $\ell^{\infty}(0,T; H_h^{-1} (Ω)) \cap \ell^{2}(0,T; \ell^2(Ω))$ norm for the saturations of two phases, is established. Finally, various numerical examples are presented to verify the theoretical results and demonstrate the efficiency of the proposed schemes.

math.NA↗