arXiv subjects

Bin Shi

Publications and source records attributed to Bin Shi.

At least 19 recordsLinked to original sources

arXiv2026

Numerical Construction of Quasi-Periodic Solutions for Nonlinear PDEs: II. Unbounded Perturbation

Many nonlinear partial differential equations (PDEs) arising in physical models involve unbounded perturbations, where nonlinear terms contain spatial derivatives. Such perturbations can be expressed as compositions of unbounded operators with bounded nonlinear maps. In this paper, we propose alternating numerical schemes for constructing quasi-periodic solutions to this class of PDEs, including the nonlinear acoustic wave (NLAW) equation and the Korteweg-de Vries (KdV) equation. To render the nonlinear perturbations bounded, we apply inverse differential operators as a preconditioning; this, however, also rescales the linear part by polynomial factors in the spatial mode $n$. Two main difficulties arise. The first is to control the measure of the resulting ``bad'' frequencies, since the bounds on the measures of the excluded frequency sets are enlarged by polynomial factors in $n$; we show that this measure nevertheless remains small. The second concerns resonances involving the perturbed eigenvalues of the linearized operator at large scales. Our key observation is that, when the dispersive frequencies grow polynomially in $n$ with degree greater than one, such resonances cannot occur if the magnitude of the temporal index lies below a threshold proportional to $|n|$ raised to one less than that degree. It therefore suffices to consider the complementary regime, in which the growth induced by the unbounded perturbation can be controlled in terms of the temporal index. At large scales, an additional complication arises: for a given spatial index $n$, all temporal indices in a box may be ``bad''. We show, however, that at each scale there is at most one such spatial index. Consequently, the resulting counting loss is only polynomial and can be absorbed into the exponential-logarithmic threshold, allowing us once again to retain control over the measures of the excluded frequency sets.

math.NA↗

arXiv2026

Label Ensemble Perspective for Reduced-Complexity Graph Node Classification under Label Noise

Graph Neural Networks (GNNs) have been widely employed for semi-supervised node classification tasks on graphs. However, the performance of GNNs is significantly affected by \emph{label noise}, that is, a small amount of incorrectly labeled nodes can substantially misguide model training. Mainstream solutions define node classification with label noise (NCLN) as a reliable labeling task, often introducing node similarity with quadratic computational complexity to more accurately assess label reliability. To this end, in this paper, we introduce the Label Ensemble Graph Neural Network (LEGNN), a lower complexity method for robust GNNs training against label noise. LEGNN reframes NCLN as a label ensemble task, gathering informative multiple labels instead of constructing a single reliable label, avoiding high-complexity computations for reliability assessment. Specifically, LEGNN conducts a two-step process: bootstrapping neighboring contexts and robust learning with gathered multiple labels. In the former step, we apply random neighbor masks for each node and gather the predicted labels as a high-probability label set. This mitigates the impact of inaccurately labeled neighbors and diversifies the label set. In the latter step, we utilize a partial label learning based strategy to aggregate the high-probability label information for model training. Additionally, we symmetrically gather a low-probability label set to counteract potential noise from the high-probability label set. Extensive experiments on six datasets demonstrate that LEGNN achieves strong classification performance while maintaining computational efficiency. Moreover, it exhibits good scalability on datasets with over one hundred thousand nodes and one million edges.

cs.LG↗

arXiv2026

Memory as Belief: Bayesian Evolution of Memory for Self-Evolving LLM Agents

Large language model (LLM) agents increasingly rely on external memory to accumulate past experiences for continual adaptation. However, effectively reusing memory requires accurately assessing its value, as retrieved experiences may become unreliable when transferred across task contexts. Despite its importance, memory valuation remains largely underexplored, with existing methods relying on historical retrieval success rates that overlook the context dependency of memory usefulness and the varying reliability of estimates under different amounts of evidence. Inspired by the Bayesian brain hypothesis, we propose BEAM (Bayesian-style Evolutionary Agentic Memory), a framework that reformulates memory value evaluation as a parameterized cognitive inference process, where memory value is represented as a context-conditioned dynamic belief rather than a passive historical statistic. Specifically, BEAM infers memory value beliefs from current task contexts and continuously calibrates them using execution feedback as empirical evidence, transforming memory from passive storage into an adaptive cognitive mechanism for continual self-evolution. Extensive experiments across reasoning and code generation benchmarks demonstrate that BEAM consistently improves memory utilization and enables continual self-evolution of LLM agents.

cs.LG↗

arXiv2026

When Should Agents Check External State? Budgeting Observations for Stored Intentions

Prospective memory allows an agent to retain an intention tied to a future condition, but the stored intention does not reveal whether that condition currently holds. Checking it may require web access, multi-step tool use, and paid calls. Existing systems decide when intentions require attention, but do not allocate the resulting observations under a shared budget. We introduce the first resource-allocation formulation for the external observations required by stored intentions under a shared episode budget. BudgetPM offers two policy variants that share a hard-budget executor. BudgetPM-Static uses a lightweight Logistic scorer to learn whether a check improves the current decision. BudgetPM-Sequential distills full-episode hindsight schedules into a lightweight policy that decides when to spend or reserve capacity using only pre-query information at deployment. We evaluate BudgetPM against two public memory-agent systems, five matched controls, and four hand-designed monitoring or budget-adaptation rules. Across two benchmarks and three backbones, BudgetPM-Static outperforms adapted Mem0 and PMA workflows. On PM-Bench, its Logistic scorer reaches competitive quality--cost operating points alongside higher-capacity scorers and retains 99.9--100\% of unconstrained quality with 42--54\% fewer observations. Under severe scarcity and the same hard caps, BudgetPM-Sequential exceeds the strongest tested natural monitoring schedule by 1.92--2.58 Set F1 points. It reaches the same Set F1 and on-time recall with 16--33\% fewer observations. Matched attribution, exact-cost analysis, and a fixed-budget load intervention link this gain to competition between present and future opportunities. These results yield a demand--capacity design rule: local gating works when capacity covers demand, while future-aware supervision adds value when observations compete across time.

cs.AI↗

arXiv2026

Teaching MLP More Graph Information: A Three-stage Multitask Knowledge Distillation Framework

We study the challenging problem for inference tasks on large-scale graph datasets of Graph Neural Networks: huge time and memory consumption, and try to overcome it by reducing reliance on graph structure. Even though distilling graph knowledge to student MLP is an excellent idea, it faces two major problems of positional information loss and low generalization. To solve the problems, we propose a new three-stage multitask distillation framework. In detail, we use Positional Encoding to capture positional information. Also, we introduce Neural Heat Kernels responsible for graph data processing in GNN and utilize hidden layer outputs matching for better performance of student MLP's hidden layers. To the best of our knowledge, it is the first work to include hidden layer distillation for student MLP on graphs and to combine graph Positional Encoding with MLP. We test its performance and robustness with several settings and draw the conclusion that our work can outperform well with good stability. Code implementation is in https://github.com/lijunxian111/KMP.

cs.LG↗

arXiv2026

DecepEval: A Benchmark for Evaluating Deception in LLM Agents

As large language model (LLM) agents become increasingly autonomous, they may pursue task performance through deception, raising concerns about their reliable deployment. Existing evaluations show that LLM agents can deceive, but often examine isolated scenarios or narrowly defined conditions, limiting systematic understanding of when deception becomes more likely. To address this gap, we introduce DecepEval, a benchmark comprising 1,532 instances across 3 task families and 28 professional scenarios. Drawing on classical fraud theories, we propose the LLM Deception Diamond framework, which characterizes four external conditions that may induce deception: pressure, incentive, opportunity, and conflict. DecepEval pairs neutral and induced versions of each instance to measure condition-dependent changes in deception rates, while explicit task facts and observable agent behavior help distinguish deception from capability-related errors. Evaluations of nine frontier LLMs show that inducements increase deception across models and task families, even among models with low baseline deception rates. DecepEval makes these vulnerabilities measurable, providing a shared benchmark for progress toward trustworthy artificial intelligence.

cs.LG↗

arXiv2026

Numerical Construction of Quasi-Periodic Solutions for Nonlinear PDEs: I. Bounded Perturbation

In this paper, we propose an alternating numerical scheme for constructing quasi-periodic solutions to a class of nonlinear partial differential equations (PDEs) with bounded perturbations, including the one-dimensional nonlinear Schrödinger (NLS) equations and nonlinear wave (NLW) equations under periodic and Dirichlet boundary conditions. A key observation concerning the resonant $Q$-equations allows us to establish directly a local diffeomorphism between the amplitudes and the drifted frequencies. This renders the proof considerably cleaner, since it avoids the Birkhoff normal form and the associated coordinate transformations required in classical KAM theory for PDEs.Unlike in the finite-dimensional setting, the lattice boxes must also include the spatial index, so that the multiscale induction has to be carried out in one additional dimension. This introduces two difficulties. First, the measure estimate for the excluded set of ``bad'' frequencies must account for the spatial index. For both the NLS and NLW equations, the linear frequencies and their differences are integers or close to integers; this allows the spatial dependence to be controlled through the modulus of the temporal index, so that the excluded measure remains under control. Second, a singular set may contain sites with the same temporal index but widely separated spatial indices, which obstructs the ``inversion implies localization'' process. For the one-dimensional NLS and NLW equations, however, such sites occur only in pairs with opposite spatial indices. They can therefore be separated by small boxes, after which the global inverse is obtained from the local inverses via the resolvent identity. Numerical experiments illustrate the scheme for nonlinear traveling and standing waves, exhibiting both the computed quasi-periodic solutions and the convergence of the iteration.

math.NA↗

arXiv2026

Generalist Graph Anomaly Detection via Prototype-Based Distillation

Driven by the pressing demand for graph anomaly detection (GAD) in high-stakes domains, the generalist GAD paradigm, which trains a single detector transferable across new graphs, has recently gained growing attention. However, existing methods often rely on scarce and costly annotations for training and sometimes even require few-shot support at inference, which limits their robustness to diverse and unseen anomaly patterns. To address this limitation, we introduce ProMoS, the first unsupervised generalist GAD framework, which detects anomalies by modeling the abundant normality in unlabeled data. ProMoS adopts a knowledge-distillation paradigm to distill normality priors from a frozen self-supervised graph neural network (GNN) teacher to a mixture-of-students model with shared global and lightweight personalized branches, enabling efficient and expressive normality modeling without learning from scratch. We further propose prototype-guided soft-label distillation to align teacher and student in a shared prototype space, enhancing cross-graph generalizability. During inference, ProMoS performs zero-shot anomaly detection on unseen graphs via distillation bias and prototype geometric deviation. Extensive experiments show the effectiveness and efficiency of ProMoS, charting a practical path toward label-free, zero-shot generalist GAD.

cs.LG↗

arXiv2026

Cross-Relational Preference Learning for Better LLM Instruction Following

Large Language Models (LLMs) still exhibit limited capability in following complex instructions. While existing approaches often rely on preference learning to enhance this ability, they typically overlook the relationships between the permissible response spaces of different instructions, which restricts a model to align with subtle and diverse constraint variations. To address this, we propose Cross-Relational Preference Learning (CRPL), a novel framework for constructing preference data that explicitly models inter-instruction relationships through two key techniques: Cross-Relationship Perturbation and Cross-Region Pair Sampling. This enables the generation of more diverse preference data that captures a wide spectrum of constraint variations. Additionally, we introduce an atomic constraint-based verification mechanism to rigorously assess response satisfaction, ensuring high-quality preference pair construction. Extensive experiments across multiple preference learning methods (e.g., DPO, KTO), LLM backbones and four instruction-following benchmarks demonstrate that our approach achieves substantial improvements over prior baselines and exhibits strong generalization.

cs.AI↗

arXiv2026

The Most Dangerous Seed: Nonlinear Optimal Perturbations in Rayleigh-Taylor Instability

Long-term instabilities in astrophysical fluids are inherently nonlinear, where even small-amplitude perturbations can trigger dramatic instability. However, owing to the complex interactions among non-normal modes, the perturbation structures responsible for the greatest growth remain poorly understood. In this paper, we employ the nonlinear optimization method known as the conditional nonlinear optimal perturbation (CNOP) to identify the most dangerous initial velocity perturbation, i.e., the perturbation that maximizes the kinetic energy growth in the two-dimensional compressible Rayleigh-Taylor instability in astrophysical hydrodynamics. Compared with random perturbations, the optimal perturbation forms a coherent wave-packet structure localized around the density interface. We investigate its dependence on spatial resolution and optimization time horizon through two sets of numerical experiments. For a fixed optimization time, increasing the spatial resolution produces a more sharply localized wave packet, whereas for a fixed spatial resolution, increasing the optimization time causes the wave packet to become progressively more dispersed. Furthermore, we analyze the optimal perturbations in Fourier space using the fast Fourier transform (FFT), which provides a clearer characterization of the spectral distribution. Higher-resolution simulations concentrate most of the perturbation energy into only a few dominant modes, while longer optimization times distribute the energy over a broader range of modes. These results indicate that short optimization time horizons involve relatively weak modal interactions and remain closer to the linear regime, whereas longer optimization times enhance nonlinear modal interactions, broaden the spectral distribution, and reduce the predictive capability of linear stability theory.

astro-ph.GA↗

arXiv2026

Modern Theory of Gradient-Based Optimization

In this review, we offer a comprehensive survey of emerging techniques in gradient-based optimization, with a particular emphasis on the interplay between ordinary differential equation (ODE) perspectives and their extensions into discrete Lyapunov analysis. We begin by examining the acceleration mechanisms underlying Nesterov's accelerated gradient method for strongly convex functions (NAG-SC) and Polyak's heavy-ball method, identifying the gradient-correction term as the primary driver of acceleration. This mechanistic insight is substantiated through high-resolution ODE modeling and the systematic construction of Lyapunov functions. We then synthesize recent advancements in convex optimization regarding NAG and its proximal generalization, the fast iterative shrinkage-thresholding algorithm (FISTA). Key topics include the accelerated convergence of gradient norms, underdamped acceleration, linear convergence under strong convexity, and novel Lyapunov frameworks for establishing convergence and monotonicity properties of generalized accelerated methods. Furthermore, we demonstrate how these ODE approximations and Lyapunov techniques can be extended to provide a unified framework for analyzing advanced optimization algorithms, including the alternating direction method of multipliers (ADMM), the primal-dual hybrid gradient (PDHG) method, and their respective accelerated variants. Finally, we discuss recent progress in minimax optimization and outline future directions for extending Lyapunov-based analysis to saddle-point problems.

math.OC↗

arXiv2026

Accelerated Implicit GDA Schemes: Theoretical Guarantees and Application to Proximal Augmented Lagrangian Methods

Convex optimization problems with linear equality constraints arise ubiquitously in scientific computing, machine learning, and control theory. Classical Krylov methods are effective but rely on problem-specific preconditioners and high memory. Conversely, gradient-based methods like the augmented Lagrangian method (ALM) avoid these issues yet suffer from slow outer iterations. Developing accelerated outer-iteration schemes, therefore, remains a critical research objective. In this study, we demonstrate that incorporating a proximal operation into the augmented Lagrangian framework yields the proximal ALM, where the outer iteration is equivalent to an implicit gradient descent-ascent (GDA) scheme. We further establish that this equivalence extends naturally to the setting of variable step sizes. Through Lyapunov analysis, we show that the underlying potential function must be shifted from the conventional objective gap to a variational inequality measure, signaling a shift in perspective from pure convex optimization to minimax optimization. Motivated by these observations, we first develop an implicit GDA scheme with variable step sizes based on a continuous-time ODE framework, which achieves an $o(1/k)$ last-iterate convergence rate for both the primal-dual objective gap and the gradient norm. Building upon a second-order ODE framework, we then propose a family of Nesterov-type implicit GDA schemes parameterized by $r \geq 0$, which achieves an $o(1/k^{r+1})$ last-iterate convergence rate for the primal-dual objective gap. Furthermore, specializing the second-order ODE formulation to the case $r=0$, we derive a corresponding explicit GDA scheme and prove an $o(1/k)$ last-iterate convergence rate for the primal-dual objective gap. Finally, we present several numerical experiments to validate these theoretical results and demonstrate the effectiveness of the proposed methods.

math.OC↗

arXiv2026

Beyond Soft Masks: Hard-Perturbation Mixup Explainer for Robust GNN Explainability

Graph Neural Networks (GNNs) have demonstrated remarkable performance across a range of applications involving graph-structured data, particularly in high-stakes domains. However, the opaque nature of their decision-making processes limits their trustworthiness and broader adoption. Existing post-hoc explanation methods aim to improve explainability by identifying subgraphs that influence GNN predictions and adopt mixup strategies to alleviate the out-of-distribution (OOD) issue caused by using subgraphs for prediction. Yet, these approaches typically rely on soft masks, which are inherently unable to fully eliminate label-irrelevant information, allowing redundant structures to leak into the mixup process and hindering the resolution of the OOD problem, thereby degrading explanation fidelity. In this work, we propose HPME, a Hard-Perturbation Mixup Explanation framework grounded in a generalized Graph Information Bottleneck, which leverages graph pooling to extract discrete explanatory subgraphs and to yield an information-capacity bound to thoroughly compress label-irrelevant components. Furthermore, we introduce a novel mixup strategy built upon structure-level replacement, generating in-distribution explanations to effectively mitigate the distribution shift. Extensive experiments on diverse tasks demonstrate that HPME achieves state-of-the-art performance in generating robust and interpretable explanations across both synthetic and real-world datasets.

cs.LG↗

arXiv2026

TED: Related Party Transaction guided Tax Evasion Detection on Heterogeneous Graph

Tax evasion causes severe losses of government revenues and disturbs the economic order of fair competition. To help alleviate this problem, the latest tax evasion detection solutions utilize expert knowledge to extract features and then train classifiers to determine whether a company is suspected of tax evasion. However, existing solutions mainly focus on the statistical features of the company, but fail to exploit the rich interactive information in tax scenarios, which affect the detection performance. In this paper, we first model the tax scenario as a heterogeneous graph and study the tax evasion detection problem under the heterogeneous graph model. To improve the performance of tax evasion detection, a novel graph neural network model is proposed to extract the comprehensive information of heterogeneous graphs. Specifically, we use heterogeneous and complex related party transaction groups to filter low-level noise information. Moreover, a hierarchical attention mechanism is designed to capture the deeper structure and semantic information hidden in the related party transaction group. We apply our method to the real risk management system of the tax bureau, and evaluate it on two human-labeled real-world tax datasets. The results demonstrate that our method significantly outperforms the state-of-the-art in the tax evasion detection task.

cs.LG↗

arXiv2026

Learning Dynamic Graph Representations through Timespan View Contrasts

The rich information underlying graphs has inspired further investigation of unsupervised graph representation. Existing studies mainly depend on node features and topological properties within static graphs to create self-supervised signals, neglecting the temporal components carried by real-world graph data, such as timestamps of edges. To overcome this limitation, this paper explores how to model temporal evolution on dynamic graphs elegantly. Specifically, we introduce a new inductive bias, namely temporal translation invariance, which illustrates the tendency of the identical node to keep similar labels across different timespans. Based on this assumption, we develop a dynamic graph representation framework CLDG that encourages the node to maintain locally consistent temporal translation invariance through contrastive learning on different timespans. Except for standard CLDG which only considers explicit topological links, our further proposed CLDG++ additionally employs graph diffusion to uncover global contextual correlations between nodes, and designs a multi-scale contrastive learning objective composed of local-local, local-global, and global-global contrasts to enhance representation capabilities. Interestingly, by measuring the consistency between different timespans to shape anomaly indicators, CLDG and CLDG++ are seamlessly integrated with the task of spotting anomalies on dynamic graphs, which has broad applications in many high-impact domains, such as finance, cybersecurity, and healthcare. Experiments demonstrate that CLDG and CLDG++ both exhibit desirable performance in downstream tasks including node classification and dynamic graph anomaly detection. Moreover, CLDG significantly reduces time and space complexity by implicitly exploiting temporal cues instead of complicated sequence models.

cs.LG↗

arXiv2026

Numerical Construction of Elliptic Lower-Dimensional Quasi-Periodic Solutions with a Priori Bound

A numerical framework for constructing full-dimensional quasi-periodic solutions in nearly integrable systems was recently developed by Fu and Shi[2026]. Based on an alternating scheme, this approach effectively overcomes the secular drift in angle variables, a fundamental limitation of symplectic integrators. However, in many applications, such as the restricted three-body problem, lower-dimensional quasi-periodic solutions hold greater significance. The construction of these solutions is considerably more challenging due to the presence of normal frequencies, leading to intricate resonance phenomena. Beyond the subspace resonance, one must also account for the first and second Melnikov conditions to eliminate small divisors. In this study, we extend the proposed alternating numerical scheme to compute the elliptic lower-dimensional quasi-periodic solutions. Numerical experiments are presented for the Hénon-Heiles model and the Fermi--Pasta--Ulam (FPU) model, demonstrating the effectiveness of the proposed method. Furthermore, we emphasize that the perturbation is not merely a polynomial with real coefficients but is a real-valued function. As a result, the associated perturbation operator exhibits Gevrey decay without possessing a Hankel structure. Meanwhile, we further simplify the multi-scale analysis by exploiting the resolvent identity, showing that the global inverse can be expressed linearly in terms of local inverses via the gluing procedure. This representation reveals a regime-dependent interaction structure: weak interactions dominate at short range, while strong interactions emerge at long range. This balance ensures that the Gevrey decay of the inverse remains uniformly controlled. Moreover, within this linear representation, the inversion conditions provide a clearer characterization of the localization properties.

math.NA↗

arXiv2026

Parameter-Efficient Fine-Tuning for Medical Text Summarization: A Comparative Study of Lora, Prompt Tuning, and Full Fine-Tuning

Fine-tuning large language models for domain-specific tasks such as medical text summarization demands substantial computational resources. Parameter-efficient fine-tuning (PEFT) methods offer promising alternatives by updating only a small fraction of parameters. This paper compares three adaptation approaches-Low-Rank Adaptation (LoRA), Prompt Tuning, and Full Fine-Tuning-across the Flan-T5 model family on the PubMed medical summarization dataset. Through experiments with multiple random seeds, we demonstrate that LoRA consistently outperforms full fine-tuning, achieving 43.52 +/- 0.18 ROUGE-1 on Flan-T5-Large with only 0.6% trainable parameters compared to 40.67 +/- 0.21 for full fine-tuning. Sensitivity analyses examine the impact of LoRA rank and prompt token count. Our findings suggest the low-rank constraint provides beneficial regularization, challenging assumptions about the necessity of full parameter updates. Code is available at https://github.com/eracoding/llm-medical-summarization

cs.CL↗

arXiv2026

Hide and Find: A Distributed Adversarial Attack on Federated Graph Learning

Federated Graph Learning (FedGL) is vulnerable to malicious attacks, yet developing a truly effective and stealthy attack method remains a significant challenge. Existing attack methods suffer from low attack success rates, high computational costs, and are easily identified and smoothed by defense algorithms. To address these challenges, we propose \textbf{FedShift}, a novel two-stage "Hide and Find" distributed adversarial attack. In the first stage, before FedGL begins, we inject a learnable and hidden "shifter" into part of the training data, which subtly pushes poisoned graph representations toward a target class's decision boundary without crossing it, ensuring attack stealthiness during training. In the second stage, after FedGL is complete, we leverage the global model information and use the hidden shifter as an optimization starting point to efficiently find the adversarial perturbations. During the final attack, we aggregate these perturbations from multiple malicious clients to form the final effective adversarial sample and trigger the attack. Extensive experiments on six large-scale datasets demonstrate that our method achieves the highest attack effectiveness compared to existing advanced attack methods. In particular, our attack can effectively evade 3 mainstream robust federated learning defense algorithms and converges with a time cost reduction of over 90\%, highlighting its exceptional stealthiness, robustness, and efficiency.

cs.LG↗