arXiv Science⌕ Search

arXiv subjects

Lei Shi

Publications and source records attributed to Lei Shi.

At least 91 records · Page 5Linked to original sources

Passive All-Optical Nonlinear Neuron Activation via PPLN Nanophotonic Waveguides

Artificial intelligence (AI) is transforming modern life, yet the growing scale of AI applications places mounting demands on computational resources, raising sustainability concerns. Photonic integrated circuits (PICs) offer a promising alternative, enabling massive parallelism, low latency, and reduced electrical overhead, particularly excelling in high-throughput linear operations. However, passive and fully optical nonlinear activation functions with equally superb performance remain rare, posing a critical bottleneck in realizing all-optical neural networks in PICs. Here, we demonstrate a compact and integrated all-optical nonlinear activation method, experimentally realized through strong second-order optical nonlinearities in periodically poled lithium niobate (PPLN) nanophotonic waveguides, achieving 80% absolute conversion efficiency. This activation exhibits a sigmoid-like, wavelength-selective response with femtosecond-scale dynamics and light-speed processing, operating passively without external control and auxiliary signals. We validate its feasibility for neural inference by cascading the PPLN-driven activations with a linear silicon PIC, demonstrating all-optical nonlinear neuron expressivity. Moreover, combining the measured nonlinearity with linear operations calculated by the PIC, we show that PPLN-activated multi-layer optical neural networks can achieve performance on par with digital implementations in real-world tasks, including airfoil regression and medical image classification. These results pave the way toward scalable, high-speed, and fully integrated all-optical neural networks for next-generation photonic AI hardware.

physics.optics↗

Emerging Multidimensional Real-Space Topological Structures at Chiral Bound States in the Continuum

As widely studied topological singularities, bound states in the continuum (BICs) have revealed rich physical properties through their momentum-space topology. Here, we reveal and experimentally demonstrate that magnetically induced chiral BICs possess multidimensional topological structures extending into real space. We design and realize a gyromagnetic photonic crystal slab where magnetic field breaks the time-reversal symmetry and lifts the degeneracy of BICs, creating a pair of chiral BICs with opposite circular polarizations. Near-field scanning measurements reveal phase vortices with quantized topological charges, spatially distributed near-field chirality, and skyrmionic Stokes textures arising from magnetic control. Our work unveils a previously unexplored dimension of BIC topology and establishes gyromagnetic photonic crystals as versatile platforms for manipulating complex topological states.

physics.optics↗

Twisted multilayer moiré water waves topologically robust to disorder

Moiré patterns, stacking and twisting multilayer periodic lattices into superlattices, have become cornerstones of many physical systems from condensed matter to wave phenomena, but have never been properly studied in water waves. Here, we demonstrate twisted multilayer moiré water surface waves carrying robust skyrmionic topologies. Using a custom water tank of circular multi-channel phased array, we precisely generate water-wave skyrmion lattices and superimpose them into moiré superlattices with higher-order topological textures, e.g., skyrmion bags and clusters, programmed via the twist angle. We also quantitatively compare the topological robustness of bilayer and trilayer configurations under spatiotemporal perturbations. The trilayer moiré superlattices exhibit more enhanced stability, stronger field localization and energy concentration than the bilayer. Our work establishes water waves as a macroscopic, tunable, and visually accessible platform for moiré physics, towards robust particle manipulation and classical analogues of topological quantum phenomena.

physics.optics↗

Experimentation Accelerator: Interpretable Insights and Creative Recommendations for A/B Testing with Content-Aware ranking

Modern online experimentation faces two bottlenecks: scarce traffic forces tough choices on which variants to test, and post-hoc insight extraction is manual, inconsistent, and often content-agnostic. Meanwhile, organizations underuse historical A/B results and rich content embeddings that could guide prioritization and creative iteration. We present a unified framework to (i) prioritize which variants to test, (ii) explain why winners win, and (iii) surface targeted opportunities for new, higher-potential variants. Leveraging treatment embeddings and historical outcomes, we train a CTR ranking model with fixed effects for contextual shifts that scores candidates while balancing value and content diversity. For better interpretability and understanding, we project treatments onto curated semantic marketing attributes and re-express the ranker in this space via a sign-consistent, sparse constrained Lasso, yielding per-attribute coefficients and signed contributions for visual explanations, top-k drivers, and natural-language insights. We then compute an opportunity index combining attribute importance (from the ranker) with under-expression in the current experiment to flag missing, high-impact attributes. Finally, LLMs translate ranked opportunities into concrete creative suggestions and estimate both learning and conversion potential, enabling faster, more informative, and more efficient test cycles. These components have been built into a real Adobe product, called \textit{Experimentation Accelerator}, to provide AI-based insights and opportunities to scale experimentation for customers. We provide an evaluation of the performance of the proposed framework on some real-world experiments by Adobe business customers that validate the high quality of the generation pipeline.

cs.AI↗

Acceleration via Perturbations on Low-resolution Ordinary Differential Equations

Recently, the high-resolution ordinary differential equation (ODE) framework, which retains higher-order terms, has been proposed to analyze gradient-based optimization algorithms. Through this framework, the term $\nabla^2 f(X_t)\dot{X_t}$, known as the gradient-correction term, was found to be essential for reducing oscillations and accelerating the convergence rate of function values. Despite the importance of this term, simply adding it to the low-resolution ODE may sometimes lead to a slower convergence rate. To fully understand this phenomenon, we propose a generalized perturbed ODE and analyze the role of the gradient and gradient-correction perturbation terms under both continuous-time and discrete-time settings. We demonstrate that while the gradient-correction perturbation is essential for obtaining accelerations, it can hinder the convergence rate of function values in certain cases. However, this adverse effect can be mitigated by involving an additional gradient perturbation term. Moreover, by conducting a comprehensive analysis, we derive proper choices of perturbation parameters. Numerical experiments are also provided to validate our theoretical findings.

math.OC↗

GPO: Growing Policy Optimization for Legged Robot Locomotion and Whole-Body Control

Training reinforcement learning (RL) policies for legged robots remains challenging due to high-dimensional continuous actions, hardware constraints, and limited exploration. Existing methods for locomotion and whole-body control work well for position-based control with environment-specific heuristics (e.g., reward shaping, curriculum design, and manual initialization), but are less effective for torque-based control, where sufficiently exploring the action space and obtaining informative gradient signals for training is significantly more difficult. We introduce Growing Policy Optimization (GPO), a training framework that applies a time-varying action transformation to restrict the effective action space in the early stage, thereby encouraging more effective data collection and policy learning, and then progressively expands it to enhance exploration and achieve higher expected return. We prove that this transformation preserves the PPO update rule and introduces only bounded, vanishing gradient distortion, thereby ensuring stable training. We evaluate GPO on both quadruped and hexapod robots, including zero-shot deployment of simulation-trained policies on hardware. Policies trained with GPO consistently achieve better performance. These results suggest that GPO provides a general, environment-agnostic optimization framework for learning legged locomotion.

cs.RO↗

QUARK: Robust Retrieval under Non-Faithful Queries via Query-Anchored Aggregation

User queries in real-world retrieval are often non-faithful (noisy, incomplete, or distorted), causing retrievers to fail when key semantics are missing. We formalize this as retrieval under recall noise, where the observed query is drawn from a noisy recall process of a latent target item. To address this, we propose QUARK, a simple yet effective training-free framework for robust retrieval under non-faithful queries. QUARK explicitly models query uncertainty through recovery hypotheses, i.e., multiple plausible interpretations of the latent intent given the observed query, and introduces query-anchored aggregation to combine their signals robustly. The original query serves as a semantic anchor, while recovery hypotheses provide controlled auxiliary evidence, preventing semantic drift and hypothesis hijacking. This design enables QUARK to improve recall and ranking quality without sacrificing robustness, even when some hypotheses are noisy or uninformative. Across controlled simulations and BEIR benchmarks (FIQA, SciFact, NFCorpus) with both sparse and dense retrievers, QUARK improves Recall, MRR, and nDCG over the base retriever. Ablations show QUARK is robust to the number of recovery hypotheses and that anchored aggregation outperforms unanchored max/mean/median pooling. These results demonstrate that modeling query uncertainty through recovery hypotheses, coupled with principled anchored aggregation, is essential for robust retrieval under non-faithful queries.

cs.AI↗

Evolutionary Dynamics of Reputation-Based Voluntary Prisoner's Dilemma Games

Cooperation underlies many natural and artificial systems. While voluntary participation can sustain cooperation without informational assumptions, real interactions are rarely anonymous, leaving the joint effects of participation and reputation insufficiently understood. We propose a reputation-based voluntary Prisoner's Dilemma in which agents incur a monitoring cost to inspect opponents and decide whether to exit an interaction for a fixed incentive to avoid exploitation or to default to cooperation or defection. We show that reputation-conditioned exit generates multiple coexistence pathways that sustain cooperation across population structures. In well-mixed populations, cooperation persists through stable mixed coexistence, whereas in structured populations, exit-incentive-dependent regimes emerge, including local cyclic dominance and persistent oscillations. Together, these results extend voluntary participation frameworks and underscore the role of exit-incentive design in cooperative multi-agent systems.

physics.soc-ph↗

Uncertainty-Aware Gradient Signal-to-Noise Data Selection for Instruction Tuning

Instruction tuning is a standard paradigm for adapting large language models (LLMs), but modern instruction datasets are large, noisy, and redundant, making full-data fine-tuning costly and often unnecessary. Existing data selection methods either build expensive gradient datastores or assign static scores from a weak proxy, largely ignoring evolving uncertainty, and thus missing a key source of LLM interpretability. We propose GRADFILTERING, an objective-agnostic, uncertainty-aware data selection framework that utilizes a small GPT-2 proxy with a LoRA ensemble and aggregates per-example gradients into a Gradient Signal-to-Noise Ratio (G-SNR) utility. Our method matches or surpasses random subsets and strong baselines in most LLM-as-a-judge evaluations as well as in human assessment. Moreover, GRADFILTERING-selected subsets converge faster than competitive filters under the same compute budget, reflecting the benefit of uncertainty-aware scoring.

cs.CL↗

PlannerRFT: Reinforcing Diffusion Planners through Closed-Loop and Sample-Efficient Fine-Tuning

Diffusion-based planners have emerged as a promising approach for human-like trajectory generation in autonomous driving. Recent works incorporate reinforcement fine-tuning to enhance the robustness of diffusion planners through reward-oriented optimization in a generation-evaluation loop. However, they struggle to generate multi-modal, scenario-adaptive trajectories, hindering the exploitation efficiency of informative rewards during fine-tuning. To resolve this, we propose PlannerRFT, a sample-efficient reinforcement fine-tuning framework for diffusion-based planners. PlannerRFT adopts a dual-branch optimization that simultaneously refines the trajectory distribution and adaptively guides the denoising process toward more promising exploration, without altering the original inference pipeline. To support parallel learning at scale, we develop nuMax, an optimized simulator that achieves 10 times faster rollout compared to native nuPlan. Extensive experiments shows that PlannerRFT yields state-of-the-art performance with distinct behaviors emerging during the learning process.

cs.RO↗

Evolutionary vaccination dynamics under higher-order reinforcement pressure

Vaccination games in higher-order settings remain underexplored, despite their importance in shaping opinions and collective decisions. Here, we introduce a parsimonious behavioral-epidemiological model to evaluate how peer reinforcement pressure influences vaccination uptake. The framework consists of a two-layer multiplex: an epidemic layer governed by the SIR process on a square lattice, and a behavioral layer represented by a hypergraph of triadic interactions. Individuals update their vaccination strategy via imitation, modulated by a reinforcement parameter $α$ when peer support is present. We find that higher-order structure alone induces clusters of vaccinated individuals that act as protective barriers. Low but nonzero reinforcement ($α\approx 0.5$) maximizes coverage and suppresses outbreaks, while both negligible ($α\approx 0$) and moderate ($α> 0.1$) reinforcement reduce uptake, as excessive confirmation lowers adaptability and enables non-vaccinators to re-emerge. Our work bridges complex contagion theory with evolutionary game dynamics, offering insights into how contact structure and peer reinforcement jointly shape vaccination behavior.

physics.soc-ph↗

Seminormal bases of cyclotomic Hecke-Clifford algebras

In this paper, we describe actions of standard generators on certain bases of simple modules for semisimple cyclotomic Hecke-Clifford superalgebras. As applications, we explicitly construct a complete set of primitive idempotents and seminormal bases for these algebras.

math.RT↗

OPOR-Bench: Evaluating Large Language Models on Online Public Opinion Report Generation

Online Public Opinion Reports consolidate news and social media for timely crisis management by governments and enterprises. While large language models have made automated report generation technically feasible, systematic research in this specific area remains notably absent, particularly lacking formal task definitions and corresponding benchmarks. To bridge this gap, we define the Automated Online Public Opinion Report Generation (OPOR-GEN) task and construct OPOR-BENCH, an event-centric dataset covering 463 crisis events with their corresponding news articles, social media posts, and a reference summary. To evaluate report quality, we propose OPOR-EVAL, a novel agent-based framework that simulates human expert evaluation by analyzing generated reports in context. Experiments with frontier models demonstrate that our framework achieves high correlation with human judgments. Our comprehensive task definition, benchmark dataset, and evaluation framework provide a solid foundation for future research in this critical domain.

cs.CL↗

Optimal Convergence Rates of Deep Neural Network Classifiers

In this paper, we study the binary classification problem on $[0,1]^d$ under the Tsybakov noise condition (with exponent $s \in [0,\infty]$) and the compositional assumption. This assumption requires the conditional class probability function of the data distribution to be the composition of $q+1$ vector-valued multivariate functions, where each component function is either a maximum value function or a Hölder-$β$ smooth function that depends only on $d_*$ of its input variables. Notably, $d_*$ can be significantly smaller than the input dimension $d$. We prove that, under these conditions, the optimal convergence rate for the excess 0-1 risk of classifiers is $\left( \frac{1}{n} \right)^{\frac{β\cdot(1\wedgeβ)^q}{{\frac{d_*}{s+1}+(1+\frac{1}{s+1})\cdotβ\cdot(1\wedgeβ)^q}}}$, which is independent of the input dimension $d$. Additionally, we demonstrate that ReLU deep neural networks (DNNs) trained with hinge loss can achieve this optimal convergence rate up to a logarithmic factor. This result provides theoretical justification for the excellent performance of ReLU DNNs in practical classification tasks, particularly in high-dimensional settings. The generalized approach is of independent interest.

stat.ML↗

Fair and Safe: A Real-Time Hierarchical Control Framework for Intersections

Ensuring fairness in the coordination of connected and automated vehicles at intersections is essential for equitable access, social acceptance, and long-term system efficiency, yet it remains underexplored in safety-critical, real-time traffic control. This paper proposes a fairness-aware hierarchical control framework that explicitly integrates inequity aversion into intersection management. At the top layer, a centralized allocation module assigns control authority (i.e., selects a single vehicle to execute its trajectory) by maximizing a utility that accounts for waiting time, urgency, control history, and velocity deviation. At the bottom layer, the authorized vehicle executes a precomputed trajectory using a Linear Quadratic Regulator (LQR) and applies a high-order Control Barrier Function (HOCBF)-based safety filter for real-time collision avoidance. Simulation results across varying traffic demands and demand distributions demonstrate that the proposed framework achieves near-perfect fairness, eliminates collisions, reduces average delay, and maintains real-time feasibility. These results highlight that fairness can be systematically incorporated without sacrificing safety or performance, enabling scalable and equitable coordination for future autonomous traffic systems.

cs.RO↗

Quasi-bound flat bands in the continuum

Bound states in the continuum (BICs) are widely known spatially localized states experimentally implemented as quasi-BICs. Although they emerged as a promising solution for achieving high-quality resonances in photonic structures, quasi-BICs are confined to a very narrow range in k-space and are highly sensitive to disorder. Here, we introduce quasi-bound flat bands in the continuum (quasi-BFICs), a class of optical states where Bloch modes are found within a photonic flat band, leading to a quasi-BIC behaviour at every k-point above the light line. We analytically and numerically demonstrate the origin of quasi-BFICs from the disorder-induced band folding, mode localization and multiple topological charges in k-space, and identify the optimal strength of structural disorder to maximise their generation probability. Angle-resolved transmission and Q-factor measurements confirm the existence of quasi-BFICs, opening new avenues for designing devices with high quality factor and wide-angle response, presenting a counterintuitive strategy that leverages disorder to enhance optical performance.

physics.optics↗

Can Classic GNNs Be Strong Baselines for Graph-level Tasks? Simple Architectures Meet Excellence

Message-passing Graph Neural Networks (GNNs) are often criticized for their limited expressiveness, issues like over-smoothing and over-squashing, and challenges in capturing long-range dependencies. Conversely, Graph Transformers (GTs) are regarded as superior due to their employment of global attention mechanisms, which potentially mitigate these challenges. Literature frequently suggests that GTs outperform GNNs in graph-level tasks, especially for graph classification and regression on small molecular graphs. In this study, we explore the untapped potential of GNNs through an enhanced framework, GNN+, which integrates six widely used techniques: edge feature integration, normalization, dropout, residual connections, feed-forward networks, and positional encoding, to effectively tackle graph-level tasks. We conduct a systematic re-evaluation of three classic GNNs (GCN, GIN, and GatedGCN) enhanced by the GNN+ framework across 14 well-known graph-level datasets. Our results reveal that, contrary to prevailing beliefs, these classic GNNs consistently match or surpass the performance of GTs, securing top-three rankings across all datasets and achieving first place in eight. Furthermore, they demonstrate greater efficiency, running several times faster than GTs on many datasets. This highlights the potential of simple GNN architectures, challenging the notion that complex mechanisms in GTs are essential for superior graph-level performance. Our source code is available at https://github.com/LUOyk1999/GNNPlus.

cs.LG↗

TERRA: A Transformer-Enabled Recursive R-learner for Longitudinal Heterogeneous Treatment Effect Estimation

Accurately estimating heterogeneous treatment effects (HTE) in longitudinal settings is essential for personalized decision-making across healthcare, public policy, education, and digital marketing. However, time-varying interventions introduce many unique challenges, such as carryover effects, time-varying heterogeneity, and post-treatment bias, which are not addressed by standard HTE methods. To address these challenges, we introduce TERRA (Transformer-Enabled Recursive R-learner), which facilitates longitudinal HTE estimation with flexible temporal modeling and learning. TERRA has two components. First, we use a Transformer architecture to encode full treatment-feature histories, enabling the representation of long-range temporal dependencies and carryover effects, hence capturing individual- and time-specific treatment effect variation more comprehensively. Second, we develop a recursive residual-learning formulation that generalizes the classical structural nested mean models (SNMMs) beyond parametric specifications, addressing post-treatment bias while reducing reliance on functional assumptions. In simulations and data applications, TERRA consistently outperforms strong baselines in HTE estimation in both accuracy and stability, highlighting the value of combining principled causal structure with high-capacity sequence models for longitudinal HTE.

stat.ME↗