arXiv subjects

Lei Shi

Publications and source records attributed to Lei Shi.

At least 37 records · Page 2Linked to original sources

arXiv2026

Generalization Analysis of Online Stochastic Gradient Descent for Overparameterized Two-Layer Neural Networks

We investigate the generalization performance of online stochastic gradient descent (SGD) for overparameterized two-layer neural networks under the Neural Tangent Kernel (NTK) regime. Leveraging the NTK approximation together with the convergence theory of stochastic approximation in reproducing kernel Hilbert spaces (RKHSs), we develop a unified framework that connects the optimization dynamics of neural networks with kernel-based statistical learning. This framework enables us to derive sharp convergence rates for the \emph{generalization error of the last iterate} of online SGD. The obtained rates coincide with the optimal statistical rates for kernel methods under appropriate source assumptions on target function. In contrast to existing NTK analyses, which primarily establish optimization convergence or analyze averaged SGD, our results directly characterize the statistical behavior of the practically implemented last-iterate online SGD algorithm for streaming data. Moreover, our analysis substantially relaxes the required degree of overparameterization by reducing the network-width requirement from exponential to polynomial dependence on the sample size or the number of optimization iterations. These results provide a unified theoretical perspective on stochastic optimization, kernel methods, and statistical learning for overparameterized neural networks, while significantly narrowing the gap between existing theory and practical deep learning.

stat.ML↗

arXiv2026

Bifurcation and Multistability in a Collective-Risk Public Goods Game with Quorum-Activated Protection

The danger of collective risk in a public goods game could provide an effective escape route from the tragedy of the commons. Existing studies usually embed risk mitigation in the contribution itself, whereas many real systems rely on a separate costly and non-excludable protective activity that requires a participation quorum. Whether such protection can evolve and persist remains unclear. Here, we formulate an $N$-player public-goods game with ordinary cooperators, defectors, and protective cooperators. Defectors endogenously increase a saturating probability of collective failure, whereas protective cooperators incur an additional cost and reduce this risk for all group members once their number reaches the quorum. Replicator analysis and numerical bifurcation calculations yield three main findings. First, protective cooperation gains an advantage when the focal participant completes the quorum and the resulting expected loss reduction exceeds its additional cost. This advantage varies non-monotonically with group composition. Second, when a single protective cooperator cannot activate protection, protection effectiveness does not enter its first-order invasion fitness at full defection; greater effectiveness cannot overcome the rare-invasion barrier when full defection is locally asymptotically stable. Third, a boundary saddle--node bifurcation creates a saddle and a locally asymptotically stable coexistence equilibrium of defectors and protective cooperators. When full cooperation and full defection are also locally asymptotically stable, three attractors coexist, and the numerically observed evolutionary outcome depends on the initial population composition. These results distinguish the effectiveness of activated protection from its ability to become established from rarity.

physics.soc-ph↗

arXiv2026

Causal inference in two-sided randomization designs: factorial regression, two-way clustering, and covariate adjustment

We study randomized experiments involving two interacting populations, such as buyers and sellers in a marketplace. In the two-sided experiments we consider, we randomize the two populations separately and independently. For a pair consisting of one member from each population, the two assignments jointly determine one of four exposure conditions. Under a local interference assumption, we consider a broad class of linear estimands, including total, interaction, and buyer- and seller-side spillover effects. Our first main result establishes that researchers can estimate these effects using ordinary least squares and conduct asymptotically valid design-based inference using the conventional two-way cluster-robust variance estimator, clustered at the buyers' and sellers' levels. Our second main result develops a sharper variance estimator for a single linear estimand that better preserves dependence within the buyer and seller dimensions and is asymptotically less conservative than the two-way clustered estimator and existing alternatives. Our third main result establishes the theory for covariate adjustment and recommends a two-way analysis-of-variance-type covariate representation to ensure efficiency gains.

econ.EM↗

arXiv2026

An absolute measure of heterogeneity for lnOR in meta-analysis

Quantifying the heterogeneity is an important issue in meta-analysis. The conventional heterogeneity statistic, $I^2$, heavily depends on study sample sizes and tends to approach one as the sample sizes increase. To overcome this limitation, a sample size independent measure, ${\rm ICC}_{\rm MA}$, has recently been developed to quantify the heterogeneity, yet this method is restricted to meta-analysis with continuous outcomes. In practice, however, binary outcomes are more widely encountered, with the log odds ratio (lnOR) frequently adopted as an effect size to compare the effects of two treatments in terms of odds. To fill the gap, we propose a new heterogeneity measure for meta-analysis with binary outcomes by introducing a latent continuous variable model. Under this framework, the proposed measure admits a closed-form expression within the random-effects meta-analysis model with lnOR as the effect size. We define this sample size independent measure as ${\rm ICC}_{\rm MA}^{\rm OR}$, and moreover propose a new estimator, $I^2_A$, to evaluate this measure. Simulation studies demonstrate that our new estimator is nearly unbiased and aligns closely with its counterpart applied for standardized mean differences when the continuous variable is observable. A real data application further demonstrates that the proposed heterogeneity statistic for binary outcomes and its counterpart for continuous outcomes provide interpretable and coherent estimates across different outcome types.

stat.ME↗

arXiv2026

Escape-Aware Control Barrier Functions for Quadrotor Safety under Body-Rate Limits

Control barrier functions for input-constrained systems place the admissible input set inside the definition of the safe set, yet the resulting barrier is almost always a function of the state alone; On a quadrotor this is not cosmetic: because the thrust vector must be reoriented before it can decelerate an approach, and reorientation is limited by the attainable body rate, a state-only barrier certifies states from which no escape is reachable in time; We characterize the certification gap in closed form and show its width is proportional to closing speed and inversely proportional to the body-rate limit; We then define an escape barrier on the augmented pair of state and previously applied input, with escape authority measured over the one-step reachable thrust cap; It admits a closed form and an analytic inverse for the maximum certifiable closing speed, and embeds in a predictive controller at no additional state cost; Across 550 paired closed-loop episodes on a 13-state quadrotor, the proposed controller completes every tested scenario, whereas the stopping-distance barrier enforced over the same horizon fails 15% and 25% of episodes in exactly the two scenarios that enter the predicted gap; Against an online backup-CBF baseline enforcing the same escape condition at the reached state, it holds a 29-74 degree larger directional margin and 3-18 times the clearance, and an independent conservative rollout referee finds no certified state from which escape fails.

cs.RO↗

arXiv2026

MGAvatar: Mesh-Bound Gaussians for Head Avatar Geometry and Appearance Modeling

Accurate head modeling requires a stable yet expressive geometric representation. Existing Gaussian-based head avatars commonly rely on parametric templates (e.g., FLAME) for Gaussian initialization and deformation, but these templates lack personalized priors and struggle to represent structures such as hair and clothing. To address this issue, we propose MGAvatar, a Gaussian-mesh hybrid representation that jointly models geometry and appearance through two Gaussian-mesh binding modes. Specifically, we introduce vertex-bound Gaussians and constrain their learnable parameters, enabling progressive mesh deformation to represent complex head geometry, while a pose-dependent offset module accounts for non-rigid deformations. Once geometry is stabilized, MGAvatar switches to face-bound Gaussians for appearance modeling. To improve appearance consistency across novel poses and viewpoints, we introduce a view-conditioned neural color field that alleviates artifacts caused by independently optimized Gaussian colors. In addition, we design a Gaussian offset network to predict Gaussian offset maps in the observation space, providing greater flexibility for face-bound Gaussians to capture dynamic facial textures. Extensive experiments on multi-view and monocular videos show that MGAvatar outperforms existing methods in rendering quality, producing high-fidelity head avatars with rich texture details.

cs.CV↗

arXiv2026

Stochastic Gradient Descent for Operator Learning in Hilbert Spaces: Convergence Rates and Minimax Lower Bounds

This study investigates the use of stochastic gradient descent (SGD) to learn operators between general Hilbert spaces. We study weak and strong regularity conditions for the target operator that characterize its structure and complexity. Under these conditions, we establish upper bounds for convergence rates of the SGD algorithm and derive a minimax lower bound analysis, further illustrating that our convergence analysis and regularity conditions quantitatively characterize the statistical difficulty of operator estimation under these regularity conditions. The analysis extends to nonlinear regression targets under model misspecification, in which case SGD converges to the best linear approximation. Moreover, applying our analysis to operator learning problems based on vector-valued and scalar-valued reproducing kernel Hilbert spaces yields new convergence results, thereby refining the conclusions of existing literature.

stat.ML↗

arXiv2026

Resolution-Independent Analysis of Encoder--Decoder Operator Learning via Limiting Kernels

Operator learning is formulated on function spaces, but training data are typically available only through finite-dimensional representations. In encoder--decoder architectures, a matrix-valued kernel on the encoded space induces an operator-valued kernel on the original function spaces, and the corresponding reproducing kernel Hilbert spaces are isometrically isomorphic. As the input and output resolutions increase, the induced kernels converge to a limiting kernel, in the sense of operator-norm convergence of their associated integral operators, allowing regularity assumptions to be stated independently of the encoding resolution. For regularized stochastic gradient descent, we establish upper bounds for decreasing and fixed step sizes, separating the encoding and regularization terms from optimization terms of order $t^{-θ}$ and $T^{-θ'}$, respectively, for any $θ,θ'\in(0,1)$. We further prove lower bounds showing that these encoding-induced terms are generally unavoidable. The analysis is further extended to encoder--decoder neural networks through the limiting neural tangent kernel (NTK), yielding error bounds with an additional finite-width term and polynomial parameter and sample complexity guarantees when the encoding errors decay algebraically. The framework covers matrix-valued kernels constructed from radial and dot product kernels, NTKs arising from wide encoder--decoder neural networks, and encoder--decoder pairs based on Fourier, Legendre polynomial, wavelet, PCA, or pointwise sampling representations.

stat.ML↗

arXiv2026

IDORacle: Template-Guided SQL-Sink Mediation for Object-Level Authorization in Java Applications

Insecure Direct Object Reference (IDOR), often modeled as Broken Object-Level Authorization (BOLA), remains prevalent in Java database applications because identity and authorization checks at the controller or service layer are disconnected from SQL execution based on resource identifiers. Existing work largely detects these vulnerabilities but offers limited low-intrusion runtime protection for legacy Java-SQL applications. We present IDORacle, a template-guided SQL-sink interception and rewriting framework for preventing horizontal privilege escalation at runtime. IDORacle propagates authenticated identity context across HTTP requests, asynchronous tasks, and data-access boundaries through a server-side trace identifier. At the MyBatis/JDBC boundary, it extracts SQL templates, computes dual fingerprints, and performs one-time template analysis to generate reusable mediation plans. During execution, it combines subject context, SQL ASTs, table metadata, and cached authorization proofs to permit, rewrite, or block operations. Its guard model supports direct ownership predicates, join-derived ownership, probes for group-owned resources, role-sensitive state transitions, and sensitive-column mediation. A Java-SQL benchmark grounded in real-world CVE reports shows that IDORacle prevents the tested horizontal authorization violations with a worst-case guard latency of 0.17 ms. Redundancy-aware optimization reduces average per-instance overhead by more than 90%, to 0.017 ms for hot SQL templates.

cs.CR↗

arXiv2026

Visual Analysis of LLM-based Entity Resolution from Scientific Papers

This paper focuses on the visual analytics support for extracting domain-specific entity from extensive scientific literature, a task with inherent limitations using traditional named entity resolution methods. With the advent of large language models (LLMs) such as GPT-4, significant improvements over conventional machine learning approaches have been achieved due to LLM's capability on entity resolution integrate abilities such as understanding multiple types of text. This research introduces a new visual analysis pipeline that integrates these advanced LLMs with versatile visualization and interaction designs to support batch entity resolution. Specifically, we focus on a specific material science field of Metal-Organic Frameworks (MOFs) and a large data collection namely CSD-MOFs. Through collaboration with domain experts in material science, we obtain well-labeled synthesis paragraphs. We propose human-in-the-loop refinement over the entity resolution process using visual analytics techniques, which allows domain experts to interactively integrate insights into LLM intelligence, including error analysis and interpretation of the retrieval-augmented generation (RAG) algorithm. Our evaluation through the case study of example selection for RAG demonstrates that this human-machine collaborative approach improved single-document entity resolution accuracy by approximately 30%.

cs.IR↗

arXiv2026

Fine-Grained Anomaly Perception in Wild UGC-Enhanced Images: A Comprehensive Dataset and Difference-Fusion Framework

Image enhancement and restoration have become standard back-end operations on short-video and social media platforms to boost UGC visual experience. Yet these processes inevitably introduce visual anomalies--especially in faces, texts, and textures--that directly undermine perceptual fidelity and viewer trust. While existing IQA methods perform well on classic distortions, they target holistic quality assessment and fail to capture the specific, localized anomalies caused by enhancement algorithms in real-world UGC. To bridge this gap, we formally define a new task-quality Anomaly Perception for UGC image Enhancement (UEAP), and contribute the first UEAP benchmark dataset, named UEAP-4k, curated from the real business scenarios. It provides fine-grained annotations for anomaly categories, localization and severity levels. Furthermore, we propose a Difference-Fusion Anomaly Perception Method (DFAP-UGC) for wild UGC-enhanced images, which leverages explicit problem-reference difference fusion with dense spatial querying, regional verification, and quality-aware ranking, enabling robust anomaly identification in challenging scenarios. To handle the inherent coupling of subtasks in this new task, we propose a Locality-Aware Dynamic Task Prioritization (LADTP) training strategy that enables effective end-to-end learning and eliminates multi-stage overhead. Extensive experiments show that our method outperforms baselines adapted from classical approaches for this task, validating the value of this dataset and the superior of DFAP-UGC for robust UGC-enhanced image anomaly perception. Code and data will be public.

cs.CV↗

arXiv2026

Variation Spaces for Encoder--Decoder Neural Operators: Approximation and Generalization

Inspired by the function-space theory of neural networks, we formulate and analyze a variation space for nonlinear operators between Hilbert spaces, defined through vector-valued Borel measures of bounded variation. We characterize its unit ball as the closed convex hull of a vector-valued single-neuron dictionary in Bochner spaces. For the ReLU activation, the bounded linear operators in this space are precisely the Schatten-$1$ operators, with equivalent norms. For operators in this space, we establish encoder--decoder approximation bounds in the Bochner $L^q$-norm, where the error decomposes into input and output encoding errors and a finite-width term of order $N^{-1/2}$. Under sub-Gaussian assumptions on the input and noise, we further derive high-probability generalization bounds for empirical least squares over path-norm-constrained encoder--decoder networks; the finite-sample contribution to the squared prediction error is of order $K^{-1/2}$ up to logarithmic factors. The finite-width and finite-sample constants are independent of the encoding dimensions and bases, with the latter also independent of the network width. When the encoding errors decay algebraically, these bounds yield algebraic approximation and learning rates, in contrast to the complexity barriers for Lipschitz and Fréchet differentiable operator classes.

stat.ML↗

arXiv2026

Dynamic Water-Wave Tweezers

Following a recent demonstration of stable trapping of floating particles by stationary (monochromatic) structured water waves [Nature 638, 394 (2025)], we report dynamic water-wave tweezers that enable controllable transport of the trapped particle along an arbitrary trajectory on the water surface. Furthermore, we demonstrate simultaneous transport of two trapped particles along different trajectories. We employ a triangular lattice formed by the interference of three plane waves, which can trap particles, depending on the wave frequency and particle parameters, either at intensity maxima or at intensity zeros (vortices). By introducing small frequency detunings of the interfering waves, we control 2D motion of the lattice and trapped particles. This approach is robust and effective over a relatively broad range of particle sizes and wave frequencies, offering remarkable new possibilities for noncontact manipulation of floating (e.g., biological and soft-matter) objects in fluidic environments.

physics.flu-dyn↗

arXiv2026

Online Safety Regulation Increases Attention to VPNs: Privacy Implications of the UK Online Safety Act

Governments worldwide are increasingly regulating digital platforms to reduce online harms, but access restrictions can alter user behaviour and create new privacy risks. The UK Online Safety Act, passed in 2023, rolled out in phases - illegal-content enforcement in March 2025 and mandatory age verification in July 2025. We analyse Reddit discourse across VPN and UK Politics communities and conduct a privacy-policy risk analysis of 69 VPN services. We find that the behavioural response is concentrated at the July 2025 deadline, when platforms hosting pornographic content were required to deploy age checks. UK VPN search interest on Google increased by 147% at this deadline. UK-resident users' VPN-subreddit activity increased by 145%. Their regulatory- or privacy-related VPN posts and comments rose by 1,265% at this deadline. UK Politics communities show the same concentration at a larger magnitude, with OSA-related political discourse rising by 1481%. These effects were far smaller or statistically indistinguishable from pre-existing trends at Royal Assent and the illegal-harms enforcement deadline, indicating that the deployed age checks drove the response. Users primarily frame this response around privacy, surveillance, and distrust of age-verification intermediaries rather than access-seeking, with near-zero genuine pro-OSA sentiment across two independent classifiers. Several users noted that those least able to pay for reputable VPNs are most likely to turn to free services that monetise their data. Search attention increases across all disclosed privacy-risk categories, with no evidence of a shift toward higher-risk VPN providers. Crucially, after a full year, this attention is still elevated, arguing against a temporary news-cycle reaction. Thus, online safety regulation may create secondary privacy costs without disproportionately directing attention toward higher-risk VPNs.

cs.CY↗

arXiv2026

Model Literacy: An Extra Summative Evaluation Factor for Visual Analytics

Understanding and enhancing visual analytics (VA) performance is important for maximizing their impact. Existing studies have successfully applied well-established summative evaluation methods from information visualization to the VA context, yet the recent emphasis on an extra data analysis/modeling stage in the VA pipeline poses an additional challenge. Inspired by the modern concept of visualization literacy, this paper examines model literacy, namely users' knowledge of the analysis model used in a VA technique, as an additional factor for VA performance. Results from a controlled study on the visual analysis of multidimensional data with two dimensionality-reduction models indicate a positive correlation between model-task accuracy and VA-task accuracy. The study involves two common dimensionality-reduction models, PCA and t-SNE. The correlation is stronger for PCA than for t-SNE in the current task design, a pattern consistent with the possibility that VA effectiveness is more closely associated with model literacy when model outputs are less directly readable from the visualization. Completion-time evidence does not show a stable efficiency gain, suggesting that differences in model intuitiveness may help explain when model knowledge shortens task completion and when it involves additional interpretive effort. The findings of this study suggest ways to further enrich VA evaluation methods and provide directions for developing more rigorous model-literacy assessment instruments.

cs.HC↗

arXiv2026

Weak Physics Informed Neural Networks for Geometry Compatible Hyperbolic Conservation Laws on Manifolds

Physics-informed neural networks (PINNs) provide a mesh-free approach to solving high-dimensional PDEs on complex geometries, but their theoretical foundations on manifolds remain limited. Moreover, conventional PINN analyses typically rely on solution smoothness, while PINNs may perform poorly for low-regularity solutions arising from nonlinear hyperbolic equations. In this paper, we develop a weak PINN (wPINN) framework for approximating entropy solutions of geometry-compatible hyperbolic conservation laws on Riemannian manifolds $\mathcal{M}^d$. Building on the well-posedness theory, we establish a localized $L_1$-stability estimate that converts localized entropy residuals into terminal error bounds and leads to a rigorous convergence analysis of the proposed method. We then derive approximation guarantees for time-dependent entropy solutions on manifolds, revealing how approximation errors accumulate over long time horizons. For the quadrature error, we develop a problem-adapted localization complexity analysis and show that, for a fixed adversarial test-network architecture, the solution-network contribution achieves the fast rate $\mathrm{VC}_{\mathcal F}/n$, up to logarithmic factors. The resulting algebraic network-complexity exponent depends only on the intrinsic dimension $d$, rather than the ambient dimension. For fixed localization scales, and up to logarithmic factors and the localization bias, the solution-network statistical exponent matches the corresponding minimax exponent in $d$-dimensional Euclidean Sobolev approximation. Numerical experiments illustrate that the proposed wPINN framework accurately approximates entropy solutions on manifold geometries.

math.NA↗

arXiv2026

A Quantitative Approximation Framework for Flow Distillation in Diffusion Models

We develop a quantitative framework for diffusion distillation by viewing few step sampling as approximation through compositions of learned flow maps. For trajectory distillation of the probability flow ODE, we show that low noise multimodal regimes separate score approximability from dynamical stability: the score remains efficiently approximable, while small local errors may be strongly amplified by stiff flow dynamics. In a Gaussian mixture Ornstein--Uhlenbeck model, we prove time uniform $L^p(p_t)$ score approximation by ReLU and ReQU networks with explicit polylogarithmic complexity, and derive a computable Lipschitz bound $L(t)$ for the flow velocity. The stability factor $\exp\bigl(\int_s^t L(u)\mathrm du\bigr)$ can grow exponentially as noise decreases and mixture separation increases. Comparing this certificate with a certified local Lipschitz budget for one step students identifies regimes of direct distillation difficulty, without implying an approximation lower bound. We also show that deep residual compositions control global transport error through propagated local errors, and that equalizing cumulative stability yields an optimal nonuniform segmentation. With eight segments, this grid reduces final mean relative MSE by up to $51.9\%$ versus uniform grids.

stat.ML↗

arXiv2026

Educational Short Videos: Bibliometric Trends, Thematic Structure, and Operationalisation

Educational short-video research spans disciplines, platforms and learning contexts, but the same label is applied to resources differing in function, activity, context and evaluation, complicating comparison and evidence synthesis. This study mapped the development, thematic organisation and operationalisation of educational short-video research. We analysed 2,169 records indexed in Web of Science and Scopus up to 11 June 2026 using bibliometric analysis, non-negative matrix factorisation topic modelling and structured content analysis. Publication output increased sharply from the mid-2010s but remained dispersed across outlets. Among 16 first-level topics, Skill Development in Educational Contexts was the largest, forming the structural core of the field, while topic overlap was predominantly pairwise. Video-Based Health Interventions for Attitude Change and Cognitive Load and Engagement in Instructional Video Design combined positive recent growth with comparatively high citation visibility, whereas Social Media Engagement Strategies for Education emerged as a rapidly growing direction. Knowledge/Achievement and Engagement/Motivation were the most widely represented outcome domains, and experimental and synthesis designs were more common among identifiable records in health-related topics. Indexed descriptions most often foregrounded intended users, educational uses, learning content, and interactivity. A representative duration was available for 511 records, but no consistently applied numerical threshold was evident. These findings support a working definition of educational short videos as discrete multimedia messages combining words and visuals and designed or used to promote learning. Shortness should be interpreted relative to educational purpose, content unit and surrounding activity rather than duration alone.

cs.CY↗