arXiv subjects

Ziheng Chen

Publications and source records attributed to Ziheng Chen.

At least 19 recordsLinked to original sources

arXiv2026

Riemannian Deep Learning: Modules, Networks, and Geometries

Deep neural networks on manifold-valued representations have attracted growing interest, but many basic components remain tied to specific manifolds, rely on Euclidean approximations, or require costly and numerically fragile geometric operations. This thesis develops a unified framework for Riemannian deep learning from three complementary perspectives: reusable neural modules, manifold-specific network architectures, and the design of underlying geometries. It generalizes batch normalization from Euclidean spaces and individual manifolds to broad classes of Lie groups and gyrogroups, and extends multinomial logistic regression from Euclidean space to SPD manifolds and then to general Riemannian manifolds. It further develops neural networks for several important geometric representations, including an unconstrained model of hyperbolic space, Busemann-based hyperbolic learning, and full-rank correlation matrices. Finally, it introduces adaptive and computationally efficient Riemannian metrics on SPD manifolds, including learnable Log-Euclidean geometries and fast, stable Cholesky-based geometries. The proposed methods are supported by theoretical analysis and validated through numerical experiments and applications in vision, signal processing, graph learning, and genomics.

cs.LG↗

arXiv2026

RELTA-SGLD: Relative-Growth Localized Taming for Nonconvex Stochastic-Gradient Langevin Learning

We introduce RELTA-SGLD, a taming scheme that stabilizes superlinear stochastic-gradient updates while reducing unnecessary suppression of the original learning drift. A threshold determines where the taming turns on, while a relative-growth principle derived from the one-step Lyapunov stability condition determines the required taming strength. Together, they produce a lighter $\lambda$-scale denominator and preserve a nonvanishing far-tail return. As a consequence, we prove polynomial moment stability and first-order stationary accuracy in both $W_1$ and $W_2$ for nonconvex SGLD with superlinearly growing stochastic-gradient oracles, improving the corresponding half-order and quarter-order bounds for comparable stochastic-gradient tamed schemes. On Fashion-MNIST under active stabilization pressure, RELTA improves the mean learning metrics over both untamed SGLD and TUSLA and remains competitive with a tuned AdamW reference. In an ordinary-training regime, its lighter localized denominator reduces unnecessary perturbation of the original update and maintains nearly untamed learning dynamics.

stat.ML↗

arXiv2026

Strong order one-half convergence of a coupled tamed Euler--Peano scheme for reflected stochastic differential equations with super-linearly growing coefficients

We study strong numerical approximations for reflected stochastic differential equations in possibly unbounded convex domains with super-linearly growing drift and diffusion coefficients. Under a coupled monotonicity condition and polynomial local Lipschitz assumptions, we first establish the well-posedness of the reflected SDE and derive uniform moment bounds for its solution. We then introduce a coupled tamed Euler--Peano scheme, in which the drift and the squared diffusion coefficient are tamed by a common factor and the resulting Euler--Peano path is corrected through the Skorokhod problem. This common taming factor preserves the drift--diffusion coercivity structure and yields uniform moment estimates for the numerical solution. We prove strong convergence of order $1/2$ for both the constrained state process and the boundary regulator, thereby recovering the standard Euler-type strong order in this reflected setting. Numerical experiments for a reflected stochastic Ginzburg--Landau type system illustrate the constraint preservation of the scheme and support the theoretical convergence rate.

math.NA↗

arXiv2026

Discontinuous Prior-Mode Sections and the Geometry of Ambiguity in Intrinsic Image Decomposition

The viral 2015 photograph known as "The Dress" divides observers into two camps because it is ambiguous: the same image colors can be explained either as a blue-black surface under one illuminant or as a white-gold surface under another. We propose a geometric account in which the ambiguity arises from a singularity in intrinsic image decomposition, the inverse problem of separating an observed image into reflectance and illumination. Our central claim is that the prior-mode section, i.e. the prior-preferred decomposition, switches across an ambiguity boundary in image space, and that any smooth learned model can only approximate this discontinuous switch by forming a thin transition layer. This predicts two observable signatures, where $\Delta$ is the jump between branches of the prior-mode section and $\lambda$ is the regularization strength: for inverse decomposers, an albedo Jacobian scaling as $|\Delta|/\sqrt{\lambda}$; and for forward encoders, the Fernet curvature that blows up on a scale of $1/\sqrt{\lambda}$. On CGIntrinsics ($N=1998$ images, $n=2\times 10^7$ pixels), the color-temperature albedo Jacobian of Careaga DPT has partial Spearman correlation $r=0.41$ with dense ground-truth albedo error, compared with $r=0.087$ and $r=0.021$ for brightness and saturation controls. On "The Dress", CLIP ViT-L/14 exhibits a latent curvature peak of $\kappa=73.03$ at $6473\,\mathrm{K}$, one sampled step from D65 daylight, while a control dress image peaks at $\kappa=34.75$ with no comparable feature near D65. The same characteristic appears across architectures (U-Net inverter, diffusion inverter, ViT encoder) and datasets (rendered indoor scenes, web photograph), each measured with the observable appropriate to its model class.

math.DG↗

arXiv2026

No Place to Hide: Benchmarking Video Hallucination with Background-Controlled Pairs

We introduce VidPair-Halluc, a new benchmark for evaluating video hallucination in large video models (LVMs) under rigorous and controlled conditions. Unlike previous benchmarks that primarily rely on text-based perturbations or adversarial questions while neglecting the consistency of visual backgrounds, VidPair-Halluc features video pairs with highly similar backgrounds but distinctly different foreground semantics, enabling precise attribution of model errors to genuine hallucination rather than background variation. The benchmark is constructed through PairFlow, a pipeline that leverages recent advances in text-to-image and video generation to systematically compose stories, generate coherent video clips, and assemble them into adversarial pairs. Covering both spatial and temporal reasoning across ten semantic aspects, VidPair-Halluc comprises 1K high-quality adversarial video pairs and 11K spatio-temporal QA pairs with control over background and foreground variations. Evaluations on mainstream LVMs show persistent difficulty with robust fine-grained video understanding in adversarial settings, and code and data are available at the https://jethrojames.github.io/VidPair-Halluc/.

cs.CV↗

arXiv2026

Towards Robust EEG Decoding Based on Riemannian Self-Attention

Brain-Computer Interface (BCI) based on electroencephalography (EEG) enables direct interaction between the brain and external environments and has significant applications in assistive technologies, medical rehabilitation, and entertainment. Recently, EEG decoding methods based on Symmetric Positive Definite (SPD) learning have demonstrated superior performance. However, these methods typically employ basic network architectures and do not explicitly capture local relationships between EEG signals. This limitation is problematic for EEG signals due to their inherently low Signal-to-Noise Ratio (SNR). Moreover, most existing Riemannian manifold-based methods are restricted to specific metrics. The most widely used is the Affine-Invariant Metric (AIM). However, it has a quadratic dependency on the SPD matrices and cannot handle ill-conditioned SPD matrices, which hinders the effectiveness of networks. In contrast, the Bures-Wasserstein Metric (BWM) exhibits linear dependence on SPD matrices and demonstrates superior performance for ill conditioning. To overcome these challenges, we propose a Riemannian self-attention network based on the BWM. Additionally, the recently introduced power-deformed generalized Bures-Wasserstein metric reveals a nonlinear relationship between SPD matrices and matrix power deformation. This metric provides a more nuanced representation of the geometric structure of the SPD manifold. Consequently, we extend our model to a learnable version. For simplicity, we refer to it as GBWAtt. Experimental results on three EEG benchmarking datasets validate the robustness and effectiveness of our proposed method. The code is available at https://github.com/jissc/GBWAtt.

cs.LG↗

arXiv2026

LieBN: Batch Normalization over Lie Groups

Manifold-valued measurements are prevalent in various machine learning tasks. Recent advances have extended Deep Neural Networks (DNNs) to operate on manifolds. These extensions have been accompanied by normalization techniques tailored to different geometries, collectively referred to as Riemannian normalization. However, most existing Riemannian normalization methods are either designed for specific manifolds or fail to effectively normalize manifold-valued sample distributions. To address these limitations, we propose LieBN, a framework for Riemannian Batch Normalization (RBN) over Lie groups. Our approach leverages the theoretically convenient left- and right-invariant metrics, which naturally exist in every Lie group, and provides theoretical guarantees for controlling the Riemannian mean and variance. We instantiate LieBN across nine distinct geometries: four on the Symmetric Positive Definite (SPD) manifold, one on the group of rotation matrices, and four on the manifold of full-rank correlation matrices. Notably, among the SPD metrics, we introduce a novel right-invariant metric and extend three existing Lie group structures via matrix power deformation. Experiments on different manifolds validate the effectiveness of our framework. The code is available at https://github.com/GitZH-Chen/LieBN.git.

cs.LG↗

arXiv2026

Deterministic Denominator Design for Localized Tamed Stochastic Gradient Langevin Dynamics

If the denominator in a tamed stochastic gradient Langevin update uses the current stochastic-gradient draw, the conditional mean can be biased even when the stochastic-gradient oracle is unbiased. A state-dependent denominator fixed before that draw removes this coupling. We build practical deterministic denominators from a short pilot run. A log-scale proxy is fitted to the growth score $G_\star(x)=\|b(x)\|/(1+\|x\|)$, and empirical pilot quantiles set the activation thresholds of a local proxy-quantile envelope. The reported proxy-quantile experiments use this local denominator. Separately, we describe a final denominator with a norm-polynomial tail-floor correction that can be used when one wants to certify the global effective-linearity input required by the companion deterministic-envelope Lyapunov theory. We show how proxy and threshold errors enter denominator errors and the resulting stationary observable errors. In the reported experiments, the local proxy-quantile denominator improves over random-denominator tamed SGLD at comparable production cost. It also gives observable behavior close to the $G_\star$-envelope benchmark, without the full-gradient growth-score evaluations required by that benchmark.

stat.ME↗

arXiv2026

Novel physical property preserved methods for stochastic Schr\"{o}dinger--KdV equation

In this work, we study the stochastic Schr\"odinger--KdV equation driven by additive noise from both analytical and numerical viewpoints. We first establish the evolution laws for the averaged plasmon number, momentum, and energy, together with the conservation of the averaged particle number. Motivated by these intrinsic structures, we develop two temporal discretizations. One is constructed based on the splitting strategy and Crank--Nicolson scheme, and is shown to preserve the discrete evolution laws of the averaged plasmon number and momentum, as well as the discrete conservation law of the averaged particle number. The other is proposed within the constant scalar auxiliary variable framework, in which the nonlinear energy functional is reformulated so that a modified averaged energy law can be preserved at the discrete level. Combining these temporal discretizations with a local discontinuous Galerkin approximation in space yields structure-preserving full discretizations inheriting the corresponding discrete physical laws. Numerical experiments are presented to validate the theoretical results and to demonstrate the accuracy, robustness, and effectiveness of the proposed methods.

math.NA↗

arXiv2026

TRACER: Token ReAssignment for Concept ERasure in Generative Recommendation

Generative recommendation formulates next-item prediction as autoregressive generation over semantic ID (SID) sequences derived from users' historical interactions, making modern recommender systems structurally similar to large language models (LLMs). As privacy and safety concerns grow, these systems increasingly require concept unlearning to remove sensitive or harmful concepts associated with items. However, existing LLM unlearning methods cannot be directly applied to generative recommendation. Unlike word tokens with explicit semantics, SIDs are abstract identifiers that are often shared by both forget and retain items, leading to severe conflicts between concept removal and recommendation utility preservation. To address this challenge, we propose TRACER, an end-to-end concept unlearning framework based on token reassignment. Rather than directly suppressing shared SIDs, TRACER reassigns concept-related items to alternative tokens that better facilitate forgetting while minimizing side effects on retained items. We further introduce a coherence regularizer to preserve semantic consistency among retain items during unlearning. Experiments on real-world recommendation datasets demonstrate that TRACER effectively removes target concepts while substantially better preserving recommendation utility than existing unlearning baselines.

cs.IR↗

arXiv2026

Stress Amplified Resilience: ESG and Joint Fragility in Equity Markets

Market stress rarely harms investors through one channel alone. Losses, volatility spikes, and deteriorating tradability often arrive together. We examine whether ESG is associated with lower exposure to clustered fragility in equity markets. Using monthly data on S&P 500 constituents from 2014 to 2025, we study downside returns, volatility, illiquidity, and a cofragility state that captures their joint occurrence within the same firm month. The evidence supports a stress-amplified resilience interpretation rather than an unconditional ESG return premium. In the return channel, the ESG association is concentrated in the extreme downside tail during stress months. In the volatility channel, higher ESG is associated with smaller risk spikes when aggregate conditions are weak. In the illiquidity channel, the association is more persistent, suggesting a liquidity-quality component whose relevance increases when market-wide trading conditions deteriorate. The central evidence comes from the joint analysis: a one-standard-deviation increase in ESG lowers the stress-period probability of severe cofragility by 0.92 percentage points, about 9% relative to the baseline. Double Machine Learning shows a similar negative ESG association after flexible adjustment for observable firm characteristics. Pillar evidence suggests stronger baseline resilience for Environmental scores and clearer stress amplification for Social scores. Overall, the findings characterize ESG as a multi-channel fragility signal for tail-risk monitoring, stress analysis, and pillar-level ESG assessment.

q-fin.MF↗

arXiv2026

Weak order one convergence of structure-preserving stochastic theta methods for stochastic differential algebraic equations with time-dependent singular matrices

This paper studies the weak convergence order of structure-preserving stochastic theta methods for a class of index-$1$ stochastic differential algebraic equations with time-dependent singular matrices. The singular matrix is allowed to vary in time but preserves a fixed differential-algebraic splitting, thereby extending the constant singular-matrix setting while retaining the projector structure required for constraint preservation. By exploiting the index-$1$ algebraic-differential decomposition of the exact solution, we establish an abstract weak convergence theorem for constraint-preserving one-step approximations and apply it to the stochastic theta method with $\theta \in (0,1]$. Under global Lipschitz, linear growth, and suitable smoothness assumptions, the considered method is proved to be well posed, to preserve the algebraic constraints at all time levels, and to converge with weak order one. Numerical experiments are finally presented to confirm the structure-preserving property and the theoretical convergence order.

math.NA↗

arXiv2026

Deterministic Envelopes for Tamed SGLD: Decoupling Stochastic Gradient Noise and Localizing Taming

Stochastic gradient Langevin algorithms often use tamed denominators to stabilize superlinear drifts. This paper shows that when the denominator depends on the current stochastic gradient, the transformed update can have a biased conditional mean even if the original stochastic gradient is unbiased. This creates a stationary mean-shift channel that is absent for deterministic denominators.We propose a structure-preserving framework for designing tamed denominators. The construction keeps the denominator deterministic given the current state, and uses localized deterministic envelopes to avoid unnecessary taming in typical regions. These kernels retain the stabilizing effect of taming while avoiding the bias introduced by a gradient-dependent denominator. Our theory bounds the stationary bias through Euler, envelope, and stochastic-gradient residuals. The analysis also shows why purely local taming rules can lose control in the far tail and motivates a hybrid construction with additional tail protection. Experiments confirm the stationary distortions of random denominators, the bias reduction of deterministic-envelope designs, and the stabilizing effect of the hybrid construction.

stat.ML↗

arXiv2026

Disentangling Language Roles in Multilingual LLM Task Execution

Multilingual LLMs are increasingly used when instruction, source content, and required response languages do not coincide. Existing benchmarks have expanded multilingual instruction-following evaluation, but they rarely isolate these three roles within a fully crossed design. We introduce MTM-Bench, a controlled benchmark for language-conditioned task execution in which each instance is defined by a triplet $(L_{\text{instr}}, L_{\text{content}}, L_{\text{resp}})$. Across English, Spanish, and Chinese, MTM-Bench enumerates all 27 triplets and contains 2{,}430 instances per model across semantic reversal, final-state extraction, and language purity with update realization. We evaluate 20 frontier and open-weight LLMs using decomposed metrics for semantic correctness, target-language adherence, constraint satisfaction, contamination ratio, and joint success, with scoring validated by a targeted human audit. The fully crossed design reveals that degradation is organized by the role a language occupies in the task structure, not merely by mismatch count. The response-language role is the dominant axis of variation, and a single response-slot mismatch accounts for most degradation. The response-only and full-mismatch comparison suggests that mismatch count is not a monotonic predictor of difficulty, with model-level ordering varying across systems. Task families fail through distinct channels, showing that semantic correctness alone does not capture reliable multilingual task execution.

cs.CL↗

arXiv2026

Relative Repairability: A Calibration-Based Diagnostic for High-Sparsity Post-Pruning Allocation

At very high sparsity, neural network pruning does more than decide which weights remain. It also determines where pruning induced damage is placed across the network, and whether that damage can be recovered by a fixed lightweight repair procedure. We study this problem through the lens of repair conditioned sparsity allocation. We introduce Relative Repairability (RR), a calibration based diagnostic that compares the raw activation distortion caused by layerwise pruning with the residual distortion left after channelwise variance matching repair. RR estimates the fraction of local damage that remains after repair, using only unlabeled calibration data. Across ResNet18, ResNet34, and VGG16 BN on CIFAR10 and CIFAR100, we find that RR is not a universally dominant allocation rule. Instead, it is most useful near an architecture dependent recoverability transition, where standard structural or magnitude based allocation priors begin to lose reliability but post repair recovery has not yet fully collapsed. On CIFAR100 ResNet18, a fine grained sweep shows that RR improves over ERK across the central transition band and surpasses LAMP near the upper part of this band. A projection forced ablation further shows that capped ERK can over protect projection layers, shifting excessive sparsity onto regular convolutions and reducing post repair recovery. These results suggest that high sparsity pruning should allocate not only retained weights, but also repairable damage.

cs.LG↗

arXiv2026

Adaptive Signal Resuscitation: Channel-wise Post-Pruning Repair for Sparse Vision Networks

One-shot magnitude pruning can cause severe accuracy collapse in the high-sparsity regime, even when the pruning mask preserves the largest weights. We argue that this failure reflects a granularity mismatch in post-pruning repair. Under global magnitude pruning, nearly collapsed channels can coexist with channels that retain informative activation variance within the same layer. Existing layer-wise activation repair methods apply a single correction to the whole layer, and can therefore over-amplify damaged channels while trying to restore the layer-level signal. We propose Adaptive Signal Resuscitation (ASR), a training-free channel-wise repair method that matches the granularity of repair to the granularity of damage. ASR estimates a variance-matching correction for each output channel and stabilizes it with a data-driven shrinkage rule, suppressing unreliable corrections for channels with weak post-pruning signal while preserving corrections for healthier channels. Applied before BatchNorm recalibration, ASR requires only forward passes on a small calibration set and no retraining. Across three datasets, four convolutional architectures, and both unstructured and structured sparsity settings, ASR generally improves over layer-wise repair, with the clearest gains in high-sparsity regimes. On ResNet-50 at 90% sparsity, ASR recovers 55.6% top-1 accuracy on CIFAR-10, compared with 41.0% for layer-wise repair and 28.0% for BatchNorm-only recalibration. Ablations show that naive channel-wise variance matching is insufficient, and that shrinkage stabilizes post-pruning repair.

cs.LG↗

arXiv2026

Riemannian Networks over Full-Rank Correlation Matrices

Representations on the Symmetric Positive Definite (SPD) manifold have garnered significant attention across different applications. In contrast, the manifold of full-rank correlation matrices, a normalized alternative to SPD matrices, remains largely underexplored. This paper introduces Riemannian networks over the correlation manifold, leveraging five recently developed correlation geometries. We systematically extend basic layers, including Multinomial Logistic Regression (MLR), Fully Connected (FC), and convolutional layers, to these geometries. Besides, we present methods for accurate backpropagation for two correlation geometries. Experiments comparing our approach against existing SPD and Grassmannian networks demonstrate its effectiveness.

cs.LG↗

arXiv2026

ESG as Priced Crash Insurance: State-Dependent Tail Risk and Deconfounding Evidence

This research establishes ESG as a state dependent insurance mechanism against equity crashes by addressing the decoupling of unconditional alpha from tail risk resilience. By validating market stress regimes as distinct economic states through a drawdown-based truncation rule, the study demonstrates that high ESG ratings materially reduce the incidence of discrete crash events during systemic drawdowns. To address the selection bias and high-dimensional confounding inherent in traditional linear frameworks, we implement Double Machine Learning as a structural deconfounding layer. Unlike simple predictive modeling, the Double Machine Learning framework utilizes machine learning to handle complex nuisance parameters, allowing us to isolate the asymmetric treatment effects of ESG across different market states. Distributional analysis reveals the underlying mechanism as ESG specifically attenuates the severity of realized tail losses at the most adverse quantiles instead of shifting the entire return distribution. Confirmed by structural estimates, this protection functions as priced insurance that incurs performance drags during stable periods while providing critical resilience when tail risks are most acute.

q-fin.MF↗