arXiv Science⌕ Search

arXiv subjects

Qiang Wang

Publications and source records attributed to Qiang Wang.

At least 37 records · Page 2Linked to original sources

NodeJEPA: Structure-Conditioned Latent Prediction for Node-Level Graph Self-Supervised Learning

Self-supervised learning on graphs is largely shaped by contrastive methods that depend on carefully designed augmentations, and by generative methods that reconstruct node attributes in the input space. Both paradigms can entangle representations with low-level input statistics rather than with relational structure. Joint-embedding predictive architectures (JEPA) instead learn by predicting latent targets rather than reconstructing inputs. Recent work has explored this idea for graph-level representation learning, but how to design JEPA-style objectives for node-level tasks, and which structural signals the predictor should condition on, remains less clear. We present NodeJEPA, a joint-embedding predictive architecture for node-level graph self-supervised learning. NodeJEPA masks structure-aware k-hop ego-subgraphs and trains a context encoder to predict the latent representations of the masked nodes. These targets come from an EMA-updated target encoder with stop-gradient. A structure-conditioned predictor integrates spectral and centrality descriptors through cross-attention. Variance, covariance, and Laplacian spectral regularizers help stabilize the embedding geometry, and an optional curriculum gradually increases masking difficulty during training. Because prediction occurs in latent space, NodeJEPA does not rely on input reconstruction or hand-crafted graph augmentations. We evaluate NodeJEPA on standard node classification benchmarks under linear probing and fine-tuning protocols, and conduct ablations on masking, prediction, and regularization design choices. Our study offers a practical recipe for node-level JEPA-style latent prediction on graphs, and clarifies when structural conditioning helps representation learning. Code, configurations, and evaluation scripts are publicly available at https://github.com/OliverZ-dot/Node-Jepa.

cs.LG↗

Real-time decoding of quantum error correction codes using high-performance computing

Quantum error correction (QEC) is indispensable for building scalable fault-tolerant quantum computers. Effective QEC demands stringent real-time decoding: the decoder must process syndrome measurements and determine corrections within a time scale--typically on the order of microseconds, to avoid data backlog. Scaling to large number of logical qubits further necessitates significant computational resources. In this work, we propose an architecture, called \emph{THQLink}, for real-time decoding of quantum error correction codes using high-performance computing (HPC) resources. The network connecting the HPC and the control system of quantum processing unit (QPU) is built on TH-Express and can be adapted to different quantum technologies and their associated control stacks. We report a round-trip latency of 2.944 $μ$s on average, with an incremental overhead of 130 ns per additional hop. Using a parallel window strategy, we demonstrate real-time decoding (1 $μ$s per QEC round) of the surface code up to distance 19 using a matching-based decoder on CPUs. Our work presents a scalable framework for real-time decoding in fault-tolerant quantum computing. It can be readily applied to quantum-centric supercomputers that feature tight integration between QPU and HPC resources, thereby enabling efficient support for hybrid quantum-classical algorithms and computation-intensive workloads offloaded from the QPU.

quant-ph↗

Geometry of BPS Attractor, Hessian, and Spectral Flows

We provide a systematic and rigorous geometric framework that relates three structures naturally associated to BPS central charges in $\mathcal{N}=2$ supersymmetric gauge theories: the split attractor flow (SAF) of $|Z|$, the Hessian flow (HF) of $\operatorname{Im}(e^{-i\vartheta}Z)$, and the spectral network (SN) on the base curve of the Hitchin fibration. Our main contributions are: (i) a concise proof of orthogonality between SAF and gradient Hessian flow using only the Kähler structure; (ii) a precise lift--projection duality showing that the spectral network projects to the \emph{characteristic Hessian flow} (the Hamiltonian flow of $\operatorname{Im}(e^{-i\vartheta}Z)$) on the Hitchin base, clarifying a crucial distinction; (iii) a complete proof of the Kontsevich--Soibelman (KS) equivariance by induction on the SAF tree depth, with the geometric ordering provided by the characteristic Hessian flow. We illustrate the framework with detailed and nontrivial examples: $SU(2)$ pure and $N_f=4$ (including BPS indices for higher flavour charges), $SU(3)$ pure (full BPS spectrum reconstruction), $SU(4)$, the Kronecker $3$-quiver, and we apply the induction to derive a closed-form BPS spectrum for the Argyres--Douglas $H_1$ theory, $Ω(nα_1+mα_2)=\frac{1}{n+m}\binom{n+m}{n}\binom{n+m}{n+1}$, which is known from Cecotti--Vafa and serves as a strong consistency check of our geometric recursion. In the tropical limit we obtain an explicit generating function for disk counts in $SU(N)$ gauge theories, $Z_{\mathrm{disk}}^{SU(N)}(y) = \exp\!\,\Bigl( \sum_{α\inΦ_+} \sum_{k=1}^{\infty} \frac{1}{k}\binom{k+\mathrm{ht}(α)-1}{\mathrm{ht}(α)-1} e^{-k\langleα,y\rangle} \Bigr) $, which reproduces the standard scattering diagram result and confirms the geometric framework.

math-ph↗

Sparsity-Aware Low-Rank Representation for Efficient Fine-Tuning of Large Language Models

Adapting large pre-trained language models to downstream tasks often entails fine-tuning millions of parameters or deploying costly dense weight updates, which hinders their use in resource-constrained environments. Low-rank Adaptation (LoRA) reduces trainable parameters by factorizing weight updates, yet the underlying dense weights still impose high storage and computation costs. Magnitude-based pruning can yield sparse models but typically degrades LoRA's performance when applied naively. In this paper, we introduce SALR (Sparsity-Aware Low-Rank Representation), a novel fine-tuning paradigm that unifies low-rank adaptation with sparse pruning under a rigorous mean-squared-error framework. We prove that statically pruning only the frozen base weights minimizes the pruning error bound, and we recover the discarded residual information via a truncated-SVD low-rank adapter, which provably reduces per-entry MSE by a factor of $(1 - r/\min(d,k))$. To maximize hardware efficiency, we fuse multiple low-rank adapters into a single concatenated GEMM, and we adopt a bitmap-based encoding with a two-stage pipelined decoding + GEMM design to achieve true model compression and speedup. Empirically, SALR attains 50\% sparsity on various LLMs while matching the performance of LoRA on GSM8K and MMLU, reduces model size by $2\times$, and delivers up to a $1.7\times$ inference speedup.

cs.LG↗

VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editing

Despite the rapid advancements in Vision-Language Models (VLMs), a critical gap remains in their ability to handle structured, controllable diagrammatic tasks essential for professional workflows. Existing methods predominantly rely on pixel-based synthesis, which operates in probabilistic pixel spaces and is inherently limited in editability and fidelity. Instead, we propose a new Diagram-as-Code paradigm with symbolic logic that leverages mxGraph Extensible Markup Language (XML) for precise diagram generation and editing. We present VCG-Bench, a unified benchmark for visual-centric \texttt{mxGraph} tasks. VCG-Bench comprises: (1) a taxonomized dataset of 1,449 diverse diagrams spanning 6 domains and 15 sub-domains, (2) a paradigm definition that integrates Generation (Vision-to-Code) and Editability (Code-to-Code), (3) a Tailored Evaluation Protocol employing multi-dimensional metrics such as \texttt{mxGraph} Execution Success Rate, Style Consistency Score (SCS), etc. Experimental results highlight the challenges faced by current State-of-the-Art (SOTA) VLMs in structured fidelity and instruction compliance, reflecting their vision and reasoning capabilities.

cs.CL↗

Learning a System-Level Surrogate for Hydraulic Excavators: A Simulation-to-Real LSTM Approach

Developing autonomous hydraulic excavators is constrained by limited access to physical machines and the high cost of real-world experimentation. This paper proposes a simulation-to-real framework for learning a system-level digital surrogate using Long Short-Term Memory (LSTM) networks. Instead of modeling internal dynamics, the excavator is treated as an input-output operator, and the surrogate is trained to reproduce its closed-loop behavior under identical control inputs. The approach is first validated in a MuJoCo simulation environment and then transferred to a real excavator. To address measurement inconsistencies in real-world data, a consistency-aware state estimation method based on adaptive Kalman filtering is introduced. Experimental results demonstrate that the learned surrogate achieves high fidelity in both angular velocity and long-horizon trajectory reproduction under closed-loop autoregressive evaluation. These results confirm that the proposed model can serve as a drop-in surrogate for both simulation and physical systems, enabling scalable and efficient development of excavation automation algorithms.

cs.RO↗

Dynamic Constraint Reconstruction Based Control Barrier Functions for Safety-Critical Control of High-Dimensional Manipulators

Control barrier functions (CBFs) provide formal safety guarantees for constrained nonlinear systems, but their effectiveness relies on accurate system dynamics. In high-dimensional manipulators subject to unknown disturbances and model uncertainties, fixed safety constraints constructed from nominal dynamics may become inconsistent with the actual system behavior, leading to safety degradation or excessive conservatism. This paper proposes a dynamic constraint reconstruction based control barrier function (DCR-CBF) framework for safety-critical control of disturbed robotic manipulators. An extended state observer is employed to estimate lumped disturbances online, and the estimated disturbance is incorporated into high-order control barrier functions to reconstruct safety constraints according to the estimated true dynamics. To address estimation inaccuracies, a safety margin is introduced, and a sufficient condition is derived to guarantee forward invariance under bounded estimation errors. Simulation studies on a 4-DOF excavation manipulator demonstrate that the proposed DCR-CBF method achieves zero safety violation under strong unknown disturbances while significantly improving trajectory-tracking performance compared with standard and robust CBF methods.

eess.SY↗

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers

As Model Context Protocol (MCP) servers emerge as the core infrastructure for connecting LLMs with external tools, existing benchmarks leverage real-world MCP servers to evaluate LLM agents' tool-using capabilities. However, these benchmarks overlook the continuous evolution of tool interfaces and functionalities within MCP servers, resulting in flawed assessments that fail to capture the agent's adaptability in changing tool landscapes. To bridge this gap, we introduce \textbf{MCPEvol-Bench}, a novel benchmark for evaluating the task-solving capabilities of LLM agents under dynamic toolset evolution. Inspired by large-scale empirical study, we propose 11 mutation operators to simulate realistic tool evolution within 123 MCP servers. We benchmark 12 state-of-the-art LLMs on multiple versions of MCP servers, revealing that even frontier models struggle to adapt to evolving tools. For instance, GPT-5.4 and Claude-Sonnet-4-6 exhibit performance declines of 13.7\% and 14.4\% in evolved MCP servers, respectively, accompanied by substantial increases in planning and reasoning errors. These findings highlight the vulnerability of LLM-driven workflows, establishing MCPEvol-Bench as a standard for evaluating agent adaptability in dynamic tool environments.

cs.AI↗

LPM: Industrial-Scale Generative Video Restoration

We present the Large Processing Model (LPM), a diffusion-based generative framework for photorealistic video restoration under complex, in-the-wild degradations. To our knowledge, LPM is the first generative video restoration model deployed at industrial scale. LPM addresses the diverse degradations in user-generated content (UGC) through a unified system encompassing large-scale data engineering, foundation-model training, and efficient inference. Its enhanced architecture, progressive training strategy, and temporal-pyramid inference mechanism jointly enable high-fidelity, temporally consistent restoration of arbitrarily long videos across the broad content distribution encountered on UGC platforms. LPM has been deployed in production at Kuaishou, where videos processed by the model account for approximately 45% of total viewing time, delivering consistent improvements across key quality-of-experience metrics. Beyond perceptual enhancement, LPM delivers substantial system-level benefits: at comparable perceptual quality, it reduces bitrate by 20% relative to Kuaishou's in-house codec, yielding annual bandwidth cost savings on the order of hundreds of millions. Its low serving cost also enables integration into products such as Kling, demonstrating that generative restoration can be practical, scalable, and cost-effective for large-scale video processing.

cs.CV↗

Attractor Flow Versus Hesse Flow in Wall-Crossing Structures

We recast the physics discussions in the paper of Dieter Van den Bleeken \cite{svan2012bps} within the context of wall-crossing structure à la Kontsevich and Soibelman \cite{kontsevich2014wall}. In particular, we compare the Hesse flow given in \cite{svan2012bps} and the attractor flow on the base of the complex integrable system, and show that both can be used in the formalism of wall-crossing structure. We also propose the notions of dual Hesse flow and dual attractor flow, and show that under the rotation of the $\mathbb{Z}$-affine structure, the Hesse flow can be transformed into the dual attractor flow, while the attractor flow into the dual Hesse flow. This suggests its possible use in Mirror Symmetry.

math-ph↗

Extremalization approach to black hole thermodynamics: perturbations around higher-derivative gravities

When higher-derivative terms are added to a gravitational action, black hole solutions and their thermodynamic properties are generally corrected. Recent progress has shown that, by treating higher-derivative operators as perturbations, the first-order corrections to black hole thermodynamics can be obtained without explicit knowledge of the corresponding perturbed black hole solutions. This result can be understood as a consequence of an extremalization principle underlying the Euclidean action formulation of black hole thermodynamics. In this paper, we emphasize that this extremalization approach is not restricted to perturbations around Einstein gravity. Instead, it can be applied to perturbations of more general higher-derivative gravity theories whose black hole solutions are already known and can be taken as the zeroth-order background. As an explicit illustration, we consider Einstein--Gauss--Bonnet gravity as the zeroth-order theory and study the first-order thermodynamic corrections induced by further higher-order curvature operators. We show that these corrections can be derived without solving the perturbed black hole solutions, both in asymptotically flat and asymptotically AdS spacetimes.

gr-qc↗

Quantum gravitational corrections to Reissner-Nordström black hole thermodynamics and their implications for the weak gravity conjecture

In this paper, we investigate the quantum gravitational corrections to the thermodynamical quantities of Reissner-Nordström black holes within the framework of effective field theory. The effective action originates from integrating out massless particles, including gravitons, at the one-loop level. We perform a complete thermodynamic analysis for both non-extremal and extremal black holes, and are mainly concerned about the shift in the charge-to-mass ratio $q/M$ that plays an important role in analyzing the weak gravity conjuecture. For non-extremal black holes, we identify a relationship between the shift in the charge-to-mass ratio and the thermodynamic stability of the black holes. For extremal black holes, we show that quantum gravity effects naturally lead to the super-extremality $q/M>1$ of charged black holes.

gr-qc↗

Dirac branch-cut modes with relativistic transport

Emergent Dirac fields, exhibiting effective relativistic physics, are most commonly associated with bulk and surface states in materials such as graphene and topological insulators. Here we identify a previously unexplored class of Dirac states that propagate along branch-cut defects in a complex Dirac mass field, unlike the well-known Jackiw-Rebbi and Jackiw-Rossi states localized at domain-wall and vortex defects. These traveling-wave defect states, termed Dirac branch-cut (DBC) modes, obey an effective one-dimensional relativistic Dirac equation with a reduced mass determined by the phase difference across the branch cut. Using acoustic metamaterials, we experimentally demonstrate a range of relativistic phenomena exhibited by DBC modes, including relativistic dispersion, energy-independent confinement, Klein tunnelling, and transport along freeform (e.g., spiral) trajectories. Our results establish branch-cut defects as a distinct mechanism for Dirac defect states beyond domain walls and vortices, and extend relativistic Dirac physics from bulk and surface states to propagating modes confined to defect boundaries.

physics.optics↗

Secure-CHG: A Comprehensive Framework for Robust and Fair Federated Learning via Hybrid Defense and Contribution-Aware Trust

Federated Learning (FL) is highly susceptible to stealthy backdoor attacks, which aim to force a model into predicting an attacker-chosen target class for inputs containing a specific trigger. However, existing statistical defenses primarily focus on the early stages of model convergence. In this paper, we identify a fundamental vulnerability termed ``Late-stage Failure.'' We demonstrate that as the global model converges, decaying gradient norms render malicious and benign updates morphologically indistinguishable. This vanishing statistical variance effectively blinds traditional defenses, enabling adaptive adversaries to remain dormant and subsequently hijack the training process. To overcome these constraints, we propose Secure-CHG, a hybrid framework that pivots the defense paradigm from superficial morphological detection toward intrinsic semantic contribution verification. Secure-CHG employs an adaptive defense pipeline: a cascaded statistical filter stabilizes optimization during the early oscillatory phase, while a novel CHG-Shapley mechanism takes over during late-stage convergence. By leveraging sample hardness (i.e., local training loss) to project updates into a composite Hardness-Gradient space, it effectively amplifies adversarial semantic traces, enabling the isolation of stealthy attackers even as gradient norms vanish. Furthermore, we derive a closed-form solution for CHG-Shapley, facilitating low-complexity, retraining-free node valuation and trust-modulated aggregation. Extensive evaluations on CIFAR-10, MedMNIST, and NEU-SDDB demonstrate that Secure-CHG effectively mitigates Late-stage Failure. Specifically, it significantly suppresses advanced backdoor attacks, reducing their attack success rate by 2.3$\times$ and 2.0$\times$ relative to the mainstream Krum and Trimmed Mean baselines, respectively.

cs.CR↗

HyperDFlash: Hyper-Connection-Aligned Block Speculative Decoding with Gated Residual Reduction

We present HyperDFlash, a block-parallel speculative decoding framework tailored to DeepSeek-V4's Hyper-Connections (HC). Despite the strong performance of DeepSeek-V4's native Multi-Token Prediction (MTP) module on initial token drafting, its draft accuracy degrades sharply at later positions, as error accumulation from unverified intermediate tokens harms draft acceptance rates. Although the original DFlash method supports efficient one-pass block drafting, it cannot be seamlessly adapted to the HC paradigm, since DeepSeek-V4's multi-path residual stream induces inherent feature misalignment with conventional drafting designs. To resolve this architectural mismatch, we propose two dedicated, model-aligned optimizations for HC residual streams. First, we adopt pre-collapse residual states as the exclusive conditioning signal, preserving complete multi-path structural information and better aligning the drafter with the target's native prediction pathway. Second, we replace the heavy generic linear compressor with a lightweight gated residual reducer, whose parameters are directly inherited from the target model's built-in hc_head module. This design yields input-aware path aggregation with three orders of magnitude fewer parameters while maintaining precise architectural alignment. We further enhance model training via a targeted KL distillation loss applied to the LM-head, regularizing predictions against the target distribution to improve early draft quality. Extensive experiments across math reasoning, code synthesis, and conversational benchmarks demonstrate that HyperDFlash consistently outperforms both the native MTP baseline and vanilla DFlash adaptation, achieving substantial gains in average accepted draft length and decoding speedup. These results validate HC alignment, gated reduction, and targeted distillation for high-performance speculative decoding.

cs.LG↗

A novel approach for studying two-particle momentum correlation function in relativistic nuclear collisions

Two particle momentum correlation functions provide a nontrivial tool for probing the strong interaction and/or extracting particle emission source information in relativistic nuclear collisions. Although transport models can describe the microscopic phase-space evolution of the collision system, calculating correlation functions within the framework of transport models remains challenging. In this paper, we employ the mixed-event technique to calculate two particle momentum correlation function as $C(k^*)= \mathcal{N} ξ(k^*)\frac{N_{\mathrm{same}}(k^*)}{N_{\mathrm{mixed}}(k^*)}$ based on the parton and hadron cascade model PACIAE simulated final hadronic state (FHS) with introducing a modification factor $ξ(k^*)$ to improve the treatment of final-state interactions and quantum statistics effects in the PACIAE model. The simulated results show good agreement with the ALICE data for $Kp$, $pp$, $pΛ$, and $ΛΛ$ momentum correlation functions in $pp$ collisions at $\sqrt{s}=7$ TeV. On the other hand, the particle emission source radius of the correlated pairs are also evaluated based on the simulated FHS self-consistently. Since the PACIAE model employs hadron-hadron cross sections derived from the additive quark model, the calculation of two-particle momentum correlation functions does not require prior assumptions about the interaction between the two correlated particles. This successful ``PACIAE + modification factor" approach may shed light on the future study of momentum correlation functions for dimesons, dibaryons, and even diexotic hadrons.

hep-ph↗

OGER: A Robust Offline-Guided Exploration Reward for Hybrid Reinforcement Learning

Recent advancements in Reinforcement Learning with Verifiable Rewards (RLVR) have significantly improved Large Language Model (LLM) reasoning, yet models often struggle to explore novel trajectories beyond their initial policy distribution. While offline teacher guidance and entropy-driven strategies have been proposed to address this, they often lack deep integration or are constrained by the model's inherent capacity. In this paper, we propose OGER (Offline-Guided Exploration Reward), a novel framework that unifies offline teacher guidance and online reinforcement learning through a specialized reward modeling lens. OGER employs multi-teacher collaborative training and constructs an auxiliary exploration reward that leverages both offline trajectories and the model's own entropy to incentivize autonomous exploration. Extensive experiments across mathematical and general reasoning benchmarks demonstrate that OGER consistently outperforms competitive baselines, achieving substantial gains in mathematical reasoning while maintaining robust generalization to out-of-domain tasks. We provide a comprehensive analysis of training dynamics and conduct detailed ablation studies to validate the effectiveness of our entropy-aware reward modulation. Our code is available at https://github.com/ecoli-hit/OGER.git.

cs.AI↗

Position: LLM Inference Should Be Evaluated as Energy-to-Token Production

LLM inference is still evaluated mainly as a model or software problem: accuracy, latency, throughput, and hardware utilization. This is incomplete. At deployment scale, the relevant output is a quality-conditioned token produced under joint constraints from effective compute, delivered data-center power, cooling capacity, PUE, and utilization. We argue that the ML community should treat inference as \emph{energy-to-token production}. We formalize this view with a dimensionally consistent Token Production Function in which token rate is bounded by both compute-per-token and energy-per-token ceilings. Listed API prices vary by over an order of magnitude across providers, but we use price dispersion only as directional motivation, not as causal evidence of marginal cost. The core physical question is instead: under fixed quality and service targets, when does the binding constraint move from theoretical peak compute toward delivered power, cooling, and operational efficiency? Under this framing, system optimizations -- latent KV-cache compression, sparse or heavily compressed attention, quantization, routing, and difficulty-adaptive reasoning -- are not merely local engineering tricks. They are energy-to-token levers because they reduce FLOPs/token, joules/token, memory traffic, or utilization losses under fixed $(q^{*},s^{*})$. We therefore call for inference papers and benchmarks to report Joules/token, active binding constraint, PUE-adjusted delivered power, and utilization-adjusted token output alongside accuracy and latency.

cs.CE↗