arXiv Science⌕ Search

arXiv subjects

Hai Zhang

Publications and source records attributed to Hai Zhang.

At least 19 recordsLinked to original sources

OpenRDMA: A GPU-Native Multi-Path Reliable RDMA Transport Architecture

As the computing power density of large-scale AI clusters rises, network communication increasingly limits system performance. GPU-initiated communication requires low-overhead request submission to overlap communication with computation. However, GPUDirect RDMA (GDR) still relies on CPU involvement in its control path, while InfiniBand GPUDirect Async (IBGDA) requires GPUs to assemble Work Queue Entries (WQEs), consuming additional SM resources and memory bandwidth. We propose OpenRDMA, an open-source multi-path reliable RDMA transport architecture designed for GPU-friendly communication. First, OpenRDMA provides a minimal GPU doorbell mechanism: the GPU issues an 8-byte token, and a dedicated FPGA NIC reconstructs the complete WQE from preconfigured context. Second, building on Multipath Reliable Connection (MRC), OpenRDMA supports per-packet multi-path transport and out-of-order arrivals, while selective retransmission, ordered DMA placement, and GPU-visible flag polling provide reliable delivery and safe data consumption. Third, a hardware-software co-designed retransmission mechanism keeps the GPU submission path lightweight and reduces FPGA hardware state overhead: the NIC handles fast data transfer, while CPU software manages complex timeout detection, state tracking, and recovery policies. We describe the architecture and key hardware components of OpenRDMA; implementation of the FPGA prototype is underway.

cs.AR↗

Faithful Federated Tabular Data Synthesis

Synthetic data is an important data source in the AI era. This paper studies the generation of mixed-type tabular synthetic data in federated settings, where two key challenges arise: ensuring distributional fidelity and effectively handling mixed-type data. We propose Federated Integrative Two-Step Synthesis (FITS), a framework for mixed-type tabular data synthesis. At its core is a two-step federated algorithm for estimating conditional cumulative distribution functions (CDFs) using local linear regression. Building on this algorithm, we develop a federated synthesis procedure based on the probability chain rule to ensure distributional fidelity. To handle mixed-type data, FITS introduces a continualization method that lifts discrete variables into a continuous space and recovers their discrete distributions without loss at both the density-function and CDF levels. This transformation provides a unified continuous representation of mixed-type variables, facilitating the application of local linear regression and synthetic data generation. Our theoretical analysis characterizes the conditional density and cumulative distribution functions of the continualized mixed-type variables and establishes the uniform convergence of the resulting federated conditional CDF estimators. Experiments demonstrate that FITS-generated synthetic data improves downstream task performance for all clients, with the benefits depending on how the synthetic data is used.

cs.LG↗

A Statistical Imaging Framework for Inverse Obstacle Scattering and Its Resolution Analysis

We develop a general statistical framework for inverse obstacle imaging and resolution analysis from far-field second moments under random illumination. The regularized $Q$-statistic is introduced and utilized to measure the minimal statistically weighted cost of synthesizing the test far field associated with a sampling point. Its reciprocal provides an imaging indicator. Under uniform full-aperture plane-wave illumination, we relate this indicator to several classical sampling indicators and derive their statistical counterparts for general random illumination. For the resolution analysis, separating the effects of radiation and noise from the statistics of induced boundary sources, we measure a correlation-free resolution limit by the one-sided half-height width of the boundary transition. In the regime of fixed wavenumber $k$ with the noise-calibrated regularization level $ρ_τ\to 0$, we establish a sharp asymptotic law for this width for simply connected domains with analytic boundaries. The width scales as \(h_Γ(x)\log\log(1/ρ_τ)/\log(1/ρ_τ)\), with $h_Γ(x)$ a geometric prefactor along the boundary determining both the boundary image contrast and the local transition width. For general boundary-source statistics, we examine how the source mean, variance, and correlation affect imaging quality. Finally, in representative scattering configurations, we provide qualitative interpretations of some typical imaging phenomena through the statistical structure of their induced boundary sources. Numerical examples illustrate these mechanisms and indicate that practical resolution is governed jointly by source statistics, radiation, the noise level, rather than by wavelength alone.

math.NA↗

Multilayer-Dynamic Network Clustering with Application to World Trade Data

International trade data, such as the FAO dataset, can be naturally represented as \emph{multilayer-dynamic networks}, where countries are nodes, trade relationships are edges, different products correspond to different layers, and networks evolve over time. An important problem is how to identify evolving community structures in such multilayer-dynamic trade networks. Motivated by this problem, we study community detection in multilayer-dynamic networks, allowing the community structure to vary across both layers and time. We propose a novel method, \emph{MuDySC} (Multilayer-Dynamic Spectral Clustering), which smooths the eigenspace projection matrices across adjacent time points and across layers at the same time point. We develop an efficient alternating iterative algorithm and establish both global and local convergence results, with the latter allowing weaker conditions on the tuning parameters when the relevant eigenspaces are sufficiently close and the algorithm is suitably initialized. We apply MuDySC to the FAO data. The analysis reveals clear asymmetry between export and import community structures and highlights both persistent and shifting trade positions of major countries. As an extension to accommodate substantial heterogeneity across network layers, we develop TLC-MuDySC, a tensor-based layer-clustering method that first identifies structurally related layers and then applies MuDySC within the estimated layer groups.

stat.AP↗

Learning Geometrically-Grounded Amodal 3D Representations for View-Generalizable Robotic Manipulation

Real-world robotic manipulation requires visuomotor policies capable of robust 3D scene reasoning under varying camera viewpoints. While recent 3D-aware manipulation policies have shown promise, they still face several limitations: (i) reliance on multi-view observations during inference, which is impractical in camera-constrained deployments; (ii) insufficient geometric fidelity in learned representations, limiting precise and viewpoint-robust control; and (iii) the lack of effective mechanisms for transferring pretrained 3D representations to downstream visuomotor policies. To address these challenges, we present GEM3D (Geometrically-Grounded 3D Manipulation), a unified 3D representation and policy learning framework for view-generalizable robotic manipulation. GEM3D learns amodal 3D representations from single-view RGB-D observations by jointly enforcing point-cloud reconstruction and Gaussian-splatting-based novel-view consistency during pretraining. A multi-step distillation strategy then transfers the learned geometric understanding into a deployable single-view visuomotor policy for downstream manipulation control. Experiments on 12 RLBench tasks and three real-world tasks demonstrate strong manipulation performance. Further zero-shot evaluations on eight RLBench tasks and the real-world tasks show robust generalization to unseen camera poses and substantial gains over existing methods.

cs.RO↗

Spiral Harmonic Products

Motivated by the systematic study of spiral minimal products, we consider harmonic maps obtained by coupling two spherical eigenmaps through a profile curve in $\mathbb S^3$, with a doubly warped product metric on the source. The source warps are independent of the profile magnitudes. This gives two complementary problems: reconstructing a compatible source metric from prescribed profile or source data, and finding closed profiles when the source metric is fixed. For arbitrary prescribed warps, homogenization of the reduced Lagrangian gives a strongly convex conic Finsler metric whose oriented graph geodesics are exactly the harmonic profiles. In the unit-speed inverse problem, the phase momenta reduce reconstruction to a scalar magnitude equation. We obtain global reconstructions from a prescribed magnitude, one source warp, or a monotone volume factor, together with periodic families in which profiles closing on finite covers are dense. In the fixed-metric problem, a change of time gives an autonomous Neumann system. One fixed source metric then carries continuous families of closed profiles and infinitely many closed graph geodesics. For fixed even $p,q\geq 2$, every fixed metric in this Neumann class on $\mathbb S^1\times\mathbb S^p\times\mathbb S^q$ supports harmonic maps into $\mathbb S^{p+q+1}$ of degree $4m$ for every $m\geq 1$. In the matched constant-warp case, these maps reduce to explicit eigenmaps.

math.DG↗

A covariance-based reduced-order framework for solving acoustic scattering problems

This paper presents a physics-aware reduced-order method (ROM) for the efficient computation of wave-scattering problems. Standard model order reduction techniques, typically treating scattering as generic parameterized systems, frequently overlook the underlying physical structure, limiting their effectiveness in practice. To address this limitation, we propose an algorithmic framework that utilizes the intrinsic low-rank structure of the induced contrast source density. By modeling the incident wave as a random variable governed by a specified prior probability measure, we formulate the contrast source as a spatial random field whose covariance function captures essential spatial correlation and physical interactions. The reduced-order basis is then constructed via the Karhunen-Loève (KL) expansion, effectively extracting the dominant features from the scattering process to resolve multiple scattering scenarios. A central algorithmic contribution is the efficient reconstruction of the covariance matrix for arbitrary scatterer geometries and specified incident wave priors. To circumvent the prohibitive computational cost of assembling high-fidelity covariance matrices, we introduce a non-intrusive, physics-informed graph neural network (GNN) surrogate to learn the complex mapping from scatterer geometry to the source correlation kernel, enabling a highly efficient offline-online computational paradigm suitable for large-scale scattering configurations. Extensive numerical experiments demonstrate that the proposed framework achieves robust computational acceleration over full-order models without sacrificing accuracy.

math.NA↗

Automatic Model-Hardware Co-Adaptation for Heterogeneous AI Accelerators

Large language models now evolve faster than production inference systems can be ported and optimized. New releases change attention, MoE routing, quantization formats, KV-cache layout, and parallel execution patterns, while deployed accelerator fleets remain heterogeneous across hardware generations, framework forks, operator libraries, compiler backends, and communication runtimes. Serving a new model on existing hardware is therefore a model-framework-kernel-hardware co-adaptation problem. We present MetaInfer, an LLM-agent system that formulates inference adaptation as route search over a costed execution-adaptation graph. The graph connects model semantics, framework dispatch, kernel choices, hardware capabilities, runtime evidence, and serving objectives. MetaInfer constructs and updates this graph during execution, restores missing or blocked routes through patches, and reduces route cost through staged validation and end-to-end profiling. Three real episodes -- DeepSeek V4 Flash on NVIDIA A800, GLM 5.3 Flash on NVIDIA A800, and DeepSeek V4 Flash on Hygon K100AI DCU -- demonstrate deployment repair, cross-model knowledge transfer, and portability across heterogeneous accelerator software stacks.

cs.MA↗

Model Selection and Parameter Estimation of One-Dimensional Gaussian Mixture Models

In this paper, we study the problem of learning one-dimensional Gaussian mixture models (GMMs) with a specific focus on estimating both the model order and the mixing distribution from independent and identically distributed (i.i.d.) samples. This paper establishes the optimal sampling complexity for model order estimation in one-dimensional Gaussian mixture models. We prove a fundamental lower bound on the number of samples required to correctly identify the number of components with high probability, showing that this limit depends critically on the separation between component means and the total number of components. We then propose a Fourier-based approach to estimate both the model order and the mixing distribution. Our algorithm utilizes Fourier measurements constructed from the samples, and our analysis demonstrates that its sample complexity matches the established lower bound, thereby confirming its optimality. Numerical experiments further show that our method outperforms conventional techniques in terms of efficiency and accuracy.

stat.ML↗

Model Selection and Parameter Estimation for Multidimensional Gaussian Mixture Models with a Common Covariance Matrix

We study model-order selection and component-mean estimation for multidimensional Gaussian mixture models with a known common covariance matrix. Using empirical characteristic-function measurements, we construct Fourier covariance matrices whose population counterparts have rank equal to the number of mixture components. We establish a minimax lower bound showing that distinguishing a separated $k$-component mixture from the class of $(k-1)$-component mixtures requires $Ω(Δ^{-(4k-4)})$ samples. We then develop an oracle spectral-thresholding estimator with a sufficient sample size of order $Δ^{-(8k-8)}$ for fixed $k$, together with a practical singular-value-ratio estimator. Given the model order, we estimate the component means by score-initialized gradient descent on a MUSIC-type projection objective. Under an explicit sample-size condition, a qualifying sample initialization lies in a certified attraction region with high probability, after which the iterates converge linearly. For fixed positive component separation, the resulting mean estimates achieve the parametric rate $\mathcal{O}_p(n^{-1/2})$. Numerical experiments demonstrate competitive accuracy and lower computational cost than expectation-maximization across a range of multidimensional settings.

stat.ML↗

Enhancing Differentially Private Linear Regression via Public Second-Moment

Leveraging information from public data has become increasingly crucial in enhancing the utility of differentially private (DP) methods. Traditional DP approaches often require adding noise based solely on private data, which can significantly degrade utility. In this paper, we address this limitation in the context of the ordinary least squares estimator (OLSE) of linear regression based on sufficient statistics perturbation (SSP) under the unbounded data assumption. We propose a novel method that involves transforming private data using the public second-moment matrix to compute a transformed SSP-OLSE, whose second-moment matrix yields a better condition number and improves the OLSE accuracy and robustness. We derive theoretical error bounds about our method and the standard SSP-OLSE to the non-DP OLSE, which reveal the improved robustness and accuracy achieved by our approach. Experiments on synthetic and real-world datasets demonstrate the utility and effectiveness of our method.

cs.LG↗

Spectral topology and edge modes for one-dimensional non-Hermitian photonic crystals

This work investigates edge modes in non-Hermitian photonic crystals with broken spectral reciprocity. In such systems, the spectra of the underlying operators generally form closed loops over the complex plane with nontrivial spectral topology, which gives rise to the so-called skin effect characterized by edge modes localized at interfaces. For discrete lattice models, the skin effect can be understood through the spectral theory of Toeplitz matrices. However, this mathematical framework no longer applies to continuous wave models, where finite-dimensional approximations break down. In this work, we employ a transfer matrix approach to describe wave propagation in one-dimensional periodic media and introduce a new spectral topological invariant based on the eigenvalues of the transfer matrix. The new topological invariant is equivalent to the winding number of the non-Hermitian spectrum and it enables the characterization of edge modes in one-dimensional non-Hermitian photonic crystals. The mathematical theory provides the theoretical foundation for the skin effect in continuous wave models.

math-ph↗

Quantitative Infrared Thermographic Assessment of Hand Cooling Dynamics During Controlled Contact with Metal Plates

This study investigates the spatiotemporal thermal response of human hands during controlled contact cooling using short wave infrared (SWIR), mid wave infrared (MWIR), and long wave infrared (LWIR) thermography. Three participants simultaneously placed one hand on a cooling metal plate and the contralateral hand on a reference plate maintained near room temperature. Temperature evolution was analyzed in five anatomical regions, including the distal finger, proximal finger, vessel associated region, non vessel region, and forearm. Quantitative metrics, including temperature variation, bilateral temperature difference, initial cooling rate, and frequency-domain amplitude, were extracted from the thermal image sequences. The results showed that the finger regions exhibited the largest temperature reductions and highest cooling rates, indicating greater sensitivity to thermal stimulation than the dorsal hand and forearm. MWIR and LWIR measurements revealed highly consistent cooling dynamics, while LWIR imaging provided enhanced thermal contrast and sensitivity. Frequency-domain analysis demonstrated that the dominant thermal response was concentrated in the low frequency range below 0.05 Hz. Furthermore, pixel-wise cooling rate maps highlighted substantial spatial heterogeneity across the hand surface. Numerical bioheat simulations confirmed that blood perfusion and skin plate contact conductance are key factors governing the cooling response. These findings demonstrate the potential of dynamic infrared thermography as a non-contact tool for assessing peripheral thermoregulation and vascular function during controlled cooling experiments.

physics.app-ph↗

Potentially Optimal Joint Actions Recognition for Cooperative Multi-Agent Reinforcement Learning

Value function factorization is widely used in cooperative multi-agent reinforcement learning (MARL). Existing approaches often impose monotonicity constraints between the joint action value and individual action values to enable decentralized execution. However, such constraints limit the expressiveness of value factorization, restricting the range of joint action values that can be represented and hindering the learning of optimal policies. To address this, we propose Potentially Optimal Joint Actions Weighting (POW), a method that ensures optimal policy recovery where existing approximate weighting strategies may fail. POW iteratively identifies potentially optimal joint actions and assigns them higher training weights through a theoretically grounded iterative weighted training process. We prove that this mechanism guarantees recovery of the true optimal policy, overcoming the limitations of prior heuristic weighting strategies. POW is architecture-agnostic and can be seamlessly integrated into existing value factorization algorithms. Extensive experiments on matrix games, difficulty-enhanced predator-prey tasks, SMAC, SMACv2, and a highway-env intersection scenario show that POW substantially improves stability and consistently surpasses state-of-the-art value-based MARL methods.

cs.LG↗

$χ_{0}$: Resource-Aware Robust Manipulation via Taming Distributional Inconsistencies

High-reliability long-horizon robotic manipulation has traditionally relied on large-scale data and compute to understand complex real-world dynamics. However, we identify that the primary bottleneck to real-world robustness is not resource scale alone, but the distributional shift among the human demonstration distribution, the inductive bias learned by the policy, and the test-time execution distribution -- a systematic inconsistency that causes compounding errors in multi-stage tasks. To mitigate these inconsistencies, we propose $χ_{0}$, a resource-efficient framework with effective modules designated to achieve production-level robustness in robotic manipulation. Our approach builds off three technical pillars: (i) Model Arithmetic, a weight-space merging strategy that efficiently soaks up diverse distributions of different demonstrations, varying from object appearance to state variations; (ii) Stage Advantage, a stage-aware advantage estimator that provides stable, dense progress signals, overcoming the numerical instability of prior non-stage approaches; and (iii) Train-Deploy Alignment, which bridges the distribution gap via spatio-temporal augmentation, heuristic DAgger corrections, and temporal chunk-wise smoothing. $χ_{0}$ enables two sets of dual-arm robots to collaboratively orchestrate long-horizon garment manipulation, spanning tasks from flattening, folding, to hanging different clothes. Our method exhibits high-reliability autonomy; we are able to run the system from arbitrary initial state for consecutive 24 hours non-stop. Experiments validate that $χ_{0}$ surpasses the state-of-the-art $π_{0.5}$ in success rate by nearly 250%, with only 20-hour data and 8 A100 GPUs. Code, data and models will be released to facilitate the community.

cs.RO↗

Differentially Private Truncation of Unbounded Data via Public Second Moments

Data privacy is important in the AI era, and differential privacy (DP) is one of the golden solutions. However, DP is typically applicable only if data have a bounded underlying distribution. We address this limitation by leveraging second-moment information from a small amount of public data. We propose Public-moment-guided Truncation (PMT), which transforms private data using the public second-moment matrix and applies a principled truncation whose radius depends only on non-private quantities: data dimension and sample size. This transformation yields a well-conditioned second-moment matrix, enabling its inversion with a significantly strengthened ability to resist the DP noise. Furthermore, we demonstrate the applicability of PMT by using penalized and generalized linear regressions. Specifically, we design new loss functions and algorithms, ensuring that solutions in the transformed space can be mapped back to the original domain. We have established improvements in the models' DP estimation through theoretical error bounds, robustness guarantees, and convergence results, attributing the gains to the conditioning effect of PMT. Experiments on synthetic and real datasets confirm that PMT substantially improves the accuracy and stability of DP models.

cs.CR↗

Principal Component Analysis-Based Terahertz Self-Supervised Denoising and Deblurring Deep Neural Networks

Terahertz (THz) systems inherently introduce frequency-dependent degradation effects, resulting in low-frequency blurring and high-frequency noise in amplitude images. Conventional image processing techniques cannot simultaneously address both issues, and manual intervention is often required due to the unknown boundary between denoising and deblurring. To tackle this challenge, we propose a principal component analysis (PCA)-based THz self-supervised denoising and deblurring network (THz-SSDD). The network employs a Recorrupted-to-Recorrupted self-supervised learning strategy to capture the intrinsic features of noise by exploiting invariance under repeated corruption. PCA decomposition and reconstruction are then applied to restore images across both low and high frequencies. The performance of the THz-SSDD network was evaluated on four types of samples. Training requires only a small set of unlabeled noisy images, and testing across samples with different material properties and measurement modes demonstrates effective denoising and deblurring. Quantitative analysis further validates the network feasibility, showing improvements in image quality while preserving the physical characteristics of the original signals.

cs.CV↗

POPL-KF: A Pose-Only Geometric Representation-Based Kalman Filter for Point-Line-Based Visual-Inertial Odometry

Mainstream Visual-inertial odometry (VIO) systems rely on point features for motion estimation and localization. However, their performance degrades in challenging scenarios. Moreover, the localization accuracy of multi-state constraint Kalman filter (MSCKF)-based VIO systems suffers from linearization errors associated with feature 3D coordinates and delayed measurement updates. To improve the performance of VIO in challenging scenes, we first propose a pose-only geometric representation for line features. Building on this, we develop POPL-KF, a Kalman filter-based VIO system that employs a pose-only geometric representation for both point and line features. POPL-KF mitigates linearization errors by explicitly eliminating both point and line feature coordinates from the measurement equations, while enabling immediate update of visual measurements. We also design a unified base-frames selection algorithm for both point and line features to ensure optimal constraints on camera poses within the pose-only measurement model. To further improve line feature quality, a line feature filter based on image grid segmentation and bidirectional optical flow consistency is proposed. Our system is evaluated on public datasets and real-world experiments, demonstrating that POPL-KF outperforms the state-of-the-art (SOTA) filter-based methods (OpenVINS, PO-KF) and optimization-based methods (PL-VINS, EPLF-VINS), while maintaining real-time performance.

cs.CV↗