arXiv subjects

Hao Wu

Publications and source records attributed to Hao Wu.

At least 451 records · Page 25Linked to original sources

arXiv2024

Large critical fields in superconducting Ti$_{4}$Ir$_2$O from spin-orbit coupling

The recently synthesized $η$-carbide-type superconductors exhibit large critical fields. A notable example is Ti$_4$Ir$_2$O, for which the upper critical field strongly violates the Pauli paramagnetic limit, behavior that is unusual for cubic materials that preserve inversion symmetry. Here, by combining density functional theory (DFT) and analytic modeling, we provide an explanation for this enhanced Pauli limiting field. We show that the nonsymmorphic Fd$\overline{3}$m symmetry implies that the electronic states near the X points exhibit strong spin-orbit coupling (SOC), which leads to a vanishing effective $g$-factor and enables the enhanced Pauli limiting field. Furthermore, our DFT results reveal a Van Hove singularity (VHS) peak near the X points, accounting for $\sim$65\% of the total density of states (DOS), occurring near the chemical potential. We propose that the strong SOC and enhanced DOS in the vicinity of the X points provide the origin of the observed enhanced critical field. This leads to a prediction that the magnetic field will lead to a strongly momentum-dependent gap suppression. The gap due to electronic states away from (near to) the X points will be rapidly (slowly) suppressed by fields.

cond-mat.supr-con↗

arXiv2024

The LAMOST Spectroscopic Survey of Supergiants in M31 and M33

We present systematic identifications of supergiants of M31/M33 based on massive LAMOST spectroscopic survey. Radial velocities of nearly 5000 photometrically selected M31/M33 supergiant candidates have been properly derived from the qualified spectra released in LAMOST DR10. By comparing their radial velocities with those predicted from the rotation curves of M31, as well as utilizing {\it Gaia} astrometric measurements to exclude foreground contaminations, 199 supergiant members in M31, including 168 `Rank1' and 31 `Rank2', have been successfully identified. This sample contains 62 blue supergiants (BSGs, all `Rank1'), 134 yellow supergiants (YSGs, 103 `Rank1' and 31 `Rank2') and 3 red supergiants (RSGs, all `Rank1'). For M33, we identify 84 supergiant members (56 `Rank1' and 28 `Rank2'), which includes 28 BSGs (all `Rank1'), 53 YSGs (25 `Rank1' and 28 `Rank2') and 3 RSGs (all `Rank1'). So far, this is one of the largest supergiant sample of M31/M33 with full optical wavelength coverage (3700 \textless $λ$ \textless 9100 Å). This sample is valuable for understanding the star formation and stellar evolution under different environments.

astro-ph.GA↗

arXiv2024

DeepContext: A Context-aware, Cross-platform, and Cross-framework Tool for Performance Profiling and Analysis of Deep Learning Workloads

Effective performance profiling and analysis are essential for optimizing training and inference of deep learning models, especially given the growing complexity of heterogeneous computing environments. However, existing tools often lack the capability to provide comprehensive program context information and performance optimization insights for sophisticated interactions between CPUs and GPUs. This paper introduces DeepContext, a novel profiler that links program contexts across high-level Python code, deep learning frameworks, underlying libraries written in C/C++, as well as device code executed on GPUs. DeepContext incorporates measurements of both coarse- and fine-grained performance metrics for major deep learning frameworks, such as PyTorch and JAX, and is compatible with GPUs from both Nvidia and AMD, as well as various CPU architectures, including x86 and ARM. In addition, DeepContext integrates a novel GUI that allows users to quickly identify hotpots and an innovative automated performance analyzer that suggests users with potential optimizations based on performance metrics and program context. Through detailed use cases, we demonstrate how DeepContext can help users identify and analyze performance issues to enable quick and effective optimization of deep learning workloads. We believe Deep Context is a valuable tool for users seeking to optimize complex deep learning workflows across multiple compute environments.

cs.PF↗

arXiv2024

Privacy-Preserving Federated Learning via Dataset Distillation

Federated Learning (FL) allows users to share knowledge instead of raw data to train a model with high accuracy. Unfortunately, during the training, users lose control over the knowledge shared, which causes serious data privacy issues. We hold that users are only willing and need to share the essential knowledge to the training task to obtain the FL model with high accuracy. However, existing efforts cannot help users minimize the shared knowledge according to the user intention in the FL training procedure. This work proposes FLiP, which aims to bring the principle of least privilege (PoLP) to FL training. The key design of FLiP is applying elaborate information reduction on the training data through a local-global dataset distillation design. We measure the privacy performance through attribute inference and membership inference attacks. Extensive experiments show that FLiP strikes a good balance between model accuracy and privacy protection.

cs.LG↗

arXiv2024

FaaSTube: Optimizing GPU-oriented Data Transfer for Serverless Computing

Serverless computing has gained significant traction for machine learning inference applications, which are often deployed as serverless workflows consisting of multiple CPU and GPU functions with data dependency. However, existing data-passing solutions for serverless computing primarily reply on host memory for fast data transfer, mandating substantial data movement and resulting in salient I/O overhead. In this paper, we present FaaSTube, a GPU-efficient data passing system for serverless inference. FaaSTube manages intermediate data within a GPU memory pool to facilitate direct data exchange between GPU functions. It enables fine-grained bandwidth sharing over PCIe and NVLink, minimizing data-passing latency for both host-to-GPU and GPU-to-GPU while providing performance isolation between functions. Additionally, FaaSTube implements an elastic GPU memory pool that dynamically scales to accommodate varying data-passing demands. Evaluations on real-world applications show that FaaSTube reduces end-to-end latency by up to 90\% and achieves up to 12x higher throughput compared to the state-of-the-art.

cs.DC↗

arXiv2024

Random walk on dynamical percolation in Euclidean lattices: separating critical and supercritical regimes

We study the random walk on dynamical percolation of $\mathbb{Z}^d$ (resp., the two-dimensional triangular lattice $\mathcal{T}$), where each edge (resp., each site) can be either open or closed, refreshing its status at rate $μ\in (0,1/e]$. The random walk moves along open edges in $\mathbb{Z}^d$ (resp., open sites in $\mathcal{T}$) at rate $1$. For the critical regime $p=p_c$, we prove the following two results: on $\mathcal{T}$, the mean squared displacement of the random walk from $0$ to $t$ is at most $O(tμ^{5/132-ε})$ for any $ε>0$; on $\mathbb{Z}^d$ with $d\geq 11$, the corresponding upper bound for the mean squared displacement is $O(t μ^{1/2}\log(1/μ))$. For the supercritical regime $p>p_c$, we prove that the mean squared displacement on $\mathbb{Z}^d$ is at least $ct$ for some $c=c(d)>0$ that does not depend on $μ$.

math.PR↗

arXiv2024

A new quantum machine learning algorithm: split hidden quantum Markov model inspired by quantum conditional master equation

The Hidden Quantum Markov Model (HQMM) has significant potential for analyzing time-series data and studying stochastic processes in the quantum domain as an upgrading option with potential advantages over classical Markov models. In this paper, we introduced the split HQMM (SHQMM) for implementing the hidden quantum Markov process, utilizing the conditional master equation with a fine balance condition to demonstrate the interconnections among the internal states of the quantum system. The experimental results suggest that our model outperforms previous models in terms of scope of applications and robustness. Additionally, we establish a new learning algorithm to solve parameters in HQMM by relating the quantum conditional master equation to the HQMM. Finally, our study provides clear evidence that the quantum transport system can be considered a physical representation of HQMM. The SHQMM with accompanying algorithms present a novel method to analyze quantum systems and time series grounded in physical implementation.

quant-ph↗

arXiv2024

Computation and Critical Transitions of Rate-Distortion-Perception Functions With Wasserstein Barycenter

The information rate-distortion-perception (RDP) function characterizes the three-way trade-off between description rate, average distortion, and perceptual quality measured by discrepancy between probability distributions and has been applied to emerging areas in communications empowered by generative modeling. We study several variants of the RDP functions through the lens of optimal transport to characterize their critical transitions. By transforming the information RDP function into a Wasserstein Barycenter problem, we identify the critical transitions when one of the constraints becomes inactive. Further, the non-strictly convexity brought by the perceptual constraint can be regularized by an entropy regularization term. We prove that the entropy regularized model converges to the original problem and propose an alternating iteration method based on the Sinkhorn algorithm to numerically solve the regularized optimization problem. In many practical scenarios, the computation of the Distortion-Rate-Perception (DRP) function offers a solution to minimize distortion and perceptual discrepancy under rate constraints. However, the interchange of the rate objective and the distortion constraint significantly amplifies the complexity. The proposed method effectively addresses this complexity, providing an efficient solution for DRP functions. Using our numerical method, we propose a reverse data hiding scheme that imperceptibly embeds a secret message into an image, ensuring perceptual fidelity and achieving a significant improvement in the perceptual quality of the stego image compared to traditional methods under the same embedding rate. Our theoretical results and numerical method lay an attractive foundation for steganographic communications with perceptual quality constraints.

cs.IT↗

arXiv2024

Reliable and Compact Graph Fine-tuning via GraphSparse Prompting

Recently, graph prompt learning has garnered increasing attention in adapting pre-trained GNN models for downstream graph learning tasks. However, existing works generally conduct prompting over all graph elements (e.g., nodes, edges, node attributes, etc.), which is suboptimal and obviously redundant. To address this issue, we propose exploiting sparse representation theory for graph prompting and present Graph Sparse Prompting (GSP). GSP aims to adaptively and sparsely select the optimal elements (e.g., certain node attributes) to achieve compact prompting for downstream tasks. Specifically, we propose two kinds of GSP models, termed Graph Sparse Feature Prompting (GSFP) and Graph Sparse multi-Feature Prompting (GSmFP). Both GSFP and GSmFP provide a general scheme for tuning any specific pre-trained GNNs that can achieve attribute selection and compact prompt learning simultaneously. A simple yet effective algorithm has been designed for solving GSFP and GSmFP models. Experiments on 16 widely-used benchmark datasets validate the effectiveness and advantages of the proposed GSFPs.

cs.LG↗

arXiv2024

Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling

In current deep learning tasks, Adam style optimizers such as Adam, Adagrad, RMSProp, Adafactor, and Lion have been widely used as alternatives to SGD style optimizers. These optimizers typically update model parameters using the sign of gradients, resulting in more stable convergence curves. The learning rate and the batch size are the most critical hyperparameters for optimizers, which require careful tuning to enable effective convergence. Previous research has shown that the optimal learning rate increases linearly or follows similar rules with batch size for SGD style optimizers. However, this conclusion is not applicable to Adam style optimizers. In this paper, we elucidate the connection between optimal learning rates and batch sizes for Adam style optimizers through both theoretical analysis and extensive experiments. First, we raise the scaling law between batch sizes and optimal learning rates in the sign of gradient case, in which we prove that the optimal learning rate first rises and then falls as the batch size increases. Moreover, the peak value of the surge will gradually move toward the larger batch size as training progresses. Second, we conducted experiments on various CV and NLP tasks and verified the correctness of the scaling law.

cs.LG↗

arXiv2024

Enhanced Peak and Extended Cooling of the Extreme-ultraviolet Late Phase in a Confined Solar Flare

We present observations and analysis of an X1.8 non-eruptive solar flare on 2012 October 23, which is characterized by an extremely large late-phase peak seen in the warm coronal extreme-ultraviolet (EUV) emissions ($\sim$ 3 MK), with the peak intensity over 1.4 times that of main flare peak. The flare is driven by a failed eruption of a magnetic flux rope (MFR), whose strong squeeze force acting on the overlying magnetic structures gives rise to an intense early heating of the late-phase loops. Based on differential emission measure (DEM) analysis, it is found that the late-phase loops experience a "longer-than-expected" cooling without the presence of any obvious additional heating, and meanwhile, their volume emission measure (EM) maintains a plateau level for a long time before turning into an evident decay. Without the need for an additional heating, we propose that the special thermodynamic evolution of the late-phase loops revealed in this flare might arise from loop cross-sectional expansions with height, which are evidenced by both direct measurements from EUV images and by magnetic field extrapolation. By blocking the losses of both heat flux and mass from the corona, such an upward cross-sectional expansion not only elongates the loop cooling time, but also more effectively sustains the loop density, therefore leading to a later-than-expected occurrence of the warm coronal late phase in combination with a sufficiently high late-phase peak. We further verify such a scenario by analytically solving the cooling process of a late-phase loop characterized by a variable cross section.

astro-ph.SR↗

arXiv2024

Divide-and-Conquer Predictive Coding: a structured Bayesian inference algorithm

Unexpected stimuli induce "error" or "surprise" signals in the brain. The theory of predictive coding promises to explain these observations in terms of Bayesian inference by suggesting that the cortex implements variational inference in a probabilistic graphical model. However, when applied to machine learning tasks, this family of algorithms has yet to perform on par with other variational approaches in high-dimensional, structured inference problems. To address this, we introduce a novel predictive coding algorithm for structured generative models, that we call divide-and-conquer predictive coding (DCPC). DCPC differs from other formulations of predictive coding, as it respects the correlation structure of the generative model and provably performs maximum-likelihood updates of model parameters, all without sacrificing biological plausibility. Empirically, DCPC achieves better numerical performance than competing algorithms and provides accurate inference in a number of problems not previously addressed with predictive coding. We provide an open implementation of DCPC in Pyro on Github.

stat.ML↗

arXiv2024

Towards Robust Blockchain Price Oracle: A Study on Human-Centric Node Selection Strategy and Incentive Mechanism

As a trusted middleware connecting the blockchain and the real world, the blockchain oracle can obtain trusted real-time price information for financial applications such as payment and settlement, and asset valuation on the blockchain. However, the current oracle schemes face the dilemma of security and service quality in the process of node selection, and the implicit interest relationship in financial applications leads to a significant conflict of interest between the task publisher and the executor, which reduces the participation enthusiasm of both parties and system security. Therefore, this paper proposes an anonymous node selection scheme that anonymously selects nodes with high reputations to participate in tasks to ensure the security and service quality of nodes. Then, this paper also details the interest requirements and behavioral motives of all parties in the payment settlement and asset valuation scenarios. Under the hypothesis of rational man, an incentive mechanism based on the Stackelberg game is proposed. It can achieve equilibrium under the pursuit of the revenue of task publishers and executors, thereby ensuring the revenue of all types of users and improving the enthusiasm for participation. Finally, we verify the security of the proposed scheme through security analysis. The experimental results show that the proposed scheme can reduce the variance of obtaining price data by about 55\% while ensuring security, and meeting the revenue of all parties.

cs.CR↗

arXiv2024

Alternating Maximization Algorithm for Mismatch Capacity with Oblivious Relaying

Reliable communication over a discrete memoryless channel with the help of a relay has aroused interest due to its widespread applications in practical scenarios. By considering the system with a mismatched decoder, previous works have provided optimization models to evaluate the mismatch capacity in these scenarios. The proposed models, however, are difficult due to the complicated structure of the mismatched decoding problem with the information flows in hops given by the relay. Existing methods, such as the grid search, become impractical as they involve finding all roots of a nonlinear system, with the growing size of the alphabet. To address this problem, we reformulate the max-min optimization model as a consistent maximization form, by considering the dual form of the inner minimization problem and the Lagrangian with a fixed multiplier. Based on the proposed formulation, an alternating maximization framework is designed, which provides the closed-form solution with simple iterations in each step by introducing a suitable variable transformation. The effectiveness of the proposed approach is demonstrated by the simulations over practical scenarios, including Quaternary and Gaussian channels. Moreover, the simulation results of the transitional probability also shed light on the promising application attribute to the quantizer design in the relay node.

cs.IT↗

arXiv2024

LayerKV: Optimizing Large Language Model Serving with Layer-wise KV Cache Management

The expanding context windows in large language models (LLMs) have greatly enhanced their capabilities in various applications, but they also introduce significant challenges in maintaining low latency, particularly in Time to First Token (TTFT). This paper identifies that the sharp rise in TTFT as context length increases is predominantly driven by queuing delays, which are caused by the growing demands for GPU Key-Value (KV) cache allocation clashing with the limited availability of KV cache blocks. To address this issue, we propose LayerKV, a simple yet effective plug-in method that effectively reduces TTFT without requiring additional hardware or compromising output performance, while seamlessly integrating with existing parallelism strategies and scheduling techniques. Specifically, LayerKV introduces layer-wise KV block allocation, management, and offloading for fine-grained control over system memory, coupled with an SLO-aware scheduler to optimize overall Service Level Objectives (SLOs). Comprehensive evaluations on representative models, ranging from 7B to 70B parameters, across various GPU configurations, demonstrate that LayerKV improves TTFT latency up to 69x and reduces SLO violation rates by 28.7%, significantly enhancing the user experience.

cs.DC↗

arXiv2024

Quantum Vector Signal Analyzer: Wideband Electric Field Sensing via Motional Raman Transitions

Ultrasensitive detection of the frequency, phase, and amplitude of radio frequency (RF) electric fields is central to a variety of important applications, including radio communication, cosmology, dark matter searches, and high-fidelity qubit control. Quantum harmonic oscillator (QHO) systems, especially trapped ions, have been used with several quantum sensing techniques to achieve electric field sensing with state-of-the-art sensitivity and nanometer spatial resolution. However, these systems are limited to a narrow frequency range centered around either the motional frequency of the trapped ion oscillator or the frequency of an optical transition in the ion; often these techniques are not sensitive to the RF phase. Here, we propose and demonstrate a procedure that unlocks the extreme sensitivity of a QHO to allow high precision wideband detection of the frequency, phase, and amplitude of an unknown electric field. Specifically, we use motional Raman transitions in a single trapped ion, cooled near its motional ground state to realize state of the art sensitivities to frequency, phase, and amplitude, and show the technique works over a frequency range that is >800x larger than previous techniques. Further, this technique is shown to be compatible with both quantum amplification via squeezing and measurement in the Fock basis, allowing performance 3.4(20) dB below the standard quantum limit and the potential for several orders of magnitude improvement in sensitivity with moderate upgrades. In addition to providing an attractive platform for quantum sensing of small fields, this technique allows in situ calibration of qubit control lines in QHO systems, as well as transduction of external, non-resonant drives into oscillator excitation. Additionally, this approach can be extended to other QHO systems, such as a superconducting qubit-resonator system.

physics.atom-ph↗

arXiv2024

CLIP-Guided Generative Networks for Transferable Targeted Adversarial Attacks

Transferable targeted adversarial attacks aim to mislead models into outputting adversary-specified predictions in black-box scenarios. Recent studies have introduced \textit{single-target} generative attacks that train a generator for each target class to generate highly transferable perturbations, resulting in substantial computational overhead when handling multiple classes. \textit{Multi-target} attacks address this by training only one class-conditional generator for multiple classes. However, the generator simply uses class labels as conditions, failing to leverage the rich semantic information of the target class. To this end, we design a \textbf{C}LIP-guided \textbf{G}enerative \textbf{N}etwork with \textbf{C}ross-attention modules (CGNC) to enhance multi-target attacks by incorporating textual knowledge of CLIP into the generator. Extensive experiments demonstrate that CGNC yields significant improvements over previous multi-target generative attacks, e.g., a 21.46\% improvement in success rate from ResNet-152 to DenseNet-121. Moreover, we propose a masked fine-tuning mechanism to further strengthen our method in attacking a single class, which surpasses existing single-target methods.

cs.CV↗

arXiv2024

A Decentralized Primal-Dual Method with Quasi-Newton Tracking

This paper considers the decentralized optimization problem of minimizing a finite sum of strongly convex and twice continuously differentiable functions over a fixed-connected undirected network. A fully decentralized primal-dual method(DPDM) and its generalization(GDPDM), which allows for multiple primal steps per iteration, are proposed. In our methods, both primal and dual updates use second-order information obtained by quasi-Newton techniques which only involve matrix-vector multiplication. Specifically, the primal update applies a Jacobi relaxation step using the BFGS approximation for both computation and communication efficiency. The dual update employs a new second-order correction step. We show that the decentralized local primal updating direction on each node asymptotically approaches the centralized quasi-Newton direction. Under proper choice of parameters, GDPDM including DPDM has global linear convergence for solving strongly convex decentralized optimization problems. Our numerical results show both GDPDM and DPDM are very efficient compared with other state-of-the-art methods for solving decentralized optimization.

math.OC↗