arXiv subjects

Qi Wang

Publications and source records attributed to Qi Wang.

At least 469 records · Page 26Linked to original sources

arXiv2023

Generic and Robust Root Cause Localization for Multi-Dimensional Data in Online Service Systems

Localizing root causes for multi-dimensional data is critical to ensure online service systems' reliability. When a fault occurs, only the measure values within specific attribute combinations are abnormal. Such attribute combinations are substantial clues to the underlying root causes and thus are called root causes of multidimensional data. This paper proposes a generic and robust root cause localization approach for multi-dimensional data, PSqueeze. We propose a generic property of root cause for multi-dimensional data, generalized ripple effect (GRE). Based on it, we propose a novel probabilistic cluster method and a robust heuristic search method. Moreover, we identify the importance of determining external root causes and propose an effective method for the first time in literature. Our experiments on two real-world datasets with 5400 faults show that the F1-score of PSqueeze outperforms baselines by 32.89%, while the localization time is around 10 seconds across all cases. The F1-score in determining external root causes of PSqueeze achieves 0.90. Furthermore, case studies in several production systems demonstrate that PSqueeze is helpful to fault diagnosis in the real world.

cs.SE↗

arXiv2023

Improving Urban Flood Prediction using LSTM-DeepLabv3+ and Bayesian Optimization with Spatiotemporal feature fusion

Deep learning models have become increasingly popular for flood prediction due to their superior accuracy and efficiency compared to traditional methods. However, current machine learning methods often rely on separate spatial or temporal feature analysis and have limitations on the types, number, and dimensions of input data. This study presented a CNN-RNN hybrid feature fusion modelling approach for urban flood prediction, which integrated the strengths of CNNs in processing spatial features and RNNs in analyzing different dimensions of time sequences. This approach allowed for both static and dynamic flood predictions. Bayesian optimization was applied to identify the seven most influential flood-driven factors and determine the best combination strategy. By combining four CNNs (FCN, UNet, SegNet, DeepLabv3+) and three RNNs (LSTM, BiLSTM, GRU), the optimal hybrid model was identified as LSTM-DeepLabv3+. This model achieved the highest prediction accuracy (MAE, RMSE, NSE, and KGE were 0.007, 0.025, 0.973 and 0.755, respectively) under various rainfall input conditions. Additionally, the processing speed was significantly improved, with an inference time of 1.158s (approximately 1/125 of the traditional computation time) compared to the physically-based models.

cs.LG↗

arXiv2023

Green's Function Integral method for Pressure Reconstruction from Measured Pressure Gradient and the Interpretation of Omnidirectional Integration

Accurately and efficiently measuring the pressure field is of paramount importance in many fluid mechanics applications. The pressure gradient field of a fluid flow can be determined from the balance of the momentum equation based on the particle image velocimetry (PIV) measurement of the flow kinematics, which renders the experimental evaluation of the material acceleration and the viscous stress terms possible. We present a novel method of reconstructing the pressure fields from error-embedded pressure gradient measurement data. This method utilized Green's function of the Laplacian operator as the convolution kernel that relates pressure to pressure gradient. A compatibility condition on the boundary offers equations to solve for the boundary pressure. This Green's function integral (GFI) method has a deep mathematical connection with the state-of-the-art omnidirectional integration (ODI). As mathematically equivalent to ODI in the limit of an infinite number of line integral paths, GFI spares the necessity of line integration along zigzag integral paths, rendering generalized implementation schemes for both two and three-dimensional problems with arbitrary geometry while bringing in improved computational efficiency. In the current work, we apply GFI to pressure reconstruction of simple canonical and isotropic turbulence flows embedded with error in two-dimensional and three-dimensional domains, respectively. Uncertainty quantification is performed by eigenanalysis of the GFI operator in a square domain. The accuracy and computational efficiency of GFI are evaluated and compared with ODI.

physics.flu-dyn↗

arXiv2023

Regularized Shallow Image Prior for Electrical Impedance Tomography

Untrained Neural Network Prior (UNNP) based algorithms have gained increasing popularity in tomographic imaging, as they offer superior performance compared to hand-crafted priors and do not require training. UNNP-based methods usually rely on deep architectures which are known for their excellent feature extraction ability compared to shallow ones. Contrary to common UNNP-based approaches, we propose a regularized shallow image prior method that combines UNNP with hand-crafted prior for Electrical Impedance Tomography (EIT). Our approach employs a 3-layer Multi-Layer Perceptron (MLP) as the UNNP in regularizing 2D and 3D EIT inversion. We demonstrate the influence of two typical hand-crafted regularizations when representing the conductivity distribution with shallow MLPs. We show considerably improved EIT image quality compared to conventional regularization algorithms, especially in structure preservation. The results suggest that combining the shallow image prior and the hand-crafted regularization can achieve similar performance to the Deep Image Prior (DIP) but with less architectural dependency and complexity of the neural network.

eess.IV↗

arXiv2023

Boundary-to-Solution Mapping for Groundwater Flows in a Toth Basin

In this paper, the authors propose a new approach to solving the groundwater flow equation in the Toth basin of arbitrary top and bottom topographies using deep learning. Instead of using traditional numerical solvers, they use a DeepONet to produce the boundary-to-solution mapping. This mapping takes the geometry of the physical domain along with the boundary conditions as inputs to output the steady state solution of the groundwater flow equation. To implement the DeepONet, the authors approximate the top and bottom boundaries using truncated Fourier series or piecewise linear representations. They present two different implementations of the DeepONet: one where the Toth basin is embedded in a rectangular computational domain, and another where the Toth basin with arbitrary top and bottom boundaries is mapped into a rectangular computational domain via a nonlinear transformation. They implement the DeepONet with respect to the Dirichlet and Robin boundary condition at the top and the Neumann boundary condition at the impervious bottom boundary, respectively. Using this deep-learning enabled tool, the authors investigate the impact of surface topography on the flow pattern by both the top surface and the bottom impervious boundary with arbitrary geometries. They discover that the average slope of the top surface promotes long-distance transport, while the local curvature controls localized circulations. Additionally, they find that the slope of the bottom impervious boundary can seriously impact the long-distance transport of groundwater flows. Overall, this paper presents a new and innovative approach to solving the groundwater flow equation using deep learning, which allows for the investigation of the impact of surface topography on groundwater flow patterns.

physics.geo-ph↗

arXiv2023

A Three-Player GAN for Super-Resolution in Magnetic Resonance Imaging

Learning based single image super resolution (SISR) task is well investigated in 2D images. However, SISR for 3D Magnetics Resonance Images (MRI) is more challenging compared to 2D, mainly due to the increased number of neural network parameters, the larger memory requirement and the limited amount of available training data. Current SISR methods for 3D volumetric images are based on Generative Adversarial Networks (GANs), especially Wasserstein GANs due to their training stability. Other common architectures in the 2D domain, e.g. transformer models, require large amounts of training data and are therefore not suitable for the limited 3D data. However, Wasserstein GANs can be problematic because they may not converge to a global optimum and thus produce blurry results. Here, we propose a new method for 3D SR based on the GAN framework. Specifically, we use instance noise to balance the GAN training. Furthermore, we use a relativistic GAN loss function and an updating feature extractor during the training process. We show that our method produces highly accurate results. We also show that we need very few training samples. In particular, we need less than 30 samples instead of thousands of training samples that are typically required in previous studies. Finally, we show improved out-of-sample results produced by our model.

eess.IV↗

arXiv2023

A Spatio-temporal Decomposition Method for the Coordinated Economic Dispatch of Integrated Transmission and Distribution Grids

With numerous distributed energy resources (DERs) integrated into the distribution networks (DNs), the coordinated economic dispatch (C-ED) is essential for the integrated transmission and distribution grids. For large scale power grids, the centralized C-ED meets high computational burden and information privacy issues. To tackle these issues, this paper proposes a spatio-temporal decomposition algorithm to solve the C-ED in a distributed and parallel manner. In the temporal dimension, the multi-period economic dispatch (ED) of transmission grid (TG) is decomposed to several subproblems by introducing auxiliary variables and overlapping time intervals to deal with the temporal coupling constraints. Besides, an accelerated alternative direction method of multipliers (A-ADMM) based temporal decomposition algorithm with the warm-start strategy, is developed to solve the ED subproblems of TG in parallel. In the spatial dimension, a multi-parametric programming projection based spatial decomposition algorithm is developed to coordinate the ED problems of TG and DNs in a distributed manner. To further improve the convergence performance of the spatial decomposition algorithm, the aggregate equivalence approach is used for determining the feasible range of boundary variables of TG and DNs. Moreover, we prove that the proposed spatio-temporal decomposition method can obtain the optimal solution for bilevel convex optimization problems with continuously differentiable objectives and constraints. Numerical tests are conducted on three systems with different scales, demonstrating the high computational efficiency and scalability of the proposed spatio-temporal decomposition method.

eess.SY↗

arXiv2023

Improving Video Retrieval by Adaptive Margin

Video retrieval is becoming increasingly important owing to the rapid emergence of videos on the Internet. The dominant paradigm for video retrieval learns video-text representations by pushing the distance between the similarity of positive pairs and that of negative pairs apart from a fixed margin. However, negative pairs used for training are sampled randomly, which indicates that the semantics between negative pairs may be related or even equivalent, while most methods still enforce dissimilar representations to decrease their similarity. This phenomenon leads to inaccurate supervision and poor performance in learning video-text representations. While most video retrieval methods overlook that phenomenon, we propose an adaptive margin changed with the distance between positive and negative pairs to solve the aforementioned issue. First, we design the calculation framework of the adaptive margin, including the method of distance measurement and the function between the distance and the margin. Then, we explore a novel implementation called "Cross-Modal Generalized Self-Distillation" (CMGSD), which can be built on the top of most video retrieval models with few modifications. Notably, CMGSD adds few computational overheads at train time and adds no computational overhead at test time. Experimental results on three widely used datasets demonstrate that the proposed method can yield significantly better performance than the corresponding backbone model, and it outperforms state-of-the-art methods by a large margin.

cs.CV↗

arXiv2023

Crowd Localization from Gaussian Mixture Scoped Knowledge and Scoped Teacher

Crowd localization is to predict each instance head position in crowd scenarios. Since the distance of instances being to the camera are variant, there exists tremendous gaps among scales of instances within an image, which is called the intrinsic scale shift. The core reason of intrinsic scale shift being one of the most essential issues in crowd localization is that it is ubiquitous in crowd scenes and makes scale distribution chaotic. To this end, the paper concentrates on access to tackle the chaos of the scale distribution incurred by intrinsic scale shift. We propose Gaussian Mixture Scope (GMS) to regularize the chaotic scale distribution. Concretely, the GMS utilizes a Gaussian mixture distribution to adapt to scale distribution and decouples the mixture model into sub-normal distributions to regularize the chaos within the sub-distributions. Then, an alignment is introduced to regularize the chaos among sub-distributions. However, despite that GMS is effective in regularizing the data distribution, it amounts to dislodging the hard samples in training set, which incurs overfitting. We assert that it is blamed on the block of transferring the latent knowledge exploited by GMS from data to model. Therefore, a Scoped Teacher playing a role of bridge in knowledge transform is proposed. What' s more, the consistency regularization is also introduced to implement knowledge transform. To that effect, the further constraints are deployed on Scoped Teacher to derive feature consistence between teacher and student end. With proposed GMS and Scoped Teacher implemented on five mainstream datasets of crowd localization, the extensive experiments demonstrate the superiority of our work. Moreover, comparing with existing crowd locators, our work achieves state-of-the-art via F1-meansure comprehensively on five datasets.

cs.CV↗

arXiv2023

Anomaly Detection of UAV State Data Based on Single-class Triangular Global Alignment Kernel Extreme Learning Machine

Unmanned Aerial Vehicles (UAVs) are widely used and meet many demands in military and civilian fields. With the continuous enrichment and extensive expansion of application scenarios, the safety of UAVs is constantly being challenged. To address this challenge, we propose algorithms to detect anomalous data collected from drones to improve drone safety. We deployed a one-class kernel extreme learning machine (OCKELM) to detect anomalies in drone data. By default, OCKELM uses the radial basis (RBF) kernel function as the kernel function of the model. To improve the performance of OCKELM, we choose a Triangular Global Alignment Kernel (TGAK) instead of an RBF Kernel and introduce the Fast Independent Component Analysis (FastICA) algorithm to reconstruct UAV data. Based on the above improvements, we create a novel anomaly detection strategy FastICA-TGAK-OCELM. The method is finally validated on the UCI dataset and detected on the Aeronautical Laboratory Failures and Anomalies (ALFA) dataset. The experimental results show that compared with other methods, the accuracy of this method is improved by more than 30%, and point anomalies are effectively detected.

cs.AI↗

arXiv2023

Pressure-tunable magnetic topological phases in magnetic topological insulator MnSb4Te7

Magnetic topological insulators, possessing both magnetic order and topological electronic structure, provides an excellent platform to research unusual physical properties. Here, we report a high-pressure study on the anomalous Hall effect of magnetic TI MnSb4Te7 through transports measurements combined with first-principle theoretical calculations. We discover that the ground state of MnSb4Te7 experiences a magnetic phase transition from the A-type antiferromagnetic state to ferromagnetic dominating state at 3.78 GPa, although its crystal sustains a rhombohedral phase under high pressures up to 8 GPa. The anomalous Hall conductance σxyA keeps around 10 Ω-1 cm-1, dominated by the intrinsic mechanism even after the magnetic phase transition. The results shed light on the intriguing magnetism in MnSb4Te7 and pave the way for further studies of the relationship between topology and magnetism in topological materials.

cond-mat.supr-con↗

arXiv2023

Optimization-based Block Coordinate Gradient Coding for Mitigating Partial Stragglers in Distributed Learning

Gradient coding schemes effectively mitigate full stragglers in distributed learning by introducing identical redundancy in coded local partial derivatives corresponding to all model parameters. However, they are no longer effective for partial stragglers as they cannot utilize incomplete computation results from partial stragglers. This paper aims to design a new gradient coding scheme for mitigating partial stragglers in distributed learning. Specifically, we consider a distributed system consisting of one master and N workers, characterized by a general partial straggler model and focuses on solving a general large-scale machine learning problem with L model parameters using gradient coding. First, we propose a coordinate gradient coding scheme with L coding parameters representing L possibly different diversities for the L coordinates, which generates most gradient coding schemes. Then, we consider the minimization of the expected overall runtime and the maximization of the completion probability with respect to the L coding parameters for coordinates, which are challenging discrete optimization problems. To reduce computational complexity, we first transform each to an equivalent but much simpler discrete problem with N\llL variables representing the partition of the L coordinates into N blocks, each with identical redundancy. This indicates an equivalent but more easily implemented block coordinate gradient coding scheme with N coding parameters for blocks. Then, we adopt continuous relaxation to further reduce computational complexity. For the resulting minimization of expected overall runtime, we develop an iterative algorithm of computational complexity O(N^2) to obtain an optimal solution and derive two closed-form approximate solutions both with computational complexity O(N). For the resultant maximization of the completion probability, we develop an iterative algorithm of...

cs.IT↗

arXiv2023

Pressure Reconstruction from the Measured Pressure Gradient Using Gaussian Process Regression

Many numerical algorithms have been established to reconstruct pressure fields from measured kinematic data with noise by Particle Image Velocimetry (PIV), such as the Pressure Poisson solver and the Omni-Directional Integration (ODI) method. This study adopts Gaussian Process Regression (GPR), a probabilistic framework with an intrinsic de-noising mechanism to tackle drawbacks of traditional Pressure Poisson solver and compares the performance with ODI. To evaluate the accuracy of the algorithm, GPR and ODI are tested in detail in a canonical setup of forced homogeneous isotropic turbulence from the Johns Hopkins Turbulence Database. According to the result, GPR has the same level of accuracy as ODI with optimized hyper-parameters for the isotropic turbulence flow. However, GPR has the tendency to flatten impulsive signals. Therefore, without further modifications, it is not suitable to detect flow structures with impulsive true signals. The error propagation of the proposed framework is also analyzed and discussed in both physical and spectral spaces.

physics.flu-dyn↗

arXiv2023

Propagating spin-wave spectroscopy in nanometer-thick YIG films at millikelvin temperatures

Performing propagating spin-wave spectroscopy of thin films at millikelvin temperatures is the next step towards the realisation of large-scale integrated magnonic circuits for quantum applications. Here we demonstrate spin-wave propagation in a $100\,\mathrm{nm}$-thick yttrium-iron-garnet film at the temperatures down to $45 \,\mathrm{mK}$, using stripline nanoantennas deposited on YIG surface for the electrical excitation and detection. The clear transmission characteristics over the distance of $10\,μ\mathrm{m}$ are measured and the subtracted spin-wave group velocity and the YIG saturation magnetisation agree well with the theoretical values. We show that the gadolinium-gallium-garnet substrate influences the spin-wave propagation characteristics only for the applied magnetic fields beyond $75\,\mathrm{mT}$, originating from a GGG magnetisation up to $47 \,\mathrm{kA/m}$ at $45 \,\mathrm{mK}$. Our results show that the developed fabrication and measurement methodologies enable the realisation of integrated magnonic quantum nanotechnologies at millikelvin temperatures.

physics.app-ph↗

arXiv2023

Numerical simulation of the radiation force from transient acoustic fields: Application to laser-guided acoustic tweezers

Using pulsed acoustic waves could provide a superior selectivity for microscale acoustic tweezers. However, the theory for the radiation force of pulsed acoustic waves has only been recently derived and no numerical implementations are available. In this paper, we present a finite-element implementation of this model to simulate the transient acoustic radiation force on small spheres. We use the model to simulate laser-guided acoustic tweezers and optimize their performance. By enabling numerical simulations of the transient radiation force, this work may accelerate the rational design of pulse-based high-selectivity acoustic tweezers devices.

physics.flu-dyn↗

arXiv2023

Dynamics of a predator-prey system in open advective heterogeneous environments

In this paper, we investigate the effect of dispersal and advection on the dynamics of a predator-prey model. More precisely, we show that the linear stability of the semi-trivial steady state is determined by the dispersal rate, the mortality rate of the predator and the advection rate. We point out that compared to homogeneous intrinsic growth rate and carrying capacity, the case in this paper is more complicated. This work gives a investigation to an open problem proposed by Nie et al. in \cite{NWW} by considering a more general model, and then, can be seen as a further development of their work \cite{NWW}.

math.AP↗

arXiv2023

RELIANT: Fair Knowledge Distillation for Graph Neural Networks

Graph Neural Networks (GNNs) have shown satisfying performance on various graph learning tasks. To achieve better fitting capability, most GNNs are with a large number of parameters, which makes these GNNs computationally expensive. Therefore, it is difficult to deploy them onto edge devices with scarce computational resources, e.g., mobile phones and wearable smart devices. Knowledge Distillation (KD) is a common solution to compress GNNs, where a light-weighted model (i.e., the student model) is encouraged to mimic the behavior of a computationally expensive GNN (i.e., the teacher GNN model). Nevertheless, most existing GNN-based KD methods lack fairness consideration. As a consequence, the student model usually inherits and even exaggerates the bias from the teacher GNN. To handle such a problem, we take initial steps towards fair knowledge distillation for GNNs. Specifically, we first formulate a novel problem of fair knowledge distillation for GNN-based teacher-student frameworks. Then we propose a principled framework named RELIANT to mitigate the bias exhibited by the student model. Notably, the design of RELIANT is decoupled from any specific teacher and student model structures, and thus can be easily adapted to various GNN-based KD frameworks. We perform extensive experiments on multiple real-world datasets, which corroborates that RELIANT achieves less biased GNN knowledge distillation while maintaining high prediction utility.

cs.LG↗

arXiv2022

Spin excitations in the kagome-lattice metallic antiferromagnet Fe$_{0.89}$Co$_{0.11}$Sn

Kagome-lattice materials have attracted tremendous interest due to the broad prospect for seeking superconductivity, quantum spin liquid states, and topological electronic structures. Among them, the transition-metal kagome lattices are high-profile objects for the combination of topological properties, rich magnetism, and multiple-orbital physics. Here we report an inelastic neutron scattering study on the spin dynamics of a kagome-lattice antiferromagnetic metal Fe$_{0.89}$Co$_{0.11}$Sn. Although the magnetic excitations can be observed up to $\sim$250 meV, well-defined spin waves are only identified below $\sim$90 meV and can be modeled using Heisenberg exchange with ferromagnetic in-plane nearest-neighbor coupling $J_1$, in-plane next-nearest-neighbor coupling $J_2$, and antiferromagnetic (AFM) interlayer coupling $J_c$ under linear spin-wave theory. Above $\sim$90 meV, the spin waves enter the itinerant Stoner continuum and become highly damped particle-hole excitations. At the K point of the Brillouin zone, we reveal a possible band crossing of the spin wave, which indicates a potential Dirac magnon. Our results uncover the evolution of the spin excitations from the planar AFM state to the axial AFM state in Fe$_{0.89}$Co$_{0.11}$Sn, solve the magnetic Hamiltonian for both states, and confirm the significant influence of the itinerant magnetism on the spin excitations.

cond-mat.str-el↗