arXiv subjects

Lei Wu

Publications and source records attributed to Lei Wu.

At least 163 records · Page 9Linked to original sources

arXiv2024

Efficient parallel solver for rarefied gas flow using GSIS

Recently, the general synthetic iterative scheme (GSIS) has been proposed to find the steady-state solution of the Boltzmann equation in the whole range of gas rarefaction, where its fast-converging and asymptotic-preserving properties lead to the significant reduction of iteration numbers and spatial cells in the near-continuum flow regime. However, the efficiency and accuracy of GSIS has only been demonstrated in two-dimensional problems with small numbers of spatial cells and discrete velocities. Here, a large-scale parallel computing strategy is designed to extend the GSIS to three-dimensional flow problems, including the supersonic flows which are usually difficult to solve by the discrete velocity method. Since the GSIS involves the calculation of the mesoscopic kinetic equation which is defined in six-dimensional phase-space, and the macroscopic high-temperature Navier-Stokes-Fourier equations in three-dimensional physical space, the proper partition of the spatial and velocity spaces, and the allocation of CPU cores to the mesoscopic and macroscopic solvers, are the keys to improving the overall computational efficiency. These factors are systematically tested to achieve optimal performance, up to 100 billion spatial and velocity grids. For hypersonic flows around the Apollo reentry capsule, the X38-like vehicle, and the space station, our parallel solver can obtain the converged solution within one hour.

physics.flu-dyn↗

arXiv2024

Constraining Bosonic Dark Matter-Baryon Interactions from Neutron Star Collapse

Dark matter (DM) may be captured around a neutron star (NS) through DM-nucleon interactions. We observe that the enhancement of such capturing is particularly significant when the DM velocity and/or momentum transfer depend on the DM-nucleon scattering cross-section. This could potentially lead to the formation of a black hole within the typical lifetime of the NS. As the black hole expands through the accretion of matter from the NS, it ultimately results in the collapse of the host. Utilizing the existing pulsar data J0437-4715 and J2124-3858, we derive the stringent constraints on the DM-nucleon scattering cross-section across a broad range of DM masses.

hep-ph↗

arXiv2024

Exploring Neural Network Landscapes: Star-Shaped and Geodesic Connectivity

One of the most intriguing findings in the structure of neural network landscape is the phenomenon of mode connectivity: For two typical global minima, there exists a path connecting them without barrier. This concept of mode connectivity has played a crucial role in understanding important phenomena in deep learning. In this paper, we conduct a fine-grained analysis of this connectivity phenomenon. First, we demonstrate that in the overparameterized case, the connecting path can be as simple as a two-piece linear path, and the path length can be nearly equal to the Euclidean distance. This finding suggests that the landscape should be nearly convex in a certain sense. Second, we uncover a surprising star-shaped connectivity: For a finite number of typical minima, there exists a center on minima manifold that connects all of them simultaneously via linear paths. These results are provably valid for linear networks and two-layer ReLU networks under a teacher-student setup, and are empirically supported by models trained on MNIST and CIFAR-10.

cs.LG↗

arXiv2024

The Devil Behind the Mirror: Tracking the Campaigns of Cryptocurrency Abuses on the Dark Web

The dark web has emerged as the state-of-the-art solution for enhanced anonymity. Just like a double-edged sword, it also inadvertently becomes the safety net and breeding ground for illicit activities. Among them, cryptocurrencies have been prevalently abused to receive illicit income while evading regulations. Despite the continuing efforts to combat illicit activities, there is still a lack of an in-depth understanding regarding the characteristics and dynamics of cryptocurrency abuses on the dark web. In this work, we conduct a multi-dimensional and systematic study to track cryptocurrency-related illicit activities and campaigns on the dark web. We first harvest a dataset of 4,923 cryptocurrency-related onion sites with over 130K pages. Then, we detect and extract the illicit blockchain transactions to characterize the cryptocurrency abuses, targeting features from single/clustered addresses and illicit campaigns. Throughout our study, we have identified 2,564 illicit sites with 1,189 illicit blockchain addresses, which account for 90.8 BTC in revenue. Based on their inner connections, we further identify 66 campaigns behind them. Our exploration suggests that illicit activities on the dark web have strong correlations, which can guide us to identify new illicit blockchain addresses and onions, and raise alarms at the early stage of their deployment.

cs.CR↗

arXiv2024

The modified Korteweg--de Vries limit of the Ablowitz--Ladik system

For slowly-varying initial data, solutions to the Ablowitz-Ladik system have been proven to converge to solutions of the cubic Schrödinger equation. In this paper we show that in the continuum limit, solutions to the Ablowitz-Ladik system with $H^1$ initial data may also converge to solutions of the modified Korteweg--de Vries equation. To exhibit this new limiting behavior, it suffices that the initial data is supported near the inflection points of the dispersion relation associated with the Ablowitz-Ladik system. Our arguments employ harmonic analysis tools, Strichartz estimates, and the conservation of mass and energy. Correspondingly, they are applicable beyond the completely integrable models of greatest interest to us.

math.AP↗

arXiv2024

Kinetic modelling of rarefied gas mixtures with disparate mass

The simulation of rarefied gas flow based on the Boltzmann equation is challenging, especially when the gas mixtures have disparate molecular masses. In this paper, a computationally tractable kinetic model is proposed for monatomic gas mixtures, to mimic the Boltzmann collision operator as closely as possible. The intra- and inter-collisions are modelled separately using relaxation approximations, to correctly recover the relaxation timescales that could span several orders of magnitude. The proposed kinetic model preserves the accuracy of the Boltzmann equation in the continuum regime by recovering the four critical transport properties of a gas mixture: the shear viscosity, the thermal conductivity, the coefficients of diffusion and the thermal diffusion. While in the rarefied flow regimes, the kinetic model is found to be accurate when comparing its solutions with those from the direct simulation Monte Carlo method in several representative cases (e.g. one-dimensional normal shock wave, Fourier flow and Couette flow, two-dimensional supersonic flow passing a cylinder and nozzle flow into a vacuum), for binary mixtures with a wide range of mass ratios (up to 1000), species concentrations, and different intermolecular potentials. Pronounced separations in species properties have been observed, and the flow characteristics of gas mixtures in shock waves are found to change as the mass difference increases from moderate to substantial.

physics.flu-dyn↗

arXiv2024

Detecting Quadratically Coupled Ultra-light Dark Matter with Stimulated Annihilation

Ultra-light Dark Matter (ULDM) is one of the most promising DM candidates. Due to the Bose enhancement, we find the annihilation rate of the ULDM in the presence of background photon radiation can be greatly enhanced and produce a distinctive reflected electromagnetic wave with an angular frequency equal to the ULDM mass. We propose to utilize such stimulated annihilation to probe the ULDM with the electromagnetic quadratic coupling by emitting a beam of radio into space. With a power of 50 MW emitter, we forecast the sensitivity of quadratic coupling in different local halo models for low-frequency radio telescopes, such as LOFAR, UTR-2 and ngLOBO.

hep-ph↗

arXiv2024

A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent

In this paper, we provide a theoretical study of noise geometry for minibatch stochastic gradient descent (SGD), a phenomenon where noise aligns favorably with the geometry of local landscape. We propose two metrics, derived from analyzing how noise influences the loss and subspace projection dynamics, to quantify the alignment strength. We show that for (over-parameterized) linear models and two-layer nonlinear networks, when measured by these metrics, the alignment can be provably guaranteed under conditions independent of the degree of over-parameterization. To showcase the utility of our noise geometry characterizations, we present a refined analysis of the mechanism by which SGD escapes from sharp minima. We reveal that unlike gradient descent (GD), which escapes along the sharpest directions, SGD tends to escape from flatter directions and cyclical learning rates can exploit this SGD characteristic to navigate more effectively towards flatter regions. Lastly, extensive experiments are provided to support our theoretical findings.

cs.LG↗

arXiv2024

Quasi-binary encoding based quantum alternating operator ansatz

This paper proposes a quasi-binary encoding based algorithm for solving a specific quadratic optimization models with discrete variables, in the quantum approximate optimization algorithm (QAOA) framework. The quadratic optimization model has three constraints: 1. Discrete constraint, the variables are required to be integers. 2. Bound constraint, each variable is required to be greater than or equal to an integer and less than or equal to another integer. 3. Sum constraint, the sum of all variables should be a given integer. To solve this optimization model, we use quasi-binary encoding to encode the variables. For an integer variable with upper bound $U_i$ and lower bound $L_i$, this encoding method can use at most $2\log_2 (U_i-L_i+1)$ qubits to encode the variable. Moreover, we design a mixing operator specifically for this encoding to satisfy the hard constraint model. In the hard constraint model, the quantum state always satisfies the constraints during the evolution, and no penalty term is needed in the objective function. In other parts of the QAOA framework, we also incorporate ideas such as CVaR-QAOA and parameter scheduling methods into our QAOA algorithm. In the financial field, by introducing precision, portfolio optimization problems can be reduced to the above model. We will use portfolio optimization cases for numerical simulation. We design an iterative method to solve the problem of coarse precision caused by insufficient qubits of the simulators or quantum computers. This iterative method can refine the precision by multiple few-qubit experiments.

quant-ph↗

arXiv2024

An Improved Bound on Accelerated Light Dark Matter

Light (sub-GeV) dark matter has gained increasing interest in terms of direct detection. Accelerated dark matter is a promising candidate that can generate detectable nuclear recoil energy within the sub-GeV range. Because of the large kinetic energy, its interactions with the nucleus are predominantly governed by inelastic scattering, including quasi-elastic and deep inelastic scattering. In this work, we calculated the inelastic effects in dark matter--Earth scattering mediated by a vector particle. Our analysis revealed that the impact of inelastic scattering relies on the mediator mass and the kinetic energy spectrum of dark matter. The results exhibited considerable disparity: the upper bounds of the exclusion limit for the spin-independent cross-section between accelerated dark matter and nuclei via a heavy mediator differ by several tens of times when inelastic scattering is considered.

hep-ph↗

arXiv2024

Cosmological phase transitions: from perturbative particle physics to gravitational waves

Gravitational waves (GWs) were recently detected for the first time. This revolutionary discovery opens a new way of learning about particle physics through GWs from first-order phase transitions (FOPTs) in the early Universe. FOPTs could occur when new fundamental symmetries are spontaneously broken down to the Standard Model and are a vital ingredient in solutions of the matter anti-matter asymmetry problem. The purpose of our work is to review the path from a particle physics model to GWs, which contains many specialized parts, so here we provide a timely review of all the required steps, including: (i) building a finite-temperature effective potential in a particle physics model and checking for FOPTs; (ii) computing transition rates; (iii) analyzing the dynamics of bubbles of true vacuum expanding in a thermal plasma; (iv) characterizing a transition using thermal parameters; and, finally, (v) making predictions for GW spectra using the latest simulations and theoretical results and considering the detectability of predicted spectra at future GW detectors. For each step we emphasize the subtleties, advantages and drawbacks of different methods, discuss open questions and review the state-of-art approaches available in the literature. This provides everything a particle physicist needs to begin exploring GW phenomenology.

hep-ph↗

arXiv2024

Theoretical Analysis of Inductive Biases in Deep Convolutional Networks

In this paper, we provide a theoretical analysis of the inductive biases in convolutional neural networks (CNNs). We start by examining the universality of CNNs, i.e., the ability to approximate any continuous functions. We prove that a depth of $\mathcal{O}(\log d)$ suffices for deep CNNs to achieve this universality, where $d$ in the input dimension. Additionally, we establish that learning sparse functions with CNNs requires only $\widetilde{\mathcal{O}}(\log^2d)$ samples, indicating that deep CNNs can efficiently capture {\em long-range} sparse correlations. These results are made possible through a novel combination of the multichanneling and downsampling when increasing the network depth. We also delve into the distinct roles of weight sharing and locality in CNNs. To this end, we compare the performance of CNNs, locally-connected networks (LCNs), and fully-connected networks (FCNs) on a simple regression task, where LCNs can be viewed as CNNs without weight sharing. On the one hand, we prove that LCNs require $Ω(d)$ samples while CNNs need only $\widetilde{\mathcal{O}}(\log^2d)$ samples, highlighting the critical role of weight sharing. On the other hand, we prove that FCNs require $Ω(d^2)$ samples, whereas LCNs need only $\widetilde{\mathcal{O}}(d)$ samples, underscoring the importance of locality. These provable separations quantify the difference between the two biases, and the major observation behind our proof is that weight sharing and locality break different symmetries in the learning process.

cs.LG↗

arXiv2023

Embedding Inequalities for Barron-type Spaces

An important problem in machine learning theory is to understand the approximation and generalization properties of two-layer neural networks in high dimensions. To this end, researchers have introduced the Barron space $\mathcal{B}_s(Ω)$ and the spectral Barron space $\mathcal{F}_s(Ω)$, where the index $s\in [0,\infty)$ indicates the smoothness of functions within these spaces and $Ω\subset\mathbb{R}^d$ denotes the input domain. However, the precise relationship between the two types of Barron spaces remains unclear. In this paper, we establish a continuous embedding between them as implied by the following inequality: for any $δ\in (0,1), s\in \mathbb{N}^{+}$ and $f: Ω\mapsto\mathbb{R}$, it holds that \[ δ\|f\|_{\mathcal{F}_{s-δ}(Ω)}\lesssim_s \|f\|_{\mathcal{B}_s(Ω)}\lesssim_s \|f\|_{\mathcal{F}_{s+1}(Ω)}. \] Importantly, the constants do not depend on the input dimension $d$, suggesting that the embedding is effective in high dimensions. Moreover, we also show that the lower and upper bound are both tight.

stat.ML↗

arXiv2023

9DTact: A Compact Vision-Based Tactile Sensor for Accurate 3D Shape Reconstruction and Generalizable 6D Force Estimation

The advancements in vision-based tactile sensors have boosted the aptitude of robots to perform contact-rich manipulation, particularly when precise positioning and contact state of the manipulated objects are crucial for successful execution. In this work, we present 9DTact, a straightforward yet versatile tactile sensor that offers 3D shape reconstruction and 6D force estimation capabilities. Conceptually, 9DTact is designed to be highly compact, robust, and adaptable to various robotic platforms. Moreover, it is low-cost and easy-to-fabricate, requiring minimal assembly skills. Functionally, 9DTact builds upon the optical principles of DTact and is optimized to achieve 3D shape reconstruction with enhanced accuracy and efficiency. Remarkably, we leverage the optical and deformable properties of the translucent gel so that 9DTact can perform 6D force estimation without the participation of auxiliary markers or patterns on the gel surface. More specifically, we collect a dataset consisting of approximately 100,000 image-force pairs from 175 complex objects and train a neural network to regress the 6D force, which can generalize to unseen objects. To promote the development and applications of vision-based tactile sensors, we open-source both the hardware and software of 9DTact, along with a comprehensive video tutorial, all of which are available at https://linchangyi1.github.io/9DTact.

cs.RO↗

arXiv2023

Detecting DBMS Bugs with Context-Sensitive Instantiation and Multi-Plan Execution

DBMS bugs can cause serious consequences, posing severe security and privacy concerns. This paper works towards the detection of memory bugs and logic bugs in DBMSs, and aims to solve the two innate challenges, including how to generate semantically correct SQL queries in a test case, and how to propose effective oracles to capture logic bugs. To this end, our system proposes two key techniques. The first key technique is called context-sensitive instantiation, which considers all static semantic requirements (including but not limited to the identifier type used by existing systems) to generate semantically valid SQL queries. The second key technique is called multi-plan execution, which can effectively capture logic bugs. Given a test case, multi-plan execution makes the DBMS execute all query plans instead of the default optimal one, and compares the results. A logic bug is detected if a difference is found among the execution results of the executed query plans. We have implemented a prototype system called Kangaroo and applied it to three widely used and well-tested DBMSs, including SQLite, PostgreSQL, and MySQL. Our system successfully detected 50 new bugs. The comparison between our system with the state-of-the-art systems shows that our system outperforms them in terms of the number of generated semantically valid SQL queries, the explored code paths during testing, and the detected bugs.

cs.DB↗

arXiv2023

Further acceleration of multiscale simulation of rarefied gas flow via a generalized boundary treatment

The recently-developed general synthetic iterative scheme (GSIS) is efficient in simulating multiscale rarefied gas flows due to the coupling of mesoscopic kinetic equation and macroscopic synthetic equation: for linearized Poiseuille flow where the boundary flux is fixed at each iterative step, the steady-state solutions are found within dozens of iterations in solving the gas kinetic equations, while for general nonlinear flows the iteration number is increased by about one order of magnitude, caused by the incompatible treatment of the boundary flux for the macroscopic synthetic equation. In this paper, we propose a generalized boundary treatment (GBT) to further accelerate the convergence of GSIS. The main idea is, the truncated velocity distribution function at the boundary, similar to that used in the Grad 13-moment equation, is reconstructed by the macroscopic conserved quantities from the synthetic equation, and the high-order correction of non-equilibrium stress and heat flux from the kinetic equation; therefore, in each inner iteration solving the synthetic equation, the explicit constitutive relations facilitate real-time updates of the macroscopic boundary flux, driving faster information exchange in the flow field, and consequently achieving quicker convergence. Moreover, the high-order correction derived from the kinetic equation can compensate the approximation by the truncation and ensure the boundary accuracy. The accuracy of GSIS-GBT is validated by the direct simulation Monte Carlo method, the previous versions of GSIS, and the unified gas-kinetic wave-particle method. For the efficiency, in the near-continuum flow regime and slip regime, GSIS-GBT can be faster than the conventional iteration scheme in the discrete velocity method and the previous versions of GSIS by two- and one-order of magnitude, respectively.

physics.flu-dyn↗

arXiv2023

NiST: a non-localized spatial-temporal constitutive relation in rarefied gas dynamics

Although the mesoscopic Boltzmann equation describes the rarefied gas dynamics, finding its solutions in complicated engineering problems is challenging. Therefore, over the past one and a half centuries, many partial differential equations based on a few macroscopic variables are proposed. However, they not only have complicated forms, but also cannot make satisfactory prediction when the Knudsen number is large. Here, we propose a non-localized spatial-temporal (NiST) constitutive relation for rarefied gas dynamics, where the stress/heat flux at time $t$ and position $\bm x$ is determined by the velocity/temperature gradient in the nearby spatial-temporal coordinates, via convolution operators. By using the solutions of the Boltzmann equation for the Couette/Fourier flow and the spontaneous Rayleigh-Brillouin scattering, we extract the universal parameters of non-locality as functions of the spatial and temporal Knudsen numbers. Further tests in the sound propagation in rarefied gas show that the NiST constitutive relation can predict the rarefied gas flow over a wide range of Knudsen number.

physics.flu-dyn↗

arXiv2023

On the shock wave boundary layer interaction in slightly-rarefied gas

The shock wave and boundary layer interaction (SWBLI) plays an important role in the design of hypersonic vehicles. However, discrepancies between the numerical results of high-temperature gas dynamics and experiment data have not been fully addressed. It is believed that the rarefaction effects are important in SWBLI, but the systematic analysis of the temperature-jump boundary conditions and the role of translational/rotational/vibrational heat conductivities are lacking. In this paper, we derive the three-temperature Navier-Stokes-Fourier (NSF) equations from the gas kinetic theory, with special attention paid to the components of heat conductivity. With proper temperature-jump boundary conditions, we simulate the SWBLI in the double cone experiment. Our numerical results show that, when the three heat conductivities are properly recovered, the NSF equations can capture the position and peak value of the surface heat flux, in both low- and high-enthalpy inflow conditions. Moreover, the separation bubble induced by the separated shock and the reattachment point induced by impact between transmitted shock and boundary layer are found to agree with the experimental measurement.

physics.flu-dyn↗