arXiv subjects

Haochen Li

Publications and source records attributed to Haochen Li.

86 records · Page 5Linked to original sources

arXiv2022

Gradient Information and Regularization for Gene Expression Programming to Develop Data-Driven Physics Closure Models

Learning accurate numerical constants when developing algebraic models is a known challenge for evolutionary algorithms, such as Gene Expression Programming (GEP). This paper introduces the concept of adaptive symbols to the GEP framework by Weatheritt and Sandberg (2016) to develop advanced physics closure models. Adaptive symbols utilize gradient information to learn locally optimal numerical constants during model training, for which we investigate two types of nonlinear optimization algorithms. The second contribution of this work is implementing two regularization techniques to incentivize the development of implementable and interpretable closure models. We apply $L_2$ regularization to ensure small magnitude numerical constants and devise a novel complexity metric that supports the development of low complexity models via custom symbol complexities and multi-objective optimization. This extended framework is employed to four use cases, namely rediscovering Sutherland's viscosity law, developing laminar flame speed combustion models and training two types of fluid dynamics turbulence models. The model prediction accuracy and the convergence speed of training are improved significantly across all of the more and less complex use cases, respectively. The two regularization methods are essential for developing implementable closure models and we demonstrate that the developed turbulence models substantially improve simulations over state-of-the-art models.

physics.comp-ph↗

arXiv2022

Exploring Representation-Level Augmentation for Code Search

Code search, which aims at retrieving the most relevant code fragment for a given natural language query, is a common activity in software development practice. Recently, contrastive learning is widely used in code search research, where many data augmentation approaches for source code (e.g., semantic-preserving program transformation) are proposed to learn better representations. However, these augmentations are at the raw-data level, which requires additional code analysis in the preprocessing stage and additional training costs in the training stage. In this paper, we explore augmentation methods that augment data (both code and query) at representation level which does not require additional data processing and training, and based on this we propose a general format of representation-level augmentation that unifies existing methods. Then, we propose three new augmentation methods (linear extrapolation, binary interpolation, and Gaussian scaling) based on the general format. Furthermore, we theoretically analyze the advantages of the proposed augmentation methods over traditional contrastive learning methods on code search. We experimentally evaluate the proposed representation-level augmentation methods with state-of-the-art code search models on a large-scale public dataset consisting of six programming languages. The experimental results show that our approach can consistently boost the performance of the studied code search models. Our source code is available at https://github.com/Alex-HaochenLi/RACS.

cs.SE↗

arXiv2019

Energy-efficient Alternating Iterative Secure Structure of Maximizing Secrecy Rate for Directional Modulation Networks

In a directional modulation (DM) network, the issues of security and privacy have taken on an increasingly important role. Since the power allocation of confidential message and artificial noise will make a constructive effect on the system performance, it is important to jointly consider the relationship between the beamforming vectors and the power allocation (PA) factors. To maximize the secrecy rate (SR), an alternating iterative structure (AIS) between the beamforming and PA is proposed. With only two or three iterations, it can rapidly converge to its rate ceil. Simulation results indicate that the SR performance of proposed AIS is much better than the null-space projection (NSP) based PA strategy in the medium and large signal-to-noise ratio (SNR) regions, especially when the number of antennas at the DM transmitter is small.

cs.IT↗

arXiv2018

Sparse Winograd Convolutional neural networks on small-scale systolic arrays

The reconfigurability, energy-efficiency, and massive parallelism on FPGAs make them one of the best choices for implementing efficient deep learning accelerators. However, state-of-art implementations seldom consider the balance between high throughput of computation power and the ability of the memory subsystem to support it. In this paper, we implement an accelerator on FPGA by combining the sparse Winograd convolution, clusters of small-scale systolic arrays, and a tailored memory layout design. We also provide an analytical model analysis for the general Winograd convolution algorithm as a design reference. Experimental results on VGG16 show that it achieves very high computational resource utilization, 20x ~ 30x energy efficiency, and more than 5x speedup compared with the dense implementation.

cs.DC↗

arXiv2018

A Novel Sixth Order Energy-Conserved Method for Three-Dimensional Time-Domain Maxwell's Equations

In this paper, a novel sixth order energy-conserved method is proposed for solving the three-dimensional time-domain Maxwell's equations. The new scheme preserves five discrete energy conservation laws, three momentum conservation laws, symplectic conservation law as well as two divergence-free properties and is proved to be unconditionally stable, non-dissipative. An optimal error estimate is established based on the energy method, which shows that the proposed method is of sixth order accuracy in time and spectral accuracy in space in discrete $L^{2}$-norm. The constant in the error estimate is proved to be only $O(T)$. Furthermore, the numerical dispersion relation is analyzed in detail and a fast solver is presented to solve the resulting discrete linear equations efficiently. Numerical results are addressed to verify our theoretical analysis.

math.NA↗

arXiv2017

Reconfigurable Power Electronics Topologies

This paper presents two novel topologies for automatically transforming power converter topology from three-phase 3-level cascaded H-bridge to three-phase 2-level converter design. These techniques are implemented by flicking specific switches to rearrange circuit connections. The switches can be controlled by signals in order to realize automation.

eess.SP↗

arXiv2017

Partitioned AVF methods

The classic second-order average vector field (AVF) method can exactly preserve the energy for Hamiltonian ordinary differential equations and partial differential equations. However, the AVF method inevitably leads to fully-implicit nonlinear algebraic equations for general nonlinear systems. To address this drawback and maintain the desired energy-preserving property, a first-order partitioned AVF method is proposed which first divides the variables into groups and then applies the AVF method step by step. In conjunction with its adjoint method we present the partitioned AVF composition method and plus method respectively to improve its accuracy to second order. Concrete schemes for two classic model equations are constructed with semi-implicit, linear-implicit properties that make considerable lower cost than the original AVF method. Furthermore, additional conservative property can be generated besides the conventional energy preservation for specific problems. Numerical verification of these schemes further conforms our results.

math.NA↗

arXiv2015

Discrete line integral method for the Lorentz force system

In this paper, we apply the Boole discrete line integral to solve the Lorentz force system which is written as a non-canonical Hamiltonian system. The method is exactly energy-conserving for polynomial Hamiltonians of degree $ν\leq 4$. In any other case, the energy can also be conserved approximatively. With comparison to well-used Boris method, numerical experiments are presented to demonstrate the energy-preserving property of the method.

math.NA↗

arXiv2014

A sixth order averaged vector field method

In this paper, based on the theory of rooted trees and B-series, we propose the concrete formulas of the substitution law for the trees of order =5. With the help of the new substitution law, we derive a B-series integrator extending the averaged vector field (AVF) method to high order. The new integrator turns out to be of order six and exactly preserves energy for Hamiltonian systems. Numerical experiments are presented to demonstrate the accuracy and the energy-preserving property of the sixth order AVF method.

math.NA↗

arXiv2007

Merging of single-particle levels and non-Fermi-liquid behavior of finite Fermi systems

We examine the problem of finite Fermi systems having a degenerate single-particle spectrum and show that the Landau approach, applied to such a system, admits the possibility of merging single-particle levels. It is demonstrated that the opportunity for this behavior is widespread in quantum many-body systems. The salient feature of the phenomenon is the occurrence of nonintegral quasiparticle occupation numbers, leading to a radical alteration of the standard quasiparticle picture. Implications of this alteration are considered for nuclear, atomic, and solid-state systems.

cond-mat.str-el↗

arXiv2006

Merging of single-particle levels in finite Fermi systems

Properties of the distribution of single-particle levels adjacent to the Fermi surface in finite Fermi systems are studied, focusing on the case in which these levels are degenerate. The interaction of the quasiparticles occupying these levels lifts the degeneracy and affects the distance between the closest levels on opposite sides of the Fermi surface, as the number of particles in the system is varied. In addition to the familiar scenario of level crossing, a new phenomenon is uncovered, in which the merging of single-particle levels results in the disappearance of well-defined single-particle excitations. Implications of this finding are discussed for nuclear, solid-state, and atomic systems.

cond-mat.str-el↗

arXiv2006

Modeling Nuclear Properties with Support Vector Machines

We have made initial studies of the potential of support vector machines (SVM) for providing statistical models of nuclear systematics with demonstrable predictive power. Using SVM regression and classification procedures, we have created global models of atomic masses, beta-decay halflives, and ground-state spins and parities. These models exhibit performance in both data-fitting and prediction that is comparable to that of the best global models from nuclear phenomenology and microscopic theory, as well as the best statistical models based on multilayer feedforward neural networks.

nucl-th↗

arXiv2006

Application Of Support Vector Machines To Global Prediction Of Nuclear Properties

Advances in statistical learning theory present the opportunity to develop statistical models of quantum many-body systems exhibiting remarkable predictive power. The potential of such ``theory-thin'' approaches is illustrated with the application of Support Vector Machines (SVMs) to global prediction of nuclear properties as functions of proton and neutron numbers $Z$ and $N$ across the nuclidic chart. Based on the principle of structural-risk minimization, SVMs learn from examples in the existing database of a given property $Y$, automatically and optimally identify a set of ``support vectors'' corresponding to representative nuclei in the training set, and approximate the mapping $(Z,N) \to Y$ in terms of these nuclei. Results are reported for nuclear masses, beta-decay lifetimes, and spins/parities of nuclear ground states. These results indicate that SVM models can match or even surpass the predictive performance of the best conventional ``theory-thick'' global models based on nuclear phenomenology.

nucl-th↗

arXiv2005

The Nonradial Oscillation Node Precession of Neutron Stars

The standing wave nodes of nonradial oscillations on a neutron star crust will drift with a definite angle velocity around rotational pole due to the rotation of neutron stars. This is called the nonradial oscillation node precession of neutron stars. This article estimated the precession velocity and pointed out that it merely lies on the star's rotation velocity and the angular order of spherical harmonic $l$ by one order approximation. If we suppose that oscillations effect the particles' escaping from the polar cap of a neutron star, so that the antinode and node areas of the standing waves have different radiative intensity, several unusual conclusions are acquired by reviewing the observation of pulsars which had already been taken as neutron stars. For example, the drifting subpulse period $P_{3}$ can be gotten from the width of subpulses and order $l$; the larger velocity drift may produce the peak structure of average pulse profiles; the dissimilar radiation phenomena between neighboring periods generated from drift provide a reasonable explanation of interpulses which have been found on some pulsars.

astro-ph↗