arXiv subjects

Xin Dong

Publications and source records attributed to Xin Dong.

At least 109 records · Page 6Linked to original sources

arXiv2022

MixMix: All You Need for Data-Free Compression Are Feature and Data Mixing

User data confidentiality protection is becoming a rising challenge in the present deep learning research. Without access to data, conventional data-driven model compression faces a higher risk of performance degradation. Recently, some works propose to generate images from a specific pretrained model to serve as training data. However, the inversion process only utilizes biased feature statistics stored in one model and is from low-dimension to high-dimension. As a consequence, it inevitably encounters the difficulties of generalizability and inexact inversion, which leads to unsatisfactory performance. To address these problems, we propose MixMix based on two simple yet effective techniques: (1) Feature Mixing: utilizes various models to construct a universal feature space for generalized inversion; (2) Data Mixing: mixes the synthesized images and labels to generate exact label information. We prove the effectiveness of MixMix from both theoretical and empirical perspectives. Extensive experiments show that MixMix outperforms existing methods on the mainstream compression tasks, including quantization, knowledge distillation, and pruning. Specifically, MixMix achieves up to 4% and 20% accuracy uplift on quantization and pruning, respectively, compared to existing data-free compression work.

cs.LG↗

arXiv2021

Constraints on Gluon Distribution Functions in the Nucleon and Nucleus from Open Charm Hadron Production at the Electron-Ion Collider

The Electron-Ion Collider (EIC) at Brookhaven National Laboratory will be a precision Quantum Chromodynamics machine that will enable a vast physics program with electron+proton/ion collisions across a broad center-of-mass range. Measurements of hard probes such as heavy flavor in deep inelastic scatterings will be an essential component to the EIC physics program and are one of the detector R\&D driving aspects. In this paper we study the projected statistical precision of open charm hadron production through exclusive hadronic channel reconstruction with a silicon detector concept currently being developed using a PYTHIA-based simulation. We further study the impact of possible intrinsic charm in the proton on projected data, and estimate the constraint on the nuclear gluon parton distribution function (PDF) from the charm structure functions $F_{2}^{c\overline{c}}$ in $e$+Au collisions using a Bayesian PDF re-weighting technique. Our studies show the EIC will be capable delivering an unprecedented measurement of charm hadron production across a broad kinematic region and will provide strong constraints to both intrinsic charm and nuclear gluon PDFs.

hep-ph↗

arXiv2021

Probing gluon helicity with heavy flavor at the EIC

We propose a new measurement of the heavy flavor hadron double spin asymmetry in deep-inelastic scattering at a future Electron-Ion Collider (EIC) to constrain the polarized gluon distribution function inside the proton. Statistical projection on $D^0$ meson double spin asymmetry is calculated with an EIC central detector using an all-silicon tracker and vertexing subsystem. A first impact study was done by interpreting pseudo-data at next-to-leading order in QCD. The sensitivity of the experimental observable in constraining gluon helicity distribution in a wide range of parton momentum fraction $x$ has been investigated considering different beam energy configurations. This measurement complements the inclusive spin-dependent structure function measurement and provides an opportunity to constrain the gluon helicity distribution in the moderate $x$ region.

hep-ex↗

arXiv2021

Fast query-by-example speech search using separable model

Traditional Query-by-Example (QbE) speech search approaches usually use methods based on frame-level features, while state-of-the-art approaches tend to use models based on acoustic word embeddings (AWEs) to transform variable length audio signals into fixed length feature vector representations. However, these approaches cannot meet the requirements of the search quality as well as speed at the same time. In this paper, we propose a novel fast QbE speech search method based on separable models to fix this problem. First, a QbE speech search training framework is introduced. Second, we design a novel model inference scheme based on RepVGG which can efficiently improve the QbE search quality. Third, we modify and improve our QbE speech search model according to the proposed model inference scheme. Experiments on keywords dataset shows that our proposed method can improve the GPU Real-time Factor (RTF) from 1/150 to 1/2300 by just applying separable model scheme and outperforms other state-of-the-art methods.

eess.AS↗

arXiv2021

Investigation of Experimental Observables in Search of the Chiral Magnetic Effect in Heavy-ion Collisions in the STAR experiment

The chiral magnetic effect (CME) is a novel transport phenomenon, arising from the interplay between quantum anomalies and strong magnetic fields in chiral systems. In high-energy nuclear collisions, the CME may survive the expansion of the quark-gluon plasma fireball and be detected in experiments. Over the past decade, the experimental searches for the CME have aroused extensive interest at the Relativistic Heavy Ion Collider (RHIC) and the Large Hadron Collider (LHC). The main goal of this article is to investigate three pertinent experimental approaches: the $γ$ correlator, the $R$ correlator and the signed balance functions. We will exploit both simple Monte Carlo simulations and a realistic event generator (EBE-AVFD) to verify the equivalence in the kernel-component observables among these methods and to ascertain their sensitivities to the CME signal for the isobaric collisions at RHIC.

nucl-ex↗

arXiv2021

Study of a background reconstruction method for the measurement of D-meson azimuthal angular correlations

We study experimental background reconstruction methods for the measurement of $D-\overline{D}$ correlation using a PYTHIA simulation. Like-sign and side-band background methods that are widely used in the experimental measurements of single $D$-meson production yields were deployed for the correlation background study. It is found that the like-sign method which well describes the combinatorial background of single $D^{0}$ meson yields fails to reproduce the correlated background in the $D^{0}-\overline{D^{0}}$ correlation measurement, while the side-band background method yields a good description of the background for both the single $D^0$ yields and of the correlated background of the $D^{0}-\overline{D^{0}}$ correlation measurement.

hep-ph↗

arXiv2021

A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibration

Spiking Neural Network (SNN) has been recognized as one of the next generation of neural networks. Conventionally, SNN can be converted from a pre-trained ANN by only replacing the ReLU activation to spike activation while keeping the parameters intact. Perhaps surprisingly, in this work we show that a proper way to calibrate the parameters during the conversion of ANN to SNN can bring significant improvements. We introduce SNN Calibration, a cheap but extraordinarily effective method by leveraging the knowledge within a pre-trained Artificial Neural Network (ANN). Starting by analyzing the conversion error and its propagation through layers theoretically, we propose the calibration algorithm that can correct the error layer-by-layer. The calibration only takes a handful number of training data and several minutes to finish. Moreover, our calibration algorithm can produce SNN with state-of-the-art architecture on the large-scale ImageNet dataset, including MobileNet and RegNet. Extensive experiments demonstrate the effectiveness and efficiency of our algorithm. For example, our advanced pipeline can increase up to 69% top-1 accuracy when converting MobileNet on ImageNet compared to baselines. Codes are released at https://github.com/yhhhli/SNN_Calibration.

cs.LG↗

arXiv2021

Friction-induced instability and vibration in a precision motion stage with a friction isolator

Motion stages are widely used for precision positioning in manufacturing and metrology applications. However, they suffer from nonlinear premotion (i.e. "static") friction, which adversely affects their speed and motion precision. In this article, a friction isolator is used as a simple and robust solution to mitigate the undesirable effects of premotion friction in precision motion stages. For the first time, a theoretical study is carried out to understand the dynamic phenomena associated with using a friction isolator on a motion stage. Theoretical analysis and numerical simulation are conducted to examine the dynamical effects of friction isolator on a proportional-integral-derivative-controlled motion stage under LuGre friction dynamics. The influence of friction isolator on the response and stability of the system is examined through theoretical and numerical analyses. Parametric analysis is also carried out to study the effects of friction isolator and friction parameters on the eigenvalue and stability characteristics. The numerical results validate the theoretical findings and demonstrate several other interesting nonlinear phenomena associated with the introduction of friction isolator. This motivates deeper nonlinear dynamical analyses of friction isolator for precision motion control.

math.DS↗

arXiv2021

EIC Physics from An All-Silicon Tracking Detector

The proposed electron-ion collider has a rich physics program to study the internal structure of protons and heavy nuclei. This program will impose strict requirements on detector design. This paper explores how these requirements can be satisfied using an all-silicon tracking detector, by consideration of three representative probes: heavy flavor hadrons, jets, and exclusive vector mesons.

nucl-ex↗

arXiv2020

Leveraging Adversarial Training in Self-Learning for Cross-Lingual Text Classification

In cross-lingual text classification, one seeks to exploit labeled data from one language to train a text classification model that can then be applied to a completely different language. Recent multilingual representation models have made it much easier to achieve this. Still, there may still be subtle differences between languages that are neglected when doing so. To address this, we present a semi-supervised adversarial training process that minimizes the maximal loss for label-preserving input perturbations. The resulting model then serves as a teacher to induce labels for unlabeled target language samples that can be used during further adversarial training, allowing us to gradually adapt our model to the target language. Compared with a number of strong baselines, we observe significant gains in effectiveness on document and intent classification for a diverse set of languages.

cs.CL↗

arXiv2020

Charm and beauty isolation from heavy flavor decay electrons in Au+Au collisions at $\sqrt{s_{\rm NN}}$ = 200 GeV at RHIC

We present a study of charm and beauty isolation based on a data-driven method with recent measurements on heavy flavor hadrons and their decay electrons in Au+Au collisions at $\sqrt{s_{\rm NN}}$ = 200 GeV at RHIC. The individual electron $p_{\rm T}$ spectra, $R_{\rm AA}$ and $v_2$ distributions from charmed and beauty hadron decays are obtained. We find that the electron $R_{\rm AA}$ from beauty hadron decays ($R_{\rm AA}^{\rm b\rightarrow e}$) is suppressed in minimum bias Au+Au collisions but less suppressed compared with that from charmed hadron decays at $p_{\rm T}$ $>$ 3.5 GeV/$c$, which indicates that beauty quark interacts with the hot-dense medium with depositing its energy and is consistent with the mass-dependent energy loss scenario. For the first time, the non-zero electron $v_2$ from beauty hadron decays ($v_2^{\rm b\rightarrow e}$) at $p_{\rm T}$ $>$ 3.0 GeV/$c$ is observed and shows smaller elliptic flow compared with that from charmed hadron decays at $p_{\rm T}$ $<$ 4.0 GeV/$c$. At 2.5 GeV/$c$ $<$ $p_{\rm T}$ $<$ 4.5 GeV/$c$, $v_2^{\rm b\rightarrow e}$ is smaller than a number-of-constituent-quark (NCQ) scaling hypothesis. This suggests that beauty quark is unlikely thermalized and too heavy to be moved in a partonic collectivity in heavy-ion collisions at the RHIC energy.

nucl-ex↗

arXiv2020

Efficient Bitwidth Search for Practical Mixed Precision Neural Network

Network quantization has rapidly become one of the most widely used methods to compress and accelerate deep neural networks. Recent efforts propose to quantize weights and activations from different layers with different precision to improve the overall performance. However, it is challenging to find the optimal bitwidth (i.e., precision) for weights and activations of each layer efficiently. Meanwhile, it is yet unclear how to perform convolution for weights and activations of different precision efficiently on generic hardware platforms. To resolve these two issues, in this paper, we first propose an Efficient Bitwidth Search (EBS) algorithm, which reuses the meta weights for different quantization bitwidth and thus the strength for each candidate precision can be optimized directly w.r.t the objective without superfluous copies, reducing both the memory and computational cost significantly. Second, we propose a binary decomposition algorithm that converts weights and activations of different precision into binary matrices to make the mixed precision convolution efficient and practical. Experiment results on CIFAR10 and ImageNet datasets demonstrate our mixed precision QNN outperforms the handcrafted uniform bitwidth counterparts and other mixed precision techniques.

cs.LG↗

arXiv2020

The Hartree equation with a constant magnetic field: Well-posedness theory

We consider the Hartree equation for infinitely many electrons with a constant external magnetic field. For the system, we show a local well-posedness result when the initial data is the pertubation of a Fermi sea, which is a non-trace class stationary solution to the system. In this case, the one particle Hamiltonian is the Pauli operator, which possesses distinct properties from the Laplace operator, for example, it has a discrete spectrum and infinite-dimensional eigenspaces. The new ingredient is that we use the Fourier-Wigner transform and the asymptotic properties of associated Laguerre polynomials to derive a collapsing estimate, by which we establish the local well-posedness result.

math-ph↗

arXiv2020

Additive Powers-of-Two Quantization: An Efficient Non-uniform Discretization for Neural Networks

We propose Additive Powers-of-Two~(APoT) quantization, an efficient non-uniform quantization scheme for the bell-shaped and long-tailed distribution of weights and activations in neural networks. By constraining all quantization levels as the sum of Powers-of-Two terms, APoT quantization enjoys high computational efficiency and a good match with the distribution of weights. A simple reparameterization of the clipping function is applied to generate a better-defined gradient for learning the clipping threshold. Moreover, weight normalization is presented to refine the distribution of weights to make the training more stable and consistent. Experimental results show that our proposed method outperforms state-of-the-art methods, and is even competitive with the full-precision models, demonstrating the effectiveness of our proposed APoT quantization. For example, our 4-bit quantized ResNet-50 on ImageNet achieves 76.6% top-1 accuracy without bells and whistles; meanwhile, our model reduces 22% computational cost compared with the uniformly quantized counterpart. The code is available at https://github.com/yhhhli/APoT_Quantization.

cs.LG↗

arXiv2020

ABSent: Cross-Lingual Sentence Representation Mapping with Bidirectional GANs

A number of cross-lingual transfer learning approaches based on neural networks have been proposed for the case when large amounts of parallel text are at our disposal. However, in many real-world settings, the size of parallel annotated training data is restricted. Additionally, prior cross-lingual mapping research has mainly focused on the word level. This raises the question of whether such techniques can also be applied to effortlessly obtain cross-lingually aligned sentence representations. To this end, we propose an Adversarial Bi-directional Sentence Embedding Mapping (ABSent) framework, which learns mappings of cross-lingual sentence representations from limited quantities of parallel data.

cs.CL↗

arXiv2019

Asymmetrical Hierarchical Networks with Attentive Interactions for Interpretable Review-Based Recommendation

Recently, recommender systems have been able to emit substantially improved recommendations by leveraging user-provided reviews. Existing methods typically merge all reviews of a given user or item into a long document, and then process user and item documents in the same manner. In practice, however, these two sets of reviews are notably different: users' reviews reflect a variety of items that they have bought and are hence very heterogeneous in their topics, while an item's reviews pertain only to that single item and are thus topically homogeneous. In this work, we develop a novel neural network model that properly accounts for this important difference by means of asymmetric attentive modules. The user module learns to attend to only those signals that are relevant with respect to the target item, whereas the item module learns to extract the most salient contents with regard to properties of the item. Our multi-hierarchical paradigm accounts for the fact that neither are all reviews equally useful, nor are all sentences within each review equally pertinent. Extensive experimental results on a variety of real datasets demonstrate the effectiveness of our method.

cs.IR↗

arXiv2019

RTN: Reparameterized Ternary Network

To deploy deep neural networks on resource-limited devices, quantization has been widely explored. In this work, we study the extremely low-bit networks which have tremendous speed-up, memory saving with quantized activation and weights. We first bring up three omitted issues in extremely low-bit networks: the squashing range of quantized values; the gradient vanishing during backpropagation and the unexploited hardware acceleration of ternary networks. By reparameterizing quantized activation and weights vector with full precision scale and offset for fixed ternary vector, we decouple the range and magnitude from the direction to extenuate the three issues. Learnable scale and offset can automatically adjust the range of quantized values and sparsity without gradient vanishing. A novel encoding and computation pat-tern are designed to support efficient computing for our reparameterized ternary network (RTN). Experiments on ResNet-18 for ImageNet demonstrate that the proposed RTN finds a much better efficiency between bitwidth and accuracy, and achieves up to 26.76% relative accuracy improvement compared with state-of-the-art methods. Moreover, we validate the proposed computation pattern on Field Programmable Gate Arrays (FPGA), and it brings 46.46x and 89.17x savings on power and area respectively compared with the full precision convolution.

cs.LG↗

arXiv2019

Design, Modelling and Validation of a Novel Extra Slender Continuum Robot for In-situ Inspection and Repair in Aeroengine

In-situ aeroengine maintenance works are highly beneficial as it can significantly reduce the current maintenance cycle which is extensive and costly due to the disassembly requirement of engines from aircrafts. However, navigating in/out via inspection ports and performing multi-axis movements with end-effectors in constrained environments (e.g. combustion chamber) are fairly challenging. A novel extra-slender (diameter-to-length ratio <0.02) dual-stage continuum robot (16 degree-of-freedom) is proposed to navigate in/out confined environments and perform required configuration shapes for further repair operations. Firstly, the robot design presents several innovative mechatronic solutions: (i) dual-stage tendon-driven structure with bevelled disks to perform required shapes and to provide selective stiffness for carrying high payloads; (ii) various rigid-compliant combined joints to enable different flexibility and stiffness in each stage; (iii) three commanding cables for each 2-DoF section to minimise the number of actuators with precise actuations. Secondly, a segment-scaled piecewise-constant-curvature-theory based kinematic model and a Kirchhoff-elastic-rod-theory based static model are established by considering the applied forces/moments (friction, actuation, gravity and external load), where the friction coefficient is modelled as a function of bending angle. Finally, experiments were carried out to validate the proposed static modelling and to evaluate the robot capabilities of performing the predefined shape and stiffness.

cs.RO↗