arXiv subjects

Hang Yin

Publications and source records attributed to Hang Yin.

At least 109 records · Page 6Linked to original sources

arXiv2022

Ultra-fast synthesis and thermodynamic analysis of MoAlB by self-propagating high temperature combustion synthesis

MoAlB as a typical member of the MAB phases has attracted much growing attention due to its unique properties. However, the low production of MoAlB powders limits its further development and potential applications. To respond this challenge, the ultra-fast preparation of high-purity MoAlB powders is achieved in a few seconds by self-propagating high temperature combustion synthesis (SHS) using the raw powder mixture at the atomic ratio of 1Mo/1.3Al/1B. The reaction mechanism in SHS process was obtained by analyzing the corresponding composition changes of starting materials. Furthermore, the thermodynamic prediction for the SHS reaction of Mo + (1+y)Al + B = MoAlB + yAl is consistent with the present experiments, where the preparation of MoAlB also conforms to two common self-propagating conditions of SHS. Enthalpy vs temperature curve shows that the adiabatic temperature of the reaction decreases with increasing the amount of excuse Al, but increase when pre-heating the reactants. The thermodynamic calculation method also provides a new idea for the preparation of other MAB phases by SHS.

cond-mat.mtrl-sci↗

arXiv2022

How to Sense the World: Leveraging Hierarchy in Multimodal Perception for Robust Reinforcement Learning Agents

This work addresses the problem of sensing the world: how to learn a multimodal representation of a reinforcement learning agent's environment that allows the execution of tasks under incomplete perceptual conditions. To address such problem, we argue for hierarchy in the design of representation models and contribute with a novel multimodal representation model, MUSE. The proposed model learns hierarchical representations: low-level modality-specific representations, encoded from raw observation data, and a high-level multimodal representation, encoding joint-modality information to allow robust state estimation. We employ MUSE as the sensory representation model of deep reinforcement learning agents provided with multimodal observations in Atari games. We perform a comparative study over different designs of reinforcement learning agents, showing that MUSE allows agents to perform tasks under incomplete perceptual experience with minimal performance loss. Finally, we evaluate the performance of MUSE in literature-standard multimodal scenarios with higher number and more complex modalities, showing that it outperforms state-of-the-art multimodal variational autoencoders in single and cross-modality generation.

cs.LG↗

arXiv2021

Adaptive List Decoder with Flip Operations for Polar Codes

Successive cancellation list decoders with flip operations (SCL-Flip) can utilize re-decoding attempts to significantly improve the error-correction performance of polar codes. However, these re-decoding attempts result in extra computation complexity, which thus leads to increased energy consumption and decoding latency to the communication system adopting SCL-Flip decoders. To significantly reduce the computation complexity of current SCL-Flip decoders, we design a new adaptive SCL-Flip (AD-SCLF) decoder, which can be easily implemented based on existing SCL-Flip techniques. Simulation results showed that the AD-SCLF can reduce up to 80.85\% of the computational complexity of a current SCL-Flip decoder at a matched $FER=10^{-3}$. The result implies our decoder can significantly reduce the energy consumption caused by redundant re-decoding attempts from the SCL-Flip decoder.

cs.IT↗

arXiv2021

Reduction of the electroweak correlation in the PDF updating by using the forward-backward asymmetry of Drell-Yan process

We propose a new observable for the measurement of the forward-backward asymmetry $(A_{FB})$ in Drell-Yan lepton production. At hadron colliders, the $A_{FB}$ distribution is sensitive to both the electroweak (EW) fundamental parameter $\sin^2 θ_{W}$, the weak mixing angle, and the parton distribution functions (PDFs). Hence, the determination of $\sin^2 θ_{W}$ and the updating of PDFs by directly using the same $A_{FB}$ spectrum are strongly correlated. This correlation would introduce large bias or uncertainty into both precise measurements of EW and PDF sectors. In this article, we show that the sensitivity of $A_{FB}$ on $\sin^2 θ_{W}$ is dominated by its average value around the $Z$ pole region, while the shape (or gradient) of the $A_{FB}$ spectrum is insensitive to $\sin^2 θ_{W}$ and contains important information on the PDF modeling. Accordingly, a new observable related to the gradient of the spectrum is introduced, and demonstrated to be able to significantly reduce the potential bias on the determination of $\sin^2 θ_{W}$ when updating the PDFs using the same $A_{FB}$ data.

hep-ph↗

arXiv2021

Benchmarking the Combinatorial Generalizability of Complex Query Answering on Knowledge Graphs

Complex Query Answering (CQA) is an important reasoning task on knowledge graphs. Current CQA learning models have been shown to be able to generalize from atomic operators to more complex formulas, which can be regarded as the combinatorial generalizability. In this paper, we present EFO-1-QA, a new dataset to benchmark the combinatorial generalizability of CQA models by including 301 different queries types, which is 20 times larger than existing datasets. Besides, our work, for the first time, provides a benchmark to evaluate and analyze the impact of different operators and normal forms by using (a) 7 choices of the operator systems and (b) 9 forms of complex queries. Specifically, we provide the detailed study of the combinatorial generalizability of two commonly used operators, i.e., projection and intersection, and justify the impact of the forms of queries given the canonical choice of operators. Our code and data can provide an effective pipeline to benchmark CQA models.

cs.CL↗

arXiv2021

A General Modeling Framework for Network Autoregressive Processes

The paper develops a general flexible framework for Network Autoregressive Processes (NAR), wherein the response of each node linearly depends on its past values, a prespecified linear combination of neighboring nodes and a set of node-specific covariates. The corresponding coefficients are node-specific, while the framework can accommodate heavier than Gaussian errors with both spatial-autorgressive and factor based covariance structures. We provide a sufficient condition that ensures the stability (stationarity) of the underlying NAR that is significantly weaker than its counterparts in previous work in the literature. Further, we develop ordinary and generalized least squares estimators for both a fixed, as well as a diverging number of network nodes, and also provide their ridge regularized counterparts that exhibit better performance in large network settings, together with their asymptotic distributions. We also address the issue of misspecifying the network connectivity and its impact on the aforementioned asymptotic distributions of the various NAR parameter estimators. The framework is illustrated on both synthetic and real air pollution data.

stat.ME↗

arXiv2021

Learning Deep Energy Shaping Policies for Stability-Guaranteed Manipulation

Deep reinforcement learning (DRL) has been successfully used to solve various robotic manipulation tasks. However, most of the existing works do not address the issue of control stability. This is in sharp contrast to the control theory community where the well-established norm is to prove stability whenever a control law is synthesized. What makes traditional stability analysis difficult for DRL are the uninterpretable nature of the neural network policies and unknown system dynamics. In this work, stability is obtained by deriving an interpretable deep policy structure based on the $\textit{energy shaping}$ control of Lagrangian systems. Then, stability during physical interaction with an unknown environment is established based on $\textit{passivity}$. The result is a stability guaranteeing DRL in a model-free framework that is general enough for contact-rich manipulation tasks. With an experiment on a peg-in-hole task, we demonstrate, to the best of our knowledge, the first DRL with stability guarantee on a real robotic manipulator.

cs.RO↗

arXiv2021

On the Impact of Spurious Correlation for Out-of-distribution Detection

Modern neural networks can assign high confidence to inputs drawn from outside the training distribution, posing threats to models in real-world deployments. While much research attention has been placed on designing new out-of-distribution (OOD) detection methods, the precise definition of OOD is often left in vagueness and falls short of the desired notion of OOD in reality. In this paper, we present a new formalization and model the data shifts by taking into account both the invariant and environmental (spurious) features. Under such formalization, we systematically investigate how spurious correlation in the training set impacts OOD detection. Our results suggest that the detection performance is severely worsened when the correlation between spurious features and labels is increased in the training set. We further show insights on detection methods that are more effective in reducing the impact of spurious correlation and provide theoretical analysis on why reliance on environmental features leads to high OOD detection error. Our work aims to facilitate a better understanding of OOD samples and their formalization, as well as the exploration of methods that enhance OOD detection.

cs.LG↗

arXiv2021

Graph-based Normalizing Flow for Human Motion Generation and Reconstruction

Data-driven approaches for modeling human skeletal motion have found various applications in interactive media and social robotics. Challenges remain in these fields for generating high-fidelity samples and robustly reconstructing motion from imperfect input data, due to e.g. missed marker detection. In this paper, we propose a probabilistic generative model to synthesize and reconstruct long horizon motion sequences conditioned on past information and control signals, such as the path along which an individual is moving. Our method adapts the existing work MoGlow by introducing a new graph-based model. The model leverages the spatial-temporal graph convolutional network (ST-GCN) to effectively capture the spatial structure and temporal correlation of skeletal motion data at multiple scales. We evaluate the models on a mixture of motion capture datasets of human locomotion with foot-step and bone-length analysis. The results demonstrate the advantages of our model in reconstructing missing markers and achieving comparable results on generating realistic future poses. When the inputs are imperfect, our model shows improvements on robustness of generation.

cs.CV↗

arXiv2021

Graph-based Task-specific Prediction Models for Interactions between Deformable and Rigid Objects

Capturing scene dynamics and predicting the future scene state is challenging but essential for robotic manipulation tasks, especially when the scene contains both rigid and deformable objects. In this work, we contribute a simulation environment and generate a novel dataset for task-specific manipulation, involving interactions between rigid objects and a deformable bag. The dataset incorporates a rich variety of scenarios including different object sizes, object numbers and manipulation actions. We approach dynamics learning by proposing an object-centric graph representation and two modules which are Active Prediction Module (APM) and Position Prediction Module (PPM) based on graph neural networks with an encode-process-decode architecture. At the inference stage, we build a two-stage model based on the learned modules for single time step prediction. We combine modules with different prediction horizons into a mixed-horizon model which addresses long-term prediction. In an ablation study, we show the benefits of the two-stage model for single time step prediction and the effectiveness of the mixed-horizon model for long-term prediction tasks. Supplementary material is available at https://github.com/wengzehang/deformable_rigid_interaction_prediction

cs.RO↗

arXiv2021

Learning Stable Normalizing-Flow Control for Robotic Manipulation

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control stability. Ideally, one would like to achieve stability guarantees while staying within the framework of state-of-the-art deep RL algorithms. Such a solution does not exist in general, especially one that scales to complex manipulation tasks. We contribute towards closing this gap by introducing $\textit{normalizing-flow}$ control structure, that can be deployed in any latest deep RL algorithms. While stable exploration is not guaranteed, our method is designed to ultimately produce deterministic controllers with provable stability. In addition to demonstrating our method on challenging contact-rich manipulation tasks, we also show that it is possible to achieve considerable exploration efficiency--reduced state space coverage and actuation efforts--without losing learning efficiency.

cs.RO↗

arXiv2021

Impact of LHCb 13 TeV $W$ and $Z$ pseudo-data on the Parton Distribution Functions

We study the potential of the LHCb 13 TeV single $W^{\pm}$ and $Z$ boson pseudo-data for constraining the parton distribution functions (PDFs) of the proton. As an example, we demonstrate the sensitivity of the LHCb 13 TeV data, collected with integrated luminosities of 5 fb$^{-1}$ and 300 fb$^{-1}$, to reducing the PDF uncertainty bands of the CT14HERA2 PDFs, using the error PDF updating package {\sc ePump}. The sensitivities of various experimental observables are compared. Generally, sizable reductions in PDF uncertainties can be observed in the 300 fb$^{-1}$ data sample, particularly in the small-$x$ region. The double-differential cross section measurement of $Z$ boson $p_T$ and rapidity can greatly reduce the uncertainty bands of $u$ and $d$ quarks in almost the whole $x$ range, as compared to various single observable measurements.

hep-ph↗

arXiv2021

Gaussian Mixture Graphical Lasso with Application to Edge Detection in Brain Networks

Sparse inverse covariance estimation (i.e., edge de-tection) is an important research problem in recent years, wherethe goal is to discover the direct connections between a set ofnodes in a networked system based upon the observed nodeactivities. Existing works mainly focus on unimodal distributions,where it is usually assumed that the observed activities aregenerated from asingleGaussian distribution (i.e., one graph).However, this assumption is too strong for many real-worldapplications. In many real-world applications (e.g., brain net-works), the node activities usually exhibit much more complexpatterns that are difficult to be captured by one single Gaussiandistribution. In this work, we are inspired by Latent DirichletAllocation (LDA) [4] and consider modeling the edge detectionproblem as estimating a mixture ofmultipleGaussian distribu-tions, where each corresponds to a separate sub-network. Toaddress this problem, we propose a novel model called GaussianMixture Graphical Lasso (MGL). It learns the proportionsof signals generated by each mixture component and theirparameters iteratively via an EM framework. To obtain moreinterpretable networks, MGL imposes a special regularization,called Mutual Exclusivity Regularization (MER), to minimize theoverlap between different sub-networks. MER also addresses thecommon issues in read-world data sets,i.e., noisy observationsand small sample size. Through the extensive experiments onsynthetic and real brain data sets, the results demonstrate thatMGL can effectively discover multiple connectivity structuresfrom the observed node activities

cs.LG↗

arXiv2021

Explainable Deep Behavioral Sequence Clustering for Transaction Fraud Detection

In e-commerce industry, user behavior sequence data has been widely used in many business units such as search and merchandising to improve their products. However, it is rarely used in financial services not only due to its 3V characteristics - i.e. Volume, Velocity and Variety - but also due to its unstructured nature. In this paper, we propose a Financial Service scenario Deep learning based Behavior data representation method for Clustering (FinDeepBehaviorCluster) to detect fraudulent transactions. To utilize the behavior sequence data, we treat click stream data as event sequence, use time attention based Bi-LSTM to learn the sequence embedding in an unsupervised fashion, and combine them with intuitive features generated by risk experts to form a hybrid feature representation. We also propose a GPU powered HDBSCAN (pHDBSCAN) algorithm, which is an engineering optimization for the original HDBSCAN algorithm based on FAISS project, so that clustering can be carried out on hundreds of millions of transactions within a few minutes. The computation efficiency of the algorithm has increased 500 times compared with the original implementation, which makes flash fraud pattern detection feasible. Our experimental results show that the proposed FinDeepBehaviorCluster framework is able to catch missed fraudulent transactions with considerable business values. In addition, rule extraction method is applied to extract patterns from risky clusters using intuitive features, so that narrative descriptions can be attached to the risky clusters for case investigation, and unknown risk patterns can be mined for real-time fraud detection. In summary, FinDeepBehaviorCluster as a complementary risk management strategy to the existing real-time fraud detection engine, can further increase our fraud detection and proactive risk defense capabilities.

cs.LG↗

arXiv2020

Algebraic Degree Periodicity in Recurrence Sequences

The degree sequence of the algebraic numbers in an algebraic linear recurrence sequence is shown to be virtually periodic. This is proved using the Skolem-Mahler-Lech theorem. It has applications to the degree sequence and the minimal polynomial sequence for exponential sums over finite fields. The degree periodicity also holds for some more complicated non-linear recurrence sequences. We give one example from the iterations of a polynomial map. This depending on the dynamic Mordell-Lang conjecture which has been proved in some cases.

math.NT↗

arXiv2020

Stability-Guaranteed Reinforcement Learning for Contact-rich Manipulation

Reinforcement learning (RL) has had its fair share of success in contact-rich manipulation tasks but it still lags behind in benefiting from advances in robot control theory such as impedance control and stability guarantees. Recently, the concept of variable impedance control (VIC) was adopted into RL with encouraging results. However, the more important issue of stability remains unaddressed. To clarify the challenge in stable RL, we introduce the term all-the-time-stability that unambiguously means that every possible rollout will be stability certified. Our contribution is a model-free RL method that not only adopts VIC but also achieves all-the-time-stability. Building on a recently proposed stable VIC controller as the policy parameterization, we introduce a novel policy search algorithm that is inspired by Cross-Entropy Method and inherently guarantees stability. Our experimental studies confirm the feasibility and usefulness of stability guarantee and also features, to the best of our knowledge, the first successful application of RL with all-the-time-stability on the benchmark problem of peg-in-hole.

cs.RO↗

arXiv2020

Data-efficient Model Learning and Prediction for Contact-rich Manipulation Tasks

In this letter, we investigate learning forward dynamics models and multi-step prediction of state variables (long-term prediction) for contact-rich manipulation. The problems are formulated in the context of model-based reinforcement learning (MBRL). We focus on two aspects-discontinuous dynamics and data-efficiency-both of which are important in the identified scope and pose significant challenges to State-of-the-Art methods. We contribute to closing this gap by proposing a method that explicitly adopts a specific hybrid structure for the model while leveraging the uncertainty representation and data-efficiency of Gaussian process. Our experiments on an illustrative moving block task and a 7-DOF robot demonstrate a clear advantage when compared to popular baselines in low data regimes.

cs.RO↗

arXiv2020

Analyses of residual accelerations for TianQin based on the global MHD simulation

TianQin is a proposed space-based gravitational wave observatory. It is designed to detect the gravitational wave signals in the frequency range of 0.1 mHz -- 1 Hz. At a geocentric distance of $10^5$ km, the plasma in the earth magnetosphere will contribute as the main source of environmental noises. Here, we analyze the acceleration noises that are caused by the magnetic field of space plasma for the test mass of TianQin. The real solar wind data observed by the Advanced Composition Explorer are taken as the input of the magnetohydrodynamic simulation. The Space Weather Modeling Framework is used to simulate the global magnetosphere of the earth, from which we obtain the plasma and magnetic field parameters on the detector's orbits. We calculate the time series of the residual accelerations and the corresponding amplitude spectral densities on these orbit configurations. We find that the residual acceleration produced by the interaction between the TM's magnetic moment induced by the space magnetic field and the spacecraft magnetic field ($\bm{a}_{\rm M1}$) is the dominant term, which can approach $10^{-15}$ m/s$^2$/Hz$^{1/2}$ at $f \approx$ 0.2 mHz for the nominal values of the magnetic susceptibility ($χ_{\rm m} = 10^{-5}$) and the magnetic shielding factor ($ξ_{\rm m} = 10$) of the test mass. The ratios between the amplitude spectral density of the acceleration noise caused by the space magnetic field and the preliminary goal of the inertial sensor are 0.38 and 0.08 at 1 mHz and 10 mHz, respectively. We discuss the further reduction of this acceleration noise by decreasing $χ_{\rm m}$ and/or increasing $ξ_{\rm m}$ in the future instrumentation development for TianQin.

astro-ph.IM↗