arXiv subjects

Yuan Yao

Publications and source records attributed to Yuan Yao.

At least 289 records · Page 16Linked to original sources

arXiv2020

An exact solution in Markov decision process with multiplicative rewards as a general framework

We develop an exactly solvable framework of Markov decision process with a finite horizon, and continuous state and action spaces. We first review the exact solution of conventional linear quadratic regulation with a linear transition and a Gaussian noise, whose optimal policy does not depend on the Gaussian noise, which is an undesired feature in the presence of significant noises. It motivates us to investigate exact solutions which depend on noise. To do so, we generalize the reward accumulation to be a general binary commutative and associative operation. By a new multiplicative accumulation, we obtain an exact solution of optimization assuming linear transitions with a Gaussian noise and the optimal policy is noise dependent in contrast to the additive accumulation. Furthermore, we also show that the multiplicative scheme is a general framework that covers the additive one with an arbitrary precision, which is a model-independent principle.

cs.LG↗

arXiv2020

Denoising Relation Extraction from Document-level Distant Supervision

Distant supervision (DS) has been widely used to generate auto-labeled data for sentence-level relation extraction (RE), which improves RE performance. However, the existing success of DS cannot be directly transferred to the more challenging document-level relation extraction (DocRE), since the inherent noise in DS may be even multiplied in document level and significantly harm the performance of RE. To address this challenge, we propose a novel pre-trained model for DocRE, which denoises the document-level DS data via multiple pre-training tasks. Experimental results on the large-scale DocRE benchmark show that our model can capture useful information from noisy DS data and achieve promising results.

cs.CL↗

arXiv2020

Crossmodal Language Grounding in an Embodied Neurocognitive Model

Human infants are able to acquire natural language seemingly easily at an early age. Their language learning seems to occur simultaneously with learning other cognitive functions as well as with playful interactions with the environment and caregivers. From a neuroscientific perspective, natural language is embodied, grounded in most, if not all, sensory and sensorimotor modalities, and acquired by means of crossmodal integration. However, characterising the underlying mechanisms in the brain is difficult and explaining the grounding of language in crossmodal perception and action remains challenging. In this paper, we present a neurocognitive model for language grounding which reflects bio-inspired mechanisms such as an implicit adaptation of timescales as well as end-to-end multimodal abstraction. It addresses developmental robotic interaction and extends its learning capabilities using larger-scale knowledge-based data. In our scenario, we utilise the humanoid robot NICO in obtaining the EMIL data collection, in which the cognitive robot interacts with objects in a children's playground environment while receiving linguistic labels from a caregiver. The model analysis shows that crossmodally integrated representations are sufficient for acquiring language merely from sensory input through interaction with objects in an environment. The representations self-organise hierarchically and embed temporal and spatial information through composition and decomposition. This model can also provide the basis for further crossmodal integration of perceptually grounded cognitive representations.

cs.NE↗

arXiv2020

The Ground State Electronic Energy of Benzene

We report on the findings of a blind challenge devoted to determining the frozen-core, full configuration interaction (FCI) ground state energy of the benzene molecule in a standard correlation-consistent basis set of double-$ζ$ quality. As a broad international endeavour, our suite of wave function-based correlation methods collectively represents a diverse view of the high-accuracy repertoire offered by modern electronic structure theory. In our assessment, the evaluated high-level methods are all found to qualitatively agree on a final correlation energy, with most methods yielding an estimate of the FCI value around $-863$ m$E_{\text{H}}$. However, we find the root-mean-square deviation of the energies from the studied methods to be considerable (1.3 m$E_{\text{H}}$), which in light of the acclaimed performance of each of the methods for smaller molecular systems clearly displays the challenges faced in extending reliable, near-exact correlation methods to larger systems. While the discrepancies exposed by our study thus emphasize the fact that the current state-of-the-art approaches leave room for improvement, we still expect the present assessment to provide a valuable community resource for benchmark and calibration purposes going forward.

physics.chem-ph↗

arXiv2020

Almost exact energies for the Gaussian-2 set with the semistochastic heat-bath configuration interaction method

The recently developed semistochastic heat-bath configuration interaction (SHCI) method is a systematically improvable selected configuration interaction plus perturbation theory method capable of giving essentially exact energies for larger systems than is possible with other such methods. We compute SHCI atomization energies for 55 molecules which have been used as a test set in prior studies because their atomization energies are known from experiment. Basis sets from cc-pVDZ to cc-pV5Z are used, totaling up to 500 orbitals and a Hilbert space of $10^{32}$ Slater determinants for the largest molecules. For each basis, an extrapolated energy well within chemical accuracy (1 kcal/mol or 1.6 mHa/mol) of the exact energy for that basis is computed using only a tiny fraction of the entire Hilbert space. We also use our almost exact energies to benchmark coupled-cluster [CCSD(T)] energies. The energies are extrapolated to the complete basis set limit and compared to the experimental atomization energies. The extrapolations are done both without and with a basis-set correction based on density-functional theory. The mean absolute deviations from experiment for these extrapolations are 0.46 kcal/mol and 0.51 kcal/mol, respectively. Orbital optimization methods used to obtain improved convergence of the SHCI energies are also discussed.

physics.chem-ph↗

arXiv2020

Knowledge Transfer via Pre-training for Recommendation: A Review and Prospect

Recommender systems aim to provide item recommendations for users, and are usually faced with data sparsity problem (e.g., cold start) in real-world scenarios. Recently pre-trained models have shown their effectiveness in knowledge transfer between domains and tasks, which can potentially alleviate the data sparsity problem in recommender systems. In this survey, we first provide a review of recommender systems with pre-training. In addition, we show the benefits of pre-training to recommender systems through experiments. Finally, we discuss several promising directions for future research for recommender systems with pre-training.

cs.IR↗

arXiv2020

Leveraging both Lesion Features and Procedural Bias in Neuroimaging: An Dual-Task Split dynamics of inverse scale space

The prediction and selection of lesion features are two important tasks in voxel-based neuroimage analysis. Existing multivariate learning models take two tasks equivalently and optimize simultaneously. However, in addition to lesion features, we observe that there is another type of feature, which is commonly introduced during the procedure of preprocessing steps, which can improve the prediction result. We call such a type of feature as procedural bias. Therefore, in this paper, we propose that the features/voxels in neuroimage data are consist of three orthogonal parts: lesion features, procedural bias, and null features. To stably select lesion features and leverage procedural bias into prediction, we propose an iterative algorithm (termed GSplit LBI) as a discretization of differential inclusion of inverse scale space, which is the combination of Variable Splitting scheme and Linearized Bregman Iteration (LBI). Specifically, with a variable the splitting term, two estimators are introduced and split apart, i.e. one is for feature selection (the sparse estimator) and the other is for prediction (the dense estimator). Implemented with Linearized Bregman Iteration (LBI), the solution path of both estimators can be returned with different sparsity levels on the sparse estimator for the selection of lesion features. Besides, the dense the estimator can additionally leverage procedural bias to further improve prediction results. To test the efficacy of our method, we conduct experiments on the simulated study and Alzheimer's Disease Neuroimaging Initiative (ADNI) database. The validity and the benefit of our model can be shown by the improvement of prediction results and the interpretability of visualized procedural bias and lesion features.

cs.CV↗

arXiv2020

DessiLBI: Exploring Structural Sparsity of Deep Networks via Differential Inclusion Paths

Over-parameterization is ubiquitous nowadays in training neural networks to benefit both optimization in seeking global optima and generalization in reducing prediction error. However, compressive networks are desired in many real world applications and direct training of small networks may be trapped in local optima. In this paper, instead of pruning or distilling over-parameterized models to compressive ones, we propose a new approach based on differential inclusions of inverse scale spaces. Specifically, it generates a family of models from simple to complex ones that couples a pair of parameters to simultaneously train over-parameterized deep models and structural sparsity on weights of fully connected and convolutional layers. Such a differential inclusion scheme has a simple discretization, proposed as Deep structurally splitting Linearized Bregman Iteration (DessiLBI), whose global convergence analysis in deep learning is established that from any initializations, algorithmic iterations converge to a critical point of empirical risks. Experimental evidence shows that DessiLBI achieve comparable and even better performance than the competitive optimizers in exploring the structural sparsity of several widely used backbones on the benchmark datasets. Remarkably, with early stopping, DessiLBI unveils "winning tickets" in early epochs: the effective sparse structure with comparable test accuracy to fully trained over-parameterized models.

cs.CV↗

arXiv2020

Chemistry of the spin-1/2 kagome Heisenberg antiferromagnet

We believe that a necessary first step in understanding the ground state properties of the spin-${\scriptstyle\frac{1}{2}}$ kagome Heisenberg antiferromagnet is a better understanding of this model's very large number of low energy singlet states. A description of the low energy states that is both accurate and amenable for numerical work may ultimately prove to have greater value than knowing only what these properties are, in particular when these turn on the delicate balance of many small energies. We demonstrate how this program would be implemented using the basis of spin-singlet dimerized states, though other bases that have been proposed may serve the same purpose. The quality of a basis is evaluated by its participation in all the low energy singlets, not just the ground state. From an experimental perspective, and again in light of the small energy scales involved, methods that can deliver all the low energy states promise more robust predictions than methods that only refine a fraction of these states.

cond-mat.str-el↗

arXiv2020

Video Playback Rate Perception for Self-supervisedSpatio-Temporal Representation Learning

In self-supervised spatio-temporal representation learning, the temporal resolution and long-short term characteristics are not yet fully explored, which limits representation capabilities of learned models. In this paper, we propose a novel self-supervised method, referred to as video Playback Rate Perception (PRP), to learn spatio-temporal representation in a simple-yet-effective way. PRP roots in a dilated sampling strategy, which produces self-supervision signals about video playback rates for representation model learning. PRP is implemented with a feature encoder, a classification module, and a reconstructing decoder, to achieve spatio-temporal semantic retention in a collaborative discrimination-generation manner. The discriminative perception model follows a feature encoder to prefer perceiving low temporal resolution and long-term representation by classifying fast-forward rates. The generative perception model acts as a feature decoder to focus on comprehending high temporal resolution and short-term representation by introducing a motion-attention mechanism. PRP is applied on typical video target tasks including action recognition and video retrieval. Experiments show that PRP outperforms state-of-the-art self-supervised models with significant margins. Code is available at github.com/yuanyao366/PRP

cs.CV↗

arXiv2020

Two-photon interference: the Hong-Ou-Mandel effect

Nearly 30 years ago, two-photon interference was observed, marking the beginning of a new quantum era. Indeed, two-photon interference has no classical analogue, giving it a distinct advantage for a range of applications. The peculiarities of quantum physics may now be used to our advantage to outperform classical computations, securely communicate information, simulate highly complex physical systems and increase the sensitivity of precise measurements. This separation from classical to quantum physics has motivated physicists to study two-particle interference for both fermionic and bosonic quantum objects. So far, two-particle interference has been observed with massive particles, among others, such as electrons and atoms, in addition to plasmons, demonstrating the extent of this effect to larger and more complex quantum systems. A wide array of novel applications to this quantum effect is to be expected in the future. This review will thus cover the progress and applications of two-photon (two-particle) interference over the last three decades.

quant-ph↗

arXiv2020

Nonlinear parameter-gauge coupling approach to generalization of generalized Thouless pumps and $-1$-form anomaly

We study the nontrivial topology of the parameter space of general $U(1)$-symmetric fermionic non-degenerately gapped system and its consequences on the transport properties in arbitrary dimensions. By a nonlinear parameter-gauge topological response theory, we find that such nontrivial topology can impose quantization constraints on the charge transport in the presence of background fluxes or, more generally, instantons in general dimensions and our result generalizes the Thouless pump and its higher dimensional generalizations. We also show that these nontrivial transport properties are related to an unconventional quantum anomaly, which generalizes $-1$-form anomalies. This anomaly imposes non-perturbative ingappabilities of various types of spatial interfaces or time-dependent system evolution.

cond-mat.str-el↗

arXiv2020

Learning the mapping $\mathbf{x}\mapsto \sum_{i=1}^d x_i^2$: the cost of finding the needle in a haystack

The task of using machine learning to approximate the mapping $\mathbf{x}\mapsto\sum_{i=1}^d x_i^2$ with $x_i\in[-1,1]$ seems to be a trivial one. Given the knowledge of the separable structure of the function, one can design a sparse network to represent the function very accurately, or even exactly. When such structural information is not available, and we may only use a dense neural network, the optimization procedure to find the sparse network embedded in the dense network is similar to finding the needle in a haystack, using a given number of samples of the function. We demonstrate that the cost (measured by sample complexity) of finding the needle is directly related to the Barron norm of the function. While only a small number of samples is needed to train a sparse network, the dense network trained with the same number of samples exhibits large test loss and a large generalization gap. In order to control the size of the generalization gap, we find that the use of explicit regularization becomes increasingly more important as $d$ increases. The numerically observed sample complexity with explicit regularization scales as $\mathcal{O}(d^{2.5})$, which is in fact better than the theoretically predicted sample complexity that scales as $\mathcal{O}(d^{4})$. Without explicit regularization (also called implicit regularization), the numerically observed sample complexity is significantly higher and is close to $\mathcal{O}(d^{4.5})$.

cs.LG↗

arXiv2020

A generalized boundary condition applied to Lieb-Schultz-Mattis type ingappabilities and many-body Chern numbers

We introduce a new boundary condition which renders the flux-insertion argument for the Lieb-Schultz-Mattis type theorems in two or higher dimensions free from the specific choice of system sizes. It also enables a formulation of the Lieb-Schultz-Mattis type theorems in arbitrary dimensions in terms of the anomaly in field theories of $1+1$ dimensions with a bulk correspondence as a BF-theory in 2+1 dimensions. Furthermore, we apply the anomaly-based formulation to the constraints on a half-filled spinless fermion on a square lattice with $π$ flux, utilizing time-reversal, the magnetic translation and on-site internal $U(N)$ symmetries. This demonstrates the role of time-reversal anomaly on the ingappabilities of a lattice model.

cond-mat.str-el↗

arXiv2020

Boosting Semantic Human Matting with Coarse Annotations

Semantic human matting aims to estimate the per-pixel opacity of the foreground human regions. It is quite challenging and usually requires user interactive trimaps and plenty of high quality annotated data. Annotating such kind of data is labor intensive and requires great skills beyond normal users, especially considering the very detailed hair part of humans. In contrast, coarse annotated human dataset is much easier to acquire and collect from the public dataset. In this paper, we propose to use coarse annotated data coupled with fine annotated data to boost end-to-end semantic human matting without trimaps as extra input. Specifically, we train a mask prediction network to estimate the coarse semantic mask using the hybrid data, and then propose a quality unification network to unify the quality of the previous coarse mask outputs. A matting refinement network takes in the unified mask and the input image to predict the final alpha matte. The collected coarse annotated dataset enriches our dataset significantly, allows generating high quality alpha matte for real images. Experimental results show that the proposed method performs comparably against state-of-the-art methods. Moreover, the proposed method can be used for refining coarse annotated public dataset, as well as semantic segmentation methods, which reduces the cost of annotating high quality human data to a great extent.

cs.CV↗

arXiv2020

$α$ Decay Half-life Estimation and Uncertainty Analysis

The non-parametric bootstrap method is used to evaluate the uncertainties of two $α$ decay formulas, the universal decay law (UDL) and the new Geiger-Nuttall law (NGNL). Such a method can simultaneously obtain the uncertainty of each parameter, the correlation between each pair of parameters, and the total, statistical, and systematic uncertainties of each formula. Both even-even (ee) nuclei and odd-A (oA) nuclei are used in the analysis. The collected data are separated into three parts: ee nuclei, oA nuclei without spin or parity change (oA\_nc), and oA nuclei with spin and/or parity change (oA\_c). Based on the residues between observed data and corresponding calculations, the statistical and systematic uncertainties are decomposed from the total uncertainty, from which one can clarify the effects from the shell structure, pairing, and angular momentum change on describing $α$ decay half-life. If $N > 126$ and $N \leqslant 126$ nuclei are considered together, the systematic uncertainty of residues between observed and predicted half-lives are larger than if those groups are considered separately. Without shell correction term, a much larger systematic uncertainty is found if parameters obtained for $N \leqslant 126$ nuclei are used to describe the half-lives of $N > 126$ nuclei. A global hindrance on the $α$ decay process is found in oA\_nc (oA\_c) nuclei comparing with ee (oA\_nc) nuclei. If parameters obtained from ee (oA\_nc) nuclei are used, the half-lives of oA\_nc (oA\_c) nuclei are generally underestimated with large systematic uncertainties, which can be related to the contribution of pairing effect and angular momentum. The recently observed superallowed decay from $^{104}$Te to $^{100}$Sn is also discussed based on uncertainty analysis. (Abstract is not fully presented because of length limitation)

nucl-th↗

arXiv2020

Large anomalous Hall effect in a hexagonal ferromagnetic Fe5Sn3 single crystal

In this paper, we report an experimental observation of the large anomalous Hall effect (AHE) in a hexagonal ferromagnetic Fe5Sn3 single crystal with current along the b axis and a magnetic field normal to the bc plane. The intrinsic contribution of the anomalous Hall conductance sigma_AH^int was approximately 613 Ω-1 cm-1, which was more than 3 times the maximum value in the frustrated kagome magnet Fe3Sn2 and nearly independent of the temperature over a wide range between 5 and 350 K. The analysis results revealed that the large AHE was dominated by a common, intrinsic term, while the extrinsic contribution, i.e., the skew scattering and side jump, turned out to be small. In addition to the large AHE, it was found the types of majority carriers changed at approximately 275 and 30 K, consistent with the critical temperatures of the spin reorientation. These findings suggest that the hexagonal ferromagnetic Fe5Sn3 single crystal is an excellent candidate to use for the study of the topological features in ferromagnets.

cond-mat.mtrl-sci↗

arXiv2020

$\textit{Ab Initio}$ Mismatched Interface Theory of Graphene on $α$-RuCl$_3$: Doping and Magnetism

Recent developments in twisted and lattice-mismatched bilayers have revealed a rich phase space of van der Waals systems and generated excitement. Among these systems are heterobilayers which can offer new opportunities to control van der Waals systems with strong in plane correlations such as spin-orbit-assisted Mott insulator $α$-RuCl$_3$. Nevertheless, a theoretical $\textit{ab initio}$ framework for mismatched heterobilayers without even approximate periodicity is sorely lacking. We propose a general strategy for calculating electronic properties of such systems, mismatched interface theory (MINT), and apply it to the graphene/$α$-RuCl$_{3}$ (GR/$α$-RuCl$_{3}$) heterostructure. Using MINT, we predict uniform doping of 4.77$\%$ from graphene to $α$-RuCl$_3$ and magnetic interactions in $α$-RuCl$_3$ to shift the system toward the Kitaev point. Hence we demonstrate that MINT can guide targeted materialization of desired model systems and discuss recent experiments on GR/$α$-RuCl$_{3}$ heterostructures.

cond-mat.str-el↗