arXiv subjects

Yuan Li

Publications and source records attributed to Yuan Li.

At least 361 records · Page 20Linked to original sources

arXiv2021

Refiner: Refining Self-attention for Vision Transformers

Vision Transformers (ViTs) have shown competitive accuracy in image classification tasks compared with CNNs. Yet, they generally require much more data for model pre-training. Most of recent works thus are dedicated to designing more complex architectures or training methods to address the data-efficiency issue of ViTs. However, few of them explore improving the self-attention mechanism, a key factor distinguishing ViTs from CNNs. Different from existing works, we introduce a conceptually simple scheme, called refiner, to directly refine the self-attention maps of ViTs. Specifically, refiner explores attention expansion that projects the multi-head attention maps to a higher-dimensional space to promote their diversity. Further, refiner applies convolutions to augment local patterns of the attention maps, which we show is equivalent to a distributed local attention features are aggregated locally with learnable kernels and then globally aggregated with self-attention. Extensive experiments demonstrate that refiner works surprisingly well. Significantly, it enables ViTs to achieve 86% top-1 classification accuracy on ImageNet with only 81M parameters.

cs.CV↗

arXiv2021

Geometrical and electrical modulation on the transport property of silicene constrictions

We study the electrical modulation of the transport properties of silicene constrictions with different geometrical structures by adopting the tight-binding model and non-equilibrium Green's function method. The band structure and transmission properties are discussed under the influence of the external electric field and potential energy. Especially, we investigate the effects of the position and width of the central scattering region on the conductance with increasing of Fermi energy. We find that the conductance significantly depends on the position and the width. Interestingly, the symmetrical structure of the central region can induce a resonance effect and significantly enlarge the system's conductance. Obviously, we obtain an effective method to adjust the transport property of the silicene heterojunctions. Correspondingly, we propose a novel two-channel structure with an excellent performance on the conductance compared to the one-channel structure with the same total width.

cond-mat.mes-hall↗

arXiv2021

Thermal dynamics of charge density wave pinning in ZrTe3

Impurity pinning has long been discussed to have a profound effect on the dynamics of an incommensurate charge density wave (CDW), which would otherwise slide through the lattice without resistance. Here we visualize the impurity pinning evolution of the CDW in ZrTe3 using the variable temperature scanning tunneling microscopy (STM). At low temperatures, we observe a quasi-1D incommensurate CDW modulation moderately correlated to the impurity positions, indicating a weak impurity pinning. As we raise the sample temperature, the CDW modulation gets progressively weakened and distorted, while the correlation with the impurities becomes stronger. Above the CDW transition temperature, short-range modulations persist with the phase almost all pinned by impurities. The evolution from weak to strong impurity pinning through the CDW transition can be understood as a result of losing phase rigidity.

cond-mat.str-el↗

arXiv2021

On the Weight Spectrum of Pre-Transformed Polar Codes

Polar codes are the first class of channel codes achieving the symmetric capacity of the binary-input discrete memoryless channels with efficient encoding and decoding algorithms. But the weight spectrum of Polar codes is relatively poor compared to RM codes, which degrades their ML performance. Pre-transformation with an upper-triangular matrix (including cyclic redundancy check (CRC), parity-check (PC) and polarization-adjusted convolutional (PAC) codes), improves weight spectrum while retaining polarization. In this paper, the weight spectrum of upper-triangular pre-transformed Polar Codes is mathematically analyzed. In particular, we focus on calculating the number of low-weight codewords due to their impact on error-correction performance. Simulation results verify the accuracy of the analysis.

cs.IT↗

arXiv2021

Parameterization of nearshore wave breaker index

The performances of phase-averaged parametric nearshore wave transformation models depend significantly on a reliable estimate of the wave breaker index r (the breaker height-to-depth ratio), a free model parameter that essentially controls the amount of breaking energy dissipation. While the previous studies have suggested separate relationships between r and the offshore wave steepness (s0) or the normalized local water depth (kh), the parameterization of r still requires further investigation considering a wider variety of conditions and a sounder physical basis. In this study, we use the field datasets of wave height and the inverse modelling approach to reveal a composite dependence of r on both s0 and kh. Specifically, the results show a positive dependence of r on kh for larger s0, and a negative dependence of r on kh for smaller s0. Based on such composite relationships, a new r formula is proposed, and its performance is verified against the available datasets of wave height in three coasts and 14 laboratory tests. Implementation of this new formula in a parametric wave model leads to the error reduction of wave height prediction by 10~24% (mean = 19%) relative to seven widely used models in literatures. In particular, a remarkably higher model accuracy is obtained under wave conditions with small offshore wave steepness, which is important for studying onshore sediment transport and beach recovery. Two counteractive physical mechanisms for wave nonlinearity effects, namely the breaking intensification mechanism and the breaking resistance mechanism, are suggested to explain the opposite r-kh relationships within different ranges of s0.

physics.ao-ph↗

arXiv2021

The Complete Affine Automorphism Group of Polar Codes

Recently, a permutation-based successive cancellation (PSC) decoding framework for polar codes attaches much attention. It decodes several permuted codewords with independent successive cancellation (SC) decoders. Its latency thus can be reduced to that of SC decoding. However, the PSC framework is ineffective for permutations falling into the lower-triangular affine (LTA) automorphism group, as they are invariant under SC decoding. As such, a larger block lower-triangular affine (BLTA) group that contains SC-variant permutations was discovered for decreasing polar codes. But it was unknown whether BLTA equals the complete automorphism group. In this paper, we prove that BLTA equals the complete automorphisms of decreasing polar codes that can be formulated as affine trasformations.

cs.IT↗

arXiv2021

Determining the range of magnetic interactions from the relations between magnon eigenvalues at high-symmetry k points

Magnetic exchange interactions (MEIs) define networks of coupled magnetic moments and lead to a surprisingly rich variety of their magnetic properties. Typically MEIs can be estimated by fitting experimental results. But how many MEIs need to be included in the fitting process for a material is not clear a priori, which limits the quality of results obtained by these conventional methods. In this paper, based on linear spin-wave theory but without performing matrix diagonalization, we show that for a general quadratic spin Hamiltonian, there is a simple relation between the Fourier transform of MEIs and the sum of square of magnon energies (SSME). We further show that according to the real-space distance range within which MEIs are considered relevant, one can obtain the corresponding relationships between SSME in momentum space. We also develop a theoretical tool for tabulating the rule about SSME. By directly utilizing these characteristics and the experimental magnon energies at only a few high-symmetry k points in the Brillouin zone, one can obtain strong constraints about the range of exchange path beyond which MEIs can be safely neglected. Our methodology is also general applicable for other Hamiltonian with quadratic Fermi or Boson operators.

cond-mat.mtrl-sci↗

arXiv2021

Certificate complexity and symmetry of nested canalizing functions

Boolean nested canalizing functions (NCFs) have important applications in molecular regulatory networks, engineering and computer science. In this paper, we study their certificate complexity. For both Boolean values $b\in\{0,1\}$, we obtain a formula for $b$-certificate complexity and consequently, we develop a direct proof of the certificate complexity formula of an NCF. Symmetry is another interesting property of Boolean functions and we significantly simplify the proofs of some recent theorems about partial symmetry of NCFs. We also describe the algebraic normal form of $s$-symmetric NCFs. We obtain the general formula of the cardinality of the set of $n$-variable $s$-symmetric Boolean NCFs for $s=1,\dots,n$. In particular, we enumerate the strongly asymmetric Boolean NCFs.

math.CO↗

arXiv2021

Unusual heat transport of the Kitaev material Na$_2$Co$_2$TeO$_6$: putative quantum spin liquid and low-energy spin excitations

We studied the field dependent thermal conductivity ($κ$) of Na$_2$Co$_2$TeO$_6$, a compound considered as the manifestation of the Kitaev model based on the high-spin $d^7$ Co$^{2+}$ ions. We found that in-plane magnetic fields beyond a critical value $B_c \approx$~10 T are able to drastically enhance $κ$ at low temperatures, resulting in a double-peak structure of $κ(T)$ that closely resembles the behavior of $α$-RuCl$_3$. This result suggests that heat transport in Na$_2$Co$_2$TeO$_6$ is primarily phononic, and it is strongly affected by scattering from magnetic excitations that are highly tunable by external fields. Interestingly, for magnetic fields $B // a$ (i.e., along the zigzag direction of the Co-Co bonds), there is an extended field range which separates the long-range magnetic order for $B\leq B_c\approx10$ T and the partially spin-polarized gapped high-field phase for $B\gtrsim 12$ T. The low-energy phonon scattering is particularly strong in this field range, consistent with the notion that the system becomes a quantum spin liquid with prominent spin fluctuations down to energies of no more than 2 meV.

cond-mat.str-el↗

arXiv2021

Measuring Turbulence with Young Stars in the Orion Complex

Stars form in molecular clouds in the interstellar medium (ISM) with a turbulent kinematic state. Newborn stars therefore should retain the turbulent kinematics of their natal clouds. Gaia DR2 and APOGEE-2 surveys in combination provide three-dimensional (3D) positions and 3D velocities of young stars in the Orion Molecular Cloud Complex. Using the full 6D measurements, we compute the velocity structure functions (VSFs) of the stars in six different groups within the Orion Complex. We find that the motions of stars in all diffuse groups exhibit strong characteristics of turbulence. Their first-order VSFs have a power-law exponent ranging from $\sim0.2-0.5$ on scales of a few to a few tens of pc, generally consistent with Larson's relation. On the other hand, dense star clusters, such as the Orion Nebula Cluster (ONC), have experienced rapid dynamical relaxation, and have lost the memory of the initial turbulent kinematics. The VSFs of several individual groups and the whole Complex all show features supporting local energy injection from supernovae. The measured strength of turbulence depends on the location relative to the supernova epicenters and the formation history of the groups. Our detection of turbulence traced by young stars introduces a new method of probing the turbulent kinematics of the ISM. Unlike previous gas-based studies with only projected measurements accessible to observations, we utilize the full 6D information of stars, presenting a more complete picture of the 3D interstellar turbulence.

astro-ph.GA↗

arXiv2021

Extremal solution and Liouville theorem for anisotropic elliptic equations

We study the quasilinear Dirichlet boundary problem \begin{equation}\nonumber \left\{ \begin{aligned} -Qu&=λe^{u} \quad \mbox{in}\quadΩ\\ u&=0 \quad \mbox{on}\quad\partialΩ,\\ \end{aligned} \right. \end{equation} where $λ>0$ is a parameter, $Ω\subset\mathbb{R}^{N}$ with $N\geq2$ be a bounded domain, and the operator $Q$, known as Finsler-Laplacian or anisotropic Laplacian, is defined by $$Qu:=\sum_{i=1}^{N}\frac{\partial}{\partial x_{i}}(F(\nabla u)F_{ξ_{i}}(\nabla u)). $$ Here, $F_{ξ_{i}}=\frac{\partial F}{\partialξ_{i}}$ and $F: \mathbb{R}^{N}\rightarrow[0,+\infty)$ is a convex function of $ C^{2}(\mathbb{R}^{N}\setminus\{0\})$, that satisfies certain assumptions. We derive the existence of extremal solution and obtain that it's regular, if $N\leq9$. We also concern the Hénon type anisotropic Liouville equation, namely, $$-Qu=(F^{0}(x))^αe^{u}\quad\mbox{in}\quad\mathbb{R}^{N}$$ where $α>-2$, $N\geq2$ and $F^{0}$ is the support function of $K:=\{x\in\mathbb{R}^{N}:F(x)<1\}$ which is defined by $$F^{0}(x):=\sup_{ξ\in K}\langle x,ξ\rangle.$$ We obtain the Liouville theorem for stable solutions and the finite Morse index solutions for $2\leq N<10+4α$ and $3\leq N<10+4α^{-}$ respectively, where $α^{-}=\min\{α,0\}$.

math.AP↗

arXiv2020

On Dominance-Free Samples of a (Colored) Stochastic Dataset

A point $p \in \mathbb{R}^d$ is said to dominate another point $q \in \mathbb{R}^d$ if the coordinate of $p$ is greater than or equal to the coordinate of $q$ in every dimension. A set of points in $\mathbb{R}^d$ is dominance-free if any two points do not dominate each other. We consider the problem of counting the dominance-free subsets of a given dataset in $\mathbb{R}^d$, or more generally, computing the probability that a random sample of a stochastic dataset in $\mathbb{R}^d$ where each point is sampled independently with its existence probability is dominance-free. In fact, we investigate a colored generalization of the problem, in which the points in the given stochastic dataset are colored and we are interested in the random samples that are inter-color dominance-free (i.e., any two points with different colors do not dominate each other). We propose the first algorithm that solves the problem for $d=2$ in near-quadratic time. On the other hand, we show that the problem is #P-hard for any $d \geq 3$, even if the points have a restricted color pattern; this implies the #P-hardness of the uncolored version (i.e., computing the dominance-free probability of a uncolored stochastic dataset) for $d \geq 3$. In addition, we show that even when the existence probabilities of the points are all equal to 0.5, the problem remains #P-hard for any $d \geq 7$; this implies the #P-hardness of counting dominance-free subsets for $d \geq 7$. In order to prove our hardness results, we establish some results about embedding the vertices a graph into low-dimensional Euclidean space such that two vertices are connected by an edge in the graph iff they form a dominance pair in the embedding. These results may be of independent interest and can possibly be applied to other problems.

cs.CG↗

arXiv2020

FNA++: Fast Network Adaptation via Parameter Remapping and Architecture Search

Deep neural networks achieve remarkable performance in many computer vision tasks. Most state-of-the-art (SOTA) semantic segmentation and object detection approaches reuse neural network architectures designed for image classification as the backbone, commonly pre-trained on ImageNet. However, performance gains can be achieved by designing network architectures specifically for detection and segmentation, as shown by recent neural architecture search (NAS) research for detection and segmentation. One major challenge though is that ImageNet pre-training of the search space representation (a.k.a. super network) or the searched networks incurs huge computational cost. In this paper, we propose a Fast Network Adaptation (FNA++) method, which can adapt both the architecture and parameters of a seed network (e.g. an ImageNet pre-trained network) to become a network with different depths, widths, or kernel sizes via a parameter remapping technique, making it possible to use NAS for segmentation and detection tasks a lot more efficiently. In our experiments, we apply FNA++ on MobileNetV2 to obtain new networks for semantic segmentation, object detection, and human pose estimation that clearly outperform existing networks designed both manually and by NAS. We also implement FNA++ on ResNets and NAS networks, which demonstrates a great generalization ability. The total computation cost of FNA++ is significantly less than SOTA segmentation and detection NAS approaches: 1737x less than DPC, 6.8x less than Auto-DeepLab, and 8.0x less than DetNAS. A series of ablation studies are performed to demonstrate the effectiveness, and detailed analysis is provided for more insights into the working mechanism. Codes are available at https://github.com/JaminFong/FNA.

cs.CV↗

arXiv2020

Spin-orbit phase behaviors of Na2Co2TeO6 at low temperatures

We present a comprehensive study of single crystals of Na2Co2TeO6, a putative Kitaev honeycomb magnet, focusing on its low-temperature phase behaviors. A new thermal phase transition is identified at 31.0 K, below which the system develops a two-dimensional (2D) long-range magnetic order. This order precedes the well-known 3D order below 26.7 K, and is likely driven by strongly anisotropic interactions. Surprisingly, excitations from the 3D order do not support the order's commonly accepted "zigzag" nature, and are instead consistent with a "triple-q" description. The 3D order exerts a fundamental feedback on high-energy excitations that likely involve orbital degrees of freedom, and it remains highly frustrated until a much lower temperature is reached. These findings render Na2Co2TeO6 a spin-orbit entangled frustrated magnet that hosts very rich physics.

cond-mat.str-el↗

arXiv2020

Role of anion in the pairing interaction of iron-based superconductivity

High-temperature iron-based superconductivity develops in a structure with unusual lattice-orbital geometry, based on a planar layer of Fe atoms with 3d orbitals and tetrahedrally coordinated by anions. Here we elucidate the electronic role of anions in the iron-based superconductors utilizing state-of-the-art scanning tunneling microscopy. By measuring the local electronic structure, we find that As anion in Ba0.4K0.6Fe2As2 has a striking impact on the electron pairing. The superconducting electronic feature can be switched off/on by removing/restoring As atoms on Fe layer at the atomic scale. Our analysis shows that this remarkable atomic switch effect is related to the geometrical cooperation between anion mediated hopping and unconventional pairing interaction. Our results uncover that the local Fe-anion coupling is fundamental for the pairing interaction of iron-based superconductivity, and promise the potential of bottom-up engineering of electron pairing.

cond-mat.supr-con↗

arXiv2020

Paramagnons and high-temperature superconductivity in mercury-based cuprates

We present a comparative study of magnetic excitations in the first two Ruddlesden-Popper members of the Hg-family of high-temperature superconducting cuprates, which are chemically nearly identical and have the highest critical temperature ($T_\mathrm{c}$) among all cuprate families. Our inelastic photon scattering experiments reveal that the two compounds' paramagnon spectra are nearly identical apart from an energy scale factor of $\sim130\%$ that matches the ratio of $T_\mathrm{c}$'s, as expected in magnetic Cooper pairing theories. By relating our observations to other cuprates, we infer that the strength of magnetic interactions determines how high $T_\mathrm{c}$ can reach. Our finding can be viewed as a magnetic analogue of the isotope effect, thus firmly supporting models of magnetically mediated high-temperature superconductivity.

cond-mat.supr-con↗

arXiv2020

Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space

When trained effectively, the Variational Autoencoder (VAE) can be both a powerful generative model and an effective representation learning framework for natural language. In this paper, we propose the first large-scale language VAE model, Optimus. A universal latent embedding space for sentences is first pre-trained on large text corpus, and then fine-tuned for various language generation and understanding tasks. Compared with GPT-2, Optimus enables guided language generation from an abstract level using the latent vectors. Compared with BERT, Optimus can generalize better on low-resource language understanding tasks due to the smooth latent space structure. Extensive experimental results on a wide range of language tasks demonstrate the effectiveness of Optimus. It achieves new state-of-the-art on VAE language modeling benchmarks. We hope that our first pre-trained big VAE language model itself and results can help the NLP community renew the interests of deep generative models in the era of large-scale pre-training, and make these principled methods more practical.

cs.CL↗

arXiv2020

Cloning of Quantum Entanglement

Quantum no-cloning, the impossibility of perfectly cloning an arbitrary unknown quantum state, is one of the most fundamental limitations due to the laws of quantum mechanics, which underpin the physical security of quantum key distribution. Quantum physics does allow, however, approximate cloning with either imperfect state fidelity and/or probabilistic success. Whereas approximate quantum cloning of single-particle states has been tested previously, experimental cloning of quantum entanglement -- a highly non-classical correlation -- remained unexplored. Based on a multiphoton linear optics platform, we demonstrate quantum cloning of two photon entangled states for the first time. Remarkably our results show that one maximally entangled photon pair can be broadcast into two entangled pairs, both with state fidelities above 50\%. Our results are a key step towards cloning of complex quantum systems, and are likely to provide new insights into quantum entanglement.

quant-ph↗