arXiv subjects

Yu Liu

Publications and source records attributed to Yu Liu.

At least 829 records · Page 46Linked to original sources

arXiv2022

Meta Knowledge Distillation

Recent studies pointed out that knowledge distillation (KD) suffers from two degradation problems, the teacher-student gap and the incompatibility with strong data augmentations, making it not applicable to training state-of-the-art models, which are trained with advanced augmentations. However, we observe that a key factor, i.e., the temperatures in the softmax functions for generating probabilities of both the teacher and student models, was mostly overlooked in previous methods. With properly tuned temperatures, such degradation problems of KD can be much mitigated. However, instead of relying on a naive grid search, which shows poor transferability, we propose Meta Knowledge Distillation (MKD) to meta-learn the distillation with learnable meta temperature parameters. The meta parameters are adaptively adjusted during training according to the gradients of the learning objective. We validate that MKD is robust to different dataset scales, different teacher/student architectures, and different types of data augmentation. With MKD, we achieve the best performance with popular ViT architectures among compared methods that use only ImageNet-1K as training data, ranging from tiny to large models. With ViT-L, we achieve 86.5% with 600 epochs of training, 0.6% better than MAE that trains for 1,650 epochs.

cs.LG↗

arXiv2022

UniFormer: Unified Transformer for Efficient Spatiotemporal Representation Learning

It is a challenging task to learn rich and multi-scale spatiotemporal semantics from high-dimensional videos, due to large local redundancy and complex global dependency between video frames. The recent advances in this research have been mainly driven by 3D convolutional neural networks and vision transformers. Although 3D convolution can efficiently aggregate local context to suppress local redundancy from a small 3D neighborhood, it lacks the capability to capture global dependency because of the limited receptive field. Alternatively, vision transformers can effectively capture long-range dependency by self-attention mechanism, while having the limitation on reducing local redundancy with blind similarity comparison among all the tokens in each layer. Based on these observations, we propose a novel Unified transFormer (UniFormer) which seamlessly integrates merits of 3D convolution and spatiotemporal self-attention in a concise transformer format, and achieves a preferable balance between computation and accuracy. Different from traditional transformers, our relation aggregator can tackle both spatiotemporal redundancy and dependency, by learning local and global token affinity respectively in shallow and deep layers. We conduct extensive experiments on the popular video benchmarks, e.g., Kinetics-400, Kinetics-600, and Something-Something V1&V2. With only ImageNet-1K pretraining, our UniFormer achieves 82.9%/84.8% top-1 accuracy on Kinetics-400/Kinetics-600, while requiring 10x fewer GFLOPs than other state-of-the-art methods. For Something-Something V1 and V2, our UniFormer achieves new state-of-the-art performances of 60.9% and 71.2% top-1 accuracy respectively. Code is available at https://github.com/Sense-X/UniFormer.

cs.CV↗

arXiv2022

Topological Defects Induced High-Spin Quartet State in Truxene-Based Molecular Graphenoids

Topological defects in graphene materials introduce exotic properties which are absent in their defect-free counterparts with both fundamental importance and technological implications. Although individual topological defects have been widely studied, collective magnetic behaviors originating from well-organized multiple topological defects remain a great challenge. Here, we studied the collective magnetic properties originating from three pentagon topological defects in truxene-based molecular graphenoids by using scanning tunneling microscopy and non-contact atomic force microscopy. Unpaired $π$ electrons are introduced into the aromatic topology of truxene molecular graphenoids one by one by dissociating hydrogen atoms at the pentagon defects via atom manipulation. Scanning tunneling spectroscopy measurements together with density functional theory calculations suggest that the unpaired electrons are ferromagnetically coupled, forming a collective high-spin quartet state of S=3/2. Our work demonstrates that the collective spin ordering can be realized through engineering regular patterned topological defects in molecular graphenoids, providing a new platform for designer one-dimensional ferromagnetic spin chains and two-dimensional ferromagnetic networks.

cond-mat.mes-hall↗

arXiv2022

Ancient and recent collisions revealed by phosphate minerals in the Chelyabinsk meteorite

The collision history of asteroids is an important archive of inner Solar System evolution. Evidence for these collisions is brought to Earth by meteorites, which can preserve impact-reset radioisotope mineral ages. However, as meteorites often preserve numerous mineral ages, their interpretation is controversial. Here, we combine analysis of phosphate U-Pb ages and mineral microtextures to construct a collision history for the highly shocked Chelyabinsk meteorite. We show that phosphate U-Pb ages in the meteorite are independent of thermal history at macro-to-microscales, correlating instead with phosphate microtexture. Isotopic data from pristine phosphate domains is largely concordant, whereas fracture-damaged domains universally display discordance. Combining both populations best constrains upper (4,473 +/- 11 Ma) and lower intercept (-9 +/- 55 Ma, i.e., within error of the present day) U-Pb ages for Chelyabinsk phosphates. We conclude that all phosphate U-Pb ages were completely reset during an ancient high energy collision. Fracture-damaged phosphate domains experienced further Pb-loss during mild collisional heating in the geologically recent past, and must be targeted to properly constrain a lower intercept age. Targeting textural sub-populations of phosphate grains can significantly improve the calculation and interpretation of U-Pb ages, permitting more robust reconstruction of both ancient and recent asteroidal collision histories.

astro-ph.EP↗

arXiv2022

Two-dimensional charge order stabilized in clean polytype heterostructures

Compelling evidence suggests distinct correlated electron behavior may exist only in clean 2D materials such as 1T-TaS2. Unfortunately, experiment and theory suggest that extrinsic disorder in free standing 2D layers disrupts correlation-driven quantum behavior. Here we demonstrate a route to realizing fragile 2D quantum states through endotaxial polytype engineering of van der Waals materials. The true isolation of 2D charge density waves (CDWs) between metallic layers stabilizes commensurate long-range order and lifts the coupling between neighboring CDW layers to restore mirror symmetries via interlayer CDW twinning. The twinned-commensurate charge density wave (tC-CDW) reported herein has a single metal--insulator phase transition at ~350 K as measured structurally and electronically. Fast in-situ transmission electron microscopy and scanned nanobeam diffraction map the formation of tC-CDWs. This work introduces endotaxial polytype engineering of van der Waals materials to access latent 2D ground states distinct from conventional 2D fabrication.

cond-mat.mtrl-sci↗

arXiv2022

Ferroelectric superdomain controlled graphene plasmon for tunable mid-infrared photodetector with dual-band spectral selectivity

Dual-band infrared photodetectors (DBIPs) can discriminate desired signals from complex scenes and thus are highly expected for threat-warning, remote sensing, and astronomy applications. Conventional DBIPs with high-performances are, however, typically based on semiconductor thin films, but remain the challenges of complex spatial align, expensive growth and cooling requirement. Here, we report a tunable graphene plasmonic photodetector with dual-band infrared spectral selectivity driven by ferroelectric superdomain. The periodic ferroelectric polarization array with nanoscale ring shapes provides ultrahigh electrostatic field for spatially doping of monolayer graphene to desired patterns, and is further used to excite and confine intrinsic graphene plasmons. Our devices exhibit tunable resonance photoresponse in both two bands of 3.7-16.3 um and 15.1-52.1 um. The numerical calculations show that our devices own ultrahigh responsivities of 667-1080 A W-1 at room temperature in range of 5-50 um. Our devices make possible the applications of infrared imaging system and both stationary and motion state of objects detection. These investigations provide a novel approach for advanced infrared system construction by employing simple, low-cost, uncooling multispectral detectors array.

physics.optics↗

arXiv2021

The $f$-Divergence Reinforcement Learning Framework

The framework of deep reinforcement learning (DRL) provides a powerful and widely applicable mathematical formalization for sequential decision-making. This paper present a novel DRL framework, termed \emph{$f$-Divergence Reinforcement Learning (FRL)}. In FRL, the policy evaluation and policy improvement phases are simultaneously performed by minimizing the $f$-divergence between the learning policy and sampling policy, which is distinct from conventional DRL algorithms that aim to maximize the expected cumulative rewards. We theoretically prove that minimizing such $f$-divergence can make the learning policy converge to the optimal policy. Besides, we convert the process of training agents in FRL framework to a saddle-point optimization problem with a specific $f$ function through Fenchel conjugate, which forms new methods for policy evaluation and policy improvement. Through mathematical proofs and empirical evaluation, we demonstrate that the FRL framework has two advantages: (1) policy evaluation and policy improvement processes are performed simultaneously and (2) the issues of overestimating value function are naturally alleviated. To evaluate the effectiveness of the FRL framework, we conduct experiments on Atari 2600 video games and show that agents trained in the FRL framework match or surpass the baseline DRL algorithms.

cs.LG↗

arXiv2021

Overcome Anterograde Forgetting with Cycled Memory Networks

Learning from a sequence of tasks for a lifetime is essential for an agent towards artificial general intelligence. This requires the agent to continuously learn and memorize new knowledge without interference. This paper first demonstrates a fundamental issue of lifelong learning using neural networks, named anterograde forgetting, i.e., preserving and transferring memory may inhibit the learning of new knowledge. This is attributed to the fact that the learning capacity of a neural network will be reduced as it keeps memorizing historical knowledge, and the fact that conceptual confusion may occur as it transfers irrelevant old knowledge to the current task. This work proposes a general framework named Cycled Memory Networks (CMN) to address the anterograde forgetting in neural networks for lifelong learning. The CMN consists of two individual memory networks to store short-term and long-term memories to avoid capacity shrinkage. A transfer cell is designed to connect these two memory networks, enabling knowledge transfer from the long-term memory network to the short-term memory network to mitigate the conceptual confusion, and a memory consolidation mechanism is developed to integrate short-term knowledge into the long-term memory network for knowledge accumulation. Experimental results demonstrate that the CMN can effectively address the anterograde forgetting on several task-related, task-conflict, class-incremental and cross-domain benchmarks.

cs.LG↗

arXiv2021

Optimization of RIS Configurations for Multiple-RIS-Aided mmWave Positioning Systems based on CRLB Analysis

Reconfigurable intelligent surface (RIS) is a promising technology for future millimeter-wave (mmWave) communication systems. However, its potential benefits of adopting RIS for high-precision positioning in mmWave systems are still less understood. In this paper, we study a multiple-RIS-aided mmWave positioning system and derive the Cram$\rm{\acute{e}}$r-Rao error bound. Based on the derived bound, we optimize the phase shift of the RISs by the particle swarm optimization (PSO) algorithm. Numerical results have demonstrated the advantages of using multiple RISs in enhancing the positioning accuracy in mmWave systems.

eess.SP↗

arXiv2021

Arbitrary Virtual Try-On Network: Characteristics Preservation and Trade-off between Body and Clothing

Deep learning based virtual try-on system has achieved some encouraging progress recently, but there still remain several big challenges that need to be solved, such as trying on arbitrary clothes of all types, trying on the clothes from one category to another and generating image-realistic results with few artifacts. To handle this issue, we in this paper first collect a new dataset with all types of clothes, \ie tops, bottoms, and whole clothes, each one has multiple categories with rich information of clothing characteristics such as patterns, logos, and other details. Based on this dataset, we then propose the Arbitrary Virtual Try-On Network (AVTON) that is utilized for all-type clothes, which can synthesize realistic try-on images by preserving and trading off characteristics of the target clothes and the reference person. Our approach includes three modules: 1) Limbs Prediction Module, which is utilized for predicting the human body parts by preserving the characteristics of the reference person. This is especially good for handling cross-category try-on task (\eg long sleeves $\leftrightarrow$ short sleeves or long pants $\leftrightarrow$ skirts, \etc), where the exposed arms or legs with the skin colors and details can be reasonably predicted; 2) Improved Geometric Matching Module, which is designed to warp clothes according to the geometry of the target person. We improve the TPS based warping method with a compactly supported radial function (Wendland's $Ψ$-function); 3) Trade-Off Fusion Module, which is to trade off the characteristics of the warped clothes and the reference person. This module is to make the generated try-on images look more natural and realistic based on a fine-tune symmetry of the network structure. Extensive simulations are conducted and our approach can achieve better performance compared with the state-of-the-art virtual try-on methods.

cs.CV↗

arXiv2021

Reviewing continual learning from the perspective of human-level intelligence

Humans' continual learning (CL) ability is closely related to Stability Versus Plasticity Dilemma that describes how humans achieve ongoing learning capacity and preservation for learned information. The notion of CL has always been present in artificial intelligence (AI) since its births. This paper proposes a comprehensive review of CL. Different from previous reviews that mainly focus on the catastrophic forgetting phenomenon in CL, this paper surveys CL from a more macroscopic perspective based on the Stability Versus Plasticity mechanism. Analogous to biological counterpart, "smart" AI agents are supposed to i) remember previously learned information (information retrospection); ii) infer on new information continuously (information prospection:); iii) transfer useful information (information transfer), to achieve high-level CL. According to the taxonomy, evaluation metrics, algorithms, applications as well as some open issues are then introduced. Our main contributions concern i) rechecking CL from the level of artificial general intelligence; ii) providing a detailed and extensive overview on CL topics; iii) presenting some novel ideas on the potential development of CL.

cs.LG↗

arXiv2021

Learning by Active Forgetting for Neural Networks

Remembering and forgetting mechanisms are two sides of the same coin in a human learning-memory system. Inspired by human brain memory mechanisms, modern machine learning systems have been working to endow machine with lifelong learning capability through better remembering while pushing the forgetting as the antagonist to overcome. Nevertheless, this idea might only see the half picture. Up until very recently, increasing researchers argue that a brain is born to forget, i.e., forgetting is a natural and active process for abstract, rich, and flexible representations. This paper presents a learning model by active forgetting mechanism with artificial neural networks. The active forgetting mechanism (AFM) is introduced to a neural network via a "plug-and-play" forgetting layer (P\&PF), consisting of groups of inhibitory neurons with Internal Regulation Strategy (IRS) to adjust the extinction rate of themselves via lateral inhibition mechanism and External Regulation Strategy (ERS) to adjust the extinction rate of excitatory neurons via inhibition mechanism. Experimental studies have shown that the P\&PF offers surprising benefits: self-adaptive structure, strong generalization, long-term learning and memory, and robustness to data and parameter perturbation. This work sheds light on the importance of forgetting in the learning process and offers new perspectives to understand the underlying mechanisms of neural networks.

cs.LG↗

arXiv2021

Sharpness of phase transition for Voronoi percolation in hyperbolic space

In this paper, we consider Voronoi percolation in the hyperbolic space $\mathbb{H}^d$ ($d\ge 2$) and show that the phase transition is sharp. More precisely, we show that for Voronoi percolation with parameter $p$ generated by a homogeneous Poisson point process with intensity $λ$, there exists $p_c:=p_c(λ,d)$ such that the probability of a monochromatic path from the origin reaching a distance of $n$ decays exponentially fast in $n$. We also prove the mean-field lower bound $\mathbb{P}_{λ,p}(0\leftrightarrow \infty)\ge c(p-p_c)$ for $p>p_c$.

math.PR↗

arXiv2021

Spatio-Temporal Urban Knowledge Graph Enabled Mobility Prediction

With the rapid development of the mobile communication technology, mobile trajectories of humans are massively collected by Internet service providers (ISPs) and application service providers (ASPs). On the other hand, the rising paradigm of knowledge graph (KG) provides us a promising solution to extract structured "knowledge" from massive trajectory data. In this paper, we focus on modeling users' spatio-temporal mobility patterns based on knowledge graph techniques, and predicting users' future movement based on the "knowledge'' extracted from multiple sources in a cohesive manner. Specifically, we propose a new type of knowledge graph, i.e., spatio-temporal urban knowledge graph (STKG), where mobility trajectories, category information of venues, and temporal information are jointly modeled by the facts with different relation types in STKG. The mobility prediction problem is converted to the knowledge graph completion problem in STKG. Further, a complex embedding model with elaborately designed scoring functions is proposed to measure the plausibility of facts in STKG to solve the knowledge graph completion problem, which considers temporal dynamics of the mobility patterns and utilizes PoI categories as the auxiliary information and background knowledge. Extensive evaluations confirm the high accuracy of our model in predicting users' mobility, i.e., improving the accuracy by 5.04% compared with the state-of-the-art algorithms. In addition, PoI categories as the background knowledge and auxiliary information are confirmed to be helpful by improving the performance by 3.85% in terms of accuracy. Additionally, experiments show that our proposed method is time-efficient by reducing the computational time by over 43.12% compared with existing methods.

cs.SI↗

arXiv2021

A model for nuclear spin product-state distributions of ultracold chemical reactions in magnetic fields

Based on a theoretical model where the nuclear spins remain unchanged during a collision, we provide an analytical and general expression for the nuclear spin state-to-state distribution of an ultracold chemical reaction in a magnetic field, for given rotational transitions of the molecules. It simply requires knowledge of the field-dependent eigenfunctions of the molecular reactants and products of the chemical reaction. The final state-to-state distribution drastically changes with the magnetic field. When the distribution is summed over all the final products, a simplified expression is found where only the knowledge of the eigenfunctions of the molecular reactants is required. The present theoretical formalism has been successfully used to explain the magnetic field behavior of the product-state distribution in chemical reactions of ultracold KRb molecules [Hu et al., Nat. Chem. 13, 435 (2021)].

physics.atom-ph↗

arXiv2021

Knowledge-driven Site Selection via Urban Knowledge Graph

Site selection determines optimal locations for new stores, which is of crucial importance to business success. Especially, the wide application of artificial intelligence with multi-source urban data makes intelligent site selection promising. However, existing data-driven methods heavily rely on feature engineering, facing the issues of business generalization and complex relationship modeling. To get rid of the dilemma, in this work, we borrow ideas from knowledge graph (KG), and propose a knowledge-driven model for site selection, short for KnowSite. Specifically, motivated by distilled knowledge and rich semantics in KG, we firstly construct an urban KG (UrbanKG) with cities' key elements and semantic relationships captured. Based on UrbanKG, we employ pre-training techniques for semantic representations, which are fed into an encoder-decoder structure for site decisions. With multi-relational message passing and relation path-based attention mechanism developed, KnowSite successfully reveals the relationship between various businesses and site selection criteria. Extensive experiments on two datasets demonstrate that KnowSite outperforms representative baselines with both effectiveness and explainability achieved.

cs.AI↗

arXiv2021

A Novel Binocular Eye-Tracking SystemWith Stereo Stimuli for 3D Gaze Estimation

Eye-tracking technologies have been widely used in applications like psychological studies and human computer interactions (HCI). However, most current eye trackers focus on 2D point of gaze (PoG) estimation and cannot provide accurate gaze depth.Concerning future applications such as HCI with 3D displays, we propose a novel binocular eye tracking device with stereo stimuli to provide highly accurate 3D PoG estimation. In our device, the 3D stereo imaging system can provide users with a friendly and immersive 3D visual experience without wearing any accessories. The eye capturing system can directly record the users eye movements under 3D stimuli without disturbance. A regression based 3D eye tracking model is built based on collected eye movement data under stereo stimuli. Our model estimates users 2D gaze with features defined by eye region landmarks and further estimates 3D PoG with a multi source feature set constructed by comprehensive eye movement features and disparity features from stereo stimuli. Two test stereo scenes with different depths of field are designed to verify the model effectiveness. Experimental results show that the average error for 2D gaze estimation was 0.66\degree and for 3D PoG estimation, the average errors are 1.85~cm/0.15~m over the workspace volume 50~cm $\times$ 30~cm $\times$ 75~cm/2.4~m $\times$ 4.0~m $\times$ 7.9~m separately.

cs.CV↗

arXiv2021

Hyperbolic Geometry is Not Necessary: Lightweight Euclidean-Based Models for Low-Dimensional Knowledge Graph Embeddings

Recent knowledge graph embedding (KGE) models based on hyperbolic geometry have shown great potential in a low-dimensional embedding space. However, the necessity of hyperbolic space in KGE is still questionable, because the calculation based on hyperbolic geometry is much more complicated than Euclidean operations. In this paper, based on the state-of-the-art hyperbolic-based model RotH, we develop two lightweight Euclidean-based models, called RotL and Rot2L. The RotL model simplifies the hyperbolic operations while keeping the flexible normalization effect. Utilizing a novel two-layer stacked transformation and based on RotL, the Rot2L model obtains an improved representation capability, yet costs fewer parameters and calculations than RotH. The experiments on link prediction show that Rot2L achieves the state-of-the-art performance on two widely-used datasets in low-dimensional knowledge graph embeddings. Furthermore, RotL achieves similar performance as RotH but only requires half of the training time.

cs.AI↗