arXiv subjects

Xiao Li

Publications and source records attributed to Xiao Li.

At least 469 records · Page 26Linked to original sources

arXiv2018

Optimal Hierarchical Learning Path Design with Reinforcement Learning

E-learning systems are capable of providing more adaptive and efficient learning experiences for students than the traditional classroom setting. A key component of such systems is the learning strategy, the algorithm that designs the learning paths for students based on information such as the students' current progresses, their skills, learning materials, and etc. In this paper, we address the problem of finding the optimal learning strategy for an E-learning system. To this end, we first develop a model for students' hierarchical skills in the E-learning system. Based on the hierarchical skill model and the classical cognitive diagnosis model, we further develop a framework to model various proficiency levels of hierarchical skills. The optimal learning strategy on top of the hierarchical structure is found by applying a model-free reinforcement learning method, which does not require information on students' learning transition process. The effectiveness of the proposed framework is demonstrated via numerical experiments.

cs.LG↗

arXiv2018

Automata Guided Reinforcement Learning With Demonstrations

Tasks with complex temporal structures and long horizons pose a challenge for reinforcement learning agents due to the difficulty in specifying the tasks in terms of reward functions as well as large variances in the learning signals. We propose to address these problems by combining temporal logic (TL) with reinforcement learning from demonstrations. Our method automatically generates intrinsic rewards that align with the overall task goal given a TL task specification. The policy resulting from our framework has an interpretable and hierarchical structure. We validate the proposed method experimentally on a set of robotic manipulation tasks.

cs.AI↗

arXiv2018

Mobility edge and intermediate phase in one-dimensional incommensurate lattice potentials

We study theoretically the localization properties of two distinct one-dimensional quasiperiodic lattice models with a single-particle mobility edge (SPME) separating extended and localized states in the energy spectrum. The first one is the familiar Soukoulis-Economou trichromatic potential model with two incommensurate potentials, and the second is a system consisting of two coupled 1D Aubry-Andre chains each containing one incommensurate potential. We show that as a function of the Hamiltonian model parameters, both models have a wide single-particle intermediate phase (SPIP), defined as the regime where localized and extended single-particle states coexist in the spectrum, leading to a behavior intermediate between purely extended or purely localized when the system is dynamically quenched from a generic initial state. Our results thus suggest that both systems could serve as interesting experimental platforms for studying the interplay between localized and extended states, and may provide insight into the role of the coupling of small baths to localized systems. We also calculate the Lyapunov (or localization) exponent for several incommensurate 1D models exhibiting SPME, finding that such localization critical exponents for quasiperiodic potential induced localization are nonuniversal and depend on the microscopic details of the Hamiltonian.

cond-mat.dis-nn↗

arXiv2018

Reversing the asymmetry in data exfiltration

Preventing data exfiltration from computer systems typically depends on perimeter defences, but these are becoming increasingly fragile. Instead we suggest an approach in which each at-risk document is supplemented by many fake versions of itself. An attacker must either exfiltrate all of them; or try to discover which is the real one while operating within the penetrated system, and both are difficult. Creating and maintaining many fakes is relatively inexpensive, so the advantage that typically accrues to an attacker now lies with the defender. We show that algorithmically generated fake documents are reasonably difficult to detect using algorithmic analytics.

cs.CR↗

arXiv2018

Modeling Surface Appearance from a Single Photograph using Self-augmented Convolutional Neural Networks

We present a convolutional neural network (CNN) based solution for modeling physically plausible spatially varying surface reflectance functions (SVBRDF) from a single photograph of a planar material sample under unknown natural illumination. Gathering a sufficiently large set of labeled training pairs consisting of photographs of SVBRDF samples and corresponding reflectance parameters, is a difficult and arduous process. To reduce the amount of required labeled training data, we propose to leverage the appearance information embedded in unlabeled images of spatially varying materials to self-augment the training process. Starting from an initial approximative network obtained from a small set of labeled training pairs, we estimate provisional model parameters for each unlabeled training exemplar. Given this provisional reflectance estimate, we then synthesize a novel temporary labeled training pair by rendering the exact corresponding image under a new lighting condition. After refining the network using these additional training samples, we re-estimate the provisional model parameters for the unlabeled data and repeat the self-augmentation process until convergence. We demonstrate the efficacy of the proposed network structure on spatially varying wood, metals, and plastics, as well as thoroughly validate the effectiveness of the self-augmentation training process.

cs.GR↗

arXiv2018

Experimental evidence of giant chiral magnetic effect in type-II Weyl semimetal WP$_{2+δ}$ crystals

Chiral magnetic effect is a quantum phenomenon that is breaking of chiral symmetry of relativistic Weyl fermions by quantum fluctuation under paralleled electric field E and magnetic field B. Intuitively, Weyl fermions with different chirality, under stimulus of paralleled E and B, will have different chemical potential that gives rise to an extra current, whose role likes a chiral battery in solids. However, up to now, the experimental evidence for chiral magnetic effect is the negative longitudinal magnetoresistance rather than a chiral electric source. Here, totally different from previous reports, we observed the giant chiral magnetic effect evidenced by: 'negative' resistivity and corresponding voltage-current curves lying the second-fourth quadrant in type-II Weyl semimetal WP$_{2+δ}$ under following conditions: the misaligned angle between E and B is smaller than 20$^\circ$, temperature <30 K and externally applied E<50 mA. Phenomenologically, based on macroscopic Chern-Simon-Maxwell equation, the giant chiral magnetic effect observed in WP$_{2+δ}$ is attributed to two-order higher coherent time of chiral Weyl-fermion quantum state over Drude transport relaxation-time. This work demonstrates the giant chiral-magnetic/chiral-battery effect in Weyl semimetals.

cond-mat.mtrl-sci↗

arXiv2018

Automata-Guided Hierarchical Reinforcement Learning for Skill Composition

Skills learned through (deep) reinforcement learning often generalizes poorly across domains and re-training is necessary when presented with a new task. We present a framework that combines techniques in \textit{formal methods} with \textit{reinforcement learning} (RL). The methods we provide allows for convenient specification of tasks with logical expressions, learns hierarchical policies (meta-controller and low-level controllers) with well-defined intrinsic rewards, and construct new skills from existing ones with little to no additional exploration. We evaluate the proposed methods in a simple grid world simulation as well as a more complicated kitchen environment in AI2Thor

cs.AI↗

arXiv2018

Geometric Dynamics of Magnetization: Electronic Contribution

To give a general description of the influences of electric fields or currents on magnetization dynamics, we developed a semiclassical theory for the magnetization implicitly coupled to electronic degrees of freedom. In the absence of electric fields the Bloch electron Hamiltonian changes the Berry curvature, the effective magnetic field, and the damping in the dynamical equation of the magnetization, which we classify into intrinsic and extrinsic effects. Static electric fields modify these as first-order perturbations, using which we were able to give a physically clear interpretation of the current-induced spin-orbit torques. We used a toy model mimicking a ferromagnet-topological-insulator interface to illustrate the various effects, and predicted an anisotropic gyromagnetic ratio and the dynamical stability for an in-plane magnetization. Our formalism can also be applied to the slow dynamics of other order parameters in crystalline solids.

cond-mat.mes-hall↗

arXiv2018

Sub-linear Time Support Recovery for Compressed Sensing using Sparse-Graph Codes

We study the support recovery problem for compressed sensing, where the goal is to reconstruct the a high-dimensional $K$-sparse signal $\mathbf{x}\in\mathbb{R}^N$, from low-dimensional linear measurements with and without noise. Our key contribution is a new compressed sensing framework through a new family of carefully designed sparse measurement matrices associated with minimal measurement costs and a low-complexity recovery algorithm. The measurement matrix in our framework is designed based on the well-crafted sparsification through capacity-approaching sparse-graph codes, where the sparse coefficients can be recovered efficiently in a few iterations by performing simple error decoding over the observations. We formally connect this general recovery problem with sparse-graph decoding in packet communication systems, and analyze our framework in terms of the measurement cost, time complexity and recovery performance. In the noiseless setting, our framework can recover any arbitrary $K$-sparse signal in $O(K)$ time using $2K$ measurements asymptotically with high probability. In the noisy setting, when the sparse coefficients take values in a finite and quantized alphabet, our framework can achieve the same goal in time $O(K\log(N/K))$ using $O(K\log(N/K))$ measurements obtained from measurement matrix with elements $\{-1,0,1\}$. When the sparsity $K$ is sub-linear in the signal dimension $K=O(N^δ)$ for some $0<δ<1$, our results are order-optimal in terms of measurement costs and run-time, both of which are sub-linear in the signal dimension $N$. The sub-linear measurement cost and run-time can also be achieved with continuous-valued sparse coefficients, with a slight increment in the logarithmic factors. This offers the desired scalability of our framework that can potentially enable real-time or near-real-time processing for massive datasets featuring sparsity.

cs.IT↗

arXiv2018

Optical trapping of anti-reflection coating-coated spheres

It was theoretically proposed and experimentally demonstrated that anti-reflection coating allows one to trap a high dielectric sphere, at the same time enhancing the transverse optical force. Here, by explicitly calculating the gradient force and the scattering force, we rigorously show that these were mainly consequences of the reduction in scattering force due to the suppression of backward scattering, and enhancement in gradient force due to the increased in overall particle size. The reduction of scattering force can be understood within a ray optics theory and also the Mie theory. The coating approach only works for a spherical particle trapped by an aplanatic beam, and it does not work in general.

physics.optics↗

arXiv2017

Topological Dirac states beyond $π$ orbitals for silicene on SiC(0001) surface

The discovery of intriguing properties related to the Dirac states in graphene has spurred huge interest in exploring its two-dimensional group-IV counterparts, such as silicene, germanene, and stanene. However, these materials have to be obtained via synthesizing on substrates with strong interfacial interactions, which usually destroy their intrinsic $π$($p_z$)-orbital Dirac states. Here we report a theoretical study on the existence of Dirac states arising from the $p_{x,y}$ orbitals instead of $p_z$ orbitals in silicene on 4H-SiC(0001), which survive in spite of the strong interfacial interactions. We also show that the exchange field together with the spin-orbital coupling give rise to a detectable band gap of 1.3 meV. Berry curvature calculations demonstrate the nontrivial topological nature of such Dirac states with a Chern number $C = 2$, presenting the potential of realizing quantum anomalous Hall effect for silicene on SiC(0001). Finally, we construct a minimal effective model to capture the low-energy physics of this system. This finding is expected to be also applicable to germanene and stanene, and imply great application potentials in nanoelectronics.

cond-mat.mes-hall↗

arXiv2017

A Policy Search Method For Temporal Logic Specified Reinforcement Learning Tasks

Reward engineering is an important aspect of reinforcement learning. Whether or not the user's intentions can be correctly encapsulated in the reward function can significantly impact the learning outcome. Current methods rely on manually crafted reward functions that often require parameter tuning to obtain the desired behavior. This operation can be expensive when exploration requires systems to interact with the physical world. In this paper, we explore the use of temporal logic (TL) to specify tasks in reinforcement learning. TL formula can be translated to a real-valued function that measures its level of satisfaction against a trajectory. We take advantage of this function and propose temporal logic policy search (TLPS), a model-free learning technique that finds a policy that satisfies the TL specification. A set of simulated experiments are conducted to evaluate the proposed approach.

cs.AI↗

arXiv2017

Exploring the Single-Particle Mobility Edge in a One-Dimensional Quasiperiodic Optical Lattice

A single-particle mobility edge (SPME) marks a critical energy separating extended from localized states in a quantum system. In one-dimensional systems with uncorrelated disorder, a SPME cannot exist, since all single-particle states localize for arbitrarily weak disorder strengths. However, if correlations are present in the disorder potential, the localization transition can occur at a finite disorder strength and SPMEs become possible. In this work, we find experimental evidence for the existence of such a SPME in a one-dimensional quasi-periodic optical lattice. Specifically, we find a regime where extended and localized single-particle states coexist, in good agreement with theoretical simulations, which predict a SPME in this regime.

cond-mat.quant-gas↗

arXiv2017

Mobility Edges in 1D Bichromatic Incommensurate Potentials

We theoretically study a one-dimensional (1D) mutually incommensurate bichromatic lattice system which has been implemented in ultracold atoms to study quantum localization. It has been universally believed that the tight-binding version of this bichromatic incommensurate system is represented by the well-known Aubry-Andre model. Here we establish that this belief is incorrect and that the Aubry-Andre model description, which applies only in the extreme tight-binding limit of very deep primary lattice potential, generically breaks down near the localization transition due to the unavoidable appearance of single-particle mobility edges (SPME). In fact, we show that the 1D bichromatic incommensurate potential system manifests generic mobility edges which disappear in the tight-binding limit, leading to the well-studied Aubry-Andre physics. We carry out an extensive study of the localization properties of the 1D incommensurate optical lattice without making any tight-binding approximation. We find that, for the full lattice system, an intermediate phase between completely localized and completely delocalized regions appears due to the existence of the SPME, making the system qualitatively distinct from the Aubry-Andre prediction. Using the Wegner flow approach, we show that the SPME in the real lattice system can be attributed to significant corrections of higher-order harmonics in the lattice potential which are absent in the strict tight-binding limit. We calculate the dynamical consequences of the intermediate phase in detail to guide future experimental investigations for the observation of 1D SPME and the associated intermediate phase. We consider effects of interaction numerically, and conjecture the stability of SPME to weak interaction effects, thus leading to the exciting possibility of an experimentally viable nonergodic extended phase in interacting 1D optical lattices.

cond-mat.dis-nn↗

arXiv2017

Electric control of the edge magnetization in zigzag stanene nanoribbon

There has been tremendous interest in manipulating electron and hole-spin states in low-dimensional structures for electronic and spintronic applications. We study the edge magnetic coupling and anisotropy in zigzag stanene nanoribbons, by first-principles calculations. Taking into account considerable spin-orbit coupling and ferromagnetism at each edge, zigzag stanene nanoribbon is insulating and its band gap depends on the inter-edge magnetic coupling and the magnetization direction. Especially for nanoribbon edges with out-of-plane antiferromagnetic coupling, two non-degenerate valleys of edge states emerge and the spin degeneracy is tunable by a transverse electric field, which give full play to spin and valley degrees of freedom. More importantly, both the magnetic order and anisotropy can be selectively controlled by electron and hole doping, demonstrating a readily accessible gate-induced modulation of magnetism. These intriguing features offer a practical avenue for designing energy-efficient devices based on multiple degrees of freedom of electron and magneto-electric couplings.

cond-mat.mtrl-sci↗

arXiv2017

RoboCup 2D Soccer Simulation League: Evaluation Challenges

We summarise the results of RoboCup 2D Soccer Simulation League in 2016 (Leipzig), including the main competition and the evaluation round. The evaluation round held in Leipzig confirmed the strength of RoboCup-2015 champion (WrightEagle, i.e. WE2015) in the League, with only eventual finalists of 2016 competition capable of defeating WE2015. An extended, post-Leipzig, round-robin tournament which included the top 8 teams of 2016, as well as WE2015, with over 1000 games played for each pair, placed WE2015 third behind the champion team (Gliders2016) and the runner-up (HELIOS2016). This establishes WE2015 as a stable benchmark for the 2D Simulation League. We then contrast two ranking methods and suggest two options for future evaluation challenges. The first one, "The Champions Simulation League", is proposed to include 6 previous champions, directly competing against each other in a round-robin tournament, with the view to systematically trace the advancements in the League. The second proposal, "The Global Challenge", is aimed to increase the realism of the environmental conditions during the simulated games, by simulating specific features of different participating countries.

cs.MA↗

arXiv2017

How AD Can Help Solve Differential-Algebraic Equations

A characteristic feature of differential-algebraic equations is that one needs to find derivatives of some of their equations with respect to time, as part of so called index reduction or regularisation, to prepare them for numerical solution. This is often done with the help of a computer algebra system. We show in two significant cases that it can be done efficiently by pure algorithmic differentiation. The first is the Dummy Derivatives method, here we give a mainly theoretical description, with tutorial examples. The second is the solution of a mechanical system directly from its Lagrangian formulation. Here we outline the theory and show several non-trivial examples of using the "Lagrangian facility" of the Nedialkov-Pryce initial-value solver DAETS, namely: a spring-mass-multipendulum system, a prescribed-trajectory control problem, and long-time integration of a model of the outer planets of the solar system, taken from the DETEST testing package for ODE solvers.

math.NA↗

arXiv2017

Reinforcement Learning With Temporal Logic Rewards

Reinforcement learning (RL) depends critically on the choice of reward functions used to capture the de- sired behavior and constraints of a robot. Usually, these are handcrafted by a expert designer and represent heuristics for relatively simple tasks. Real world applications typically involve more complex tasks with rich temporal and logical structure. In this paper we take advantage of the expressive power of temporal logic (TL) to specify complex rules the robot should follow, and incorporate domain knowledge into learning. We propose Truncated Linear Temporal Logic (TLTL) as specifications language, that is arguably well suited for the robotics applications, together with quantitative semantics, i.e., robustness degree. We propose a RL approach to learn tasks expressed as TLTL formulae that uses their associated robustness degree as reward functions, instead of the manually crafted heuristics trying to capture the same specifications. We show in simulated trials that learning is faster and policies obtained using the proposed approach outperform the ones learned using heuristic rewards in terms of the robustness degree, i.e., how well the tasks are satisfied. Furthermore, we demonstrate the proposed RL approach in a toast-placing task learned by a Baxter robot.

cs.AI↗