arXiv subjects

Jian Li

Publications and source records attributed to Jian Li.

At least 505 records · Page 28Linked to original sources

arXiv2021

Observation of ultra-slow shock waves in a tunable magnetic lattice

The combination of fast propagation speeds and highly localized nature has hindered the direct observation of the evolution of shock waves at the molecular scale. To address this limitation, an experimental system is designed by tuning a one-dimensional magnetic lattice to evolve benign wave forms into shock waves at observable spatial and temporal scales, thus serving as a 'magnifying glass' to illuminate shock processes. An accompanying analysis confirms that the formation of strong shocks is fully captured. The exhibited lack of a steady state induced by indefinite expansion of a disordered transition zone points to the absence of local thermodynamic equilibrium, and resurfaces lingering questions on the validity of continuum assumptions in presence of strong shocks.

cond-mat.soft↗

arXiv2021

Quasi-graphs, zero entropy and measures with discrete spectrum

In this paper, we study dynamics of maps on quasi-graphs characterizing their invariant measures. In particular, we prove that every invariant measure of quasi-graph map with zero topological entropy has discrete spectrum. Additionally, we obtain an analog of Llibre-Misiurewicz's result relating positive topological entropy with existence of topological horseshoes. We also study dynamics on dendrites and show that if a continuous map on a dendrite, whose set of all endpoints is closed and has only finitely many accumulation points, has zero topological entropy, then every invariant measure supported on an orbit closure has discrete spectrum.

math.DS↗

arXiv2021

Higher-order Fabry-Pérot Interferometer from Topological Hinge States

We propose an intrinsic 3D Fabry-Pérot type interferometer, coined "higher-order interferometer", that utilizes the chiral hinge states of second-order topological insulators and cannot be equivalently mapped to 2D space because of higher-order topology. Quantum interference patterns in the two-terminal conductance of this interferometer are controllable not only by tuning the strength but also, particularly, by rotating the direction of the magnetic field applied perpendicularly to the transport direction. Remarkably, the conductance exhibits a characteristic beating pattern with multiple frequencies with respect to field strength or direction. Our novel interferometer provides feasible and robust magneto-transport signatures to probe the particular hinge states of higher-order topological insulators.

cond-mat.mes-hall↗

arXiv2021

Learning Augmented Index Policy for Optimal Service Placement at the Network Edge

We consider the problem of service placement at the network edge, in which a decision maker has to choose between $N$ services to host at the edge to satisfy the demands of customers. Our goal is to design adaptive algorithms to minimize the average service delivery latency for customers. We pose the problem as a Markov decision process (MDP) in which the system state is given by describing, for each service, the number of customers that are currently waiting at the edge to obtain the service. However, solving this $N$-services MDP is computationally expensive due to the curse of dimensionality. To overcome this challenge, we show that the optimal policy for a single-service MDP has an appealing threshold structure, and derive explicitly the Whittle indices for each service as a function of the number of requests from customers based on the theory of Whittle index policy. Since request arrival and service delivery rates are usually unknown and possibly time-varying, we then develop efficient learning augmented algorithms that fully utilize the structure of optimal policies with a low learning regret. The first of these is UCB-Whittle, and relies upon the principle of optimism in the face of uncertainty. The second algorithm, Q-learning-Whittle, utilizes Q-learning iterations for each service by using a two time scale stochastic approximation. We characterize the non-asymptotic performance of UCB-Whittle by analyzing its learning regret, and also analyze the convergence properties of Q-learning-Whittle. Simulation results show that the proposed policies yield excellent empirical performance.

cs.NI↗

arXiv2021

On the quantization of recurrent neural networks

Integer quantization of neural networks can be defined as the approximation of the high precision computation of the canonical neural network formulation, using reduced integer precision. It plays a significant role in the efficient deployment and execution of machine learning (ML) systems, reducing memory consumption and leveraging typically faster computations. In this work, we present an integer-only quantization strategy for Long Short-Term Memory (LSTM) neural network topologies, which themselves are the foundation of many production ML systems. Our quantization strategy is accurate (e.g. works well with quantization post-training), efficient and fast to execute (utilizing 8 bit integer weights and mostly 8 bit activations), and is able to target a variety of hardware (by leveraging instructions sets available in common CPU architectures, as well as available neural accelerators).

cs.LG↗

arXiv2020

Gradient Descent Maximizes the Margin of Homogeneous Neural Networks

In this paper, we study the implicit regularization of the gradient descent algorithm in homogeneous neural networks, including fully-connected and convolutional neural networks with ReLU or LeakyReLU activations. In particular, we study the gradient descent or gradient flow (i.e., gradient descent with infinitesimal step size) optimizing the logistic loss or cross-entropy loss of any homogeneous model (possibly non-smooth), and show that if the training loss decreases below a certain threshold, then we can define a smoothed version of the normalized margin which increases over time. We also formulate a natural constrained optimization problem related to margin maximization, and prove that both the normalized margin and its smoothed version converge to the objective value at a KKT point of the optimization problem. Our results generalize the previous results for logistic regression with one-layer or multi-layer linear networks, and provide more quantitative convergence results with weaker assumptions than previous results for homogeneous smooth neural networks. We conduct several experiments to justify our theoretical finding on MNIST and CIFAR-10 datasets. Finally, as margin is closely related to robustness, we discuss potential benefits of training longer for improving the robustness of the model.

cs.LG↗

arXiv2020

Positive entropy implies chaos along any infinite sequence

Let $G$ be an infinite countable discrete amenable group. For any $G$-action on a compact metric space $(X,ρ)$, it turns out that if the action has positive topological entropy, then for any sequence $\{s_i\}_{i=1}^{+\infty}$ with pairwise distinct elements in $G$ there exists a Cantor subset $K$ of $X$ which is Li-Yorke chaotic along this sequence, that is, for any two distinct points $x,y\in K$, one has \[\limsup_{i\to+\infty}ρ(s_i x,s_iy)>0,\ \text{and}\ \liminf_{i\to+\infty}ρ(s_ix,s_iy)=0.\]

math.DS↗

arXiv2020

Nonclassical oscillations in pre- and post-selected quantum walks

Quantum walks are counterparts of classical random walks. They spread faster, which can be exploited in information processing tasks, and constitute a versatile simulation platform for many quantum systems. Yet, some of their properties can be emulated with classical light. This rises a question: which aspects of the model are truly nonclassical? We address it by carrying out a photonic experiment based on a pre- and post-selection paradox. The paradox implies that if somebody could choose to ask, either if the particle is at position x = 0 at even time steps, or at position x = d (d > 1) at odd time steps, the answer would be positive, no matter the question asked. Therefore, the particle seems to undergo long distance oscillations despite the fact that the model allows to jump one position at a time. We translate this paradox into a Bell-like inequality and experimentally confirm its violation up to eight standard deviations.

quant-ph↗

arXiv2020

High-fidelity, high-scalability two-qubit gate scheme for superconducting qubits

High-quality two-qubit gate operations are crucial for scalable quantum information processing. Often, the gate fidelity is compromised when the system becomes more integrated. Therefore, a low-error-rate, easy-to-scale two-qubit gate scheme is highly desirable. Here, we experimentally demonstrate a new two-qubit gate scheme that exploits fixed-frequency qubits and a tunable coupler in a superconducting quantum circuit. The scheme requires less control lines, reduces crosstalk effect, simplifies calibration procedures, yet produces a controlled-Z gate in 30ns with a high fidelity of 99.5%, derived from the interleaved randomized benchmarking method. Error analysis shows that gate errors are mostly coherence limited. Our demonstration paves the way for large-scale implementation of high-fidelity quantum operations.

quant-ph↗

arXiv2020

PA-Cache: Evolving Learning-Based Popularity-Aware Content Caching in Edge Networks

As ubiquitous and personalized services are growing boomingly, an increasingly large amount of traffic is generated over the network by massive mobile devices. As a result, content caching is gradually extending to network edges to provide low-latency services, improve quality of service, and reduce redundant data traffic. Compared to the conventional content delivery networks, caches in edge networks with smaller sizes usually have to accommodate more bursty requests. In this paper, we propose an evolving learning-based content caching policy, named PA-Cache in edge networks. It adaptively learns time-varying content popularity and determines which contents should be replaced when the cache is full. Unlike conventional deep neural networks (DNNs), which learn a fine-tuned but possibly outdated or biased prediction model using the entire training dataset with high computational complexity, PA-Cache weighs a large set of content features and trains the multi-layer recurrent neural network from shallow to deeper when more requests arrive over time. We extensively evaluate the performance of our proposed PA-Cache on real-world traces from a large online video-on-demand service provider. \rb{The results show that PA-Cache outperforms existing popular caching algorithms and approximates the optimal algorithm with only a 3.8\% performance gap when the cache percentage is 1.0\%}. PA-Cache also significantly reduces the computational cost compared to conventional DNN-based approaches.

cs.NI↗

arXiv2020

Exploration by Maximizing Rényi Entropy for Reward-Free RL Framework

Exploration is essential for reinforcement learning (RL). To face the challenges of exploration, we consider a reward-free RL framework that completely separates exploration from exploitation and brings new challenges for exploration algorithms. In the exploration phase, the agent learns an exploratory policy by interacting with a reward-free environment and collects a dataset of transitions by executing the policy. In the planning phase, the agent computes a good policy for any reward function based on the dataset without further interacting with the environment. This framework is suitable for the meta RL setting where there are many reward functions of interest. In the exploration phase, we propose to maximize the Renyi entropy over the state-action space and justify this objective theoretically. The success of using Renyi entropy as the objective results from its encouragement to explore the hard-to-reach state-actions. We further deduce a policy gradient formulation for this objective and design a practical exploration algorithm that can deal with complex environments. In the planning phase, we solve for good policies given arbitrary reward functions using a batch RL algorithm. Empirically, we show that our exploration algorithm is effective and sample efficient, and results in superior policies for arbitrary reward functions in the planning phase.

cs.LG↗

arXiv2020

Generalized quantum teleportation of shared quantum secret with quantum walks

Very recently, Lee et al. proposed the first secure quantum teleporation protocol, where quantum information shared by an arbitrary number of senders can be transferred to another arbitrary number of receivers. Here, by introducing quantum walks, a novel secure (n,m) quantum teleportation of shared quantum secret between n senders and $m$ receivers is presented. Firstly, two kinds of (n,2) teleportation schemes are proposed by n-walker quantum walks on the line, the first walker of which is driven by three coins, respectively, based on two kinds of coin operators: the homogeneous coins and the position-dependent coins. Secondly, by increasing the amount of the coins of the first walker to m+1, the previous (n,2) scheme can be generalized to (n,m) teleportation scheme. Then, we give the proof of the information security of our proposed scheme, in which neither any single nor subparties of senders and receivers can fully access the secret quantum information. Moreover, the projective measurements are needed, instead of the joint Bell measurements that are necessary in Lee et al.'s protocol. Our work can also be extended further to QWs on the cycle. This work provides an additional relevant instance of the richness of quantum walks for quantum information processing tasks and thus opens the wider application purpose of quantum walks.

quant-ph↗

arXiv2020

Distributed Stochastic Consensus Optimization with Momentum for Nonconvex Nonsmooth Problems

While many distributed optimization algorithms have been proposed for solving smooth or convex problems over the networks, few of them can handle non-convex and non-smooth problems. Based on a proximal primal-dual approach, this paper presents a new (stochastic) distributed algorithm with Nesterov momentum for accelerated optimization of non-convex and non-smooth problems. Theoretically, we show that the proposed algorithm can achieve an $ε$-stationary solution under a constant step size with $\mathcal{O}(1/ε^2)$ computation complexity and $\mathcal{O}(1/ε)$ communication complexity. When compared to the existing gradient tracking based methods, the proposed algorithm has the same order of computation complexity but lower order of communication complexity. To the best of our knowledge, the presented result is the first stochastic algorithm with the $\mathcal{O}(1/ε)$ communication complexity for non-convex and non-smooth problems. Numerical experiments for a distributed non-convex regression problem and a deep neural network based classification problem are presented to illustrate the effectiveness of the proposed algorithms.

math.OC↗

arXiv2020

Chiral Majorana Hinge Modes in Superconducting Dirac Materials

Chiral Majorana hinge modes are characteristic of a second-order topological superconductor in three dimensions. Here we systematically study pairing symmetry in the point group D_{2h}, and find that the leading pairing channels can be of s-, d-, and s+id-wave pairing in Dirac materials. Except for the odd-parity s-wave pairing superconductivity, the s+id-wave pairing superconductor is topologically nontrivial and possesses Majorana hinge and surface modes. The chiral Majorana hinge modes can be characterized by a winding number of the quadrupole moment, or quantized quadruple moment at the symmetrically invariant point. Our findings suggest the strong spin-orbital coupling, crystalline symmetries and electron-electron interaction in the Dirac materials may provide a microscopic mechanism to realize chiral Majorana hinge modes without utilizing the proximity effect or external fields.

cond-mat.supr-con↗

arXiv2020

Secure Transmission by Leveraging Multiple Intelligent Reflecting Surfaces in MISO Systems

Due to the broadcast nature of wireless communications, physical layer security has always been a fundamental but challenging problem. Recent advance of Intelligent Reflecting Surface (IRS) introduces a new dimension for secure communications by reconfiguring the transmission environments. In this paper, we devise a secure transmission scheme for multi-user MISO systems by leveraging multiple collaborative IRSs. Specifically, to guarantee the worst-case achievable secrecy rate among multiple legitimate users, we formulate a max-min problem that can be solved by an alternative optimization method to decouple it into multiple sub-problems. Based on semidefinite relaxation and successive convex approximation, each sub-problem can be further converted into convex problem and easily solved. Extensive experimental results demonstrate that our proposed scheme can adapt to complex scenarios for multiple users and achieve significant gain in terms of achievable secrecy rate. The gap between the secrecy rate from our proposed scheme and that from the traditional sum-rate maximization and our results show that the secrecy rate obtained from our scheme converges to that achieved from the traditional sum-rate maximization when increasing the number of elements on IRSs.

eess.SP↗

arXiv2020

Online Algorithms for Multi-shop Ski Rental with Machine Learned Advice

We study the problem of augmenting online algorithms with machine learned (ML) advice. In particular, we consider the \emph{multi-shop ski rental} (MSSR) problem, which is a generalization of the classical ski rental problem. In MSSR, each shop has different prices for buying and renting a pair of skis, and a skier has to make decisions on when and where to buy. We obtain both deterministic and randomized online algorithms with provably improved performance when either a single or multiple ML predictions are used to make decisions. These online algorithms have no knowledge about the quality or the prediction error type of the ML prediction. The performance of these online algorithms are robust to the poor performance of the predictors, but improve with better predictions. Extensive experiments using both synthetic and real world data traces verify our theoretical observations and show better performance against algorithms that purely rely on online decision making.

cs.DS↗

arXiv2020

Kalman Filtering Attention for User Behavior Modeling in CTR Prediction

Click-through rate (CTR) prediction is one of the fundamental tasks for e-commerce search engines. As search becomes more personalized, it is necessary to capture the user interest from rich behavior data. Existing user behavior modeling algorithms develop different attention mechanisms to emphasize query-relevant behaviors and suppress irrelevant ones. Despite being extensively studied, these attentions still suffer from two limitations. First, conventional attentions mostly limit the attention field only to a single user's behaviors, which is not suitable in e-commerce where users often hunt for new demands that are irrelevant to any historical behaviors. Second, these attentions are usually biased towards frequent behaviors, which is unreasonable since high frequency does not necessarily indicate great importance. To tackle the two limitations, we propose a novel attention mechanism, termed Kalman Filtering Attention (KFAtt), that considers the weighted pooling in attention as a maximum a posteriori (MAP) estimation. By incorporating a priori, KFAtt resorts to global statistics when few user behaviors are relevant. Moreover, a frequency capping mechanism is incorporated to correct the bias towards frequent behaviors. Offline experiments on both benchmark and a 10 billion scale real production dataset, together with an Online A/B test, show that KFAtt outperforms all compared state-of-the-arts. KFAtt has been deployed in the ranking system of a leading e commerce website, serving the main traffic of hundreds of millions of active users everyday.

cs.LG↗

arXiv2020

Improved Algorithms for Convex-Concave Minimax Optimization

This paper studies minimax optimization problems $\min_x \max_y f(x,y)$, where $f(x,y)$ is $m_x$-strongly convex with respect to $x$, $m_y$-strongly concave with respect to $y$ and $(L_x,L_{xy},L_y)$-smooth. Zhang et al. provided the following lower bound of the gradient complexity for any first-order method: $Ω\Bigl(\sqrt{\frac{L_x}{m_x}+\frac{L_{xy}^2}{m_x m_y}+\frac{L_y}{m_y}}\ln(1/ε)\Bigr).$ This paper proposes a new algorithm with gradient complexity upper bound $\tilde{O}\Bigl(\sqrt{\frac{L_x}{m_x}+\frac{L\cdot L_{xy}}{m_x m_y}+\frac{L_y}{m_y}}\ln\left(1/ε\right)\Bigr),$ where $L=\max\{L_x,L_{xy},L_y\}$. This improves over the best known upper bound $\tilde{O}\left(\sqrt{\frac{L^2}{m_x m_y}} \ln^3\left(1/ε\right)\right)$ by Lin et al. Our bound achieves linear convergence rate and tighter dependency on condition numbers, especially when $L_{xy}\ll L$ (i.e., when the interaction between $x$ and $y$ is weak). Via reduction, our new bound also implies improved bounds for strongly convex-concave and convex-concave minimax optimization problems. When $f$ is quadratic, we can further improve the upper bound, which matches the lower bound up to a small sub-polynomial factor.

cs.LG↗