arXiv subjects

Jian Li

Publications and source records attributed to Jian Li.

At least 469 records · Page 26Linked to original sources

arXiv2021

Multi-token Markov Game with Switching Costs

We study a general Markov game with metric switching costs: in each round, the player adaptively chooses one of several Markov chains to advance with the objective of minimizing the expected cost for at least $k$ chains to reach their target states. If the player decides to play a different chain, an additional switching cost is incurred. The special case in which there is no switching cost was solved optimally by Dumitriu, Tetali, and Winkler~\cite{DTW03} by a variant of the celebrated Gittins Index for the classical multi-armed bandit (MAB) problem with Markovian rewards \cite{Git74,Git79}. However, for Markovian multi-armed bandit with nontrivial switching cost, even if the switching cost is a constant, the classic paper by Banks and Sundaram \cite{BS94} showed that no index strategy can be optimal. In this paper, we complement their result and show there is a simple index strategy that achieves a constant approximation factor if the switching cost is constant and $k=1$. To the best of our knowledge, this index strategy is the first strategy that achieves a constant approximation factor for a general Markovian MAB variant with switching costs. For the general metric, we propose a more involved constant-factor approximation algorithm, via a nontrivial reduction to the stochastic $k$-TSP problem, in which a Markov chain is approximated by a random variable. Our analysis makes extensive use of various interesting properties of the Gittins index.

cs.DS↗

arXiv2021

LSTC: Boosting Atomic Action Detection with Long-Short-Term Context

In this paper, we place the atomic action detection problem into a Long-Short Term Context (LSTC) to analyze how the temporal reliance among video signals affect the action detection results. To do this, we decompose the action recognition pipeline into short-term and long-term reliance, in terms of the hypothesis that the two kinds of context are conditionally independent given the objective action instance. Within our design, a local aggregation branch is utilized to gather dense and informative short-term cues, while a high order long-term inference branch is designed to reason the objective action class from high-order interaction between actor and other person or person pairs. Both branches independently predict the context-specific actions and the results are merged in the end. We demonstrate that both temporal grains are beneficial to atomic action recognition. On the mainstream benchmarks of atomic action detection, our design can bring significant performance gain from the existing state-of-the-art pipeline. The code of this project can be found at [this url](https://github.com/TencentYoutuResearch/ActionDetection-LSTC)

cs.CV↗

arXiv2021

Critical Learning Periods in Federated Learning

Federated learning (FL) is a popular technique to train machine learning (ML) models with decentralized data. Extensive works have studied the performance of the global model; however, it is still unclear how the training process affects the final test accuracy. Exacerbating this problem is the fact that FL executions differ significantly from traditional ML with heterogeneous data characteristics across clients, involving more hyperparameters. In this work, we show that the final test accuracy of FL is dramatically affected by the early phase of the training process, i.e., FL exhibits critical learning periods, in which small gradient errors can have irrecoverable impact on the final test accuracy. To further explain this phenomenon, we generalize the trace of the Fisher Information Matrix (FIM) to FL and define a new notion called FedFIM, a quantity reflecting the local curvature of each clients from the beginning of the training in FL. Our findings suggest that the {\em initial learning phase} plays a critical role in understanding the FL performance. This is in contrast to many existing works which generally do not connect the final accuracy of FL to the early phase training. Finally, seizing critical learning periods in FL is of independent interest and could be useful for other problems such as the choices of hyperparameters such as the number of client selected per round, batch size, and more, so as to improve the performance of FL training and testing.

cs.LG↗

arXiv2021

Unsupervised Open-Domain Question Answering

Open-domain Question Answering (ODQA) has achieved significant results in terms of supervised learning manner. However, data annotation cannot also be irresistible for its huge demand in an open domain. Though unsupervised QA or unsupervised Machine Reading Comprehension (MRC) has been tried more or less, unsupervised ODQA has not been touched according to our best knowledge. This paper thus pioneers the work of unsupervised ODQA by formally introducing the task and proposing a series of key data construction methods. Our exploration in this work inspiringly shows unsupervised ODQA can reach up to 86% performance of supervised ones.

cs.CL↗

arXiv2021

Antenna enhanced infrared photoinduced force imaging in aqueous environment with super-resolution and hypersensitivity

Tip enhanced IR spectra and imaging have been widely used in cutting-edge studies for the in-depth understanding of the composition, structure and function of interfaces at the nanoscale. However, molecular monolayer sensitivity has only been demonstrated on solid/gas interfaces. In aqueous environment, the reduced sensitivity due to strong damping of the cantilever oscillation and background IR absorption extremely limits the practical applications of tip enhanced IR nanospectroscopy. Here, we demonstrate hypersensitive nanoscale IR spectra and imaging in aqueous environment with the combination of photoinduced force (PiF) microscopy and resonant antennas. The highly confined electromagnetic field inbetween the tip end and antenna extremely amplifies the photoinduced force to the detectable level, while the excitation via plasmon internal reflection mode minimizes the environmental absorption. A polydimethylsiloxane (PDMS) layer (~1-2 nm thickness) functionalized on the AFM tip has been successfully identified in water with antennas of different sizes. Sampling volume of ~604 chemical bonds from PDMS was demonstrated with sub-10 nm spatial resolution confirmed by electric (E) field distribution mapping on antennas, which strongly suggests the desired requirements for interfacial spectroscopy. This platform demonstrates for the first time the application of photoinduced force microscopy in aqueous environments, providing a brand-new configuration to achieve highly enhanced nanoscale IR signals, which is extremely promising for future research of interfaces and nanosystems in aqueous environments.

physics.optics↗

arXiv2021

Routing in Small Satellite Networks: A GNN-based Learning Approach

Small satellite networks (SSNs), which are constructed by large number of small satellites in low earth orbits (LEO), are considered as promising ways to provide ubiquitous Internet access. To handle stochastic Internet traffic, on-board routing is necessary in SSNs. However, large-scale, high dynamic SSN topologies and limited resources make on-board routing in SSNs face great challenges. To address this issue, we turn to graph neural network (GNN), a deep learning network inherently designed for graph data, motivated by the fact that SSNs can be naturally modeled as graphs. By exploiting GNN's topology extraction capabilities, we propose a GNN-based learning routing approach (GLR) to achieve near-optimal on-board routing with low complexity. We design high-order and low-order feature extractor and cross process to deal with high dynamic topologies of SSNs, even those topologies that have never been seen in training. Simulation results demonstrate that GLR results in a significant reduction in routing computation cost while achieves near-optimal routing performance in SSNs with different scales compared with typical existing satellite routing algorithms.

cs.NI↗

arXiv2021

Graph maps with zero topological entropy and sequence entropy pairs

We show that graph map with zero topological entropy is Li-Yorke chaotic if and only if it has an NS-pair (a pair of non-separable points containing in a same solenoidal $ω$-limit set), and a non-diagonal pair is an NS-pair if and only if it is an IN-pair if and only if it is an IT-pair. This completes characterization of zero topological sequence entropy for graph maps.

math.DS↗

arXiv2021

Discrete-time quantum walk approach to high-dimensional quantum state transfer and quantum routing

High-dimensional quantum systems can offer extended possibilities and multiple advantages while developing advanced quantum technologies. In this paper, we propose a class of quantum-walk architecture networks that admit the efficient routing of high-dimensional quantum states. Perfect state transfer of an arbitrary unknown qudit state can be achieved between two arbitrary nodes via a one-dimensional lackadaisical discrete-time quantum walk. In addition, this method can be generalized to the high-dimensional lattices, where it allows distillable entanglement to be shared between arbitrary input and output ports. Implementation of our scheme is more feasible through exploiting the coin degrees of freedom and the settings of the coin flipping operators are simple. These results provide a direct application in a high-dimensional computational architecture to process much more information.

quant-ph↗

arXiv2021

Oblique and asymmetric Klein tunneling across smooth NP junctions or NPN junctions in 8-Pmmn borophene

The tunneling of electrons and holes in quantum structures plays a crucial role in studying the transport properties of materials and the related devices. 8-Pmmn borophene is a new two-dimensional Dirac material, which hosts tilted Dirac cone and chiral, anisotropic massless Dirac fermions. We develop the transfer matrix method to investigate the Klein tunneling of massless fermions across the smooth NP junctions and NPN junctions of 8-Pmmn borophene. Like the sharp NP junctions of 8-Pmmn borophene, the tilted Dirac cones induce the oblique Klein tunneling. The angle of perfect transmission to the normal incidence is 20.4 degrees, a constant determined by the Hamiltonian of 8-Pmmn borophene. For the NPN junction, there are branches of the Klein tunneling in the phase diagram. We find that the asymmetric Klein tunneling is induced by the chirality and anisotropy of the carriers. Furthermore, we show the oscillation of electrical resistance related to the Klein tunneling in the NPN junctions. One may analyze the pattern of electrical resistance and verify the existence of asymmetric Klein tunneling experimentally.

cond-mat.mes-hall↗

arXiv2021

Low-frequency tunable topological interface states in soft phononic crystal cylinders

Topological phononic crystals have attracted intensive attention due to their peculiar topologically protected interface or edge states. Their operating frequency, however, is generally fixed once designed and fabricated. Here, we propose to overcome this limitation by utilizing soft topological phononic crystals. In particular, we design a simple one-dimensional periodic system of soft cylindrical waveguides to realize mechanically tunable topological interface states for longitudinal waves. To this end, we employ the nonlinear elasticity theory and its linearized incremental version to fully account for both geometric and material nonlinearities of the system. We derive the dispersion relation for small-amplitude longitudinal motions superimposed on the finitely deformed state. In addition, our analytical results provide information about the corresponding Bloch wave modes, displacement field distributions, and signal transmission coefficients for finite cylindrical waveguides with identical or various unit-cell topologies. Our numerical results illustrate the low-frequency topological interface state occurring at the interface between two topologically distinct soft phononic cylinders. Moreover, we show that the corresponding frequency in the overlapped band gap can be continuously adjusted by an external force. This analytical result is also validated by the finite element simulations. Finally, we provide the topological phase diagrams to demonstrate the tunable position and existence condition of the topological interface states when tuning the external loading. The low-frequency tunable topological interface states with remarkable field enhancement may find a wide range of potential applications such as tunable energy harvesters, low-pass filters and high-sensitivity detectors for biomedical applications.

cond-mat.soft↗

arXiv2021

Measurement-device-independent quantum key distribution with insecure sources

Measurement-device-independent quantum key distribution (MDI-QKD) can eliminate all detector side-channel loopholes and has shown excellent performance in long-distance secret keys sharing. Conventional security proofs, however, require additional assumptions on sources and that can be compromised through uncharacterized side channels in practice. Here, we present a general formalism based on reference technique to prove the security of MDI-QKD against any possible sources imperfection and/or side channels. With this formalism, we investigate the asymptotic performance of single-photon sources without any extra assumptions on the state preparations. Our results highlight the importance of transmitters' security.

quant-ph↗

arXiv2021

Apsidal asymmetric-alignment of Jupiter Trojans

The most distant Kuiper belt objects exhibit the clustering in their orbits, and this anomalous architecture could be caused by Planet 9 with large eccentricity and high inclination. We then suppose that the orbital clustering of minor planets may be observed somewhere else in the solar system. In this paper, we consider the over 7000 Jupiter Trojans from the Minor Planet Center, and find that they are clustered in the longitude of perihelion $\varpi$, around the locations $\varpi_{\mbox{J}}+60^{\circ}$ and $\varpi_{\mbox{J}}-60^{\circ}$ ($\varpi_{\mbox{J}}$ is the longitude of perihelion of Jupiter) for the L4 and L5 swarms, respectively. Then we build a Hamiltonian system to describe the associated dynamical aspects for the co-orbital motion. The phase space displays the existence of the apsidally aligned islands of libration centered on $Δ\varpi=\varpi-\varpi_{\mbox{J}}\approx\pm60^{\circ}$, for the Trojan-like orbits with eccentricities $e<0.1$. Through a detailed analysis, we have shown that the observed Jupiter Trojans with proper eccentricities $e_p<0.1$ spend most of their time in the range of $|Δ\varpi|=0-120^{\circ}$, while the more eccentric ones with $e_p>0.1$ are too few to affect the orbital clustering within this $Δ\varpi$ range for the entire Trojan population. Our numerical results further prove that, even starting from a uniform $Δ\varpi$ distribution, the apsidal alignment of simulated Trojans similar to the observation can appear on the order of the age of the solar system. We conclude that the apsidal asymmetric-alignment of Jupiter Trojans is robust, and this new finding can be helpful to design the survey strategy in the future.

astro-ph.EP↗

arXiv2021

FOSSIL: I. The Spin Rate Limit of Jupiter Trojans

Rotation periods of 53 small (diameters $2 < D < 40$ km) Jupiter Trojans (JTs) were derived using the high-cadence light curves obtained by the FOSSIL phase I survey, a Subaru/Hyper Suprime-Cam intensive program. These are the first reported periods measured for JTs with $D < 10$ km. We found a lower limit of the rotation period near 4 hr, instead of the previously published result of 5 hr (Ryan et al. 2017; Szabo et al. 2017, 2020) found for larger JTs. Assuming a rubble-pile structure for JTs, a bulk density of 0.9 gcm$^{-3}$ is required to withstand this spin rate limit, consistent with the value $0.8-1.0$ gcm$^{-3}$ (Marchis et al. 2006; Mueller et al. 2010; Buie et al. 2015; Berthier et al. 2020) derived from the binary JT system, (617) Patroclus-Menoetius system.

astro-ph.EP↗

arXiv2021

Discrete Auto-regressive Variational Attention Models for Text Modeling

Variational autoencoders (VAEs) have been widely applied for text modeling. In practice, however, they are troubled by two challenges: information underrepresentation and posterior collapse. The former arises as only the last hidden state of LSTM encoder is transformed into the latent space, which is generally insufficient to summarize the data. The latter is a long-standing problem during the training of VAEs as the optimization is trapped to a disastrous local optimum. In this paper, we propose Discrete Auto-regressive Variational Attention Model (DAVAM) to address the challenges. Specifically, we introduce an auto-regressive variational attention approach to enrich the latent space by effectively capturing the semantic dependency from the input. We further design discrete latent space for the variational attention and mathematically show that our model is free from posterior collapse. Extensive experiments on language modeling tasks demonstrate the superiority of DAVAM against several VAE counterparts.

cs.LG↗

arXiv2021

Theory of polymer diffusion in polymer-nanoparticle mixtures: effect of nanoparticle concentration and polymer length

The dynamics of polymer-nanoparticle (NP) mixtures, which involves multiple scales and system-specific variables, has posed a long-standing challenge on its theoretical description. In this paper, we construct a microscopic theory for polymer diffusion in the mixtures based on a combination of generalized Langevin equation, mode-coupling approach, and polymer physics ideas. The parameter-free theory has an explicit expression and remains tractable on pair correlation level with system-specific equilibrium structures as input. Taking a minimal polymer-NP mixture as an example, our theory correctly captures the dependence of polymer diffusion on NP concentration and average interparticle distance. Importantly, the polymer diffusion exhibits a power law decay as the polymer length increases at dense NPs and/or long chain, which marks the emergence of entanglement-like motion. The work provides a first-principle theoretical foundation to investigate dynamic problems in diverse polymer nanocomposites.

cond-mat.soft↗

arXiv2021

Simple Combinatorial Algorithms for Combinatorial Bandits: Corruptions and Approximations

We consider the stochastic combinatorial semi-bandit problem with adversarial corruptions. We provide a simple combinatorial algorithm that can achieve a regret of $\tilde{O}\left(C+d^2K/Δ_{min}\right)$ where $C$ is the total amount of corruptions, $d$ is the maximal number of arms one can play in each round, $K$ is the number of arms. If one selects only one arm in each round, we achieves a regret of $\tilde{O}\left(C+\sum_{Δ_i>0}(1/Δ_i)\right)$. Our algorithm is combinatorial and improves on the previous combinatorial algorithm by [Gupta et al., COLT2019] (their bound is $\tilde{O}\left(KC+\sum_{Δ_i>0}(1/Δ_i)\right)$), and almost matches the best known bounds obtained by [Zimmert et al., ICML2019] and [Zimmert and Seldin, AISTATS2019] (up to logarithmic factor). Note that the algorithms in [Zimmert et al., ICML2019] and [Zimmert and Seldin, AISTATS2019] require one to solve complex convex programs while our algorithm is combinatorial, very easy to implement, requires weaker assumptions and has very low oracle complexity and running time. We also study the setting where we only get access to an approximation oracle for the stochastic combinatorial semi-bandit problem. Our algorithm achieves an (approximation) regret bound of $\tilde{O}\left(d\sqrt{KT}\right)$. Our algorithm is very simple, only worse than the best known regret bound by $\sqrt{d}$, and has much lower oracle complexity than previous work.

cs.LG↗

arXiv2021

Schema2QA: High-Quality and Low-Cost Q&A Agents for the Structured Web

Building a question-answering agent currently requires large annotated datasets, which are prohibitively expensive. This paper proposes Schema2QA, an open-source toolkit that can generate a Q&A system from a database schema augmented with a few annotations for each field. The key concept is to cover the space of possible compound queries on the database with a large number of in-domain questions synthesized with the help of a corpus of generic query templates. The synthesized data and a small paraphrase set are used to train a novel neural network based on the BERT pretrained model. We use Schema2QA to generate Q&A systems for five Schema.org domains, restaurants, people, movies, books and music, and obtain an overall accuracy between 64% and 75% on crowdsourced questions for these domains. Once annotations and paraphrases are obtained for a Schema.org schema, no additional manual effort is needed to create a Q&A agent for any website that uses the same schema. Furthermore, we demonstrate that learning can be transferred from the restaurant to the hotel domain, obtaining a 64% accuracy on crowdsourced questions with no manual effort. Schema2QA achieves an accuracy of 60% on popular restaurant questions that can be answered using Schema.org. Its performance is comparable to Google Assistant, 7% lower than Siri, and 15% higher than Alexa. It outperforms all these assistants by at least 18% on more complex, long-tail questions.

cs.CL↗

arXiv2021

Towards Sharper Utility Bounds for Differentially Private Pairwise Learning

Pairwise learning focuses on learning tasks with pairwise loss functions, depends on pairs of training instances, and naturally fits for modeling relationships between pairs of samples. In this paper, we focus on the privacy of pairwise learning and propose a new differential privacy paradigm for pairwise learning, based on gradient perturbation. Except for the privacy guarantees, we also analyze the excess population risk and give corresponding bounds under both expectation and high probability conditions. We use the \textit{on-average stability} and the \textit{pairwise locally elastic stability} theories to analyze the expectation bound and the high probability bound, respectively. Moreover, our analyzed utility bounds do not require convex pairwise loss functions, which means that our method is general to both convex and non-convex conditions. Under these circumstances, the utility bounds are similar to (or better than) previous bounds under convexity or strongly convexity assumption, which are attractive results.

cs.LG↗