arXiv subjects

Jian Li

Publications and source records attributed to Jian Li.

At least 433 records · Page 24Linked to original sources

arXiv2022

Scalable Method for Eliminating Residual $ZZ$ Interaction between Superconducting Qubits

Unwanted $ZZ$ interaction is a quantum-mechanical crosstalk phenomenon which correlates qubit dynamics and is ubiquitous in superconducting qubit systems. It adversely affects the quality of quantum operations and can be detrimental in scalable quantum information processing. Here we propose and experimentally demonstrate a practically extensible approach for complete cancellation of residual $ZZ$ interaction between fixed-frequency transmon qubits, which are known for long coherence and simple control. We apply to the intermediate coupler that connects the qubits a weak microwave drive at a properly chosen frequency in order to noninvasively induce an ac Stark shift for $ZZ$ cancellation. We verify the cancellation performance by measuring vanishing two-qubit entangling phases and $ZZ$ correlations. In addition, we implement a randomized benchmarking experiment to extract the idling gate fidelity which shows good agreement with the coherence limit, demonstrating the effectiveness of $ZZ$ cancellation. Our method allows independent addressability of each qubit-qubit connection, and is applicable to both nontunable and tunable couplers, promising better compatibility with future large-scale quantum processors.

quant-ph↗

arXiv2022

Analyzing and Mitigating Interference in Neural Architecture Search

Weight sharing is a popular approach to reduce the cost of neural architecture search (NAS) by reusing the weights of shared operators from previously trained child models. However, the rank correlation between the estimated accuracy and ground truth accuracy of those child models is low due to the interference among different child models caused by weight sharing. In this paper, we investigate the interference issue by sampling different child models and calculating the gradient similarity of shared operators, and observe: 1) the interference on a shared operator between two child models is positively correlated with the number of different operators; 2) the interference is smaller when the inputs and outputs of the shared operator are more similar. Inspired by these two observations, we propose two approaches to mitigate the interference: 1) MAGIC-T: rather than randomly sampling child models for optimization, we propose a gradual modification scheme by modifying one operator between adjacent optimization steps to minimize the interference on the shared operators; 2) MAGIC-A: forcing the inputs and outputs of the operator across all child models to be similar to reduce the interference. Experiments on a BERT search space verify that mitigating interference via each of our proposed methods improves the rank correlation of super-pet and combining both methods can achieve better results. Our discovered architecture outperforms RoBERTa$_{\rm base}$ by 1.1 and 0.6 points and ELECTRA$_{\rm base}$ by 1.6 and 1.1 points on the dev and test set of GLUE benchmark. Extensive results on the BERT compression, reading comprehension and ImageNet task demonstrate the effectiveness and generality of our proposed methods.

cs.CL↗

arXiv2022

Towards Robust On-Ramp Merging via Augmented Multimodal Reinforcement Learning

Despite the success of AI-enabled onboard perception, on-ramp merging has been one of the main challenges for autonomous driving. Due to limited sensing range of onboard sensors, a merging vehicle can hardly observe main road conditions and merge properly. By leveraging the wireless communications between connected and automated vehicles (CAVs), a merging CAV has potential to proactively obtain the intentions of nearby vehicles. However, CAVs can be prone to inaccurate observations, such as the noisy basic safety messages (BSM) and poor quality surveillance images. In this paper, we present a novel approach for Robust on-ramp merge of CAVs via Augmented and Multi-modal Reinforcement Learning, named by RAMRL. Specifically, we formulate the on-ramp merging problem as a Markov decision process (MDP) by taking driving safety, comfort driving behavior, and traffic efficiency into account. To provide reliable merging maneuvers, we simultaneously leverage BSM and surveillance images for multi-modal observation, which is used to learn a policy model through proximal policy optimization (PPO). Moreover, to improve data efficiency and provide better generalization performance, we train the policy model with augmented data (e.g., noisy BSM and noisy surveillance images). Extensive experiments are conducted with Simulation of Urban MObility (SUMO) platform under two typical merging scenarios. Experimental results demonstrate the effectiveness and efficiency of our robust on-ramp merging design.

cs.RO↗

arXiv2022

Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structures

Multivariate time series forecasting has seen widely ranging applications in various domains, including finance, traffic, energy, and healthcare. To capture the sophisticated temporal patterns, plenty of research studies designed complex neural network architectures based on many variants of RNNs, GNNs, and Transformers. However, complex models are often computationally expensive and thus face a severe challenge in training and inference efficiency when applied to large-scale real-world datasets. In this paper, we introduce LightTS, a light deep learning architecture merely based on simple MLP-based structures. The key idea of LightTS is to apply an MLP-based structure on top of two delicate down-sampling strategies, including interval sampling and continuous sampling, inspired by a crucial fact that down-sampling time series often preserves the majority of its information. We conduct extensive experiments on eight widely used benchmark datasets. Compared with the existing state-of-the-art methods, LightTS demonstrates better performance on five of them and comparable performance on the rest. Moreover, LightTS is highly efficient. It uses less than 5% FLOPS compared with previous SOTA methods on the largest benchmark dataset. In addition, LightTS is robust and has a much smaller variance in forecasting accuracy than previous SOTA methods in long sequence forecasting tasks.

cs.LG↗

arXiv2022

Vibration-Assisted Multi-Photon Resonance and Multi-Ion Excitation

We investigate the multi-photon resonance and multi-ion excitation in a single-mode cavity with identical vibrating ion-qubits, which enables the tripartite interaction among the internal states of ions, the cavity mode and the ions' vibrational motion. Under particular resonant conditions, we derive effective Hamiltonians for the three-photon and the three-excitation cases, respectively, and find that the magnitude of the effective coupling energy can be tuned through the vibration mode, allowing for manipulations of ion-photon coupling in experiments. Furthermore, we analyze the system dynamics of our proposed setups and demonstrate the Rabi oscillation behaviors in these systems with dissipation effects. We propose our system as a versatile platform for the exploration of entangled multi-qubit physics.

quant-ph↗

arXiv2022

Fidelity-Guarantee Entanglement Routing in Quantum Networks

Entanglement routing establishes remote entanglement connection between two arbitrary nodes, which is one of the most important functions in quantum networks. The existing routing mechanisms mainly improve the robustness and throughput facing the failure of entanglement generations, which, however, rarely include the considerations on the most important metric to evaluate the quality of connection, entanglement fidelity. To solve this problem, we propose purification-enabled entanglement routing designs to provide fidelity guarantee for multiple Source-Destination (SD) pairs in quantum networks. In our proposal, we first consider the single S-D pair scenario and design an iterative routing algorithm, Q-PATH, to find the optimal purification decisions along the routing path with minimum entangled pair cost. Further, a low-complexity routing algorithm using an extended Dijkstra algorithm, Q-LEAP, is designed to reduce the computational complexity by using a simple but effective purification decision method. Then we consider the common scenario with multiple S-D pairs and design a greedy-based algorithm considering resource allocation and rerouting process for multiple routing requests. To verify the effectiveness and superiority of the proposed algorithms, extensive simulations are conducted, and the simulation results show that the proposed algorithms not only can provide fidelity-guarantee routing solutions, but also has superior performance in terms of throughput, fidelity of end-to-end entanglement connection, and resource utilization ratio, compared with the existing routing scheme.

quant-ph↗

arXiv2022

Uncertainty quantification of two-phase flow in porous media via coupled-TgNN surrogate model

Uncertainty quantification (UQ) of subsurface two-phase flow usually requires numerous executions of forward simulations under varying conditions. In this work, a novel coupled theory-guided neural network (TgNN) based surrogate model is built to facilitate computation efficiency under the premise of satisfactory accuracy. The core notion of this proposed method is to bridge two separate blocks on top of an overall network. They underlie the TgNN model in a coupled form, which reflects the coupling nature of pressure and water saturation in the two-phase flow equation. The TgNN model not only relies on labeled data, but also incorporates underlying scientific theory and experiential rules (e.g., governing equations, stochastic parameter fields, boundary and initial conditions, well conditions, and expert knowledge) as additional components into the loss function. The performance of the TgNN-based surrogate model for two-phase flow problems is tested by different numbers of labeled data and collocation points, as well as the existence of data noise. The proposed TgNN-based surrogate model offers an effective way to solve the coupled nonlinear two-phase flow problem and demonstrates good accuracy and strong robustness when compared with the purely data-driven surrogate model. By combining the accurate TgNN-based surrogate model with the Monte Carlo method, UQ tasks can be performed at a minimum cost to evaluate statistical quantities. Since the heterogeneity of the random fields strongly impacts the results of the surrogate model, corresponding variance and correlation length are added to the input of the neural network to maintain its predictive capacity. The results show that the TgNN-based surrogate model achieves satisfactory accuracy, stability, and efficiency in UQ problems of subsurface two-phase flow.

physics.flu-dyn↗

arXiv2022

Self-supervised graph neural networks for accurate prediction of Néel temperature

Antiferromagnetic materials are exciting quantum materials with rich physics and great potential for applications. It is highly demanded of the accurate and efficient theoretical method for determining the critical transition temperatures, Néel temperatures, of antiferromagnetic materials. The powerful graph neural networks (GNN) that succeed in predicting material properties lose their advantage in predicting magnetic properties due to the small dataset of magnetic materials, while conventional machine learning models heavily depend on the quality of material descriptors. We propose a new strategy to extract high-level material representations by utilizing self-supervised training of GNN on large-scale unlabeled datasets. According to the dimensional reduction analysis, we find that the learned knowledge about elements and magnetism transfers to the generated atomic vector representations. Compared with popular manually constructed descriptors and crystal graph convolutional neural networks, self-supervised material representations can help us obtain a more accurate and efficient model for Néel temperatures, and the trained model can successfully predict high Néel temperature antiferromagnetic materials. Our self-supervised GNN may serve as a universal pre-training framework for various material properties.

cond-mat.mtrl-sci↗

arXiv2022

Incremental Fermi Large Area Telescope Fourth Source Catalog

We present an incremental version (4FGL-DR3, for Data Release 3) of the fourth Fermi-LAT catalog of gamma-ray sources. Based on the first twelve years of science data in the energy range from 50 MeV to 1 TeV, it contains 6658 sources. The analysis improves on that used for the 4FGL catalog over eight years of data: more sources are fit with curved spectra, we introduce a more robust spectral parameterization for pulsars, and we extend the spectral points to 1 TeV. The spectral parameters, spectral energy distributions, and associations are updated for all sources. Light curves are rebuilt for all sources with 1 yr intervals (not 2 month intervals). Among the 5064 original 4FGL sources, 16 were deleted, 112 are formally below the detection threshold over 12 yr (but are kept in the list), while 74 are newly associated, 10 have an improved association, and seven associations were withdrawn. Pulsars are split explicitly between young and millisecond pulsars. Pulsars and binaries newly detected in LAT sources, as well as more than 100 newly classified blazars, are reported. We add three extended sources and 1607 new point sources, mostly just above the detection threshold, among which eight are considered identified, and 699 have a plausible counterpart at other wavelengths. We discuss degree-scale residuals to the global sky model and clusters of soft unassociated point sources close to the Galactic plane, which are possibly related to limitations of the interstellar emission model and missing extended sources.

astro-ph.HE↗

arXiv2022

Ridgeless Regression with Random Features

Recent theoretical studies illustrated that kernel ridgeless regression can guarantee good generalization ability without an explicit regularization. In this paper, we investigate the statistical properties of ridgeless regression with random features and stochastic gradient descent. We explore the effect of factors in the stochastic gradient and random features, respectively. Specifically, random features error exhibits the double-descent curve. Motivated by the theoretical findings, we propose a tunable kernel algorithm that optimizes the spectral density of kernel during training. Our work bridges the interpolation theory and practical algorithm.

cs.LG↗

arXiv2022

Phase dependent evolution within large luminosity range of 1A 0535+262 observed by Insight-HXMT during 2020 giant outburst

We have performed phase-resolved spectral analysis of the accreting pulsar 1A~0535+262 based on observations of Insight-HXMT during the 2020 Type-II outburst of the source. We focus on the two-dimensional dependence of the cyclotron resonance scattering features (CRSFs) along the outburst time and at different phases. The fundamental CRSF line (f-CRSF) shows different time- and phase-dependent behaviors. At higher luminosity, the phase profile of the f-CRSF energy changes from a single peak to double peaks, with the transition occurring at MJD 59185. On the contrary, the first harmonic CRSF (1-st CRSF) at $\sim$ 100 keV is only detected within a narrow phase range (0.8$-$1.0) accompanied by a shallow f-CRSF line. Based on these results, we speculate that when the source enters the supercritical regime, the higher accretion column can significantly enhance the harmonic line at a narrow phase through an "anti-pencil" beam at a higher energy band. At the same time, it will also affect the behavior of the fundamental line.

astro-ph.HE↗

arXiv2022

Stability and Generalization of Differentially Private Minimax Problems

In the field of machine learning, many problems can be formulated as the minimax problem, including reinforcement learning, generative adversarial networks, to just name a few. So the minimax problem has attracted a huge amount of attentions from researchers in recent decades. However, there is relatively little work on studying the privacy of the general minimax paradigm. In this paper, we focus on the privacy of the general minimax setting, combining differential privacy together with minimax optimization paradigm. Besides, via algorithmic stability theory, we theoretically analyze the high probability generalization performance of the differentially private minimax algorithm under the strongly-convex-strongly-concave condition. To the best of our knowledge, this is the first time to analyze the generalization performance of general minimax paradigm, taking differential privacy into account.

cs.LG↗

arXiv2022

Sharper Utility Bounds for Differentially Private Models

In this paper, by introducing Generalized Bernstein condition, we propose the first $\mathcal{O}\big(\frac{\sqrt{p}}{nε}\big)$ high probability excess population risk bound for differentially private algorithms under the assumptions $G$-Lipschitz, $L$-smooth, and Polyak-Łojasiewicz condition, based on gradient perturbation method. If we replace the properties $G$-Lipschitz and $L$-smooth by $α$-H{ö}lder smoothness (which can be used in non-smooth setting), the high probability bound comes to $\mathcal{O}\big(n^{-\fracα{1+2α}}\big)$ w.r.t $n$, which cannot achieve $\mathcal{O}\left(1/n\right)$ when $α\in(0,1]$. To solve this problem, we propose a variant of gradient perturbation method, \textbf{max$\{1,g\}$-Normalized Gradient Perturbation} (m-NGP). We further show that by normalization, the high probability excess population risk bound under assumptions $α$-H{ö}lder smooth and Polyak-Łojasiewicz condition can achieve $\mathcal{O}\big(\frac{\sqrt{p}}{nε}\big)$, which is the first $\mathcal{O}\left(1/n\right)$ high probability excess population risk bound w.r.t $n$ for differentially private algorithms under non-smooth conditions. Moreover, we evaluate the performance of the new proposed algorithm m-NGP, the experimental results show that m-NGP improves the performance of the differentially private model over real datasets. It demonstrates that m-NGP improves the utility bound and the accuracy of the DP model on real datasets simultaneously.

cs.LG↗

arXiv2022

A Deep Learning Galerkin Method for the Closed-Loop Geothermal System

There has been an arising trend of adopting deep learning methods to study partial differential equations (PDEs). This article is to propose a Deep Learning Galerkin Method (DGM) for the closed-loop geothermal system, which is a new coupled multi-physics PDEs and mainly consists of a framework of underground heat exchange pipelines to extract the geothermal heat from the geothermal reservoir. This method is a natural combination of Galerkin Method and machine learning with the solution approximated by a neural network instead of a linear combination of basis functions. We train the neural network by randomly sampling the spatiotemporal points and minimize loss function to satisfy the differential operators, initial condition, boundary and interface conditions. Moreover, the approximate ability of the neural network is proved by the convergence of the loss function and the convergence of the neural network to the exact solution in L^2 norm under certain conditions. Finally, some numerical examples are carried out to demonstrate the approximation ability of the neural networks intuitively.

math.NA↗

arXiv2022

Entanglement properties of superconducting qubits coupled to a semi-infinite transmission line

Quantum entanglement, a key resource in quantum information processing, is reduced by interaction between the quantum system concerned and its unavoidable noisy environment. Therefore it is of particular importance to study the dynamical properties of entanglement in open quantum systems. In this work, we mainly focus on two qubits coupled to an adjustable environment, namely a semi-infinite transmission line. The two qubits' relaxations, through individual channels or collective channel or both, can be adjusted by the qubits' transition frequencies. We examine entanglement dynamics in this model system with initial Werner state, and show that the phenomena of entanglement sudden death and revival can be observed. Due to the hardness of preparing the Werner state experimentally, we introduce a new type of entangled state called pseudo-Werner state, which preserves as much entangling property as the Werner state, and more importantly, is experiment friendly. Furthermore, we provide detailed procedures for generating pseudo-Werner state and studying entanglement dynamics with it, which can be straightforwardly implemented in a superconducting waveguide quantum electrodynamics system.

quant-ph↗

arXiv2022

Broken family sensitivity in transitive systems

Let $(X,T)$ be a topological dynamical system, $n\geq 2$ and $\mathcal{F}$ be a Furstenberg family of subsets of $\mathbb{Z}_+$. $(X,T)$ is called broken $\mathcal{F}$-$n$-sensitive if there exist $δ>0$ and $F\in\mathcal{F}$ such that for every opene (non-empty open) subset $U$ of $X$ and every $l\in\mathbb{N}$, there exist $x_1^l,x_2^l,\dotsc,x_n^l\in U$ and $m_l\in \mathbb{Z}_+$ satisfying $d(T^k x_i^l, T^k x_j^l)> δ,\ \forall 1\leq i 0$. We also obtain specific properties for them by analyzing the factor maps to their maximal equicontinuous factors. Furthermore, we show examples to distinguish different kinds of broken family sensitivity.

math.DS↗

arXiv2022

Reinforcement Learning for Finite-Horizon Restless Multi-Armed Multi-Action Bandits

We study a finite-horizon restless multi-armed bandit problem with multiple actions, dubbed R(MA)^2B. The state of each arm evolves according to a controlled Markov decision process (MDP), and the reward of pulling an arm depends on both the current state of the corresponding MDP and the action taken. The goal is to sequentially choose actions for arms so as to maximize the expected value of the cumulative rewards collected. Since finding the optimal policy is typically intractable, we propose a computationally appealing index policy which we call Occupancy-Measured-Reward Index Policy. Our policy is well-defined even if the underlying MDPs are not indexable. We prove that it is asymptotically optimal when the activation budget and number of arms are scaled up, while keeping their ratio as a constant. For the case when the system parameters are unknown, we develop a learning algorithm. Our learning algorithm uses the principle of optimism in the face of uncertainty and further uses a generative model in order to fully exploit the structure of Occupancy-Measured-Reward Index Policy. We call it the R(MA)^2B-UCB algorithm. As compared with the existing algorithms, R(MA)^2B-UCB performs close to an offline optimum policy, and also achieves a sub-linear regret with a low computational complexity. Experimental results show that R(MA)^2B-UCB outperforms the existing algorithms in both regret and run time.

cs.LG↗

arXiv2022

Radio pulsations from a neutron star within the gamma-ray binary LS I +61$^{\circ}$ 303

LS I +61$^{\circ}$ 303 is one of the rare gamma-ray binaries, emitting most of their luminosity in photons with energies beyond 100 MeV. The $\sim$26.5 d orbital period is clearly detected at many wavelengths. Additional aspects of its multi-frequency behavior make it the most interesting example of the class. The morphology of high-resolution radio images changes with orbital phase displaying a cometary tail pointing away from the high-mass star. LS I +61$^{\circ}$ 303 also shows superorbital variability. A couple of energetic ($\sim 10^{37}$ erg s$^{-1}$), short, magnetar-like bursts have been plausibly ascribed to it. LS I +61$^{\circ}$ 303's phenomenology has been put under theoretical scrutiny for decades, but the lack of certainty regarding the nature of the compact object in the binary has prevented advancing our understanding of the source. Here, using observations done with the Five-hundred-meter Aperture Spherical radio Telescope (FAST), we report on the existence of transient radio pulsations from the direction of LS I +61$^{\circ}$ 303. We find a period $P=269.15508 \pm 0.00016$ ms at a significance of $> 20σ$. This is the first evidence for pulsations from this source at any frequency, and strongly argues for the existence of a rotating neutron star in LS I +61$^{\circ}$ 303.

astro-ph.HE↗