arXiv Science⌕ Search

arXiv subjects

Qi Chen

Publications and source records attributed to Qi Chen.

At least 271 records · Page 15Linked to original sources
arXiv2021

Heterogeneously integrated, superconducting silicon-photonic platform for measurement-device-independent quantum key distribution

Integrated photonics provides a route both to miniaturize quantum key distribution (QKD) devices and to enhance their performance. A key element for achieving discrete-variable QKD is a single-photon detector. It is highly desirable to integrate detectors onto a photonic chip to enable the realization of practical and scalable quantum networks. We realize an integrated heterogeneous superconducting-silicon-photonic chip. Harnessing the unique high-speed feature of our optical waveguide-integrated superconducting detector, we perform the first optimal Bell-state measurement (BSM) of time-bin encoded qubits generated from two independent lasers. The optimal BSM enables an increased key rate of measurement-device-independent QKD, which is immune to all attacks against the detection system, and hence provides the basis for a QKD network with untrusted relays. Together with the time-multiplexed technique, we have enhanced the sifted key rate by almost one order of magnitude. With a 125 MHz clock rate, we obtain a secure key rate of 6.166 kbps over 24.0 dB loss, which is comparable to the state-of-the-art MDI-QKD experimental results with GHz clock rate. Combined with integrated QKD transmitters, a scalable, chip-based and cost-effective QKD network should become realizable in the near future.

quant-ph↗
arXiv2021

GLOW : Global Weighted Self-Attention Network for Web Search

Deep matching models aim to facilitate search engines retrieving more relevant documents by mapping queries and documents into semantic vectors in the first-stage retrieval. When leveraging BERT as the deep matching model, the attention score across two words are solely built upon local contextualized word embeddings. It lacks prior global knowledge to distinguish the importance of different words, which has been proved to play a critical role in information retrieval tasks. In addition to this, BERT only performs attention across sub-words tokens which weakens whole word attention representation. We propose a novel Global Weighted Self-Attention (GLOW) network for web document search. GLOW fuses global corpus statistics into the deep matching model. By adding prior weights into attention generation from global information, like BM25, GLOW successfully learns weighted attention scores jointly with query matrix $Q$ and key matrix $K$. We also present an efficient whole word weight sharing solution to bring prior whole word knowledge into sub-words level attention. It aids Transformer to learn whole word level attention. To make our models applicable to complicated web search scenarios, we introduce combined fields representation to accommodate documents with multiple fields even with variable number of instances. We demonstrate GLOW is more efficient to capture the topical and semantic representation both in queries and documents. Intrinsic evaluation and experiments conducted on public data sets reveal GLOW to be a general framework for document retrieve task. It significantly outperforms BERT and other competitive baselines by a large margin while retaining the same model complexity with BERT.

cs.IR↗
arXiv2021

Contrastive Neural Architecture Search with Neural Architecture Comparators

One of the key steps in Neural Architecture Search (NAS) is to estimate the performance of candidate architectures. Existing methods either directly use the validation performance or learn a predictor to estimate the performance. However, these methods can be either computationally expensive or very inaccurate, which may severely affect the search efficiency and performance. Moreover, as it is very difficult to annotate architectures with accurate performance on specific tasks, learning a promising performance predictor is often non-trivial due to the lack of labeled data. In this paper, we argue that it may not be necessary to estimate the absolute performance for NAS. On the contrary, we may need only to understand whether an architecture is better than a baseline one. However, how to exploit this comparison information as the reward and how to well use the limited labeled data remains two great challenges. In this paper, we propose a novel Contrastive Neural Architecture Search (CTNAS) method which performs architecture search by taking the comparison results between architectures as the reward. Specifically, we design and learn a Neural Architecture Comparator (NAC) to compute the probability of candidate architectures being better than a baseline one. Moreover, we present a baseline updating scheme to improve the baseline iteratively in a curriculum learning manner. More critically, we theoretically show that learning NAC is equivalent to optimizing the ranking over architectures. Extensive experiments in three search spaces demonstrate the superiority of our CTNAS over existing methods.

cs.CV↗
arXiv2021

Pareto-Frontier-aware Neural Architecture Generation for Diverse Budgets

Designing feasible and effective architectures under diverse computation budgets incurred by different applications/devices is essential for deploying deep models in practice. Existing methods often perform an independent architecture search for each target budget, which is very inefficient yet unnecessary. Moreover, the repeated independent search manner would inevitably ignore the common knowledge among different search processes and hamper the search performance. To address these issues, we seek to train a general architecture generator that automatically produces effective architectures for an arbitrary budget merely via model inference. To this end, we propose a Pareto-Frontier-aware Neural Architecture Generator (NAG) which takes an arbitrary budget as input and produces the Pareto optimal architecture for the target budget. We train NAG by learning the Pareto frontier (i.e., the set of Pareto optimal architectures) over model performance and computational cost (e.g., latency). Extensive experiments on three platforms (i.e., mobile, CPU, and GPU) show the superiority of the proposed method over existing NAS methods.

cs.LG↗
arXiv2021

Towards Accurate and Compact Architectures via Neural Architecture Transformer

Designing effective architectures is one of the key factors behind the success of deep neural networks. Existing deep architectures are either manually designed or automatically searched by some Neural Architecture Search (NAS) methods. However, even a well-designed/searched architecture may still contain many nonsignificant or redundant modules/operations. Thus, it is necessary to optimize the operations inside an architecture to improve the performance without introducing extra computational cost. To this end, we have proposed a Neural Architecture Transformer (NAT) method which casts the optimization problem into a Markov Decision Process (MDP) and seeks to replace the redundant operations with more efficient operations, such as skip or null connection. Note that NAT only considers a small number of possible transitions and thus comes with a limited search/transition space. As a result, such a small search space may hamper the performance of architecture optimization. To address this issue, we propose a Neural Architecture Transformer++ (NAT++) method which further enlarges the set of candidate transitions to improve the performance of architecture optimization. Specifically, we present a two-level transition rule to obtain valid transitions, i.e., allowing operations to have more efficient types (e.g., convolution->separable convolution) or smaller kernel sizes (e.g., 5x5->3x3). Note that different operations may have different valid transitions. We further propose a Binary-Masked Softmax (BMSoftmax) layer to omit the possible invalid transitions. Extensive experiments on several benchmark datasets show that the transformed architecture significantly outperforms both its original counterpart and the architectures optimized by existing methods.

cs.CV↗
arXiv2021

StrokeGAN: Reducing Mode Collapse in Chinese Font Generation via Stroke Encoding

The generation of stylish Chinese fonts is an important problem involved in many applications. Most of existing generation methods are based on the deep generative models, particularly, the generative adversarial networks (GAN) based models. However, these deep generative models may suffer from the mode collapse issue, which significantly degrades the diversity and quality of generated results. In this paper, we introduce a one-bit stroke encoding to capture the key mode information of Chinese characters and then incorporate it into CycleGAN, a popular deep generative model for Chinese font generation. As a result we propose an efficient method called StrokeGAN, mainly motivated by the observation that the stroke encoding contains amount of mode information of Chinese characters. In order to reconstruct the one-bit stroke encoding of the associated generated characters, we introduce a stroke-encoding reconstruction loss imposed on the discriminator. Equipped with such one-bit stroke encoding and stroke-encoding reconstruction loss, the mode collapse issue of CycleGAN can be significantly alleviated, with an improved preservation of strokes and diversity of generated characters. The effectiveness of StrokeGAN is demonstrated by a series of generation tasks over nine datasets with different fonts. The numerical results demonstrate that StrokeGAN generally outperforms the state-of-the-art methods in terms of content and recognition accuracies, as well as certain stroke error, and also generates more realistic characters.

cs.CV↗
arXiv2021

On the $L^\infty$ stability of Prandtl expansions in Gevrey class

In this paper, we prove the $L^\infty\cap L^2$ stability of Prandtl expansions of shear flow type as $\big(U(y/\sqrtν),0\big)$ for the initial perturbation in the Gevrey class, where $U(y)$ is a monotone and concave function and $ν$ is the viscosity coefficient. To this end, we develop the direct resolvent estimate method for the linearized Orr-Sommerfeld operator instead of the Rayleigh-Airy iteration method introduced by Grenier, Guo and Nguyen.

math.AP↗
arXiv2020

Mid-infrared single photon detector with superconductor Mo$_{80}$Si$_{20}$ nanowire

A mid-infrared single photon detector (MIR-SNSPD) was reported based on 30 nm-wide superconductor molybdenum silicide nanowires in this work. Saturated quantum efficiencies (QEs) were achieved at the wavelength ranging from 1.55 to 5.07 micrometer in experiments. At the same time, the intrinsic dark count rate (DCR) was below 100 cps. Thus, this device produced a noise equivalent power (NEP) of 4.5 * 10-19 W/sqrt(Hz). The results provide the foundation of developing 10 micrometer-SNSPD for the applications of infrared astronomy observation.

physics.app-ph↗
arXiv2020

Multi-frequency Point Supported LLRF Front-end for CiADS Wide-bandwidth Application

The China initiative Accelerator Driven System, CiADS, physics design adopts $162.5 \,\mathrm{MHz}$, $325 \,\mathrm{MHz}$, and $650 \,\mathrm{MHz}$ cavities, which are driven by the corresponding radio frequency (RF) power system, requiring frequency translation front-end for the RF station. For that application, a general-purpose design front-end prototype has been developed to evaluate the multi-frequency point supported design feasibility. The difficult parts to achieve the requirements of the general-purpose design are reasonable device selection and balanced design. With a carefully selected low-noise wide-band RF mixer and amplifier to balance the performance of multi-frequency supported down-conversion, specially designed local oscillator (LO) distribution net to increase isolation between adjacent channels, and external band-pass filter to realize expected up-conversion frequencies, high maintenance and modular front-end general-purpose design has been implemented. Results of standard parameters show an $R^2$ value of at least $99.991\%$ in the range of $-60 \sim 10\,\mathrm{dBm}$ for linearity, up to $18\,\mathrm{dBm}$ for P1dB, and up to $89\,\mathrm{dBc}$ for crosstalk between adjacent channels. The phase noise spectrum is lower than $80\,\mathrm{dBc}$ in the range of $0 \sim 1\,\mathrm{MHz}$, and cumulative phase noise is $0.006^\circ$; amplitude and phase stability are $0.022\%$ and $0.034^\circ$, respectively.

physics.acc-ph↗
arXiv2020

Object as Hotspots: An Anchor-Free 3D Object Detection Approach via Firing of Hotspots

Accurate 3D object detection in LiDAR based point clouds suffers from the challenges of data sparsity and irregularities. Existing methods strive to organize the points regularly, e.g. voxelize, pass them through a designed 2D/3D neural network, and then define object-level anchors that predict offsets of 3D bounding boxes using collective evidences from all the points on the objects of interest. Contrary to the state-of-the-art anchor-based methods, based on the very nature of data sparsity, we observe that even points on an individual object part are informative about semantic information of the object. We thus argue in this paper for an approach opposite to existing methods using object-level anchors. Inspired by compositional models, which represent an object as parts and their spatial relations, we propose to represent an object as composition of its interior non-empty voxels, termed hotspots, and the spatial relations of hotspots. This gives rise to the representation of Object as Hotspots (OHS). Based on OHS, we further propose an anchor-free detection head with a novel ground truth assignment strategy that deals with inter-object point-sparsity imbalance to prevent the network from biasing towards objects with more points. Experimental results show that our proposed method works remarkably well on objects with a small number of points. Notably, our approach ranked 1st on KITTI 3D Detection Benchmark for cyclist and pedestrian detection, and achieved state-of-the-art performance on NuScenes 3D Detection Benchmark.

cs.CV↗
arXiv2020

CoFF: Cooperative Spatial Feature Fusion for 3D Object Detection on Autonomous Vehicles

To reduce the amount of transmitted data, feature map based fusion is recently proposed as a practical solution to cooperative 3D object detection by autonomous vehicles. The precision of object detection, however, may require significant improvement, especially for objects that are far away or occluded. To address this critical issue for the safety of autonomous vehicles and human beings, we propose a cooperative spatial feature fusion (CoFF) method for autonomous vehicles to effectively fuse feature maps for achieving a higher 3D object detection performance. Specially, CoFF differentiates weights among feature maps for a more guided fusion, based on how much new semantic information is provided by the received feature maps. It also enhances the inconspicuous features corresponding to far/occluded objects to improve their detection precision. Experimental results show that CoFF achieves a significant improvement in terms of both detection precision and effective detection range for autonomous vehicles, compared to previous feature fusion solutions.

cs.CV↗
arXiv2020

Recurrence Quantification Analysis of Dynamic Brain Networks

Evidence suggests that brain network dynamics is a key determinant of brain function and dysfunction. Here we propose a new framework to assess the dynamics of brain networks based on recurrence analysis. Our framework uses recurrence plots and recurrence quantification analysis to characterize dynamic networks. For resting-state magnetoencephalographic dynamic functional networks (dFNs), we have found that functional networks recur more quickly in people with epilepsy than healthy controls. This suggests that recurrence of dFNs may be used as a biomarker of epilepsy. For stereo electroencephalography data, we have found that dFNs involved in epileptic seizures emerge before seizure onset, and recurrence analysis allows us to detect seizures. We further observe distinct dFNs before and after seizures, which may inform neurostimulation strategies to prevent seizures. Our framework can also be used for understanding dFNs in healthy brain function and in other neurological disorders besides epilepsy.

q-bio.NC↗
arXiv2020

Inertia and feedback parameters adaptive control of virtual synchronous generator

The virtual synchronous generator technology analogs the characteristics of the synchronous generator via the controller design. It improved the stability of the grid systems which include the new energy. At the same time, according to the adjustable characteristics of the virtual synchronous generator parameters, the parameter adaptive adjustment is used to improve the dynamic performance of the system. However, the traditional virtual synchronous generator adaptive control technology still has two drawbacks: on the one hand, the large-scale adjustment of the damping droop coefficient and the virtual moment of inertia requires the system having a high energy storage margin; On the other hand, there is a power overshoot phenomenon in the transient regulation process, which is disadvantageous to the power equipment. First, this paper provides a convenient adjustment method for improving the transient stability of the system, the system damping is adjusted by introducing the output speed feedback. Second, according to the transient power-angle characteristics of the system, a parameter adaptive control strategy is proposed, which shortens the transient adjustment time and ensures that the deviation of the system frequency in the transient adjustment process is within the allowable range, and improves the transient performance of the grid frequency adjustment, at the same time, the power overshoot is suppressed. Finally, the experimental results show that the proposed control strategy is superior to the existing adaptive control strategy.

eess.SY↗
arXiv2020

Beyond $\mathcal{H}$-Divergence: Domain Adaptation Theory With Jensen-Shannon Divergence

We reveal the incoherence between the widely-adopted empirical domain adversarial training and its generally-assumed theoretical counterpart based on $\mathcal{H}$-divergence. Concretely, we find that $\mathcal{H}$-divergence is not equivalent to Jensen-Shannon divergence, the optimization objective in domain adversarial training. To this end, we establish a new theoretical framework by directly proving the upper and lower target risk bounds based on joint distributional Jensen-Shannon divergence. We further derive bi-directional upper bounds for marginal and conditional shifts. Our framework exhibits inherent flexibilities for different transfer learning problems, which is usable for various scenarios where $\mathcal{H}$-divergence-based theory fails to adapt. From an algorithmic perspective, our theory enables a generic guideline unifying principles of semantic conditional matching, feature marginal matching, and label marginal shift correction. We employ algorithms for each principle and empirically validate the benefits of our framework on real datasets.

cs.LG↗
arXiv2020

DCANet: Learning Connected Attentions for Convolutional Neural Networks

While self-attention mechanism has shown promising results for many vision tasks, it only considers the current features at a time. We show that such a manner cannot take full advantage of the attention mechanism. In this paper, we present Deep Connected Attention Network (DCANet), a novel design that boosts attention modules in a CNN model without any modification of the internal structure. To achieve this, we interconnect adjacent attention blocks, making information flow among attention blocks possible. With DCANet, all attention blocks in a CNN model are trained jointly, which improves the ability of attention learning. Our DCANet is generic. It is not limited to a specific attention module or base network architecture. Experimental results on ImageNet and MS COCO benchmarks show that DCANet consistently outperforms the state-of-the-art attention modules with a minimal additional computational overhead in all test cases. All code and models are made publicly available.

cs.CV↗
arXiv2020

Floquet engineering the Hofstadter butterfly in the square lattice and its effective Hamiltonian

In this paper, we use Floquet theory to theoretically study the effect of monochromatic circularly and linearly polarized light on the Hofstadter butterfly in the square lattice, which is induced by uniform perpendicular magnetic field. In the absence of laser, the butterfly has a fractal, self-similar structure particle-hole symmetry and reflection symmetry about magnetic flux $ϕ= 1/2$. These symmetries are preserved by the sub-lattice and the time-reversal symmetry, respectively. As the system is exposed to circularly polarized light, the original Hofsatdter butterfly in equilibrium is deformed by breaking both the particle-hole symmetry and the mirror symmetry, while the inversion symmetry about energy $E=0$ and magnetic flux $ϕ=1/2$ is preserved. Our study show that, the circularly polarized light break both the sub-lattice symmetry and the time-reversal symmetry. The inversion symmetry is preserved because the Hamiltonian at magnetic flux $ϕ$ and $1-ϕ$ is connected through the sub-lattice transformation. Focusing on the small flux region, we study the Landau level and the influence of circularly polarized light on the Landau level. On the contrary, the linearly polarized light deforms the original Hofstadter butterfly by breaking the rotational symmetry while preserving sub-lattice and the time-reversal symmetry. Further, we study the influence of the periodic drive on the Chern number of the lowest band in middle Floquet copy within the off-resonance regime. We found strong circularly polarized light will change the Chern number. For linearly polarized light, the Chern number will not change and the values stay independent of laser polarization direction. Our work highlights the generic features expected for the periodically driven Hofstadter problem on square lattice and provide the strategy to engineering the Hofstadter butterfly with laser.

cond-mat.mes-hall↗
arXiv2020

Transition threshold for the 3D Couette flow in a finite channel

In this paper, we study nonlinear stability of the 3D plane Couette flow $(y,0,0)$ at high Reynolds number ${Re}$ in a finite channel $\mathbb{T}\times [-1,1]\times \mathbb{T}$. It is well known that the plane Couette flow is linearly stable for any Reynolds number. However, it could become nonlinearly unstable and transition to turbulence for small but finite perturbations at high Reynolds number. This is so-called Sommerfeld paradox. One resolution of this paradox is to study the transition threshold problem, which is concerned with how much disturbance will lead to the instability of the flow and the dependence of disturbance on the Reynolds number. This work shows that if the initial velocity $v_0$ satisfies $\|v_0-(y,0,0)\|_{H^2}\le c_0{Re}^{-1}$ for some $c_0>0$ independent of $Re$, then the solution of the 3D Navier-Stokes equations is global in time and does not transition away from the Couette flow in the $L^\infty$ sense, and rapidly converges to a streak solution for $t\gg Re^{\frac 13}$ due to the mixing-enhanced dissipation effect. This result confirms the transition threshold conjecture proposed by Trefethen et al.(Science, 261(1993), 578-584). To this end, we develop the resolvent estimate method to establish the space-time estimates for the full linearized Navier-Stokes system around the flow $(V(t,y,z), 0,0)$, where $V(t,y,z)$ is a small perturbation(but independent of $Re$) of the Couette flow $y$.

math.AP↗