arXiv Science⌕ Search

arXiv subjects

Wei Huang

Publications and source records attributed to Wei Huang.

At least 397 records · Page 22Linked to original sources

Efficient sorting of orbital-angular-momentum states with large topological charges and their unknown superpositions via machine learning

Light beams carrying orbital-angular-momentum (OAM) play an important role in optical manipulation and communication owing to their unbounded state space. However, it is still challenging to efficiently discriminate OAM modes with large topological charges and thus only a small part of the OAM states have been usually used. Here we demonstrate that neural networks can be trained to sort OAM modes with large topological charges and unknown superpositions. Using intensity images of OAM modes generalized in simulations and experiments as the input data, we illustrate that our neural network has great generalization power to recognize OAM modes of large topological charges beyond training areas with high accuracy. Moreover, the trained neural network can correctly classify and predict arbitrary superpositions of two OAM modes with random topological charges. Our machine learning approach only requires a small portion of experimental samples and significantly reduces the cost in experiments, which paves the way to study the OAM physics and increase the state space of OAM beams in practical applications.

physics.optics↗

Coverage Guided Testing for Recurrent Neural Networks

Recurrent neural networks (RNNs) have been applied to a broad range of applications, including natural language processing, drug discovery, and video recognition. Their vulnerability to input perturbation is also known. Aligning with a view from software defect detection, this paper aims to develop a coverage guided testing approach to systematically exploit the internal behaviour of RNNs, with the expectation that such testing can detect defects with high possibility. Technically, the long short term memory network (LSTM), a major class of RNNs, is thoroughly studied. A family of three test metrics are designed to quantify not only the values but also the temporal relations (including both step-wise and bounded-length) exhibited when LSTM processing inputs. A genetic algorithm is applied to efficiently generate test cases. The test metrics and test case generation algorithm are implemented into a tool TestRNN, which is then evaluated on a set of LSTM benchmarks. Experiments confirm that TestRNN has advantages over the state-of-art tool DeepStellar and attack-based defect detection methods, owing to its working with finer temporal semantics and the consideration of the naturalness of input perturbation. Furthermore, TestRNN enables meaningful information to be collected and exhibited for users to understand the testing results, which is an important step towards interpretable neural network testing.

cs.LG↗

Conformer: Local Features Coupling Global Representations for Visual Recognition

Within Convolutional Neural Network (CNN), the convolution operations are good at extracting local features but experience difficulty to capture global representations. Within visual transformer, the cascaded self-attention modules can capture long-distance feature dependencies but unfortunately deteriorate local feature details. In this paper, we propose a hybrid network structure, termed Conformer, to take advantage of convolutional operations and self-attention mechanisms for enhanced representation learning. Conformer roots in the Feature Coupling Unit (FCU), which fuses local features and global representations under different resolutions in an interactive fashion. Conformer adopts a concurrent structure so that local features and global representations are retained to the maximum extent. Experiments show that Conformer, under the comparable parameter complexity, outperforms the visual transformer (DeiT-B) by 2.3% on ImageNet. On MSCOCO, it outperforms ResNet-101 by 3.7% and 3.6% mAPs for object detection and instance segmentation, respectively, demonstrating the great potential to be a general backbone network. Code is available at https://github.com/pengzhiliang/Conformer.

cs.CV↗

Adiabatic following of terahertz surface plasmon-polaritons coupler via two waveguides structure

Most recently, two remarkable papers [New J. Phys. 21, 113004 (2019); IEEE J. Sel. Top. Quantum Electron 27, 1 (2020)] propose broadband complete transfer terahertz (THz) surface plasmon polaritons (SPPs) waveguide coupler by applying coherent quantum control -- Stimulated Raman adiabatic passage (STIRAP). However, previous researches request three SPPs waveguides coupler. In this paper, we propose a new design of a broadband complete transfer THz SPPs coupler with an innovative structure of two waveguides by employing two state adiabatic following. In order to realize this design, we introduce the detuning parameter into the coupling equation of SPPs waveguides for the first time. We believe that this finding will improve the THz communication domain.

physics.optics↗

PD-GAN: Probabilistic Diverse GAN for Image Inpainting

We propose PD-GAN, a probabilistic diverse GAN for image inpainting. Given an input image with arbitrary hole regions, PD-GAN produces multiple inpainting results with diverse and visually realistic content. Our PD-GAN is built upon a vanilla GAN which generates images based on random noise. During image generation, we modulate deep features of input random noise from coarse-to-fine by injecting an initially restored image and the hole regions in multiple scales. We argue that during hole filling, the pixels near the hole boundary should be more deterministic (i.e., with higher probability trusting the context and initially restored image to create natural inpainting boundary), while those pixels lie in the center of the hole should enjoy more degrees of freedom (i.e., more likely to depend on the random noise for enhancing diversity). To this end, we propose spatially probabilistic diversity normalization (SPDNorm) inside the modulation to model the probability of generating a pixel conditioned on the context information. SPDNorm dynamically balances the realism and diversity inside the hole region, making the generated content more diverse towards the hole center and resemble neighboring image content more towards the hole boundary. Meanwhile, we propose a perceptual diversity loss to further empower PD-GAN for diverse content generation. Experiments on benchmark datasets including CelebA-HQ, Places2 and Paris Street View indicate that PD-GAN is effective for diverse and visually realistic image restoration.

cs.CV↗

Universal coupled theory for metamaterial Bound states in the continuum

In this paper, we present a novel universal coupled theory for metamaterial Bound states in the continuum (BIC) or quasi-Bound states in the continuum (quasi-BIC) which provides ultra-high Q resonance for metamaterial devices. Our theory analytically calculates the coupling of two bright modes with phase. Our method has much more accuracy for ultra-strong coupling comparing with the previous theory (the coupling of one bright mode and one dark mode). Therefore, our theory is much more suitable for BIC or quasi-BIC and we can accurately predict the transmission spectrum of metamaterial BIC or quasi-BIC for the first time.

physics.optics↗

Detecting Operational Adversarial Examples for Reliable Deep Learning

The utilisation of Deep Learning (DL) raises new challenges regarding its dependability in critical applications. Sound verification and validation methods are needed to assure the safe and reliable use of DL. However, state-of-the-art debug testing methods on DL that aim at detecting adversarial examples (AEs) ignore the operational profile, which statistically depicts the software's future operational use. This may lead to very modest effectiveness on improving the software's delivered reliability, as the testing budget is likely to be wasted on detecting AEs that are unrealistic or encountered very rarely in real-life operation. In this paper, we first present the novel notion of "operational AEs" which are AEs that have relatively high chance to be seen in future operation. Then an initial design of a new DL testing method to efficiently detect "operational AEs" is provided, as well as some insights on our prospective research plan.

cs.SE↗

DeFLOCNet: Deep Image Editing via Flexible Low-level Controls

User-intended visual content fills the hole regions of an input image in the image editing scenario. The coarse low-level inputs, which typically consist of sparse sketch lines and color dots, convey user intentions for content creation (\ie, free-form editing). While existing methods combine an input image and these low-level controls for CNN inputs, the corresponding feature representations are not sufficient to convey user intentions, leading to unfaithfully generated content. In this paper, we propose DeFLOCNet which relies on a deep encoder-decoder CNN to retain the guidance of these controls in the deep feature representations. In each skip-connection layer, we design a structure generation block. Instead of attaching low-level controls to an input image, we inject these controls directly into each structure generation block for sketch line refinement and color propagation in the CNN feature space. We then concatenate the modulated features with the original decoder features for structure generation. Meanwhile, DeFLOCNet involves another decoder branch for texture generation and detail enhancement. Both structures and textures are rendered in the decoder, leading to user-intended editing results. Experiments on benchmarks demonstrate that DeFLOCNet effectively transforms different user intentions to create visually pleasing content.

cs.CV↗

Efficiency at maximum power of thermoelectric heat engines with the symmetric semiconductor superlattice

Efficiency at maximum power (EMP) is a very important specification for a heat engine to evaluate the capacity of outputting adequate power with high efficiency. It has been proved theoretically that the limit EMP of thermoelectric heat engine can be achieved with the hypothetical boxcar-shaped electron transmission, which is realized here by the resonant tunneling in the one-dimensional symmetric InP/InSe superlattice. It is found with the transfer matrix method that a symmetric mode is robust that regardless of the periodicity, and the obtained boxcar-like electron transmission stems from the strong coupling between symmetric mode and Fabry-Pérot modes inside the allowed band. High uniformity of the boxcar-like transmission and the sharp drop of the transmission edge are both beneficial to the maximum power and the EMP, which are optimized by the bias voltage and the thicknesses of barrier and well. The maximum power and EMP are extracted with the help of machine learning technique, and more than 95% of their theoretical limits can both be achieved for smaller temperature difference, smaller barrier width and larger well width. We hope the obtain results could provide some basic guidance for the future designs of high EMP thermoelectric heat engines.

cond-mat.mes-hall↗

Machine learning topological invariants of non-Hermitian systems

The study of topological properties by machine learning approaches has attracted considerable interest recently. Here we propose machine learning the topological invariants that are unique in non-Hermitian systems. Specifically, we train neural networks to predict the winding of eigenvalues of four prototypical non-Hermitian Hamiltonians on the complex energy plane with nearly $100\%$ accuracy. Our demonstrations in the non-Hermitian Hatano-Nelson model, Su-Schrieffer-Heeger model and generalized Aubry-André-Harper model in one dimension, and two-dimensional Dirac fermion model with non-Hermitian terms show the capability of the neural networks in exploring topological invariants and the associated topological phase transitions and topological phase diagrams in non-Hermitian systems. Moreover, the neural networks trained by a small data set in the phase diagram can successfully predict topological invariants in untouched phase regions. Thus, our work paves the way to revealing non-Hermitian topology with the machine learning toolbox.

physics.comp-ph↗

Broadband terahertz half-wave plate with multi-layers metamaterial via quantum engineering

In this paper, we employ the novel design of the metamaterial half-wave plate by using the multiple layers of the metamaterials with some specific rotation angles. The rotation angles are given by composite pulse control which is the well-known quantum control technique. A big advantage of this method can analytically calculate the rotation angles and can be easily extended to the multiple layers. The more layers of the metamaterials can present more bandwidth of half-wave plate. In this paper, we present 1, 3, 5, 7 configurations of layers of a metamaterial half-wave plate and we demonstrate that our device increasingly enhance the bandwidth of performance.

physics.optics↗

Electronic controllable broadband and robust terahertz surface plasmon-polaritons switch based on hybrid ITO waveguide coupler

The surface plasmon-polaritons (SPPs) switch is the key element of the integrated devices in optical computation and terahertz (THz) communications. In this paper, we propose a novel design of THz SPPs switch based on quantum engineering. Due to the robustness of coherent quantum control technique, our switch is very robust against with perturbations of geometrical parameters and presents a good performance at on-state (and off-state) from 0.5 THz to 0.7 THz. The on-state and off-state of our device can be controlled by the external voltage. We believe this finding will be the great improvement for the integrated optical computing and THz communications.

physics.optics↗

Fairness and Accuracy in Federated Learning

In the federated learning setting, multiple clients jointly train a model under the coordination of the central server, while the training data is kept on the client to ensure privacy. Normally, inconsistent distribution of data across different devices in a federated network and limited communication bandwidth between end devices impose both statistical heterogeneity and expensive communication as major challenges for federated learning. This paper proposes an algorithm to achieve more fairness and accuracy in federated learning (FedFa). It introduces an optimization scheme that employs a double momentum gradient, thereby accelerating the convergence rate of the model. An appropriate weight selection algorithm that combines the information quantity of training accuracy and training frequency to measure the weights is proposed. This procedure assists in addressing the issue of unfairness in federated learning due to preferences for certain clients. Our results show that the proposed FedFa algorithm outperforms the baseline algorithm in terms of accuracy and fairness.

cs.LG↗

Implicit bias of deep linear networks in the large learning rate phase

Most theoretical studies explaining the regularization effect in deep learning have only focused on gradient descent with a sufficient small learning rate or even gradient flow (infinitesimal learning rate). Such researches, however, have neglected a reasonably large learning rate applied in most practical applications. In this work, we characterize the implicit bias effect of deep linear networks for binary classification using the logistic loss in the large learning rate regime, inspired by the seminal work by Lewkowycz et al. [26] in a regression setting with squared loss. They found a learning rate regime with a large stepsize named the catapult phase, where the loss grows at the early stage of training and eventually converges to a minimum that is flatter than those found in the small learning rate regime. We claim that depending on the separation conditions of data, the gradient descent iterates will converge to a flatter minimum in the catapult phase. We rigorously prove this claim under the assumption of degenerate data by overcoming the difficulty of the non-constant Hessian of logistic loss and further characterize the behavior of loss and Hessian for non-separable data. Finally, we demonstrate that flatter minima in the space spanned by non-separable data along with the learning rate in the catapult phase can lead to better generalization empirically.

cs.LG↗

Twin-field quantum key distribution with passive-decoy state

Twin-Field quantum key distribution (TF-QKD) and its variants, e.g. Phase-Matching QKD, Sending-or-not-sending QKD, and No Phase Post-Selection TFQKD promise high key rates at long distance to beat the rate distance limit without a repeater. The security proof of these protocols are based on decoy-state method, which is usually performed by actively modulating a variable optical attenuator together with a random number generator in practical experiments, however, active-decoy schemes like this may lead to side channel and could open a security loophole. To enhance the source security of TF-QKD, in this paper, we propose passive-decoy based TF-QKD, in which we combine TF-QKD with the passive-decoy method. And we present a simulation comparing the key generation rate with that in active-decoy, the result shows our scheme performs as good as active decoy TF-QKD, and our scheme could reach satisfactory secret key rates with just a few photon detectors. This shows our work is meaningful in practice.

quant-ph↗

Optimized protocol for twin-field quantum key distribution

Twin-field quantum key distribution (TF-QKD) and its variant protocols are highly attractive due to the advantage of overcoming the rate-loss limit for secret key rates of point-to-point QKD protocols. For variations of TF-QKD, the key point to ensure security is switching randomly between a code mode and a test mode. Among all TF-QKD protocols, their code modes are very different, e.g. modulating continuous phases, modulating only two opposite phases, and sending or not sending signal pulses. Here we show that, by discretizing the number of global phases in the code mode, we can give a unified view on the first two types of TF-QKD protocols, and demonstrate that increasing the number of discrete phases extends the achievable distance, and as a trade-off, lowers the secret key rate at short distances due to the phase post-selection.

quant-ph↗

Randomness Quantification for Quantum Random Number Generation Based on Detection of Amplified Spontaneous Emission Noise

The amplified spontaneous emission (ASE) noise has been extensively studied and employed to build quantum random number generators (QRNGs). While the previous relative works mainly focus on the realization and verification of the QRNG system, the comprehensive physical model and randomness quantification for the general detection of the ASE noise are still incomplete, which is essential for the quantitative security analysis. In this paper, a systematical physical model for the emission, detection and acquisition of the ASE noise with added electronic noise is developed and verified, based on which the numerical simulations are performed under various setups and the simulation results all significantly fit well with the corresponding experimental data. Then, a randomness quantification method and the corresponding experimentally verifiable approach are proposed and validated, which quantifies the randomness purely resulted from the quantum process and improves the security analysis for the QRNG based on the detection of the ASE noise. The physical model and the randomness quantification method proposed in this paper are of significant feasibility and applicable for the QRNG system with randomness originating from the detection of the photon number with arbitrary distributions.

quant-ph↗

High-speed Gaussian modulated continuous-variable quantum key distribution with a local local oscillator based on pilot-tone-assisted phase compensation

A high-speed Gaussian modulated continuous-variable quantum key distribution (CVQKD) with a local local oscillator (LLO) is experimentally demonstrated based on pilot-tone-assisted phase compensation. In the proposed scheme, the frequency-multiplexing and polarization-multiplexing techniques are used for the separate transmission and heterodyne detection between quantum signal and pilot tone, guaranteeing no crosstalk from strong pilot tone to weak quantum signal and different detection requirements of low-noise for quantum signal and high-saturation limitation for pilot tone. Moreover, compared with the conventional CVQKD based on homodyne detection, the proposed LLO-CVQKD scheme can measure X and P quadrature simultaneously using heterodyne detection without need of extra random basis selection. Besides, the phase noise, which contains the fast-drift phase noise due to the relative phase of two independent lasers and the slow-drift phase noise introduced by quantum channel disturbance, has been compensated experimentally in real time, so that a low level of excess noise with a 25km optical fiber channel is obtained for the achievable secure key rate of 7.04 Mbps in the asymptotic regime and 1.85 Mbps under the finite-size block of 10^7.

quant-ph↗