arXiv subjects

Qiang Wang

Publications and source records attributed to Qiang Wang.

At least 289 records · Page 16Linked to original sources

arXiv2020

Observation of Protected Photonic Edge States Induced By Real-Space Topological Lattice Defects

Topological defects (TDs) in crystal lattices are elementary lattice imperfections that cannot be removed by local perturbations, due to their real space topology. We show that adding TDs into a valley photonic crystal generates a lattice disclination that acts like a domain wall and hosts topological edge states. The disclination functions as a freeform waveguide connecting a pair of TDs of opposite topological charge. This interplay between the real-space topology of lattice defects and band topology provides a novel scheme to implement large-scale photonic structures with complex arrangements of robust topological waveguides and resonators.

cond-mat.mes-hall↗

arXiv2019

Adversarial AutoAugment

Data augmentation (DA) has been widely utilized to improve generalization in training deep neural networks. Recently, human-designed data augmentation has been gradually replaced by automatically learned augmentation policy. Through finding the best policy in well-designed search space of data augmentation, AutoAugment can significantly improve validation accuracy on image classification tasks. However, this approach is not computationally practical for large-scale problems. In this paper, we develop an adversarial method to arrive at a computationally-affordable solution called Adversarial AutoAugment, which can simultaneously optimize target related object and augmentation policy search loss. The augmentation policy network attempts to increase the training loss of a target network through generating adversarial augmentation policies, while the target network can learn more robust features from harder examples to improve the generalization. In contrast to prior work, we reuse the computation in target network training for policy evaluation, and dispense with the retraining of the target network. Compared to AutoAugment, this leads to about 12x reduction in computing cost and 11x shortening in time overhead on ImageNet. We show experimental results of our approach on CIFAR-10/CIFAR-100, ImageNet, and demonstrate significant performance improvements over state-of-the-art. On CIFAR-10, we achieve a top-1 test error of 1.36%, which is the currently best performing single model. On ImageNet, we achieve a leading performance of top-1 accuracy 79.40% on ResNet-50 and 80.00% on ResNet-50-D without extra data.

cs.CV↗

arXiv2019

BETANAS: BalancEd TrAining and selective drop for Neural Architecture Search

Automatic neural architecture search techniques are becoming increasingly important in machine learning area. Especially, weight sharing methods have shown remarkable potentials on searching good network architectures with few computational resources. However, existing weight sharing methods mainly suffer limitations on searching strategies: these methods either uniformly train all network paths to convergence which introduces conflicts between branches and wastes a large amount of computation on unpromising candidates, or selectively train branches with different frequency which leads to unfair evaluation and comparison among paths. To address these issues, we propose a novel neural architecture search method with balanced training strategy to ensure fair comparisons and a selective drop mechanism to reduce conflicts among candidate paths. The experimental results show that our proposed method can achieve a leading performance of 79.0% on ImageNet under mobile settings, which outperforms other state-of-the-art methods in both accuracy and efficiency.

cs.CV↗

arXiv2019

Exceptional Cones in 4D Parameter Space

The notion of synthetic dimensions has expanded the realm of topological physics to four dimensional (4D) space lately. In this work, non-Hermiticity is used as a synthetic parameter in PT-symmetric photonic crystals to study the topological physics in 4D non-Hermitian synthetic parameter space. We realize a 3D exceptional hypersurface (EHS) in such 4D parameter space, and the degeneracy points emerge due to the symmetry of synthetic parameters. We further demonstrate the existence of exceptional degenerate points (EDPs) on the EHS that originates from the chirality of exceptional points (EPs), and the exceptional surface near EDPs behaves like a Dirac cone. We further show that a very narrow reflection plateau can be found near these EDPs, and their sensitivity towards the PT-symmetry breaking environmental perturbation can make these degeneracy points useful in optical sensing and many other nonlinear and quantum optical applications.

physics.optics↗

arXiv2019

Non-Hermitian Dirac Cones

Non-Hermitian systems, which contain gain or loss, commonly host exceptional point degeneracies rather than the diabolic points found in Hermitian systems. We present a class of non-Hermitian lattice models with symmetry-stabilized diabolic points, such as Dirac or Weyl points. They exhibit non-Hermiticity-induced phenomena previously existing in the Hermitian regime, including topological phase transitions, Landau levels induced by pseudo-magnetic fields, and Fermi arc surface states. These behaviors are controllable via gain and loss, with promising applications in tunable active topological devices.

cond-mat.mes-hall↗

arXiv2019

Realization of Photonic Charge-2 Dirac Point by Engineering Super-modes in Topological Superlattices

Quite recently a novel variety of unconventional fourfold linear band degeneracy points has been discovered in certain condensed-matter systems. Contrary to the standard 3-D Dirac monopoles, these quadruple points referred to as the charge-2 Dirac points are characterized by nonzero net topological charges, which can be exploited to delve into hitherto unknown realms of topological physics. Here, we report on the experimental realization of the charge-2 Dirac point by deliberately engineering hybrid topological states called super-modes in a 1-D optical superlattice system with two additional synthetic dimensions. Utilizing direct reflection and transmission measurements, we exhibit the existence of super-modes attributed to the synthetic charge-2 Dirac point, which has been achieved in the visible region for the first time. We also show the experimental approach to manipulating two spawned Weyl points that are identically charged in synthetic space. Moreover, topological end modes uniquely resulting from the charge-2 Dirac point can be delicately controlled within truncated superlattice samples, opening a pathway for us to rationally engineer local fields with intense enhancement.

physics.optics↗

arXiv2019

Anchor Diffusion for Unsupervised Video Object Segmentation

Unsupervised video object segmentation has often been tackled by methods based on recurrent neural networks and optical flow. Despite their complexity, these kinds of approaches tend to favour short-term temporal dependencies and are thus prone to accumulating inaccuracies, which cause drift over time. Moreover, simple (static) image segmentation models, alone, can perform competitively against these methods, which further suggests that the way temporal dependencies are modelled should be reconsidered. Motivated by these observations, in this paper we explore simple yet effective strategies to model long-term temporal dependencies. Inspired by the non-local operators of [70], we introduce a technique to establish dense correspondences between pixel embeddings of a reference "anchor" frame and the current one. This allows the learning of pairwise dependencies at arbitrarily long distances without conditioning on intermediate frames. Without online supervision, our approach can suppress the background and precisely segment the foreground object even in challenging scenarios, while maintaining consistent performance over time. With a mean IoU of $81.7\%$, our method ranks first on the DAVIS-2016 leaderboard of unsupervised methods, while still being competitive against state-of-the-art online semi-supervised approaches. We further evaluate our method on the FBMS dataset and the ViSal video saliency dataset, showing results competitive with the state of the art.

cs.CV↗

arXiv2019

Controlling Thermal Emission by Parity-symmetric Fano Resonance of Optical Absorbers in Metasurfaces

In this study, we designed a metasurface based on Al/SiN/Al nano-sandwich optical absorbers. Parity-symmetric dark magnetic resonance modes, anti-symmetric bright magnetic resonance modes, and surface lattice modes are established simultaneously in such a meta-surface. By changing the structural parameters, the wavelength of the dark mode can be tuned to overlap with the lattice mode. Fano resonance is introduced by coupling between the dark and lattice modes. Angular-resolved thermal emission experiments showed that the thermal emission induced by Fano resonance exhibited a narrow wavelength spectrum and directional radiation angle. Fano-type thermal emitters proposed in this work can possibly be used as coherent infrared light sources in the future.

physics.optics↗

arXiv2019

Learning Deep Transformer Models for Machine Translation

Transformer is the state-of-the-art model in recent machine translation evaluations. Two strands of research are promising to improve models of this kind: the first uses wide networks (a.k.a. Transformer-Big) and has been the de facto standard for the development of the Transformer system, and the other uses deeper language representation but faces the difficulty arising from learning deep networks. Here, we continue the line of research on the latter. We claim that a truly deep Transformer model can surpass the Transformer-Big counterpart by 1) proper use of layer normalization and 2) a novel way of passing the combination of previous layers to the next. On WMT'16 English- German, NIST OpenMT'12 Chinese-English and larger WMT'18 Chinese-English tasks, our deep system (30/25-layer encoder) outperforms the shallow Transformer-Big/Base baseline (6-layer encoder) by 0.4-2.4 BLEU points. As another bonus, the deep model is 1.6X smaller in size and 3X faster in training than Transformer-Big.

cs.CL↗

arXiv2019

The Impact of GPU DVFS on the Energy and Performance of Deep Learning: an Empirical Study

Over the past years, great progress has been made in improving the computing power of general-purpose graphics processing units (GPGPUs), which facilitates the prosperity of deep neural networks (DNNs) in multiple fields like computer vision and natural language processing. A typical DNN training process repeatedly updates tens of millions of parameters, which not only requires huge computing resources but also consumes significant energy. In order to train DNNs in a more energy-efficient way, we empirically investigate the impact of GPU Dynamic Voltage and Frequency Scaling (DVFS) on the energy consumption and performance of deep learning. Our experiments cover a wide range of GPU architectures, DVFS settings, and DNN configurations. We observe that, compared to the default core frequency settings of three tested GPUs, the optimal core frequency can help conserve 8.7%$\sim$23.1% energy consumption for different DNN training cases. Regarding the inference, the benefits vary from 19.6%$\sim$26.4%. Our findings suggest that GPU DVFS has great potentials to help develop energy efficient DNN training/inference schemes.

cs.PF↗

arXiv2019

Effective Spin-2 Quasi-particles at Linear Dispersive Five-fold Degenerate Points with Tunable Topological Chern Numbers

In this work, which is based on spin-2 vectors and traceless spin-2 tensors, an effective Hamiltonian is constructed with a linearly dispersive five-fold degenerate point with spin-2 vector-momentum couplings. For the model without spin-2 vector-tensor coupling, the topological Chern numbers of five bands are calculated as 4, 2, 0, -2, -4. After including spin-2 vector-tensor coupling, separate topological Chern numbers are obtained for different couplings. A cubic lattice of atoms with five internal states is designed to realize two five-fold degenerate points. The Chern numbers of the bands can be changed by tuning the coupling coefficient. In this work we propose a theoretical design to obtain spin-2 quasi-particles.

cond-mat.quant-gas↗

arXiv2019

Construction of irreducible polynomials through rational transformations

Let $\mathbb F_q$ be the finite field with $q$ elements, where $q$ is a power of a prime. We discuss recursive methods for constructing irreducible polynomials over $\mathbb F_q$ of high degree using rational transformations. In particular, given a divisor $D>2$ of $q+1$ and an irreducible polynomial $f\in \mathbb F_{q}[x]$ of degree $n$ such that $n$ is even or $D\not \equiv 2\pmod 4$, we show how to obtain from $f$ a sequence $\{f_i\}_{i\ge 0}$ of irreducible polynomials over $\mathbb F_q$ with $\mathrm{deg}(f_i)=n\cdot D^{i}$.

math.NT↗

arXiv2019

Fast Online Object Tracking and Segmentation: A Unifying Approach

In this paper we illustrate how to perform both visual object tracking and semi-supervised video object segmentation, in real-time, with a single simple approach. Our method, dubbed SiamMask, improves the offline training procedure of popular fully-convolutional Siamese approaches for object tracking by augmenting their loss with a binary segmentation task. Once trained, SiamMask solely relies on a single bounding box initialisation and operates online, producing class-agnostic object segmentation masks and rotated bounding boxes at 55 frames per second. Despite its simplicity, versatility and fast speed, our strategy allows us to establish a new state of the art among real-time trackers on VOT-2018, while at the same time demonstrating competitive performance and the best speed for the semi-supervised video object segmentation task on DAVIS-2016 and DAVIS-2017. The project website is http://www.robots.ox.ac.uk/~qwang/SiamMask.

cs.CV↗

arXiv2019

Efficient Electrocatalytic Reduction of CO2 by Nitrogen-Doped Nanoporous Carbon-Carbon Nanotube Membranes - A Step Towards the Electrochemical CO2 Refinery

The search for earth abundant, efficient and stable electrocatalysts that can enable the chemical reduction of CO2 to value-added chemicals and fuels at an industrially relevant scale, is a high priority for the development of a global network of renewable energy conversion and storage systems that can meaningfully impact greenhouse gas induced climate change. Here we introduce a straightforward, low cost, scalable and technologically relevant method to manufacture an all-carbon, electroactive, nitrogen-doped nanoporous carbon-carbon nanotube composite membrane, dubbed "HNCM-CNT". The membrane is demonstrated to function as a binder-free, high-performance electrode for the electrocatalytic reduction of CO2 to formate. The Faradaic efficiency for the production of formate is 81%. Furthermore, the robust structural and electrochemical properties of the membrane endow it with excellent long-term stability.

physics.chem-ph↗

arXiv2019

Ambient Electro-Synthesis of Ammonia - Electrode Porosity and Composition Engineering

Ammonia, key precursor for fertilizer production, convenient hydrogen carrier and emerging clean fuel, plays a pivotal role in sustaining life on earth. Currently, the main route for NH3 synthesis is via the heterogeneous catalytic Haber-Bosch process (N2+3H2 - 2NH3), which proceeds under extreme conditions of temperature and pressure with a very large carbon footprint. Herein we report that a pristine nitrogen-doped nanoporous graphitic carbon membrane (NCM) can electrochemically convert N2 into NH3 in an aqueous acidic solution under ambient conditions. The Faradaic efficiency and rate of production of NH3 on the NCM electrode reach 5.2% and 0.08 g m-2 h-1, respectively. After functionalization of the NCM with Au nanoparticles (Au NPs) these performance metrics are dramatically enhanced to 22% and 0.36 g m-2 h-1, respectively. These efficiencies and rates for the production of NH3 at room temperature and atmospheric pressure are unprecedented. As this system offers the potential to be scaled to industrial proportions there is a high likelihood it might displace the century old Haber-Bosch process.

physics.chem-ph↗

arXiv2019

Vector and Line Quantization for Billion-scale Similarity Search on GPUs

Billion-scale high-dimensional approximate nearest neighbour (ANN) search has become an important problem for searching similar objects among the vast amount of images and videos available online. The existing ANN methods are usually characterized by their specific indexing structures, including the inverted index and the inverted multi-index structure. The inverted index structure is amenable to GPU-based implementations, and the state-of-the-art systems such as Faiss are able to exploit the massive parallelism offered by GPUs. However, the inverted index requires high memory overhead to index the dataset effectively. The inverted multi-index structure is difficult to implement for GPUs, and also ineffective in dealing with database with different data distributions. In this paper we propose a novel hierarchical inverted index structure generated by vector and line quantization methods. Our quantization method improves both search efficiency and accuracy, while maintaining comparable memory consumption. This is achieved by reducing search space and increasing the number of indexed regions. We introduce a new ANN search system, VLQ-ADC, that is based on the proposed inverted index, and perform extensive evaluation on two public billion-scale benchmark datasets SIFT1B and DEEP1B. Our evaluation shows that VLQ-ADC significantly outperforms the state-of-the-art GPU- and CPU-based systems in terms of both accuracy and search speed. The source code of VLQ-ADC is available at https://github.com/zjuchenwei/vector-line-quantization.

cs.CV↗

arXiv2019

A Distributed Synchronous SGD Algorithm with Global Top-$k$ Sparsification for Low Bandwidth Networks

Distributed synchronous stochastic gradient descent (S-SGD) has been widely used in training large-scale deep neural networks (DNNs), but it typically requires very high communication bandwidth between computational workers (e.g., GPUs) to exchange gradients iteratively. Recently, Top-$k$ sparsification techniques have been proposed to reduce the volume of data to be exchanged among workers. Top-$k$ sparsification can zero-out a significant portion of gradients without impacting the model convergence. However, the sparse gradients should be transferred with their irregular indices, which makes the sparse gradients aggregation difficult. Current methods that use AllGather to accumulate the sparse gradients have a communication complexity of $O(kP)$, where $P$ is the number of workers, which is inefficient on low bandwidth networks with a large number of workers. We observe that not all top-$k$ gradients from $P$ workers are needed for the model update, and therefore we propose a novel global Top-$k$ (gTop-$k$) sparsification mechanism to address the problem. Specifically, we choose global top-$k$ largest absolute values of gradients from $P$ workers, instead of accumulating all local top-$k$ gradients to update the model in each iteration. The gradient aggregation method based on gTop-$k$ sparsification reduces the communication complexity from $O(kP)$ to $O(k\log P)$. Through extensive experiments on different DNNs, we verify that gTop-$k$ S-SGD has nearly consistent convergence performance with S-SGD, and it has only slight degradations on generalization performance. In terms of scaling efficiency, we evaluate gTop-$k$ on a cluster with 32 GPU machines which are interconnected with 1 Gbps Ethernet. The experimental results show that our method achieves $2.7-12\times$ higher scaling efficiency than S-SGD and $1.1-1.7\times$ improvement than the existing Top-$k$ S-SGD.

cs.DC↗

arXiv2019

On the stability of periodic binary sequences with zone restriction

Traditional global stability measure for sequences is hard to determine because of large search space. We propose the $k$-error linear complexity with a zone restriction for measuring the local stability of sequences. Accordingly, we can efficiently determine the global stability by studying a local stability for these sequences. For several classes of sequences, we demonstrate that the $k$-error linear complexity is identical to the $k$-error linear complexity within a zone, while the length of a zone is much smaller than the whole period when the $k$-error linear complexity is large. These sequences have periods $2^n$, or $2^v r$ ($r$ odd prime and $2$ is primitive modulo $r$), or $2^v p_1^{s_1} \cdots p_n^{s_n}$ ($p_i$ is an odd prime and $2$ is primitive modulo $p_i$ and $p_i^2$, where $1\leq i \leq n$) respectively. In particular, we completely determine the spectrum of $1$-error linear complexity with any zone length for an arbitrary $2^n$-periodic binary sequence.

cs.IT↗