arXiv subjects

Qiang Wang

Publications and source records attributed to Qiang Wang.

At least 199 records · Page 11Linked to original sources

arXiv2023

Functional graphs of generalized cyclotomic mappings of finite fields

The functional graph of a function $g:X\rightarrow X$ is the directed graph with vertex set $X$ the edges of which are of the form $x\rightarrow g(x)$ for $x\in X$. Functional graphs are heavily studied because they allow one to understand the behavior of $g$ under iteration (i.e., to understand the discrete dynamical system $(X,g)$), which has various applications, especially when $X$ is a finite field $\mathbb{F}_q$. This paper is an extensive study of the functional graphs of so-called index $d$ generalized cyclotomic mappings of $\mathbb{F}_q$, which are a natural and manageable generalization of monomial functions. We provide both theoretical results on the structure of their functional graphs and Las Vegas algorithms for solving fundamental problems, such as parametrizing the connected components of the functional graph by representative vertices, or describing the structure of a connected component given by a representative vertex. The complexity of these algorithms is analyzed in detail, and we make the point that for fixed index $d$ and most prime powers $q$ (in the sense of asymptotic density), suitable implementations of these algorithms have an expected runtime that is polynomial in $\log{q}$ on quantum computers, whereas their expected runtime is subexponential in $\log{q}$ on a classical computer. We also discuss four special cases in which one can devise Las Vegas algorithms with this kind of complexity behavior over most finite fields that solve the graph isomorphism problem for functional graphs of generalized cyclotomic mappings.

math.NT↗

arXiv2023

Topological Transitions with an Imaginary Aubry-Andre-Harper Potential

We study one-dimensional lattices with imaginary-valued Aubry-Andre-Harper (AAH) potentials. Such lattices can host edge states with purely imaginary eigenenergies, which differ from the edge states of the Hermitian AAH model and are stabilized by a non-Hermitian particle-hole symmetry. The edge states arise when the period of the imaginary potential is a multiple of four lattice constants. They are topological in origin, and can manifest on domain walls between lattices with different modulation periods and phases, as predicted by a bulk polarization invariant. Interestingly, the edge states persist and remain localized even if the real line gap closes. These features can be used in laser arrays to select topological lasing modes under spatially extended pumping.

quant-ph↗

arXiv2023

SVDE: Scalable Value-Decomposition Exploration for Cooperative Multi-Agent Reinforcement Learning

Value-decomposition methods, which reduce the difficulty of a multi-agent system by decomposing the joint state-action space into local observation-action spaces, have become popular in cooperative multi-agent reinforcement learning (MARL). However, value-decomposition methods still have the problems of tremendous sample consumption for training and lack of active exploration. In this paper, we propose a scalable value-decomposition exploration (SVDE) method, which includes a scalable training mechanism, intrinsic reward design, and explorative experience replay. The scalable training mechanism asynchronously decouples strategy learning with environmental interaction, so as to accelerate sample generation in a MapReduce manner. For the problem of lack of exploration, an intrinsic reward design and explorative experience replay are proposed, so as to enhance exploration to produce diverse samples and filter non-novel samples, respectively. Empirically, our method achieves the best performance on almost all maps compared to other popular algorithms in a set of StarCraft II micromanagement games. A data-efficiency experiment also shows the acceleration of SVDE for sample collection and policy convergence, and we demonstrate the effectiveness of factors in SVDE through a set of ablation experiments.

cs.AI↗

arXiv2023

Local Label Point Correction for Edge Detection of Overlapping Cervical Cells

Accurate labeling is essential for supervised deep learning methods. However, it is almost impossible to accurately and manually annotate thousands of images, which results in many labeling errors for most datasets. We proposes a local label point correction (LLPC) method to improve annotation quality for edge detection and image segmentation tasks. Our algorithm contains three steps: gradient-guided point correction, point interpolation and local point smoothing. We correct the labels of object contours by moving the annotated points to the pixel gradient peaks. This can improve the edge localization accuracy, but it also causes unsmooth contours due to the interference of image noise. Therefore, we design a point smoothing method based on local linear fitting to smooth the corrected edge. To verify the effectiveness of our LLPC, we construct a largest overlapping cervical cell edge detection dataset (CCEDD) with higher precision label corrected by our label correction method. Our LLPC only needs to set three parameters, but yields 30-40$\%$ average precision improvement on multiple networks. The qualitative and quantitative experimental results show that our LLPC can improve the quality of manual labels and the accuracy of overlapping cell edge detection. We hope that our study will give a strong boost to the development of the label correction for edge detection and image segmentation. We will release the dataset and code at https://github.com/nachifur/LLPC.

cs.CV↗

arXiv2023

Dexterous Robotic Manipulation using Deep Reinforcement Learning and Knowledge Transfer for Complex Sparse Reward-based Tasks

This paper describes a deep reinforcement learning (DRL) approach that won Phase 1 of the Real Robot Challenge (RRC) 2021, and then extends this method to a more difficult manipulation task. The RRC consisted of using a TriFinger robot to manipulate a cube along a specified positional trajectory, but with no requirement for the cube to have any specific orientation. We used a relatively simple reward function, a combination of goal-based sparse reward and distance reward, in conjunction with Hindsight Experience Replay (HER) to guide the learning of the DRL agent (Deep Deterministic Policy Gradient (DDPG)). Our approach allowed our agents to acquire dexterous robotic manipulation strategies in simulation. These strategies were then applied to the real robot and outperformed all other competition submissions, including those using more traditional robotic control techniques, in the final evaluation stage of the RRC. Here we extend this method, by modifying the task of Phase 1 of the RRC to require the robot to maintain the cube in a particular orientation, while the cube is moved along the required positional trajectory. The requirement to also orient the cube makes the agent unable to learn the task through blind exploration due to increased problem complexity. To circumvent this issue, we make novel use of a Knowledge Transfer (KT) technique that allows the strategies learned by the agent in the original task (which was agnostic to cube orientation) to be transferred to this task (where orientation matters). KT allowed the agent to learn and perform the extended task in the simulator, which improved the average positional deviation from 0.134 m to 0.02 m, and average orientation deviation from 142° to 76° during evaluation. This KT concept shows good generalisation properties and could be applied to any actor-critic learning algorithm.

cs.RO↗

arXiv2023

Simulation-based Validation for Autonomous Driving Systems

Simulation is essential to validate autonomous driving systems. However, a simple simulation, even for an extremely high number of simulated miles or hours, is not sufficient. We need well-founded criteria showing that simulation does indeed cover a large fraction of the relevant real-world situations. In addition, the validation must concern not only incidents, but also the detection of any type of potentially dangerous situation, such as traffic violations. We investigate a rigorous simulation and testing-based validation method for autonomous driving systems that integrates an existing industrial simulator and a formally defined testing environment. The environment includes a scenario generator that drives the simulation process and a monitor that checks at runtime the observed behavior of the system against a set of system properties to be validated. The validation method consists in extracting from the simulator a semantic model of the simulated system including a metric graph, which is a mathematical model of the environment in which the vehicles of the system evolve. The monitor can verify properties formalized in a first-order linear temporal logic and provide diagnostics explaining their non satisfaction. Instead of exploring the system behavior randomly as many simulators do, we propose a method to systematically generate sets of scenarios that cover potentially risky situations, especially for different types of junctions where specific traffic rules must be respected. We show that the systematic exploration of risky situations has uncovered many flaws in the real simulator that would have been very difficult to discover by a random exploration process.

cs.SE↗

arXiv2023

Continuum of Bound States in a Non-Hermitian Model

In a Hermitian system, bound states must have quantized energies, whereas extended states can form a continuum. We demonstrate how this principle fails for non-Hermitian systems, by analyzing non-Hermitian continuous Hamiltonians with an imaginary momentum and Landau-type vector potential. The eigenstates, which we call ``continuum Landau modes'' (CLMs), have gaussian spatial envelopes and form a continuum filling the complex energy plane. We present experimentally-realizable 1D and 2D lattice models that can be used to study CLMs; the lattice eigenstates are localized and have other features that are the same as in the continuous model. One of these lattices can serve as a rainbow trap, whereby the response to an excitation is concentrated at a position proportional to the frequency. Another lattice can act a wave funnel, concentrating an input excitation onto a boundary over a wide frequency bandwidth. Unlike recent funneling schemes based on the non-Hermitian skin effect, this requires only a simple lattice design without nonreciprocal couplings.

quant-ph↗

arXiv2022

Complementary Calibration: Boosting General Continual Learning with Collaborative Distillation and Self-Supervision

General Continual Learning (GCL) aims at learning from non independent and identically distributed stream data without catastrophic forgetting of the old tasks that don't rely on task boundaries during both training and testing stages. We reveal that the relation and feature deviations are crucial problems for catastrophic forgetting, in which relation deviation refers to the deficiency of the relationship among all classes in knowledge distillation, and feature deviation refers to indiscriminative feature representations. To this end, we propose a Complementary Calibration (CoCa) framework by mining the complementary model's outputs and features to alleviate the two deviations in the process of GCL. Specifically, we propose a new collaborative distillation approach for addressing the relation deviation. It distills model's outputs by utilizing ensemble dark knowledge of new model's outputs and reserved outputs, which maintains the performance of old tasks as well as balancing the relationship among all classes. Furthermore, we explore a collaborative self-supervision idea to leverage pretext tasks and supervised contrastive learning for addressing the feature deviation problem by learning complete and discriminative features for all classes. Extensive experiments on four popular datasets show that our CoCa framework achieves superior performance against state-of-the-art methods. Code is available at https://github.com/lijincm/CoCa.

cs.CV↗

arXiv2022

SphereDepth: Panorama Depth Estimation from Spherical Domain

The panorama image can simultaneously demonstrate complete information of the surrounding environment and has many advantages in virtual tourism, games, robotics, etc. However, the progress of panorama depth estimation cannot completely solve the problems of distortion and discontinuity caused by the commonly used projection methods. This paper proposes SphereDepth, a novel panorama depth estimation method that predicts the depth directly on the spherical mesh without projection preprocessing. The core idea is to establish the relationship between the panorama image and the spherical mesh and then use a deep neural network to extract features on the spherical domain to predict depth. To address the efficiency challenges brought by the high-resolution panorama data, we introduce two hyper-parameters for the proposed spherical mesh processing framework to balance the inference speed and accuracy. Validated on three public panorama datasets, SphereDepth achieves comparable results with the state-of-the-art methods of panorama depth estimation. Benefiting from the spherical domain setting, SphereDepth can generate a high-quality point cloud and significantly alleviate the issues of distortion and discontinuity.

cs.CV↗

arXiv2022

Rethinking Disparity: A Depth Range Free Multi-View Stereo Based on Disparity

Existing learning-based multi-view stereo (MVS) methods rely on the depth range to build the 3D cost volume and may fail when the range is too large or unreliable. To address this problem, we propose a disparity-based MVS method based on the epipolar disparity flow (E-flow), called DispMVS, which infers the depth information from the pixel movement between two views. The core of DispMVS is to construct a 2D cost volume on the image plane along the epipolar line between each pair (between the reference image and several source images) for pixel matching and fuse uncountable depths triangulated from each pair by multi-view geometry to ensure multi-view consistency. To be robust, DispMVS starts from a randomly initialized depth map and iteratively refines the depth map with the help of the coarse-to-fine strategy. Experiments on DTUMVS and Tanks\&Temple datasets show that DispMVS is not sensitive to the depth range and achieves state-of-the-art results with lower GPU memory.

cs.CV↗

arXiv2022

The RoyalFlush System for the WMT 2022 Efficiency Task

This paper describes the submission of the RoyalFlush neural machine translation system for the WMT 2022 translation efficiency task. Unlike the commonly used autoregressive translation system, we adopted a two-stage translation paradigm called Hybrid Regression Translation (HRT) to combine the advantages of autoregressive and non-autoregressive translation. Specifically, HRT first autoregressively generates a discontinuous sequence (e.g., make a prediction every $k$ tokens, $k>1$) and then fills in all previously skipped tokens at once in a non-autoregressive manner. Thus, we can easily trade off the translation quality and speed by adjusting $k$. In addition, by integrating other modeling techniques (e.g., sequence-level knowledge distillation and deep-encoder-shallow-decoder layer allocation strategy) and a mass of engineering efforts, HRT improves 80\% inference speed and achieves equivalent translation performance with the same-capacity AT counterpart. Our fastest system reaches 6k+ words/second on the GPU latency setting, estimated to be about 3.1x faster than the last year's winner.

cs.CL↗

arXiv2022

Hierarchical reinforcement learning for in-hand robotic manipulation using Davenport chained rotations

End-to-end reinforcement learning techniques are among the most successful methods for robotic manipulation tasks. However, the training time required to find a good policy capable of solving complex tasks is prohibitively large. Therefore, depending on the computing resources available, it might not be feasible to use such techniques. The use of domain knowledge to decompose manipulation tasks into primitive skills, to be performed in sequence, could reduce the overall complexity of the learning problem, and hence reduce the amount of training required to achieve dexterity. In this paper, we propose the use of Davenport chained rotations to decompose complex 3D rotation goals into a concatenation of a smaller set of more simple rotation skills. State-of-the-art reinforcement-learning-based methods can then be trained using less overall simulated experience. We compare its performance with the popular Hindsight Experience Replay method, trained in an end-to-end fashion using the same amount of experience in a simulated robotic hand environment. Despite a general decrease in performance of the primitive skills when being sequentially executed, we find that decomposing arbitrary 3D rotations into elementary rotations is beneficial when computing resources are limited, obtaining increases of success rates of approximately 10% on the most complex 3D rotations with respect to the success rates obtained by HER trained in an end-to-end fashion, and increases of success rates between 20% and 40% on the most simple rotations.

cs.RO↗

arXiv2022

Hybrid-Regressive Neural Machine Translation

In this work, we empirically confirm that non-autoregressive translation with an iterative refinement mechanism (IR-NAT) suffers from poor acceleration robustness because it is more sensitive to decoding batch size and computing device setting than autoregressive translation (AT). Inspired by it, we attempt to investigate how to combine the strengths of autoregressive and non-autoregressive translation paradigms better. To this end, we demonstrate through synthetic experiments that prompting a small number of AT's predictions can promote one-shot non-autoregressive translation to achieve the equivalent performance of IR-NAT. Following this line, we propose a new two-stage translation prototype called hybrid-regressive translation (HRT). Specifically, HRT first generates discontinuous sequences via autoregression (e.g., make a prediction every k tokens, k>1) and then fills in all previously skipped tokens at once in a non-autoregressive manner. We also propose a bag of techniques to effectively and efficiently train HRT without adding any model parameters. HRT achieves the state-of-the-art BLEU score of 28.49 on the WMT En-De task and is at least 1.5x faster than AT, regardless of batch size and device. In addition, another bonus of HRT is that it successfully inherits the good characteristics of AT in the deep-encoder-shallow-decoder architecture. Concretely, compared to the vanilla HRT with a 6-layer encoder and 6-layer decoder, the inference speed of HRT with a 12-layer encoder and 1-layer decoder is further doubled on both GPU and CPU without BLEU loss.

cs.CL↗

arXiv2022

Observation of an acoustic octupole topological insulator

The Berry phase associated with energy bands in crystals can lead to quantized quantities, such as the quantization of electric dipole polarization in an insulator, known as a one-dimensional (1D) topological insulator (TI) phase. Recent theories have generalized such quantization from dipole to higher multipole moments, giving rise to the discovery of multipole TIs, which exhibit a cascade hierarchy of multipole topology at boundaries of boundaries: A quantized octupole moment in the three-dimensional (3D) bulk can induce quantized quadrupole moments on its two-dimensional (2D) surfaces, which then produce quantized dipole moments along 1D hinges. The model of 2D quadrupole TI has been realized in various classical structures, exhibiting zero-dimensional (0D) in-gap corner states. Here we report on the realization of a quantized octupole TI on the platform of a 3D acoustic metamaterial. By direct acoustic measurement, we observe 0D corner states, 1D hinge states, 2D surface states, and 3D bulk states, as a consequence of the topological hierarchy from octupole moment to quadrupole and dipole moment. The critical conditions of forming a nontrivial octupole moment are further demonstrated by comparing with another two samples possessing a trivial octupole moment. Our work thus establishes the multipole topology and its full cascade hierarchy in 3D geometries.

cond-mat.mes-hall↗

arXiv2022

FlowFormer: A Transformer Architecture for Optical Flow

We introduce optical Flow transFormer, dubbed as FlowFormer, a transformer-based neural network architecture for learning optical flow. FlowFormer tokenizes the 4D cost volume built from an image pair, encodes the cost tokens into a cost memory with alternate-group transformer (AGT) layers in a novel latent space, and decodes the cost memory via a recurrent transformer decoder with dynamic positional cost queries. On the Sintel benchmark, FlowFormer achieves 1.159 and 2.088 average end-point-error (AEPE) on the clean and final pass, a 16.5% and 15.5% error reduction from the best published result (1.388 and 2.47). Besides, FlowFormer also achieves strong generalization performance. Without being trained on Sintel, FlowFormer achieves 1.01 AEPE on the clean pass of Sintel training set, outperforming the best published result (1.29) by 21.7%.

cs.CV↗

arXiv2022

Topological phenomena at topological defects

There are two prominent applications of the mathematical concept of topology to the physics of materials: band topology, which classifies different topological insulators and semimetals, and topological defects that represent immutable deviations of a solid lattice from its ideal crystalline form. While these two classes of topological phenomena have generally been treated as separate topics, recent experimental advancements have begun to probe their intricate and surprising interactions, in real materials as well as synthetic metamaterials. Topological lattice defects in topological materials offer a platform to explore a diverse range of novel phenomena, such as topological pumping via topological defects, embedded topological phases, synthetic dimensions, and non-Hermitian skin effects. In this Perspective, we survey the developments in this rapidly moving field, and give an outlook of its impact on materials science and applications.

cond-mat.mtrl-sci↗

arXiv2022

Adaptive Target-Condition Neural Network: DNN-Aided Load Balancing for Hybrid LiFi and WiFi Networks

Load balancing (LB) is a challenging issue in the hybrid light fidelity (LiFi) and wireless fidelity (WiFi) networks (HLWNets), due to the nature of heterogeneous access points (APs). Machine learning has the potential to provide a complexity-friendly LB solution with near-optimal network performance, at the cost of a training process. The state-of-the-art (SOTA) learning-aided LB methods, however, need retraining when the network environment (especially the number of users) changes, significantly limiting its practicability. In this paper, a novel deep neural network (DNN) structure named adaptive target-condition neural network (A-TCNN) is proposed, which conducts AP selection for one target user upon the condition of other users. Also, an adaptive mechanism is developed to map a smaller number of users to a larger number through splitting their data rate requirements, without affecting the AP selection result for the target user. This enables the proposed method to handle different numbers of users without the need for retraining. Results show that A-TCNN achieves a network throughput very close to that of the testing dataset, with a gap less than 3%. It is also proven that A-TCNN can obtain a network throughput comparable to two SOTA benchmarks, while reducing the runtime by up to three orders of magnitude.

eess.SP↗

arXiv2022

Compositions and parities of complete mappings and of orthomorphisms

We determine the permutation groups $P_{\mathrm{comp}}(\mathbb{F}_q),P_{\mathrm{orth}}(\mathbb{F}_q)\leq\operatorname{Sym}(\mathbb{F}_q)$ generated by the complete mappings, respectively the orthomorphisms, of the finite field $\mathbb{F}_q$ -- both are equal to $\operatorname{Sym}(\mathbb{F}_q)$ unless $q\in\{2,3,4,5,8\}$. More generally, denote by $P_{\mathrm{comp}}(G)$, respectively $P_{\mathrm{orth}}(G)$, the subgroup of $\operatorname{Sym}(G)$ generated by the complete mappings, respectively the orthomorphisms, of the group $G$. Using recent results of Eberhard-Manners-Mrazović and Müyesser-Pokrovskiy, we show that for each large enough finite group $G$ that has a complete mapping (i.e., whose Sylow $2$-subgroups are trivial or noncyclic), $P_{\mathrm{comp}}(G)=\operatorname{Sym}(G)$ and $P_{\mathrm{orth}}(G)\geq\operatorname{Alt}(G)$. We also prove that $P_{\mathrm{orth}}(G)=\operatorname{Sym}(G)$ for every large enough finite solvable group $G$ that has a complete mapping. Proving these results requires us to study the parities of complete mappings and of orthomorphisms. Some connections with known results in cryptography and with parity types of Latin squares are also discussed.

math.GR↗