arXiv subjects

Yue Wang

Publications and source records attributed to Yue Wang.

At least 667 records · Page 37Linked to original sources

arXiv2022

$4$-choosability of planar graphs with $4$-cycles far apart via the Combinatorial Nullstellensatz

By a well-known theorem of Thomassen and a planar graph depicted by Voigt, we know that every planar graph is $5$-choosable, and the bound is tight. In 1999, Lam, Xu and Liu reduced $5$ to $4$ on $C_4$-free planar graphs. In the paper, by applying the famous Combinatorial Nullstellensatz, we design an effective algorithm to deal with list coloring problems. At the same time, we prove that a planar graph $G$ is $4$-choosable if any two $4$-cycles having distance at least $5$ in $G$, which extends the result of Lam et al.

math.CO↗

arXiv2022

Mathematical Representation of Clausius' and Kelvin's Statements of the Second Law and Irreversibility

We provide a stochastic mathematical representation for Clausius' and Kelvin-Planck's statements of the Second Law of Thermodynamics in terms of the entropy productions of a finite, compact driven Markov system and its lift. A surjective map is rigorously established through the lift when the state space is either a discrete graph or a continuous n-dimensional torus T^n. The corresponding lifted processes have detailed balance thus a natural potential function but no stationary probability. We show that in the long-time limit the entropy production of the finite driven system precisely equals the potential energy decrease in the lifted system. This theorem provides a dynamic foundation for the two equivalent statements of Second Law of Thermodynamics, a la Kelvin's and Clausius'. It suggests a modernized, combined statement: "A mesoscopic engine that works in completing irreversible internal cycles statistically has necessarily an external effect that lowering a weight accompanied by passing heat from a warmer to a colder body."

math.PR↗

arXiv2022

Deep Multi-agent Reinforcement Learning for Highway On-Ramp Merging in Mixed Traffic

On-ramp merging is a challenging task for autonomous vehicles (AVs), especially in mixed traffic where AVs coexist with human-driven vehicles (HDVs). In this paper, we formulate the mixed-traffic highway on-ramp merging problem as a multi-agent reinforcement learning (MARL) problem, where the AVs (on both merge lane and through lane) collaboratively learn a policy to adapt to HDVs to maximize the traffic throughput. We develop an efficient and scalable MARL framework that can be used in dynamic traffic where the communication topology could be time-varying. Parameter sharing and local rewards are exploited to foster inter-agent cooperation while achieving great scalability. An action masking scheme is employed to improve learning efficiency by filtering out invalid/unsafe actions at each step. In addition, a novel priority-based safety supervisor is developed to significantly reduce collision rate and greatly expedite the training process. A gym-like simulation environment is developed and open-sourced with three different levels of traffic densities. We exploit curriculum learning to efficiently learn harder tasks from trained models under simpler settings. Comprehensive experimental results show the proposed MARL framework consistently outperforms several state-of-the-art benchmarks.

eess.SY↗

arXiv2022

CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning

Program synthesis or code generation aims to generate a program that satisfies a problem specification. Recent approaches using large-scale pretrained language models (LMs) have shown promising results, yet they have some critical limitations. In particular, they often follow a standard supervised fine-tuning procedure to train a code generation model only from the pairs of natural-language problem descriptions and ground-truth programs. Such paradigm largely ignores some important but potentially useful signals in the problem specification such as unit tests, which thus often results in poor performance when solving complex unseen coding tasks. To address the limitations, we propose "CodeRL", a new framework for program synthesis tasks through pretrained LMs and deep reinforcement learning (RL). Specifically, during training, we treat the code-generating LM as an actor network, and introduce a critic network that is trained to predict the functional correctness of generated programs and provide dense feedback signals to the actor. During inference, we introduce a new generation procedure with a critical sampling strategy that allows a model to automatically regenerate programs based on feedback from example unit tests and critic scores. For the model backbones, we extended the encoder-decoder architecture of CodeT5 with enhanced learning objectives, larger model sizes, and better pretraining data. Our method not only achieves new SOTA results on the challenging APPS benchmark, but also shows strong zero-shot transfer capability with new SOTA results on the simpler MBPP benchmark.

cs.LG↗

arXiv2022

Phenotypic Equilibrium as Probabilistic Convergence in Multi-phenotype Cell Population Dynamics

We consider the cell population dynamics with $n$ different phenotypes. Both the Markovian branching process model (stochastic model) and the ordinary differential equation (ODE) system model (deterministic model) are presented, and exploited to investigate the dynamics of the phenotypic proportions. We will prove that in both models, these proportions will tend to constants regardless of initial population states ("phenotypic equilibrium") under weak conditions, which explains the experimental phenomenon in Gupta et al.'s paper. We also prove that Gupta et al.'s explanation is the ODE model under a special assumption. As an application, we will give sufficient and necessary conditions under which the proportion of one phenotype tends to $0$ (die out) or $1$ (dominate). We also extend our results to non-Markovian cases.

q-bio.PE↗

arXiv2022

Inference on tissue transplantation experiments

We review studies on tissue transplantation experiments for various species: one piece of the donor tissue is excised and transplanted into a slit in the host tissue, then observe the behavior of this grafted tissue. Although we have known the results of some transplantation experiments, there are many more possible experiments with unknown results. We develop a penalty function-based method that uses the known experimental results to infer the unknown experimental results. Similar experiments without similar results get penalized and correspond to smaller probability. This method can provide the most probable results of a group of experiments or the probability of a specific result for each experiment. This method is also generalized to other situations. Besides, we solve a problem: how to design experiments so that such a method can be applied most efficiently.

q-bio.QM↗

arXiv2022

Downlink Massive MIMO Channel Estimation via Deep Unrolling : Sparsity Exploitations in Angular Domain

In frequency division duplex (FDD) massive MIMO systems, reliable downlink channel estimation is essential for the subsequent data transmission but is realized at the cost of massive pilot overhead due to hundreds of antennas at base station (BS). In order to reduce the pilot overhead without compromising the estimation, compressive sensing (CS) based methods have been widely applied for channel estimation by exploiting the inherent sparse structure of massive MIMO channel in angular domain. However, they still suffer from high complexity during optimization process and the requirement of prior knowledge on sparsity information. To overcome these challenges, this paper develops a novel hybrid channel estimation framework by integrating the model-driven CS and data-driven deep unrolling techniques. The proposed framework is composed of a coarse estimation part and a fine correction part, which is implemented in a two-stage manner to exploit both inter- and intra-frame sparsities of channels in angular domain. Then, two estimation schemes are designed depending on whether priori sparsity information is required, where the second scheme designs a new thresholding function to eliminate such requirement. Numerical results are provided to verify that our schemes can achieve high accuracy with low pilot overhead and low complexity.

eess.SP↗

arXiv2022

Van der Waals Materials for Applications in Nanophotonics

Numerous optical phenomena and applications have been enabled by nanophotonic structures. Their current fabrication from high refractive index dielectrics, such as silicon or gallium phosphide, pose restricting fabrication challenges, while metals, relying on plasmons and thus exhibiting high ohmic losses, limit the achievable applications. Here, we present an emerging class of layered so-called van der Waals (vdW) crystals as a viable nanophotonics platform. We extract the dielectric response of 11 mechanically exfoliated thin-film (20-200 nm) van der Waals crystals, revealing high refractive indices up to n = 5, pronounced birefringence up to $Δ$n = 3, sharp absorption resonances, and a range of transparency windows from ultraviolet to near-infrared. We then fabricate nanoantennas on SiO$_2$ and gold utilizing the compatibility of vdW thin films with a variety of substrates. We observe pronounced Mie resonances due to the high refractive index contrast on SiO$_2$ leading to a strong exciton-photon coupling regime as well as largely unexplored high-quality-factor, hybrid Mie-plasmon modes on gold. We demonstrate further vdW-material-specific degrees of freedom in fabrication by realizing nanoantennas from stacked twisted crystalline thin-films, enabling control of nonlinear optical properties, and post-fabrication nanostructure transfer, important for nano-optics with sensitive materials.

physics.optics↗

arXiv2022

Robust Distributed Learning Against Both Distributional Shifts and Byzantine Attacks

In distributed learning systems, robustness issues may arise from two sources. On one hand, due to distributional shifts between training data and test data, the trained model could exhibit poor out-of-sample performance. On the other hand, a portion of working nodes might be subject to byzantine attacks which could invalidate the learning result. Existing works mostly deal with these two issues separately. In this paper, we propose a new algorithm that equips distributed learning with robustness measures against both distributional shifts and byzantine attacks. Our algorithm is built on recent advances in distributionally robust optimization as well as norm-based screening (NBS), a robust aggregation scheme against byzantine attacks. We provide convergence proofs in three cases of the learning model being nonconvex, convex, and strongly convex for the proposed algorithm, shedding light on its convergence behaviors and endurability against byzantine attacks. In particular, we deduce that any algorithm employing NBS (including ours) cannot converge when the percentage of byzantine nodes is 1/3 or higher, instead of 1/2, which is the common belief in current literature. The experimental results demonstrate the effectiveness of our algorithm against both robustness issues. To the best of our knowledge, this is the first work to address distributional shifts and byzantine attacks simultaneously.

cs.LG↗

arXiv2022

Distributed Swarm Learning for Internet of Things at the Edge: Where Artificial Intelligence Meets Biological Intelligence

With the proliferation of versatile Internet of Things (IoT) services, smart IoT devices are increasingly deployed at the edge of wireless networks to perform collaborative machine learning tasks using locally collected data, giving rise to the edge learning paradigm. Due to device restrictions and resource constraints, edge learning among massive IoT devices faces major technical challenges caused by the communication bottleneck, data and device heterogeneity, non-convex optimization, privacy and security concerns, and dynamic environments. To overcome these challenges, this article studies a new framework of distributed swarm learning (DSL) through a holistic integration of artificial intelligence and biological swarm intelligence. Leveraging efficient and robust signal processing and communication techniques, DSL contributes to novel tools for learning and optimization tailored for real-time operations of large-scale IoT in edge wireless environments, which will benefit a wide range of edge IoT applications.

eess.SP↗

arXiv2022

CB-DSL: Communication-efficient and Byzantine-robust Distributed Swarm Learning on Non-i.i.d. Data

The valuable data collected by IoT devices in edge networks together with the resurgence of ML stimulate the latest trend of edge AI. However, recent FL methods face major challenges including communication bottleneck, data heterogeneity and security concerns in edge IoT scenarios, especially when being adopted for distributed learning among massive IoT devices equipped with limited data and transmission resources. Meanwhile, the swarm nature of IoT systems is overlooked by most existing literature, which calls for new designs of distributed learning algorithms. Inspired by the success of biological intelligence (BI) of gregarious organisms, we propose a novel edge learning approach for swarm IoT, called communication-efficient and Byzantine-robust distributed swarm learning (CB-DSL), through a holistic integration of AI-enabled stochastic gradient descent and BI-enabled particle swarm optimization. To deal with non-i.i.d. data issues and Byzantine attacks, global data samples are introduced in CB-DSL and shared among IoT workers, which not only alleviates the local data heterogeneity effectively but also enables to fully utilize the exploration-exploitation mechanism of swarm intelligence. Further, we provide convergence analysis to theoretically demonstrate that the proposed CB-DSL is superior to the standard FL with better convergence behavior. In addition, to measure the effectiveness of the introduction of the globally shared dataset, we also evaluate the model divergence by deriving its upper bound, which is related to the distance between the data distribution at local IoT devices and the population distribution for the whole datasets. Numerical results verify that the proposed CB-DSL outperforms the existing benchmarks in terms of faster convergence speed, higher convergent accuracy, lower communication cost, and better robustness against non-i.i.d. data and Byzantine attacks.

eess.SP↗

arXiv2022

DeepRING: Learning Roto-translation Invariant Representation for LiDAR based Place Recognition

LiDAR based place recognition is popular for loop closure detection and re-localization. In recent years, deep learning brings improvements to place recognition by learnable feature extraction. However, these methods degenerate when the robot re-visits previous places with large perspective difference. To address the challenge, we propose DeepRING to learn the roto-translation invariant representation from LiDAR scan, so that robot visits the same place with different perspective can have similar representations. There are two keys in DeepRING: the feature is extracted from sinogram, and the feature is aggregated by magnitude spectrum. The two steps keeps the final representation with both discrimination and roto-translation invariance. Moreover, we state the place recognition as a one-shot learning problem with each place being a class, leveraging relation learning to build representation similarity. Substantial experiments are carried out on public datasets, validating the effectiveness of each proposed component, and showing that DeepRING outperforms the comparative methods, especially in dataset level generalization.

cs.CV↗

arXiv2022

Search for Quasi-Periodical Oscillations in Precursors of Short and Long Gamma Ray Bursts

The precursors of short and long Gamma Ray Bursts (SGRBs and LGRBs) can serve as probes of their progenitors, as well as shedding light on the physical processes of mergers or core-collapse supernovae. Some models predict the possible existence of Quasi-Periodically Oscillations (QPO) in the precursors of SGRBs. Although many previous studies have performed QPO search in the main emission of SGRBs and LGRBs, so far there was no systematic QPO search in their precursors. In this work, we perform a detailed QPO search in the precursors of SGRBs and LGRBs detected by Fermi/GBM from 2008 to 2019 using the power density spectrum (PDS) in frequency domain and Gaussian processes (GP) in time domain. We do not find any convinced QPO signal with significance above 3 $σ$, possibly due to the low fluxes of precursors. Finally, the PDS continuum properties of both the precursors and main emissions are also studied for the first time, and no significant difference is found in the distributions of the PDS slope for precursors and main emissions in both SGRBs and LGRBs.

astro-ph.HE↗

arXiv2022

Discovery of one neutron star candidate from radial velocity monitoring

We report the discovery of one possible neutron star binary ($P_{\rm orb} =$ 0.8666 day) by using the LAMOST low-resolution spectroscopic data. The visible companion is a late A-type dwarf ($T_{\rm eff} = 7900 \pm 200$ K; log$g$ $=$ 4.3$\pm$0.2; $M =$ 1.7$\pm$0.1 M$_{\odot}$; $R\ =\ 1.7\pm0.2$ R$_{\odot}$), at a distance of 1.11$\pm0.03$ kpc. No double-lined feature can be seen from the GTC/HORuS high-resolution spectra, thus the radial velocity variation indicates an invisible object hiding in the binary. The system's optical light curves show clear ellipsoidal variability, suggesting that the visible companion is tidal distorted. By fitting the multi-band light curves with the ELC and WD codes, we constrain the mass of the invisible star to be 1.1--1.3 M$_{\odot}$. Spectral disentangling shows no additional component with optical absorption spectra, supporting the system contains one compact object. No X-ray or UV emission are detected in the ROSAT archive observations. Therefore, we suspect the invisible object is more likely a neutron star rather than a white dwarf. Our finding suggests the ability of LAMOST spectroscopic survey to discover X-ray quiescent compact objects.

astro-ph.HE↗

arXiv2022

RING++: Roto-translation Invariant Gram for Global Localization on a Sparse Scan Map

Global localization plays a critical role in many robot applications. LiDAR-based global localization draws the community's focus with its robustness against illumination and seasonal changes. To further improve the localization under large viewpoint differences, we propose RING++ which has roto-translation invariant representation for place recognition, and global convergence for both rotation and translation estimation. With the theoretical guarantee, RING++ is able to address the large viewpoint difference using a lightweight map with sparse scans. In addition, we derive sufficient conditions of feature extractors for the representation preserving the roto-translation invariance, making RING++ a framework applicable to generic multi-channel features. To the best of our knowledge, this is the first learning-free framework to address all subtasks of global localization in the sparse scan map. Validations on real-world datasets show that our approach demonstrates better performance than state-of-the-art learning-free methods, and competitive performance with learning-based methods. Finally, we integrate RING++ into a multi-robot/session SLAM system, performing its effectiveness in collaborative applications.

cs.RO↗

arXiv2022

Understanding the impact of heavy ions and tailoring the optical properties of large-area Monolayer WS2 using Focused Ion Beam

Focused ion beam (FIB) has been used as an effective tool for precise nanoscale fabrication. It has recently been employed to tailor defect engineering in functional nanomaterials such as two-dimensional transition metal dichalcogenides (TMDCs), providing desirable properties in TMDC-based optoelectronic devices. However, the damage caused by the FIB irradiation and milling process to these delicate atomically thin materials, especially in the extended area, has not yet been elaboratively characterised. Understanding the correlation between lateral ion beam effects and optical properties of 2D TMDCs is crucial in designing and fabricating high-performance optoelectronic devices. In this work, we investigate lateral damage in large-area monolayer WS2 caused by the gallium focused ion beam milling process. Three distinct zones away from the milling location are identified and characterised via steady-state photoluminescence (PL) and Raman spectroscopy. An unexpected bright ring-shaped emission around the milled location has been revealed by time-resolved PL spectroscopy with high spatial resolution. Our finding opens new avenues for tailoring the optical properties of TMDCs by charge and defect engineering via focused ion beam lithography. Furthermore, our study provides evidence that while some localised damage is inevitable, distant destruction can be eliminated by reducing the ion beam current. It paves the way for the use of FIB to create nanostructures in 2D TMDCs, as well as the design and realisation of optoelectrical devices on a wafer scale.

physics.app-ph↗

arXiv2022

Learning Interpretable BEV Based VIO without Deep Neural Networks

Monocular visual-inertial odometry (VIO) is a critical problem in robotics and autonomous driving. Traditional methods solve this problem based on filtering or optimization. While being fully interpretable, they rely on manual interference and empirical parameter tuning. On the other hand, learning-based approaches allow for end-to-end training but require a large number of training data to learn millions of parameters. However, the non-interpretable and heavy models hinder the generalization ability. In this paper, we propose a fully differentiable, and interpretable, bird-eye-view (BEV) based VIO model for robots with local planar motion that can be trained without deep neural networks. Specifically, we first adopt Unscented Kalman Filter as a differentiable layer to predict the pitch and roll, where the covariance matrices of noise are learned to filter out the noise of the IMU raw data. Second, the refined pitch and roll are adopted to retrieve a gravity-aligned BEV image of each frame using differentiable camera projection. Finally, a differentiable pose estimator is utilized to estimate the remaining 3 DoF poses between the BEV frames: leading to a 5 DoF pose estimation. Our method allows for learning the covariance matrices end-to-end supervised by the pose estimation loss, demonstrating superior performance to empirical baselines. Experimental results on synthetic and real-world datasets demonstrate that our simple approach is competitive with state-of-the-art methods and generalizes well on unseen scenes.

cs.RO↗

arXiv2022

Robust Constrained Reinforcement Learning

Constrained reinforcement learning is to maximize the expected reward subject to constraints on utilities/costs. However, the training environment may not be the same as the test one, due to, e.g., modeling error, adversarial attack, non-stationarity, resulting in severe performance degradation and more importantly constraint violation. We propose a framework of robust constrained reinforcement learning under model uncertainty, where the MDP is not fixed but lies in some uncertainty set, the goal is to guarantee that constraints on utilities/costs are satisfied for all MDPs in the uncertainty set, and to maximize the worst-case reward performance over the uncertainty set. We design a robust primal-dual approach, and further theoretically develop guarantee on its convergence, complexity and robust feasibility. We then investigate a concrete example of $δ$-contamination uncertainty set, design an online and model-free algorithm and theoretically characterize its sample complexity.

cs.LG↗