arXiv subjects

Rui Yang

Publications and source records attributed to Rui Yang.

At least 289 records · Page 16Linked to original sources

arXiv2022

NCGNN: Node-Level Capsule Graph Neural Network for Semisupervised Classification

Message passing has evolved as an effective tool for designing Graph Neural Networks (GNNs). However, most existing methods for message passing simply sum or average all the neighboring features to update node representations. They are restricted by two problems, i.e., (i) lack of interpretability to identify node features significant to the prediction of GNNs, and (ii) feature over-mixing that leads to the over-smoothing issue in capturing long-range dependencies and inability to handle graphs under heterophily or low homophily. In this paper, we propose a Node-level Capsule Graph Neural Network (NCGNN) to address these problems with an improved message passing scheme. Specifically, NCGNN represents nodes as groups of node-level capsules, in which each capsule extracts distinctive features of its corresponding node. For each node-level capsule, a novel dynamic routing procedure is developed to adaptively select appropriate capsules for aggregation from a subgraph identified by the designed graph filter. NCGNN aggregates only the advantageous capsules and restrains irrelevant messages to avoid over-mixing features of interacting nodes. Therefore, it can relieve the over-smoothing issue and learn effective node representations over graphs with homophily or heterophily. Furthermore, our proposed message passing scheme is inherently interpretable and exempt from complex post-hoc explanations, as the graph filter and the dynamic routing procedure identify a subset of node features that are most significant to the model prediction from the extracted subgraph. Extensive experiments on synthetic as well as real-world graphs demonstrate that NCGNN can well address the over-smoothing issue and produce better node representations for semisupervised node classification. It outperforms the state of the arts under both homophily and heterophily.

cs.LG↗

arXiv2022

Data-driven identification of the spatio-temporal structure of turbulent flows by streaming Dynamic Mode Decomposition

Streaming Dynamic Mode Decomposition (sDMD) (Hemati et al., Phys. Fluids 26(2014)) is a low-storage version of Dynamic Mode Decomposition (DMD) (Schmid, J. Fluid Mech. 656 (2010)), a data-driven method to extract spatio-temporal flow patterns. Streaming DMD avoids storing the entire data sequence in memory by approximating the dynamic modes through incremental updates with new available data. In this paper, we use sDMD to identify and extract dominant spatio-temporal structures of different turbulent flows, requiring the analysis of large datasets. First, the efficiency and accuracy of sDMD are compared to the classical DMD, using a publicly available test dataset that consists of velocity field snapshots obtained by direct numerical simulation of a wake flow behind a cylinder. Streaming DMD not only reliably reproduces the most important dynamical features of the flow; our calculations also highlight its advantage in terms of the required computational resources. We subsequently use sDMD to analyse three different turbulent flows that all show some degree of large-scale coherence: rapidly rotating Rayleigh--Bénard convection, horizontal convection and the asymptotic suction boundary layer. Structures of different frequencies and spatial extent can be clearly separated, and the prominent features of the dynamics are captured with just a few dynamic modes. In summary, we demonstrate that sDMD is a powerful tool for the identification of spatio-temporal structures in a wide range of turbulent flows.

physics.flu-dyn↗

arXiv2022

Some notes on variational principle for metric mean dimension

Firstly, we answer the problem 1 asked by Gutman and $\rm \acute{\ S}$piewak in \cite{gs20}, then we establish a double variational principle for mean dimension in terms of R$\bar{e}$nyi information dimension and show the order of $\sup$ and $\limsup$ (or $\liminf$) of the variational principle for the metric mean dimension in terms of R$\bar{e}$nyi information dimension obtained by Gutman and $\rm \acute{\ S}$piewak can be changed under the marker property. Finally, we attempt to introduce the notion of maximal metric mean dimension measure, which is an analogue of the concept called classical maximal entropy measure related to the topological entropy.

math.DS↗

arXiv2022

Turbulent Rayleigh-Bénard convection with bubbles attached to the plate

We numerically investigate turbulent Rayleigh-Bénard convection with gas bubbles attached to the hot plate, mimicking a core feature in electrolysis, catalysis, or boiling. The existence of bubbles on the plate reduces the global heat transfer due to the much lower thermal conductivity of gases as compared to liquids and changes the structure of the boundary layers. The numerical simulations are performed in 3D at Prandtl number Pr=4.38 (water) and Rayleigh number $10^7\le Ra \le10^8$. For simplicity, we assume the bubbles to be equally-sized and having pinned contact lines. We vary the total gas-covered area fraction $0.18 \le S_0 \le 0.62$, the relative bubble height $0.02\le h/H \le0.05$ (where $H$ is the height of the Rayleigh-Bénard cell), the bubble number $40 \le n \le 144$, and their spatial distribution. In all cases, asymmetric temperature profiles are observed, which we quantitatively explain based on the heat flux conservation at each horizontal section. We further propose the idea of using an equivalent single-phase setup to mimic the system with attached bubbles. Based on this equivalence, we can calculate the heat transfer. Without introducing any free parameter, the predictions for the Nusselt number, the upper and lower thermal boundary layer thicknesses, and the mean centre temperature well agree with the numerical results. Finally, our predictions also work for the cases with much larger Pr (e.g. $400$), which indicates that our results can also be applied to predict the mass transfer in water electrolysis with bubbles attached to the electrode surface or in catalysis.

physics.flu-dyn↗

arXiv2022

Single-beam double-pass miniaturized atomic magnetometer for bio-magnetic imaging systems

Miniaturized atomic magnetometers, particularly spin-exchange relaxation-free atomic magnetometers, have been emerging in clinical imaging applications such magnetocardiography and magnetoencephalography. Miniaturization, portability, and low cost are primary development targets for bio-magnetic imaging technologies, as well as high sensitivity and spatial and time resolution. In this paper, we propose a low-cost solution for a bio-magnetic imaging system based on atomic magnetometers, in which one laser source is used for a multi-channel atomic magnetometer sensor array. A novel design is demonstrated for a miniaturized spin-exchange relaxation-free atomic magnetometer, consisting of a single-beam double-pass configuration based on an optical fiber circulator. The effects of temperature and laser power on the zero-field magnetic resonance line-width are characterized, and the experimental results show that the present design achieves better performance, than a traditional single-beam single-pass configuration. The noise power spectrum shows that the closed-loop miniaturized atomic magnetometer reaches a sensitivity of approximately 120 fT/Hz$^{1/2}$ at a bandwidth of 10 Hz. This design is especially suitable for atomic magnetometers operating in arrays as a basic building element for low-cost bio-magnetic imaging systems.

physics.atom-ph↗

arXiv2022

All-optical graph representation learning using integrated diffractive photonic computing units

Photonic neural networks perform brain-inspired computations using photons instead of electrons that can achieve substantially improved computing performance. However, existing architectures can only handle data with regular structures, e.g., images or videos, but fail to generalize to graph-structured data beyond Euclidean space, e.g., social networks or document co-citation networks. Here, we propose an all-optical graph representation learning architecture, termed diffractive graph neural network (DGNN), based on the integrated diffractive photonic computing units (DPUs) to address this limitation. Specifically, DGNN optically encodes node attributes into strip optical waveguides, which are transformed by DPUs and aggregated by on-chip optical couplers to extract their feature representations. Each DPU comprises successive passive layers of metalines to modulate the electromagnetic optical field via diffraction, where the metaline structures are learnable parameters shared across graph nodes. DGNN captures complex dependencies among the node neighborhoods and eliminates the nonlinear transition functions during the light-speed optical message passing over graph structures. We demonstrate the use of DGNN extracted features for node and graph-level classification tasks with benchmark databases and achieve superior performance. Our work opens up a new direction for designing application-specific integrated photonic circuits for high-efficiency processing of large-scale graph data structures using deep learning.

cs.ET↗

arXiv2022

Customized quantum annealing schedules

In a typical quantum annealing protocol, the system starts with a transverse field Hamiltonian which is gradually turned off and replaced by a longitudinal Ising Hamiltonian. The ground state of the Ising Hamiltonian encodes the solution to the computational problem of interest, and the state overlap with this ground state gives the success probability of the annealing protocol. The form of the annealing schedule can have a significant impact on the ground state overlap at the end of the anneal, so precise control over these annealing schedules can be a powerful tool for increasing success probabilities of annealing protocols. Here we show how superconducting circuits, in particular capacitively shunted flux qubits (CSFQs), can be used to construct quantum annealing systems by providing tools for mapping circuit flux biases to Pauli coefficients. We use this mapping to find customized annealing schedules: appropriate circuit control biases that yield a desired annealing schedule, while accounting for the physical limitations of the circuitry. We then provide examples and proposals that utilize this capability to improve quantum annealing performance.

quant-ph↗

arXiv2022

Intelligent Feedback Overhead Reduction (iFOR) in Wi-Fi 7 and Beyond

The IEEE 802.11 standard based wireless local area networks (WLANs) or Wi-Fi networks are critical to provide internet access in today's world. The increasing demand for high data rate in Wi-Fi networks has led to several advancements in the 802.11 standard. Supporting MIMO transmissions with higher number of transmit antennas operating on wider bandwidths is one of the key capabilities for reaching higher throughput. However, the increase in sounding feedback overhead due to higher number of transmit antennas may significantly curb the throughput gain. In this paper, we develop an unsupervised learning-based method to reduce the sounding duration in a Wi-Fi MIMO link. Simulation results show that our method uses approximately only 8% of the number of bits required by the existing feedback mechanism and it can boost the system throughput by up to 52%.

eess.SP↗

arXiv2022

Safe Learning-Based Feedback Linearization Tracking Control for Nonlinear System with Event-Triggered Model Update

Learning-based methods are powerful in handling complex scenarios. However, it is still challenging to use learning-based methods under uncertain environments while stability, safety, and real-time performance of the system are desired to guarantee. In this paper, we propose a learning-based tracking control scheme based on a feedback linearization controller in which uncertain disturbances are approximated online using Gaussian Processes (GPs). Using the predicted distribution of disturbances given by GPs, a Control Lyapunov Function (CLF) and Control Barrier Function (CBF) based Quadratic Program is applied, with which probabilistic stability and safety are guaranteed. In addition, the trajectory is optimized first by Model Predictive Control (MPC) based on the linearized dynamics systems to further reduce the tracking error. We also design an event trigger for GPs updates to improve efficiency while stability and safety of the system are still guaranteed. The effectiveness of the proposed tracking control strategy is illustrated in numerical simulations.

cs.RO↗

arXiv2022

Banyan: A Scoped Dataflow Engine for Graph Query Service

Graph query services (GQS) are widely used today to interactively answer graph traversal queries on large-scale graph data. Existing graph query engines focus largely on optimizing the latency of a single query. This ignores significant challenges posed by GQS, including fine-grained control and scheduling during query execution, as well as performance isolation and load balancing in various levels from across user to intra-query. To tackle these control and scheduling challenges, we propose a novel scoped dataflow for modeling graph traversal queries, which explicitly exposes concurrent execution and control of any subquery to the finest granularity. We implemented Banyan, an engine based on the scoped dataflow model for GQS. Banyan focuses on scaling up the performance on a single machine, and provides the ability to easily scale out. Extensive experiments on multiple benchmarks show that Banyan improves performance by up to three orders of magnitude over state-of-the-art graph query engines, while providing performance isolation and load balancing.

cs.DB↗

arXiv2022

Safe Learning-based Gradient-free Model Predictive Control Based on Cross-entropy Method

In this paper, a safe and learning-based control framework for model predictive control (MPC) is proposed to optimize nonlinear systems with a non-differentiable objective function under uncertain environmental disturbances. The control framework integrates a learning-based MPC with an auxiliary controller in a way of minimal intervention. The learning-based MPC augments the prior nominal model with incremental Gaussian Processes to learn the uncertain disturbances. The cross-entropy method (CEM) is utilized as the sampling-based optimizer for the MPC with a non-differentiable objective function. A minimal intervention controller is devised with a control Lyapunov function and a control barrier function to guide the sampling process and endow the system with high probabilistic safety. The proposed algorithm shows a safe and adaptive control performance on a simulated quadrotor in the tasks of trajectory tracking and obstacle avoidance under uncertain wind disturbances.

cs.RO↗

arXiv2022

Rethinking Goal-conditioned Supervised Learning and Its Connection to Offline RL

Solving goal-conditioned tasks with sparse rewards using self-supervised learning is promising because of its simplicity and stability over current reinforcement learning (RL) algorithms. A recent work, called Goal-Conditioned Supervised Learning (GCSL), provides a new learning framework by iteratively relabeling and imitating self-generated experiences. In this paper, we revisit the theoretical property of GCSL -- optimizing a lower bound of the goal reaching objective, and extend GCSL as a novel offline goal-conditioned RL algorithm. The proposed method is named Weighted GCSL (WGCSL), in which we introduce an advanced compound weight consisting of three parts (1) discounted weight for goal relabeling, (2) goal-conditioned exponential advantage weight, and (3) best-advantage weight. Theoretically, WGCSL is proved to optimize an equivalent lower bound of the goal-conditioned RL objective and generates monotonically improved policies via an iterated scheme. The monotonic property holds for any behavior policies, and therefore WGCSL can be applied to both online and offline settings. To evaluate algorithms in the offline goal-conditioned RL setting, we provide a benchmark including a range of point and simulated robot domains. Experiments in the introduced benchmark demonstrate that WGCSL can consistently outperform GCSL and existing state-of-the-art offline methods in the fully offline goal-conditioned setting.

cs.LG↗

arXiv2022

A two-qubit entangling gate based on a two-spin gadget

The faster speed and operational convenience of two-qubit gate with flux bias control makes it an important candidate for future large-scale quantum computers based on high coherence flux qubits. Based on a properly designed two-spin gadget which has small gaps during the evolution of energy levels, we build a CNOT-equivalent gate which can reach a fidelity larger than 99.9% within 40ns. Moreover, we also use the Schrieffer-Wolff Transformation to translate the spin model Ising coefficients schedule to circuit model flux bias schedule for realistic flux qubit circuits coupled by a tunable rf-squid. The two-qubit entangling gate scheme introduced here is suitable for realizing efficient two-qubit gates in the large scale flux qubit systems dominated by inductive couplings. Comparing with the current gate-based quantum computation systems dominated by capacitive couplings, it can resolve the conflict between the speed and a high coherence.

quant-ph↗

arXiv2021

Radiomic biomarker extracted from PI-RADS 3 patients support more eìcient and robust prostate cancer diagnosis: a multi-center study

Prostate Imaging Reporting and Data System (PI-RADS) based on multi-parametric MRI classiêes patients into 5 categories (PI-RADS 1-5) for routine clinical diagnosis guidance. However, there is no consensus on whether PI-RADS 3 patients should go through biopsies. Mining features from these hard samples (HS) is meaningful for physicians to achieve accurate diagnoses. Currently, the mining of HS biomarkers is insuìcient, and the eéectiveness and robustness of HS biomarkers for prostate cancer diagnosis have not been explored. In this study, biomarkers from diéerent data distributions are constructed. Results show that HS biomarkers can achieve better performances in diéerent data distributions.

eess.IV↗

arXiv2021

MHER: Model-based Hindsight Experience Replay

Solving multi-goal reinforcement learning (RL) problems with sparse rewards is generally challenging. Existing approaches have utilized goal relabeling on collected experiences to alleviate issues raised from sparse rewards. However, these methods are still limited in efficiency and cannot make full use of experiences. In this paper, we propose Model-based Hindsight Experience Replay (MHER), which exploits experiences more efficiently by leveraging environmental dynamics to generate virtual achieved goals. Replacing original goals with virtual goals generated from interaction with a trained dynamics model leads to a novel relabeling method, model-based relabeling (MBR). Based on MBR, MHER performs both reinforcement learning and supervised learning for efficient policy improvement. Theoretically, we also prove the supervised part in MHER, i.e., goal-conditioned supervised learning with MBR data, optimizes a lower bound on the multi-goal RL objective. Experimental results in several point-based tasks and simulated robotics environments show that MHER achieves significantly higher sample efficiency than previous model-free and model-based multi-goal methods.

cs.LG↗

arXiv2021

Demonstration of long-range correlations via susceptibility measurements in a one-dimensional superconducting Josephson spin chain

Spin chains have long been considered an effective medium for long-range interactions, entanglement generation, and quantum state transfer. In this work, we explore the properties of a spin chain implemented with superconducting flux circuits, designed to act as a connectivity medium between two superconducting qubits. The susceptibility of the chain is probed and shown to support long-range, cross chain correlations. In addition, interactions between the two end qubits, mediated by the coupler chain, are demonstrated. This work has direct applicability in near term quantum annealing processors as a means of generating long-range, coherent coupling between qubits.

quant-ph↗

arXiv2021

Annotation-efficient deep learning for automatic medical image segmentation

Automatic medical image segmentation plays a critical role in scientific research and medical care. Existing high-performance deep learning methods typically rely on large training datasets with high-quality manual annotations, which are difficult to obtain in many clinical applications. Here, we introduce Annotation-effIcient Deep lEarning (AIDE), an open-source framework to handle imperfect training datasets. Methodological analyses and empirical evaluations are conducted, and we demonstrate that AIDE surpasses conventional fully-supervised models by presenting better performance on open datasets possessing scarce or noisy annotations. We further test AIDE in a real-life case study for breast tumor segmentation. Three datasets containing 11,852 breast images from three medical centers are employed, and AIDE, utilizing 10% training annotations, consistently produces segmentation maps comparable to those generated by fully-supervised counterparts or provided by independent radiologists. The 10-fold enhanced efficiency in utilizing expert labels has the potential to promote a wide range of biomedical applications.

eess.IV↗

arXiv2021

Experimental Quantum Generative Adversarial Networks for Image Generation

Quantum machine learning is expected to be one of the first practical applications of near-term quantum devices. Pioneer theoretical works suggest that quantum generative adversarial networks (GANs) may exhibit a potential exponential advantage over classical GANs, thus attracting widespread attention. However, it remains elusive whether quantum GANs implemented on near-term quantum devices can actually solve real-world learning tasks. Here, we devise a flexible quantum GAN scheme to narrow this knowledge gap, which could accomplish image generation with arbitrarily high-dimensional features, and could also take advantage of quantum superposition to train multiple examples in parallel. For the first time, we experimentally achieve the learning and generation of real-world hand-written digit images on a superconducting quantum processor. Moreover, we utilize a gray-scale bar dataset to exhibit the competitive performance between quantum GANs and the classical GANs based on multilayer perceptron and convolutional neural network architectures, respectively, benchmarked by the Fréchet Distance score. Our work provides guidance for developing advanced quantum generative models on near-term quantum devices and opens up an avenue for exploring quantum advantages in various GAN-related learning tasks.

quant-ph↗