arXiv subjects

Yuan Gao

Publications and source records attributed to Yuan Gao.

At least 397 records · Page 22Linked to original sources

arXiv2023

Synthesis-based Imaging-Differentiation Representation Learning for Multi-Sequence 3D/4D MRI

Multi-sequence MRIs can be necessary for reliable diagnosis in clinical practice due to the complimentary information within sequences. However, redundant information exists across sequences, which interferes with mining efficient representations by modern machine learning or deep learning models. To handle various clinical scenarios, we propose a sequence-to-sequence generation framework (Seq2Seq) for imaging-differentiation representation learning. In this study, not only do we propose arbitrary 3D/4D sequence generation within one model to generate any specified target sequence, but also we are able to rank the importance of each sequence based on a new metric estimating the difficulty of a sequence being generated. Furthermore, we also exploit the generation inability of the model to extract regions that contain unique information for each sequence. We conduct extensive experiments using three datasets including a toy dataset of 20,000 simulated subjects, a brain MRI dataset of 1,251 subjects, and a breast MRI dataset of 2,101 subjects, to demonstrate that (1) our proposed Seq2Seq is efficient and lightweight for complex clinical datasets and can achieve excellent image quality; (2) top-ranking sequences can be used to replace complete sequences with non-inferior performance; (3) combining MRI with our imaging-differentiation map leads to better performance in clinical tasks such as glioblastoma MGMT promoter methylation status prediction and breast cancer pathological complete response status prediction. Our code is available at https://github.com/fiy2W/mri_seq2seq.

cs.CV↗

arXiv2023

Coulomb potential determining terahertz polarization in two-color laser field

The orientation and ellipticity of terahertz (THz) polarization generated by two-color strong field not only cast light on underlying mechanisms of laser-matter interaction, but also play an important role for various applications. We develop the Coulomb-corrected classical trajectory Monte Carlo (CTMC) method to well reproduce the joint measurements, that the THz polarization generated by the linearly-polarized 800 nm and circularly-polarized 400 nm fields is independent on two-color phase delay. The trajectory analysis shows that the Coulomb potential twists the THz polarization by deflecting the orientation of asymptotic momentum of electron trajectories. Further, the CTMC calculations predict that, the two-color mid-infrared field can effectively accelerate the electron rapidly away from the parent core to relieve the disturbance of Coulomb potential, and simultaneously create large transverse acceleration of trajectories, leading to the circularly-polarized THz radiation.

physics.optics↗

arXiv2022

Rabinowitz Fukaya categories and the categorical formal punctured neighborhood of infinity

This paper constructs and studies the Rabinowitz (wrapped) Fukaya category, a categorical invariant of exact cylindrical Lagrangians in a Liouville manifold whose cohomological morphisms, ``Rabinowitz wrapped Floer homology groups" measure the failure of wrapped Floer cohomology to satisfy Poincare duality (and in particular vanish for any pair with at least one compact Lagrangian). Our main result, answering a conjecture of Abouzaid, relates the Rabinowitz and usual wrapped Fukaya category by way of a general construction introduced by Efimov, the categorical formal punctured neighborhood of infinity. As an application, we show how Rabinowitz Fukaya categories can be fit into - and in particular often computed in terms of - mirror symmetry.

math.SG↗

arXiv2022

Wormhole MAML: Meta-Learning in Glued Parameter Space

In this paper, we introduce a novel variation of model-agnostic meta-learning, where an extra multiplicative parameter is introduced in the inner-loop adaptation. Our variation creates a shortcut in the parameter space for the inner-loop adaptation and increases model expressivity in a highly controllable manner. We show both theoretically and numerically that our variation alleviates the problem of conflicting gradients and improves training dynamics. We conduct experiments on 3 distinctive problems, including a toy classification problem for threshold comparison, a regression problem for wavelet transform, and a classification problem on MNIST. We also discuss ways to generalize our method to a broader class of problems.

cs.LG↗

arXiv2022

1st Place Solution for YouTubeVOS Challenge 2022: Referring Video Object Segmentation

The task of referring video object segmentation aims to segment the object in the frames of a given video to which the referring expressions refer. Previous methods adopt multi-stage approach and design complex pipelines to obtain promising results. Recently, the end-to-end method based on Transformer has proved its superiority. In this work, we draw on the advantages of the above methods to provide a simple and effective pipeline for RVOS. Firstly, We improve the state-of-the-art one-stage method ReferFormer to obtain mask sequences that are strongly correlated with language descriptions. Secondly, based on a reliable and high-quality keyframe, we leverage the superior performance of video object segmentation model to further enhance the quality and temporal consistency of the mask results. Our single model reaches 70.3 J &F on the Referring Youtube-VOS validation set and 63.0 on the test set. After ensemble, we achieve 64.1 on the final leaderboard, ranking 1st place on CVPR2022 Referring Youtube-VOS challenge. Code will be available at https://github.com/Zhiweihhh/cvpr2022-rvos-challenge.git.

cs.CV↗

arXiv2022

Time-Varying ALIP Model and Robust Foot-Placement Control for Underactuated Bipedal Robot Walking on a Swaying Rigid Surface

Controller design for bipedal walking on dynamic rigid surfaces (DRSes), which are rigid surfaces moving in the inertial frame (e.g., ships and airplanes), remains largely uninvestigated. This paper introduces a hierarchical control approach that achieves stable underactuated bipedal robot walking on a horizontally oscillating DRS. The highest layer of our approach is a real-time motion planner that generates desired global behaviors (i.e., the center of mass trajectories and footstep locations) by stabilizing a reduced-order robot model. One key novelty of this layer is the derivation of the reduced-order model by analytically extending the angular momentum based linear inverted pendulum (ALIP) model from stationary to horizontally moving surfaces. The other novelty is the development of a discrete-time foot-placement controller that exponentially stabilizes the hybrid, linear, time-varying ALIP model. The middle layer of the proposed approach is a walking pattern generator that translates the desired global behaviors into the robot's full-body reference trajectories for all directly actuated degrees of freedom. The lowest layer is an input-output linearizing controller that exponentially tracks those full-body reference trajectories based on the full-order, hybrid, nonlinear robot dynamics. Simulations of planar underactuated bipedal walking on a swaying DRS confirm that the proposed framework ensures the walking stability under different DRS motions and gait types.

cs.RO↗

arXiv2022

Tripling energy storage density through order-disorder transition induced polar nanoregions in PbZrO3 thin films by ion implantation

Dielectric capacitors are widely used in pulsed power electronic devices due to their ultrahigh power densities and extremely fast charge/discharge speed. To achieve enhanced energy storage density, both maximum polarization (Pmax) and breakdown strength (Eb) need to be improved simultaneously. However, these two key parameters are inversely correlated. In this study, order-disorder transition induced polar nanoregions (PNRs) have been achieved in PbZrO3 thin films by making use of the low-energy ion implantation, enabling us overcome the trade-off between high polarizability and breakdown strength, which leads to the tripling of the energy storage density from 20.5 J/cm3 to 62.3 J/cm3 as well as the great enhancement of breakdown strength. This approach could be extended to other dielectric oxides to improve the energy storage performance, providing a new pathway for tailoring the oxide functionalities.

cond-mat.mtrl-sci↗

arXiv2022

MFFN: Multi-view Feature Fusion Network for Camouflaged Object Detection

Recent research about camouflaged object detection (COD) aims to segment highly concealed objects hidden in complex surroundings. The tiny, fuzzy camouflaged objects result in visually indistinguishable properties. However, current single-view COD detectors are sensitive to background distractors. Therefore, blurred boundaries and variable shapes of the camouflaged objects are challenging to be fully captured with a single-view detector. To overcome these obstacles, we propose a behavior-inspired framework, called Multi-view Feature Fusion Network (MFFN), which mimics the human behaviors of finding indistinct objects in images, i.e., observing from multiple angles, distances, perspectives. Specifically, the key idea behind it is to generate multiple ways of observation (multi-view) by data augmentation and apply them as inputs. MFFN captures critical boundary and semantic information by comparing and fusing extracted multi-view features. In addition, our MFFN exploits the dependence and interaction between views and channels. Specifically, our methods leverage the complementary information between different views through a two-stage attention module called Co-attention of Multi-view (CAMV). And we design a local-overall module called Channel Fusion Unit (CFU) to explore the channel-wise contextual clues of diverse feature maps in an iterative manner. The experiment results show that our method performs favorably against existing state-of-the-art methods via training with the same data. The code will be available at https://github.com/dwardzheng/MFFN_COD.

cs.CV↗

arXiv2022

Nonstationary Dual Averaging and Online Fair Allocation

We consider the problem of fairly allocating items to a set of individuals, when the items are arriving online. A central solution concept in fair allocation is competitive equilibrium: every individual is endowed with a budget of faux currency, and the resulting competitive equilibrium is used to allocate. For the online fair allocation context, the PACE algorithm of Gao et al. [2021] leverages the dual averaging algorithm to approximate competitive equilibria. The authors show that, when items arrive i.i.d, the algorithm asymptotically achieves the fairness and efficiency guarantees of the offline competitive equilibrium allocation. However, real-world data is typically not stationary. One could instead model the data as adversarial, but this is often too pessimistic in practice. Motivated by this consideration, we study an online fair allocation setting with nonstationary item arrivals. To address this setting, we first develop new online learning results for the dual averaging algorithm under nonstationary input models. We show that the dual averaging iterates converge in mean square to both the underlying optimal solution of the "true" stochastic optimization problem as well as the "hindsight" optimal solution of the finite-sum problem given by the sample path. Our results apply to several nonstationary input models: adversarial corruption, ergodic input, and block-independent (including periodic) input. Here, the bound on the mean square error depends on a nonstationarity measure of the input. We recover the classical bound when the input data is i.i.d. We then show that our dual averaging results imply that the PACE algorithm for online fair allocation simultaneously achieves "best of both worlds" guarantees against any of these input models. Finally, we conduct numerical experiments which show strong empirical performance against nonstationary inputs.

cs.GT↗

arXiv2022

MRI-based Material Mass Density and Relative Stopping Power Estimation via Deep Learning for Proton Therapy

Magnetic Resonance Imaging (MRI) is increasingly incorporated into treatment planning, because of its superior soft tissue contrast used for tumor and soft tissue delineation versus computed tomography (CT). However, MRI cannot directly provide mass density or relative stopping power (RSP) maps required for proton radiotherapy dose calculation. To demonstrate the feasibility of MRI-only based mass density and RSP estimation using deep learning (DL) for proton radiotherapy. A DL-based framework was developed to discover underlying voxel-wise correlation between MR images and mass density and RSP. Five tissue substitute phantoms including skin, muscle, adipose, 45% hydroxyapatite (HA), and spongiosa bone were customized for MRI scanning based on material composition information from ICRP reports. Two animal tissue phantoms made of pig brain and liver were prepared for DL training. In the phantom study, two DL models were trained: one containing clinical T1 and T2 MRIs and another incorporating zero echo time (ZTE) MRIs as input. In the patient application study, two DL models were trained: one including T1 and T2 MRIs as input, and one incorporating synthetic dual-energy computed tomography (sDECT) images to provide bone tissue information. In the phantom study, DL model based on T1 and T2 MRI demonstrated higher accuracy mass density and RSP estimation in skin, muscle, adipose, brain, and liver with mean absolute percentage errors (MAPE) of 0.42%, 0.14%, 0.19%, 0.78% and 0.26% for mass density and 0.30%, 0.11%, 0.16%, 0.61% and 0.23% for RSP, respectively. DL model incorporating ZTE MRI improved the accuracy of mass density and RSP estimation in 45% HA and spongiosa bone with MAPE at 0.23% and 0.09% for mass density and 0.19% and 0.07% for RSP, respectively. Results show feasibility of MRI-only based mass density and RSP estimation for proton therapy treatment planning using DL method.

physics.med-ph↗

arXiv2022

MultiRoboLearn: An open-source Framework for Multi-robot Deep Reinforcement Learning

It is well known that it is difficult to have a reliable and robust framework to link multi-agent deep reinforcement learning algorithms with practical multi-robot applications. To fill this gap, we propose and build an open-source framework for multi-robot systems called MultiRoboLearn1. This framework builds a unified setup of simulation and real-world applications. It aims to provide standard, easy-to-use simulated scenarios that can also be easily deployed to real-world multi-robot environments. Also, the framework provides researchers with a benchmark system for comparing the performance of different reinforcement learning algorithms. We demonstrate the generality, scalability, and capability of the framework with two real-world scenarios2 using different types of multi-agent deep reinforcement learning algorithms in discrete and continuous action spaces.

cs.RO↗

arXiv2022

Data-driven Efficient Solvers for Langevin Dynamics on Manifold in High Dimensions

We study the Langevin dynamics of a physical system with manifold structure $\mathcal{M}\subset\mathbb{R}^p$ based on collected sample points $\{\mathsf{x}_i\}_{i=1}^n \subset \mathcal{M}$ that probe the unknown manifold $\mathcal{M}$. Through the diffusion map, we first learn the reaction coordinates $\{\mathsf{y}_i\}_{i=1}^n\subset \mathcal{N}$ corresponding to $\{\mathsf{x}_i\}_{i=1}^n$, where $\mathcal{N}$ is a manifold diffeomorphic to $\mathcal{M}$ and isometrically embedded in $\mathbb{R}^\ell$ with $\ell \ll p$. The induced Langevin dynamics on $\mathcal{N}$ in terms of the reaction coordinates captures the slow time scale dynamics such as conformational changes in biochemical reactions. To construct an efficient and stable approximation for the Langevin dynamics on $\mathcal{N}$, we leverage the corresponding Fokker-Planck equation on the manifold $\mathcal{N}$ in terms of the reaction coordinates $\mathsf{y}$. We propose an implementable, unconditionally stable, data-driven finite volume scheme for this Fokker-Planck equation, which automatically incorporates the manifold structure of $\mathcal{N}$. Furthermore, we provide a weighted $L^2$ convergence analysis of the finite volume scheme to the Fokker-Planck equation on $\mathcal{N}$. The proposed finite volume scheme leads to a Markov chain on $\{\mathsf{y}_i\}_{i=1}^n$ with an approximated transition probability and jump rate between the nearest neighbor points. After an unconditionally stable explicit time discretization, the data-driven finite volume scheme gives an approximated Markov process for the Langevin dynamics on $\mathcal{N}$ and the approximated Markov process enjoys detailed balance, ergodicity, and other good properties.

math.NA↗

arXiv2022

Spin Supersolidity in Nearly Ideal Easy-axis Triangular Quantum Antiferromagnet Na$_2$BaCo(PO$_4$)$_2$

Prototypical models and their material incarnations are cornerstones to the understanding of quantum magnetism. Here we show theoretically that the recently synthesized magnetic compound Na$_2$BaCo(PO$_4$)$_2$ (NBCP) is a rare, nearly ideal material realization of the $S=1/2$ triangular-lattice antiferromagnet with significant easy-axis spin exchange anisotropy. By combining the automatic parameter searching and tensor-network simulations, we establish a microscopic model description of this material with realistic model parameters, which can not only fit well the experimental thermodynamic data but also reproduce the measured magnetization curves without further adjustment of parameters. According to the established model, the NBCP hosts a spin supersolid state that breaks both the lattice translation symmetry and the spin rotational symmetry. Such a state is a spin analogue of the long-sought supersolid state, thought to exist in solid Helium and optical lattice systems, and share similar traits. The NBCP therefore represents an ideal material-based platform to explore the physics of supersolidity as well as its quantum and thermal melting.

cond-mat.str-el↗

arXiv2022

Customizable Laguerre-Gaussian Perfect Vortex Beams

The recognition in the 1990s that vortex beams (VBs), paraxial light beams with optical vortices, carry orbital angular momentum (OAM), has benefited applications ranging from optical manipulation to high-dimensional classical and quantum information communications. The transverse profiles of common VBs, e.g., Laguerre-Gaussian beam and high-order Bessel beam, are hollow donuts whose radii grow up with OAM inevitably. The inherently unperfect character of the VBs that the radius is always positively correlated with OAM, restricts the application of the VBs in many scenarios like fiber optic data transmission, spatial OAM mode (de)multiplexing communication, and particle manipulation, which call for VBs to have the same scale with distinct OAM or even the small vortex ring for large OAM. Here, we derived a theory based on the most widely used Laguerre-Gaussian beam to generate a brand new type of VB with OAM-independent radii that moves away from the common unperfect constraint, called Laguerre-Gaussian Perfect Vortex Beam (LGPVB). LGPVBs have the self-similar property like common Laguerre-Gaussian beams but can self-heal after suffering disturbance and always remain 'perfection' when propagating. Our Fourier-space design not only allows us to shape the LGPVB's propagating intensity at will, but it also gives LGPVB the fascinating potential to arbitrarily self-accelerate while still perfectly propagating, self-similar, and self-healing. This customizable self-healing LGPVB, whose properties inform our most expectations of VBs, offers a better alternative for application scenarios of common VBs in a wide range of areas.

physics.optics↗

arXiv2022

Revisit of macroscopic dynamics for some non-equilibrium chemical reactions from a Hamiltonian viewpoint

Most biochemical reactions in living cells are open systems interacting with environment through chemostats to exchange both energy and materials. At a mesoscopic scale, the number of each species in those biochemical reactions can be modeled by a random time-changed Poisson processes. To characterize macroscopic behaviors in the large volume limit, the law of large numbers in the path space determines a mean-field limit nonlinear reaction rate equation describing the dynamics of the concentration of species, while the WKB expansion for the chemical master equation yields a Hamilton-Jacobi equation (HJE) and the Lagrangian gives the good rate function in the large deviation principle. We decompose a general macroscopic reaction rate equation into a conservative part and a dissipative part in terms of the stationary solution to HJE. This stationary solution is used to determine the energy landscape and thermodynamics for general chemical reactions, which particularly maintains a positive entropy production rate at a non-equilibrium steady state. The associated energy dissipation law is proved together with the passage from the mesoscopic to macroscopic one. Furthermore, we use a reversible Hamiltonian to study a class of non-equilibrium enzyme reactions, which identifies a new concept of balance within the same reaction vector due to flux grouping degeneracy. This macroscopic reversibility, brought by the reversibility of the chemical reaction jumping process, gives an Onsager-type strong gradient flow. The reversible Hamiltonian also yields a time reversal symmetry for the corresponding Lagrangian. Thus a modified time reversed least action path serves as the transition paths with associated path affinities and energy barriers.

math.OC↗

arXiv2022

Versatile Non-diffracting Perfect Vortex Beams

The rapid scale broadening and divergence increasing of vortex beams (VBs) with orbital angular momentum (OAM), e.g., Laguerre-Gaussian beams, severely impede the wide applications of VBs ranging from optical manipulation to high-dimensional quantum information communications, which call for VBs to have the same transverse scale and divergence for distinct OAM or even the small vortex ring for large OAM. Non-diffracting beams, on the other hand, that are capable of overcoming diffraction without divergence, are very evocative and indeed appealing in numerous applications including atom optics and medical imaging. Here, we propose theoretically and demonstrate experimentally a brand new type of VB having OAM-independent radii meanwhile holding propagation-invariant without divergence as well as self-healing properties, named non-diffracting perfect vortex beam (NDPVB). We work out a versatile toolkit based on Fourier-space analysis to multidimensionally customize NDPVBs at will so that it is of propagating intensity and phase controllability with intriguing customizable behaviors of self-accelerating, self-similar, and self-rotating. This goes beyond tailoring the transverse plane to the higher-dimensional propagating characteristics in structured light beams. A deeper insight into the internal flow revealed and confirmed that the multidimensional customization of NDPVBs is dominated by inducing corresponding multidimensional internal flow, facilitating our understanding of how our design scheme of propagating properties manipulates the internal flows, unveiling the nature of structure formation and behavior transformation of structured light beams.

physics.optics↗

arXiv2022

Learning to Coordinate for a Worker-Station Multi-robot System in Planar Coverage Tasks

For massive large-scale tasks, a multi-robot system (MRS) can effectively improve efficiency by utilizing each robot's different capabilities, mobility, and functionality. In this paper, we focus on the multi-robot coverage path planning (mCPP) problem in large-scale planar areas with random dynamic interferers in the environment, where the robots have limited resources. We introduce a worker-station MRS consisting of multiple workers with limited resources for actual work, and one station with enough resources for resource replenishment. We aim to solve the mCPP problem for the worker-station MRS by formulating it as a fully cooperative multi-agent reinforcement learning problem. Then we propose an end-to-end decentralized online planning method, which simultaneously solves coverage planning for workers and rendezvous planning for station. Our method manages to reduce the influence of random dynamic interferers on planning, while the robots can avoid collisions with them. We conduct simulation and real robot experiments, and the comparison results show that our method has competitive performance in solving the mCPP problem for worker-station MRS in metric of task finish time.

cs.RO↗

arXiv2022

Exploring High-quality Target Domain Information for Unsupervised Domain Adaptive Semantic Segmentation

In unsupervised domain adaptive (UDA) semantic segmentation, the distillation based methods are currently dominant in performance. However, the distillation technique requires complicate multi-stage process and many training tricks. In this paper, we propose a simple yet effective method that can achieve competitive performance to the advanced distillation methods. Our core idea is to fully explore the target-domain information from the views of boundaries and features. First, we propose a novel mix-up strategy to generate high-quality target-domain boundaries with ground-truth labels. Different from the source-domain boundaries in previous works, we select the high-confidence target-domain areas and then paste them to the source-domain images. Such a strategy can generate the object boundaries in target domain (edge of target-domain object areas) with the correct labels. Consequently, the boundary information of target domain can be effectively captured by learning on the mixed-up samples. Second, we design a multi-level contrastive loss to improve the representation of target-domain data, including pixel-level and prototype-level contrastive learning. By combining two proposed methods, more discriminative features can be extracted and hard object boundaries can be better addressed for the target domain. The experimental results on two commonly adopted benchmarks (\textit{i.e.}, GTA5 $\rightarrow$ Cityscapes and SYNTHIA $\rightarrow$ Cityscapes) show that our method achieves competitive performance to complicated distillation methods. Notably, for the SYNTHIA$\rightarrow$ Cityscapes scenario, our method achieves the state-of-the-art performance with $57.8\%$ mIoU and $64.6\%$ mIoU on 16 classes and 13 classes. Code is available at https://github.com/ljjcoder/EHTDI.

cs.CV↗