arXiv subjects

Yuan Gao

Publications and source records attributed to Yuan Gao.

At least 451 records · Page 25Linked to original sources

arXiv2021

Orthogonal Jacobian Regularization for Unsupervised Disentanglement in Image Generation

Unsupervised disentanglement learning is a crucial issue for understanding and exploiting deep generative models. Recently, SeFa tries to find latent disentangled directions by performing SVD on the first projection of a pre-trained GAN. However, it is only applied to the first layer and works in a post-processing way. Hessian Penalty minimizes the off-diagonal entries of the output's Hessian matrix to facilitate disentanglement, and can be applied to multi-layers.However, it constrains each entry of output independently, making it not sufficient in disentangling the latent directions (e.g., shape, size, rotation, etc.) of spatially correlated variations. In this paper, we propose a simple Orthogonal Jacobian Regularization (OroJaR) to encourage deep generative model to learn disentangled representations. It simply encourages the variation of output caused by perturbations on different latent dimensions to be orthogonal, and the Jacobian with respect to the input is calculated to represent this variation. We show that our OroJaR also encourages the output's Hessian matrix to be diagonal in an indirect manner. In contrast to the Hessian Penalty, our OroJaR constrains the output in a holistic way, making it very effective in disentangling latent dimensions corresponding to spatially correlated variations. Quantitative and qualitative experimental results show that our method is effective in disentangled and controllable image generation, and performs favorably against the state-of-the-art methods. Our code is available at https://github.com/csyxwei/OroJaR

cs.CV↗

arXiv2021

Transverse mode selective laser with gain regulation by a digital micromirror device

A transverse mode selective laser system with gain regulation by a digital micromirror device (DMD) is presented in this letter. The gain regulation in laser medium is adjusted by the switch of the patterns loaded on DMD. Structured pump beam patterns can be obtained after the reflection of the loaded patterns on DMD, and then it's defocused into a microchip laser medium by a short focal lens, so that the pump patterns can be transferred to the gain medium to regulate the gain distribution. Corresponding structured laser beams can be generated by this laser system. The laser beam pattern can be regulated easily and quickly, by switching the loaded patterns on DMD. Through this method, we show a simple and flexible laser system to generate on-demand laser beam patterns.

physics.optics↗

arXiv2021

Global-Position Tracking Control of 3-D Bipedal Walking via Virtual Constraint Design and Multiple Lyapunov Analysis

A safety-critical measure of legged locomotion performance is a robot's ability to track its desired time-varying position trajectory in an environment, which is herein termed as "global-position tracking". This paper introduces a nonlinear control approach that achieves asymptotic global-position tracking for three-dimensional (3-D) bipedal robot walking. Designing a global-position tracking controller presents a challenging problem due to the complex hybrid robot model and the time-varying desired global-position trajectory. Towards tackling this problem, the first main contribution is the construction of impact invariance to ensure all desired trajectories respect the foot-landing impact dynamics, which is a necessary condition for realizing asymptotic tracking of hybrid walking systems. Thanks to their independence of the desired global position, these conditions can be exploited to decouple the higher-level planning of the global position and the lower-level planning of the remaining trajectories, thereby greatly alleviating the computational burden of motion planning. The second main contribution is the Lyapunov-based stability analysis of the hybrid closed-loop system, which produces sufficient conditions to guide the controller design for achieving asymptotic global-position tracking during fully actuated walking. Simulations and experiments on a 3-D bipedal robot with twenty revolute joints confirm the validity of the proposed control approach in guaranteeing accurate tracking.

cs.RO↗

arXiv2021

Transition path theory for Langevin dynamics on manifold: optimal control and data-driven solver

We present a data-driven point of view for rare events, which represent conformational transitions in biochemical reactions modeled by over-damped Langevin dynamics on manifolds in high dimensions. We first reinterpret the transition state theory and the transition path theory from the optimal control viewpoint. Given point clouds sampled from a reaction dynamics, we construct a discrete Markov process based on an approximated Voronoi tesselation. We use the constructed Markov process to compute a discrete committor function whose level set automatically orders the point clouds. Then based on the committor function, an optimally controlled random walk on point clouds is constructed and utilized to efficiently sample transition paths, which become an almost sure event in $O(1)$ time instead of a rare event in the original reaction dynamics. To compute the mean transition path efficiently, a local averaging algorithm based on the optimally controlled random walk is developed, which adapts the finite temperature string method to the controlled Monte Carlo samples. Numerical examples on sphere/torus including a conformational transition for the alanine dipeptide in vacuum are conducted to illustrate the data-driven solver for the transition path theory on point clouds. The mean transition path obtained via the controlled Monte Carlo simulations highly coincides with the computed dominant transition path in the transition path theory.

math.OC↗

arXiv2021

Significant Inverse Magnetocaloric Effect induced by Quantum Criticality

The criticality-enhanced magnetocaloric effect (MCE) near a field-induced quantum critical point (QCP) in the spin systems constitutes a very promising and highly tunable alternative to conventional adiabatic demagnetization refrigeration. Strong fluctuations in the low-$T$ quantum critical regime can give rise to a large thermal entropy change and thus significant cooling effect when approaching the QCP. In this work, through efficient and accurate many-body calculations, we show there exists a significant inverse MCE(iMCE) in the spin-1 quantum chain materials(CH$_3$)$_4$NNi(NO$_2$)$_3$ (TMNIN) and NiCl$_2$-4SC(NH$_2$)$_2$ (DTN), where DTN has substantial low-$T$ refrigeration capacity while requiring only moderate magnetic fields. The iMCE characteristics, including the adiabatic temperature change $ΔT_{\rm ad}$, isothermal entropy change $ΔS$, differential Grüneisen parameter, and the entropy change rate, are obtained with quantum many-body calculations at finite temperature. The cooling performance, i.e., the efficiency factor and hold time, of the two compounds is also discussed. Based on the many-body calculations on realistic models for the spin-chain materials, we conclude that the compound DTN constitutes a very promising and highly efficient quantum magnetic coolant with pronounced iMCE properties. We advocate that such quantum magnets can be used in cryofree refrigeration for space applications and quantum computing environments.

cond-mat.str-el↗

arXiv2021

Double strangeness $Ξ^{-}$ production as a probe of nuclear equation of state at high densities

Double strangeness $Ξ^{-}$ production in Au+Au collisions at 2, 4, and 6 GeV/nucleon incident beam energies is studied with the pure hadron cascade version of a multi-phase transport model. It is found that due to larger nuclear compression, the model with the soft equation of state (EoS) gives larger yields of both single strangeness ($K^{+}$ and $Λ+Σ^{0}$) and double strangeness $Ξ^{-}$. The sensitivity of the double strangeness $Ξ^{-}$ to the EoS is evidently larger than that of $K^{+}$ or $Λ+Σ^{0}$ since the phase-space distribution of produced $Ξ^{-}$ is more compact compared to those of the single strangeness. The larger sensitivity of the yields ratio of $Ξ^{-}$ to the EoS from heavy and light systems is kept compared to that of the single strangeness. The study of $Ξ^{-}$ production in relativistic heavy-ion collisions provides an alternative for the ongoing heavy-ion collision program at facilities worldwide for identifying the EoS at high densities, which is relevant to the investigation of the phase boundary and onset of deconfinement of dense nuclear matter.

nucl-th↗

arXiv2021

1st Place Solutions for UG2+ Challenge 2021 -- (Semi-)supervised Face detection in the low light condition

In this technical report, we briefly introduce the solution of our team "TAL-ai" for (Semi-) supervised Face detection in the low light condition in UG2+ Challenge in CVPR 2021. By conducting several experiments with popular image enhancement methods and image transfer methods, we pulled the low light image and the normal image to a more closer domain. And it is observed that using these data to training can achieve better performance. We also adapt several popular object detection frameworks, e.g., DetectoRS, Cascade-RCNN, and large backbone like Swin-transformer. Finally, we ensemble several models which achieved mAP 74.89 on the testing set, ranking 1st on the final leaderboard.

cs.CV↗

arXiv2021

Identification of Magnetic Interactions and High-field Quantum Spin Liquid in $α$-RuCl$_3$

The frustrated magnet $α$-RuCl$_3$ constitutes a fascinating quantum material platform that harbors the intriguing Kitaev physics. However, a consensus on its intricate spin interactions and field-induced quantum phases has not been reached yet. Here we exploit multiple state-of-the-art many-body methods and determine the microscopic spin model that quantitatively explains major observations in $α$-RuCl$_3$, including the zigzag order, double-peak specific heat, magnetic anisotropy, and the characteristic M-star dynamical spin structure, etc. According to our model simulations, the in-plane field drives the system into the polarized phase at about 7 T and a thermal fractionalization occurs at finite temperature, reconciling observations in different experiments. Under out-of-plane fields, the zigzag order is suppressed at 35 T, above which, and below a polarization field of 100 T level, there emerges a field-induced quantum spin liquid. The fractional entropy and algebraic low-temperature specific heat unveil the nature of a gapless spin liquid, which can be explored in high-field measurements on $α$-RuCl$_3$.

cond-mat.str-el↗

arXiv2021

Towards Explainable Multi-Party Learning: A Contrastive Knowledge Sharing Framework

Multi-party learning provides solutions for training joint models with decentralized data under legal and practical constraints. However, traditional multi-party learning approaches are confronted with obstacles such as system heterogeneity, statistical heterogeneity, and incentive design. How to deal with these challenges and further improve the efficiency and performance of multi-party learning has become an urgent problem to be solved. In this paper, we propose a novel contrastive multi-party learning framework for knowledge refinement and sharing with an accountable incentive mechanism. Since the existing naive model parameter averaging method is contradictory to the learning paradigm of neural networks, we simulate the process of human cognition and communication, and analogy multi-party learning as a many-to-one knowledge sharing problem. The approach is capable of integrating the acquired explicit knowledge of each client in a transparent manner without privacy disclosure, and it reduces the dependence on data distribution and communication environments. The proposed scheme achieves significant improvement in model performance in a variety of scenarios, as we demonstrated through experiments on several real-world datasets.

cs.LG↗

arXiv2021

A Multiobjective State Transition Algorithm Based on Decomposition

Aggregation functions largely determine the convergence and diversity performance of multi-objective evolutionary algorithms in decomposition methods. Nevertheless, the traditional Tchebycheff function does not consider the matching relationship between the weight vectors and candidate solutions. In this paper, the concept of matching degree is proposed which employs vectorial angles between weight vectors and candidate solutions. Based on the matching degree, a new modified Tchebycheff aggregation function is proposed, which integrates matching degree into the Tchebycheff aggregation function. Moreover, the proposed decomposition method has the same functionality with the Tchebycheff aggregation function. Based on the proposed decomposition approach, a new multiobjective optimization algorithm named decomposition-based multi-objective state transition algorithm is proposed. Relevant experimental results show that the proposed algorithm is highly competitive in comparison with other state-of-the-art multiobjetive optimization algorithms.

math.OC↗

arXiv2021

Multi-Party Dual Learning

The performance of machine learning algorithms heavily relies on the availability of a large amount of training data. However, in reality, data usually reside in distributed parties such as different institutions and may not be directly gathered and integrated due to various data policy constraints. As a result, some parties may suffer from insufficient data available for training machine learning models. In this paper, we propose a multi-party dual learning (MPDL) framework to alleviate the problem of limited data with poor quality in an isolated party. Since the knowledge sharing processes for multiple parties always emerge in dual forms, we show that dual learning is naturally suitable to handle the challenge of missing data, and explicitly exploits the probabilistic correlation and structural relationship between dual tasks to regularize the training process. We introduce a feature-oriented differential privacy with mathematical proof, in order to avoid possible privacy leakage of raw features in the dual inference process. The approach requires minimal modifications to the existing multi-party learning structure, and each party can build flexible and powerful models separately, whose accuracy is no less than non-distributed self-learning approaches. The MPDL framework achieves significant improvement compared with state-of-the-art multi-party learning methods, as we demonstrated through simulations on real-world datasets.

cs.LG↗

arXiv2021

Infinite-Dimensional Fisher Markets and Tractable Fair Division

Linear Fisher markets are a fundamental economic model with applications in fair division as well as large-scale Internet markets. In the finite-dimensional case of $n$ buyers and $m$ items, a market equilibrium can be computed using the Eisenberg-Gale convex program. Motivated by large-scale Internet advertising and fair division applications, this paper considers a generalization of a linear Fisher market where there is a finite set of buyers and a continuum of items. We introduce generalizations of the Eisenberg-Gale convex program and its dual to this infinite-dimensional setting, which leads to Banach-space optimization problems. We establish existence of optimal solutions, strong duality, as well as necessity and sufficiency of KKT-type conditions. All these properties are established via non-standard arguments, which circumvent the limitations of duality theory in optimization over infinite-dimensional Banach spaces. Furthermore, we show that there exists a pure equilibrium allocation, i.e., a division of the item space. When the item space is a closed interval and buyers have piecewise linear valuations, we show that the Eisenberg-Gale-type convex program over the infinite-dimensional allocations can be reformulated as a finite-dimensional convex conic program, which can be solved efficiently using off-the-shelf optimization software based on primal-dual interior-point methods. Based on our convex conic reformulation, we develop the first polynomial-time cake-cutting algorithm that achieves Pareto optimality, envy-freeness, and proportionality. For general buyer valuations or a very large number of buyers, we propose computing market equilibrium using stochastic dual averaging, which finds approximate equilibrium prices with high probability. Finally, we discuss how the above results easily extend to the case of quasilinear utilities.

cs.GT↗

arXiv2021

An attention-based unsupervised adversarial model for movie review spam detection

With the prevalence of the Internet, online reviews have become a valuable information resource for people. However, the authenticity of online reviews remains a concern, and deceptive reviews have become one of the most urgent network security problems to be solved. Review spams will mislead users into making suboptimal choices and inflict their trust in online reviews. Most existing research manually extracted features and labeled training samples, which are usually complicated and time-consuming. This paper focuses primarily on a neglected emerging domain - movie review, and develops a novel unsupervised spam detection model with an attention mechanism. By extracting the statistical features of reviews, it is revealed that users will express their sentiments on different aspects of movies in reviews. An attention mechanism is introduced in the review embedding, and the conditional generative adversarial network is exploited to learn users' review style for different genres of movies. The proposed model is evaluated on movie reviews crawled from Douban, a Chinese online community where people could express their feelings about movies. The experimental results demonstrate the superior performance of the proposed approach.

cs.MM↗

arXiv2021

Recognizing Micro-Expression in Video Clip with Adaptive Key-Frame Mining

As a spontaneous expression of emotion on face, micro-expression reveals the underlying emotion that cannot be controlled by human. In micro-expression, facial movement is transient and sparsely localized through time. However, the existing representation based on various deep learning techniques learned from a full video clip is usually redundant. In addition, methods utilizing the single apex frame of each video clip require expert annotations and sacrifice the temporal dynamics. To simultaneously localize and recognize such fleeting facial movements, we propose a novel end-to-end deep learning architecture, referred to as adaptive key-frame mining network (AKMNet). Operating on the video clip of micro-expression, AKMNet is able to learn discriminative spatio-temporal representation by combining spatial features of self-learned local key frames and their global-temporal dynamics. Theoretical analysis and empirical evaluation show that the proposed approach improved recognition accuracy in comparison with state-of-the-art methods on multiple benchmark datasets.

cs.CV↗

arXiv2021

Principled Ultrasound Data Augmentation for Classification of Standard Planes

Deep learning models with large learning capacities often overfit to medical imaging datasets. This is because training sets are often relatively small due to the significant time and financial costs incurred in medical data acquisition and labelling. Data augmentation is therefore often used to expand the availability of training data and to increase generalization. However, augmentation strategies are often chosen on an ad-hoc basis without justification. In this paper, we present an augmentation policy search method with the goal of improving model classification performance. We include in the augmentation policy search additional transformations that are often used in medical image analysis and evaluate their performance. In addition, we extend the augmentation policy search to include non-linear mixed-example data augmentation strategies. Using these learned policies, we show that principled data augmentation for medical image model training can lead to significant improvements in ultrasound standard plane detection, with an an average F1-score improvement of 7.0% overall over naive data augmentation strategies in ultrasound fetal standard plane classification. We find that the learned representations of ultrasound images are better clustered and defined with optimized data augmentation.

cs.CV↗

arXiv2021

Thermal Conductivities and Interfacial Thermal Conductance of 1- to 3-Layer WSe$_2$

Atomically thin materials such as graphene and semiconducting transition metal dichalcogenides have attracted extensive interest in recent years, motivating investigation into multiple properties. In this work, we used the opto thermal Raman technique to measure the thermal transport properties of a popular TMDC material WSe$_2$, in single atomic layer, bilayer, and trilayer forms.

cond-mat.mtrl-sci↗

arXiv2021

Projection method for droplet dynamics on groove-textured surface with merging and splitting

The geometric motion of small droplets placed on an impermeable textured substrate is mainly driven by the capillary effect, the competition among surface tensions of three phases at the moving contact lines, and the impermeable substrate obstacle. After introducing an infinite dimensional manifold with an admissible tangent space on the boundary of the manifold, by Onsager's principle for an obstacle problem, we derive the associated parabolic variational inequalities. These variational inequalities can be used to simulate the contact line dynamics with unavoidable merging and splitting of droplets due to the impermeable obstacle. To efficiently solve the parabolic variational inequality, we propose an unconditional stable explicit boundary updating scheme coupled with a projection method. The explicit boundary updating efficiently decouples the computation of the motion by mean curvature of the capillary surface and the moving contact lines. Meanwhile, the projection step efficiently splits the difficulties brought by the obstacle and the motion by mean curvature of the capillary surface. Furthermore, we prove the unconditional stability of the scheme and present an accuracy check. The convergence of the proposed scheme is also proved using a nonlinear Trotter-Kato's product formula under the pinning contact line assumption. After incorporating the phase transition information at splitting points, several challenging examples including splitting and merging of droplets are demonstrated.

math.NA↗

arXiv2021

Factor-augmented Smoothing Model for Functional Data

We propose modeling raw functional data as a mixture of a smooth function and a highdimensional factor component. The conventional approach to retrieving the smooth function from the raw data is through various smoothing techniques. However, the smoothing model is not adequate to recover the smooth curve or capture the data variation in some situations. These include cases where there is a large amount of measurement error, the smoothing basis functions are incorrectly identified, or the step jumps in the functional mean levels are neglected. To address these challenges, a factor-augmented smoothing model is proposed, and an iterative numerical estimation approach is implemented in practice. Including the factor model component in the proposed method solves the aforementioned problems since a few common factors often drive the variation that cannot be captured by the smoothing model. Asymptotic theorems are also established to demonstrate the effects of including factor structures on the smoothing results. Specifically, we show that the smoothing coefficients projected on the complement space of the factor loading matrix is asymptotically normal. As a byproduct of independent interest, an estimator for the population covariance matrix of the raw data is presented based on the proposed model. Extensive simulation studies illustrate that these factor adjustments are essential in improving estimation accuracy and avoiding the curse of dimensionality. The superiority of our model is also shown in modeling Canadian weather data and Australian temperature data.

stat.ME↗