arXiv Science⌕ Search

arXiv subjects

Liu Yang

Publications and source records attributed to Liu Yang.

At least 145 records · Page 8Linked to original sources
arXiv2023

Irregular proton injection to high energies at interplanetary shocks

How thermal particles are accelerated to suprathermal energies is an unsolved issue, crucial for many astrophysical systems. We report novel observations of irregular, dispersive enhancements of the suprathermal particle population upstream of a high-Mach number interplanetary shock. We interpret the observed behavior as irregular "injections" of suprathermal particles resulting from shock front irregularities. Our findings, directly compared to self-consistent simulation results, provide important insights for the study of remote astrophysical systems where shock structuring is often neglected.

physics.space-ph↗
arXiv2023

In-Context Operator Learning with Data Prompts for Differential Equation Problems

This paper introduces a new neural-network-based approach, namely In-Context Operator Networks (ICON), to simultaneously learn operators from the prompted data and apply it to new questions during the inference stage, without any weight update. Existing methods are limited to using a neural network to approximate a specific equation solution or a specific operator, requiring retraining when switching to a new problem with different equations. By training a single neural network as an operator learner, we can not only get rid of retraining (even fine-tuning) the neural network for new problems, but also leverage the commonalities shared across operators so that only a few demos in the prompt are needed when learning a new operator. Our numerical results show the neural network's capability as a few-shot operator learner for a diversified type of differential equation problems, including forward and inverse problems of ordinary differential equations (ODEs), partial differential equations (PDEs), and mean-field control (MFC) problems, and also show that it can generalize its learning capability to operators beyond the training distribution.

cs.LG↗
arXiv2023

Global optimization for the portfolio selection model with high-order moments

In this paper, we study the global optimality of polynomial portfolio optimization (PPO). The PPO is a kind of portfolio selection model with high-order moments and flexible risk preference parameters. We introduce a perturbation sample average approximation method, which can give a robust approximation of the PPO in form of linear conic optimization. The approximated problem can be solved globally with Moment-SOS relaxations. We summarize a semidefinite algorithm, which can be used to find reliable approximations of the optimal value and optimizer set of the PPO. Numerical examples are given to show the efficiency of the algorithm.

math.OC↗
arXiv2023

PathProx: A Proximal Gradient Algorithm for Weight Decay Regularized Deep Neural Networks

Weight decay is one of the most widely used forms of regularization in deep learning, and has been shown to improve generalization and robustness. The optimization objective driving weight decay is a sum of losses plus a term proportional to the sum of squared weights. This paper argues that stochastic gradient descent (SGD) may be an inefficient algorithm for this objective. For neural networks with ReLU activations, solutions to the weight decay objective are equivalent to those of a different objective in which the regularization term is instead a sum of products of $\ell_2$ (not squared) norms of the input and output weights associated with each ReLU neuron. This alternative (and effectively equivalent) regularization suggests a novel proximal gradient algorithm for network training. Theory and experiments support the new training approach, showing that it can converge much faster to the sparse solutions it shares with standard weight decay training.

cs.LG↗
arXiv2023

VERTICES: Efficient Two-Party Vertical Federated Linear Model with TTP-aided Secret Sharing

Vertical Federated Learning (VFL) has emerged as one of the most predominant approaches for secure collaborative machine learning where the training data is partitioned by features among multiple parties. Most VFL algorithms primarily rely on two fundamental privacy-preserving techniques: Homomorphic Encryption (HE) and secure Multi-Party Computation (MPC). Though generally considered with stronger privacy guarantees, existing general-purpose MPC frameworks suffer from expensive computation and communication overhead and are inefficient especially under VFL settings. This study centers around MPC-based VFL algorithms and presents a novel approach for two-party vertical federated linear models via an efficient secret sharing (SS) scheme with a trusted coordinator. Our approach can achieve significant acceleration of the training procedure in vertical federated linear models of between 2.5x and 6.6x than other existing MPC frameworks under the same security setting.

cs.CR↗
arXiv2023

Atypical sliding and Moire ferroelectricity in pure multilayer graphene

Most non-ferroelectric two-dimensional materials can be endowed with so-called sliding ferroelectricity via non-equivalent homo-bilayer stacking, which is not applicable to mono-element systems like pure graphene bilayer with inversion symmetry at any sliding vector. Herein we show first-principles evidence that multilayer graphene with N>3 can all be ferroelectric, where the polarizations of polar states stem from the symmetry breaking in stacking configurations of across-layer instead of adjacent-layer, which are electrically switchable via interlayer sliding. The non-polar states can also be electrically driven to polar states via sliding, all nearly degenerate in energy, and more diverse states with distinct polarizations will emerge in more layers. In contrast to the ferroelectric Moire domains with opposite polarization directions in twisted bilayers reported previously, the Moire pattern in some multilayer graphene systems (e.g., twisted monolayer-trilayer graphene) possess nonzero net polarizations with domains of the same direction separated by non-polar regions, which can be electrically reversed upon interlayer sliding. The distinct Moire bands of two polar states should facilitate electrical detection of such sliding Moire ferroelectricity during switching.

cond-mat.mes-hall↗
arXiv2023

Both Efficiency and Effectiveness! A Large Scale Pre-ranking Framework in Search System

In the realm of search systems, multi-stage cascade architecture is a prevalent method, typically consisting of sequential modules such as matching, pre-ranking, and ranking. It is generally acknowledged that the model used in the pre-ranking stage must strike a balance between efficacy and efficiency. Thus, the most commonly employed architecture is the representation-focused vector product based model. However, this architecture lacks effective interaction between the query and document, resulting in a reduction in the effectiveness of the search system. To address this issue, we present a novel pre-ranking framework called RankDFM. Our framework leverages DeepFM as the backbone and employs a pairwise training paradigm to learn the ranking of videos under a query. The capability of RankDFM to cross features provides significant improvement in offline and online A/B testing performance. Furthermore, we introduce a learnable feature selection scheme to optimize the model and reduce the time required for online inference, equivalent to a tree model. Currently, RankDFM has been deployed in the search system of a shortvideo App, providing daily services to hundreds of millions users.

cs.IR↗
arXiv2023

A Survey on Vertical Federated Learning: From a Layered Perspective

Vertical federated learning (VFL) is a promising category of federated learning for the scenario where data is vertically partitioned and distributed among parties. VFL enriches the description of samples using features from different parties to improve model capacity. Compared with horizontal federated learning, in most cases, VFL is applied in the commercial cooperation scenario of companies. Therefore, VFL contains tremendous business values. In the past few years, VFL has attracted more and more attention in both academia and industry. In this paper, we systematically investigate the current work of VFL from a layered perspective. From the hardware layer to the vertical federated system layer, researchers contribute to various aspects of VFL. Moreover, the application of VFL has covered a wide range of areas, e.g., finance, healthcare, etc. At each layer, we categorize the existing work and explore the challenges for the convenience of further research and development of VFL. Especially, we design a novel MOSP tree taxonomy to analyze the core component of VFL, i.e., secure vertical federated machine learning algorithm. Our taxonomy considers four dimensions, i.e., machine learning model (M), protection object (O), security model (S), and privacy-preserving protocol (P), and provides a comprehensive investigation.

cs.LG↗
arXiv2023

Wannier Topology and Quadrupole Moments for a generalized Benalcazar-Bernevig-Hughes Model

We analyze a special separable and chiral-symmetric model with a quantized quadrupole moment, extending the Benalcazar-Bernevig-Hughes model [Science 357, 61 (2017)]. Using nested-Wilson loop formalism, we give an exact expression for Wannier centers, sector polarizations, and quadrupole moments. These are connected to the winding numbers of the constitutive one-dimensional chains. We prove that these winding numbers can characterize the model's Wannier topology as a $\mathbb{Z}\times\mathbb{Z}$ set. These results clearly show that the quantization of the quadrupole moment can arise without additional spatial symmetry (except for translation symmetry) for the bulk. By switching from the Wannier representation to the Bloch representation, we derive an alternative expression for the bulk quadrupole moment and obtain its exact value. Combining the bulk quadrupole and edge polarizations, we analytically calculate the corner charge in a large square system and make the bulk-boundary correspondence explicit in an edge-consistent gauge. Our work reveals the relationship between zero-energy states at the boundary, charge localization, and the bulk quadrupole of the extended model.

cond-mat.str-el↗
arXiv2023

GP-NAS-ensemble: a model for NAS Performance Prediction

It is of great significance to estimate the performance of a given model architecture without training in the application of Neural Architecture Search (NAS) as it may take a lot of time to evaluate the performance of an architecture. In this paper, a novel NAS framework called GP-NAS-ensemble is proposed to predict the performance of a neural network architecture with a small training dataset. We make several improvements on the GP-NAS model to make it share the advantage of ensemble learning methods. Our method ranks second in the CVPR2022 second lightweight NAS challenge performance prediction track.

cs.LG↗
arXiv2022

FedEval: A Holistic Evaluation Framework for Federated Learning

Federated Learning (FL) has been widely accepted as the solution for privacy-preserving machine learning without collecting raw data. While new technologies proposed in the past few years do evolve the FL area, unfortunately, the evaluation results presented in these works fall short in integrity and are hardly comparable because of the inconsistent evaluation metrics and experimental settings. In this paper, we propose a holistic evaluation framework for FL called FedEval, and present a benchmarking study on seven state-of-the-art FL algorithms. Specifically, we first introduce the core evaluation taxonomy model, called FedEval-Core, which covers four essential evaluation aspects for FL: Privacy, Robustness, Effectiveness, and Efficiency, with various well-defined metrics and experimental settings. Based on the FedEval-Core, we further develop an FL evaluation platform with standardized evaluation settings and easy-to-use interfaces. We then provide an in-depth benchmarking study between the seven well-known FL algorithms, including FedSGD, FedAvg, FedProx, FedOpt, FedSTC, SecAgg, and HEAgg. We comprehensively analyze the advantages and disadvantages of these algorithms and further identify the suitable practical scenarios for different algorithms, which is rarely done by prior work. Lastly, we excavate a set of take-away insights and future research directions, which are very helpful for researchers in the FL area.

cs.LG↗
arXiv2022

Across-Layer Sliding Ferroelectricity in Graphene-Based Heterolayers: Asymmetry of Next Neighbor Interlayer Couplings

Although most two-dimensional (2D) materials are non-ferroelectric with highly symmetric lattices, symmetry breaking may take place in their bilayers upon certain stacking order, giving rise to so-called sliding ferroelectricity where the vertical polarizations can be electrically reversed via interlayer translation. However, it is not supposed to appear in systems like graphene bilayer with centro-symmetry at any stacking configuration, and the origin of the recently reported ferroelectricity in graphene bilayer intercalated between h-BN (Nature 2020, 588, 71) is still unclear. Here we propose a model of across-layer sliding ferroelectricity that arises from the asymmetry of next neighbor interlayer couplings. The vertical polarizations in intercalated centro-symmetric 2D materials like graphene bilayer can be switched via multilayer sliding, and the observed ferroelectric hysteresis can be clarified. Moreover, such ferroelectricity can exist in a series of other heterolayers with quasi-degenerate polar states, like graphene bilayer or trilayer on BN substrate, or even with a molecule layer on surface where each molecule can store 1 bit data independently, resolving the bottleneck issue of sliding ferroelectricity for high-density data storage.

cond-mat.mes-hall↗
arXiv2022

Distributionally Robust Optimization with Moment Ambiguity Sets

This paper studies distributionally robust optimization (DRO) when the ambiguity set is given by moments for the distributions. The objective and constraints are given by polynomials in decision variables. We reformulate the DRO with equivalent moment conic constraints. Under some general assumptions, we prove the DRO is equivalent to a linear optimization problem with moment and psd polynomial cones. A Moment-SOS relaxation method is proposed to solve it. Its asymptotic and finite convergence are shown under certain assumptions. Numerical examples are presented to show how to solve DRO problems.

math.OC↗
arXiv2022

Rotating Majorana Zero Modes in a disk geometry

We study the manipulation of Majorana zero modes in a thin disk made from a $p$-wave superconductor in order to understand their use as a building block for topological quantum computers. We analyze the second-order topological corner modes that arise when an in-plane magnetic field is applied, and calculate their dynamical evolution when rotating the magnetic field, with special emphasis on non-adiabatic effects. We characterize the phase transition between high-frequency and near-adiabatic evolution using Floquet analysis. We show that oscillations persist even in the adiabatic phase because of a frequency independent coupling between zero modes and excited states, which we have quantified numerically and analytically. These results show that controlling the rotation frequency can be a simple method to avoid the non-adiabatic errors originated from this coupling and thus increase the robustness of topological quantum computation.

quant-ph↗
arXiv2022

Phase diagram of superconducting vortex ratchet motion in a superlattice with noncentrosymmetry

Ratchet motion of superconducting vortices, which is a directional flow of vortices in superconductors, is highly useful for exploring quantum phenomena and developing superconducting devices, such as superconducting diode and microwave antenna. However, because of the challenges in the quantitative characterization of the dynamic motion of vortices, a phase diagram of the vortex ratchet motion is still missing, especially in the superconductors with low dimensional structures. Here we establish a quantitative phase diagram of the vortex ratchet motion in a highly anisotropic superlattice superconductor, (SnS)1.17NbS2, using nonreciprocal magnetotransport. The (SnS)1.17NbS2, which possesses a layered atomic structure and noncentrosymmetry, exhibits nonreciprocal magnetotransport in a magnetic field perpendicular and parallel to the plane, which is considered a manifest of ratchet motion of superconducting vortices. We demonstrated that the ratchet motion is responsive to current excitation, magnetic field and thermal perturbation. Furthermore, we extrapolated a giant nonreciprocal coefficient (γ), which quantitatively describes the magnitude of the vortex ratchet motion, and eventually established phase diagrams of the ratchet motion of the vortices with a quantitative description. Last, we propose that the ratchet motion originates from the coexistence of pancake vortices (PVs) and Josephson vortices (JVs). The phase diagrams are desirable for controlling the vortex motion in superlattice superconductors and developing next-generation energy-efficient superconducting devices.

cond-mat.supr-con↗
arXiv2022

Learning to Expand: Reinforced Pseudo-relevance Feedback Selection for Information-seeking Conversations

Information-seeking conversation systems are increasingly popular in real-world applications, especially for e-commerce companies. To retrieve appropriate responses for users, it is necessary to compute the matching degrees between candidate responses and users' queries with historical dialogue utterances. As the contexts are usually much longer than responses, it is thus necessary to expand the responses (usually short) with richer information. Recent studies on pseudo-relevance feedback (PRF) have demonstrated its effectiveness in query expansion for search engines, hence we consider expanding response using PRF information. However, existing PRF approaches are either based on heuristic rules or require heavy manual labeling, which are not suitable for solving our task. To alleviate this problem, we treat the PRF selection for response expansion as a learning task and propose a reinforced learning method that can be trained in an end-to-end manner without any human annotations. More specifically, we propose a reinforced selector to extract useful PRF terms to enhance response candidates and a BERT-based response ranker to rank the PRF-enhanced responses. The performance of the ranker serves as a reward to guide the selector to extract useful PRF terms, which boosts the overall task performance. Extensive experiments on both standard benchmarks and commercial datasets prove the superiority of our reinforced PRF term selector compared with other potential soft or hard selection methods. Both case studies and quantitative analysis show that our model is capable of selecting meaningful PRF terms to expand response candidates and also achieving the best results compared with all baselines on a variety of evaluation metrics. We have also deployed our method on online production in an e-commerce company, which shows a significant improvement over the existing online ranking system.

cs.CL↗
arXiv2022

Generative Adversarial Learning for Trusted and Secure Clustering in Industrial Wireless Sensor Networks

Traditional machine learning techniques have been widely used to establish the trust management systems. However, the scale of training dataset can significantly affect the security performances of the systems, while it is a great challenge to detect malicious nodes due to the absence of labeled data regarding novel attacks. To address this issue, this paper presents a generative adversarial network (GAN) based trust management mechanism for Industrial Wireless Sensor Networks (IWSNs). First, type-2 fuzzy logic is adopted to evaluate the reputation of sensor nodes while alleviating the uncertainty problem. Then, trust vectors are collected to train a GAN-based codec structure, which is used for further malicious node detection. Moreover, to avoid normal nodes being isolated from the network permanently due to error detections, a GAN-based trust redemption model is constructed to enhance the resilience of trust management. Based on the latest detection results, a trust model update method is developed to adapt to the dynamic industrial environment. The proposed trust management mechanism is finally applied to secure clustering for reliable and real-time data transmission, and simulation results show that it achieves a high detection rate up to 96%, as well as a low false positive rate below 8%.

cs.NI↗
arXiv2022

Generative Adversarial Learning for Intelligent Trust Management in 6G Wireless Networks

Emerging six generation (6G) is the integration of heterogeneous wireless networks, which can seamlessly support anywhere and anytime networking. But high Quality-of-Trust should be offered by 6G to meet mobile user expectations. Artificial intelligence (AI) is considered as one of the most important components in 6G. Then AI-based trust management is a promising paradigm to provide trusted and reliable services. In this article, a generative adversarial learning-enabled trust management method is presented for 6G wireless networks. Some typical AI-based trust management schemes are first reviewed, and then a potential heterogeneous and intelligent 6G architecture is introduced. Next, the integration of AI and trust management is developed to optimize the intelligence and security. Finally, the presented AI-based trust management method is applied to secure clustering to achieve reliable and real-time communications. Simulation results have demonstrated its excellent performance in guaranteeing network security and service quality.

cs.NI↗