arXiv subjects

Liang Li

Publications and source records attributed to Liang Li.

At least 325 records · Page 18Linked to original sources

arXiv2020

To Talk or to Work: Flexible Communication Compression for Energy Efficient Federated Learning over Heterogeneous Mobile Edge Devices

Recent advances in machine learning, wireless communication, and mobile hardware technologies promisingly enable federated learning (FL) over massive mobile edge devices, which opens new horizons for numerous intelligent mobile applications. Despite the potential benefits, FL imposes huge communication and computation burdens on participating devices due to periodical global synchronization and continuous local training, raising great challenges to battery constrained mobile devices. In this work, we target at improving the energy efficiency of FL over mobile edge networks to accommodate heterogeneous participating devices without sacrificing the learning performance. To this end, we develop a convergence-guaranteed FL algorithm enabling flexible communication compression. Guided by the derived convergence bound, we design a compression control scheme to balance the energy consumption of local computing (i.e., "working") and wireless communication (i.e., "talking") from the long-term learning perspective. In particular, the compression parameters are elaborately chosen for FL participants adapting to their computing and communication environments. Extensive simulations are conducted using various datasets to validate our theoretical analysis, and the results also demonstrate the efficacy of the proposed scheme in energy saving.

cs.LG↗

arXiv2020

Tunable discrete scale invariance in transition-metal pentatelluride flakes

Log-periodic quantum oscillations discovered in transition-metal pentatelluride give a clear demonstration of discrete scale invariance (DSI) in solid-state materials. The peculiar phenomenon is convincingly interpreted as the presence of two-body quasi-bound states in a Coulomb potential. However, the modifications of the Coulomb interactions in many-body systems having a Dirac-like spectrum are not fully understood. Here, we report the observation of tunable log-periodic oscillations and DSI in ZrTe5 and HfTe5 flakes. By reducing the flakes thickness, the characteristic scale factor is tuned to a much smaller value due to the reduction of the vacuum polarization effect. The decreasing of the scale factor demonstrates the many-body effect on the DSI, which has rarely been discussed hitherto. Furthermore, the cut-offs of oscillations are quantitatively explained by considering the Thomas-Fermi screening effect. Our work clarifies the many-body effect on DSI and paves a way to tune the DSI in quantum materials.

cond-mat.mtrl-sci↗

arXiv2020

Adversarial Evaluation of Autonomous Vehicles in Lane-Change Scenarios

Autonomous vehicles must be comprehensively evaluated before deployed in cities and highways. However, most existing evaluation approaches for autonomous vehicles are static and lack adaptability, so they are usually inefficient in generating challenging scenarios for tested vehicles. In this paper, we propose an adaptive evaluation framework to efficiently evaluate autonomous vehicles in adversarial environments generated by deep reinforcement learning. Considering the multimodal nature of dangerous scenarios, we use ensemble models to represent different local optimums for diversity. We then utilize a nonparametric Bayesian method to cluster the adversarial policies. The proposed method is validated in a typical lane-change scenario that involves frequent interactions between the ego vehicle and the surrounding vehicles. Results show that the adversarial scenarios generated by our method significantly degrade the performance of the tested vehicles. We also illustrate different patterns of generated adversarial environments, which can be used to infer the weaknesses of the tested vehicles.

cs.RO↗

arXiv2020

TDRE: A Tensor Decomposition Based Approach for Relation Extraction

Extracting entity pairs along with relation types from unstructured texts is a fundamental subtask of information extraction. Most existing joint models rely on fine-grained labeling scheme or focus on shared embedding parameters. These methods directly model the joint probability of multi-labeled triplets, which suffer from extracting redundant triplets with all relation types. However, each sentence may contain very few relation types. In this paper, we first model the final triplet extraction result as a three-order tensor of word-to-word pairs enriched with each relation type. And in order to obtain the sentence contained relations, we introduce an independent but joint training relation classification module. The tensor decomposition strategy is finally utilized to decompose the triplet tensor with predicted relational components which omits the calculations for unpredicted relation types. According to effective decomposition methods, we propose the Tensor Decomposition based Relation Extraction (TDRE) approach which is able to extract overlapping triplets and avoid detecting unnecessary entity pairs. Experiments on benchmark datasets NYT, CoNLL04 and ADE datasets demonstrate that the proposed method outperforms existing strong baselines.

cs.AI↗

arXiv2020

Selective Information Passing for MR/CT Image Segmentation

Automated medical image segmentation plays an important role in many clinical applications, which however is a very challenging task, due to complex background texture, lack of clear boundary and significant shape and texture variation between images. Many researchers proposed an encoder-decoder architecture with skip connections to combine low-level feature maps from the encoder path with high-level feature maps from the decoder path for automatically segmenting medical images. The skip connections have been shown to be effective in recovering fine-grained details of the target objects and may facilitate the gradient back-propagation. However, not all the feature maps transmitted by those connections contribute positively to the network performance. In this paper, to adaptively select useful information to pass through those skip connections, we propose a novel 3D network with self-supervised function, named selective information passing network (SIP-Net). We evaluate our proposed model on the MICCAI Prostate MR Image Segmentation 2012 Grant Challenge dataset, TCIA Pancreas CT-82 and MICCAI 2017 Liver Tumor Segmentation (LiTS) Challenge dataset. The experimental results across these data sets show that our model achieved improved segmentation results and outperformed other state-of-the-art methods. The source code of this work is available at https://github.com/ahukui/SIPNet.

eess.IV↗

arXiv2020

An Update to the Letter of Intent for MATHUSLA: Search for Long-Lived Particles at the HL-LHC

We report on recent progress in the design of the proposed MATHUSLA Long Lived Particle (LLP) detector for the HL-LHC, updating the information in the original Letter of Intent (LoI), see CDS:LHCC-I-031, arXiv:1811.00927. A suitable site has been identified at LHC Point 5 that is closer to the CMS Interaction Point (IP) than assumed in the LoI. The decay volume has been increased from 20 m to 25 m in height. Engineering studies have been made in order to locate much of the decay volume below ground, bringing the detector even closer to the IP. With these changes, a 100 m x 100 m detector has the same physics reach for large c$τ$ as the 200 m x 200 m detector described in the LoI and other studies. The performance for small c$τ$ is improved because of the proximity to the IP. Detector technology has also evolved while retaining the strip-like sensor geometry in Resistive Plate Chambers (RPC) described in the LoI. The present design uses extruded scintillator bars read out using wavelength shifting fibers and silicon photomultipliers (SiPM). Operations will be simpler and more robust with much lower operating voltages and without the use of greenhouse gases. Manufacturing is straightforward and should result in cost savings. Understanding of backgrounds has also significantly advanced, thanks to new simulation studies and measurements taken at the MATHUSLA test stand operating above ATLAS in 2018. We discuss next steps for the MATHUSLA collaboration, and identify areas where new members can make particularly important contributions.

physics.ins-det↗

arXiv2020

Delay-Aware Multi-Agent Reinforcement Learning for Cooperative and Competitive Environments

Action and observation delays exist prevalently in the real-world cyber-physical systems which may pose challenges in reinforcement learning design. It is particularly an arduous task when handling multi-agent systems where the delay of one agent could spread to other agents. To resolve this problem, this paper proposes a novel framework to deal with delays as well as the non-stationary training issue of multi-agent tasks with model-free deep reinforcement learning. We formally define the Delay-Aware Markov Game that incorporates the delays of all agents in the environment. To solve Delay-Aware Markov Games, we apply centralized training and decentralized execution that allows agents to use extra information to ease the non-stationarity issue of the multi-agent systems during training, without the need of a centralized controller during execution. Experiments are conducted in multi-agent particle environments including cooperative communication, cooperative navigation, and competitive experiments. We also test the proposed algorithm in traffic scenarios that require coordination of all autonomous vehicles to show the practical value of delay-awareness. Results show that the proposed delay-aware multi-agent reinforcement learning algorithm greatly alleviates the performance degradation introduced by delay. Codes and demo videos are available at: https://github.com/baimingc/delay-aware-MARL.

cs.LG↗

arXiv2020

Metamagnetic transitions and anomalous magnetoresistance in EuAg$_4$As$_2$ single crystal

In this paper, the magnetic and transport properties were systematically studied for EuAg$_4$As$_2$ single crystals, crystallizing in a centrosymmetric trigonal CaCu$_4$P$_2$ type structure. It was confirmed that two magnetic transitions occur at $\textit{T}$$_{N1}$ = 10 K and $\textit{T}$$_{N2}$ = 15 K, respectively. With the increasing field, the two transitions are noticeably driven to lower temperature. At low temperatures, applying a magnetic field in the $\textit{ab}$ plane induces two successive metamagnetic transitions. For both $\textit{H}$ $\parallel$ $\textit{ab}$ and $\textit{H}$ $\parallel$ $\textit{c}$, EuAg$_4$As$_2$ shows a positive, unexpected large magnetoresistance (up to 202\%) at low fields below 10 K, and a large negative magnetoresistance (up to -78\%) at high fields/intermediate temperatures. Such anomalous field dependence of magnetoresistance may have potential application in the future magnetic sensors. Finally, the magnetic phase diagrams of EuAg$_{4}$As$_{2}$ were constructed for both $\textit{H}$ $\parallel$ $\textit{ab}$ and $\textit{H}$ $\parallel$ $\textit{c}$.

cond-mat.mtrl-sci↗

arXiv2020

Atomic origin for hydrogenation promoted bulk oxygen vacancies removal in vanadium dioxide

Oxygen vacancies (VO), a common type of point defects in metal oxides materials, play important roles on the physical and chemical properties. To obtain stoichiometric oxide crystal, the pre-existing VO is always removed via careful post-annealing treatment at high temperature in air or oxygen atmosphere. However, the annealing conditions is difficult to control and the removal of VO in bulk phase is restrained due to high energy barrier of VO migration. Here, we selected VO2 crystal film as the model system and developed an alternative annealing treatment aided by controllable hydrogen doping, which can realizes effective removal of VO defects in VO2-δ crystal at lower temperature. This finding is attributed to the hydrogenation accelerated oxygen vacancies recovery in VO2-δ crystal. Theoretical calculations revealed that the H-doping induced electrons are prone to accumulate around the oxygen defects in VO2-δ film, which facilitates the diffusion of VO and thus makes it easier to be removed. The methodology is expected to be applied to other metal oxides for oxygen-related point defects control.

cond-mat.mtrl-sci↗

arXiv2020

Absolutely convergent fixed-point fast sweeping WENO methods for steady state of hyperbolic conservation laws

Fixed-point iterative sweeping methods were developed in the literature to efficiently solve steady state solutions of Hamilton-Jacobi equations and hyperbolic conservation laws. Similar as other fast sweeping schemes, the key components of this class of methods are the Gauss-Seidel iterations and alternating sweeping strategy to achieve fast convergence rate. Furthermore, good properties of fixed-point iterative sweeping methods include that they have explicit forms and do not involve inverse operation of nonlinear local systems, and they can be applied to general hyperbolic equations using any monotone numerical fluxes and high order approximations easily. In [L. Wu, Y.-T. Zhang, S. Zhang and C.-W. Shu, Commun. Comput. Phys., 20 (2016)], a fifth order fixed-point sweeping WENO scheme was designed and it was shown that the scheme converges much faster than the total variation diminishing (TVD) Runge-Kutta approach by stability improvement of high order schemes with a forward Euler time-marching. An open problem is that for some benchmark numerical examples, the iteration residue of the fixed-point sweeping WENO scheme hangs at a truncation error level instead of settling down to machine zero. This issue makes it difficult to determine the convergence criterion for the iteration and challenging to apply the method to complex problems. To solve this issue, in this paper we apply the multi-resolution WENO scheme developed in [J. Zhu and C.-W. Shu, J. Comput. Phys., 375 (2018)] to the fifth order fixed-point sweeping WENO scheme and obtain an absolutely convergent fixed-point fast sweeping method for steady state of hyperbolic conservation laws, i.e., the residue of the fast sweeping iterations converges to machine zero / round off errors for all benchmark problems tested.

math.NA↗

arXiv2020

Strong field induced electron density tide in high harmonic generation from solids

In strong laser fields, the electron density in solids can show up tidal motions caused by the laser ``pulling'' on the electrons, which forms an electron density tide (EDT). However, the strong field processes in solids are always explained by the single-active-electron (SAE) model and the fluctuation of background electrons is neglected previously. Here, we demonstrate the strong field induced EDT effect and propose a model for revealing its role in high harmoinc generation (HHG) from solids. We show that the EDT effect induces an additional polarization current beyond the SAE approximation. It gives a new mechanism for HHG and leads to new anisotropic structures, which are experimentally observed with MgO. Our experiment indicates that the EDT effect becomes more obvious with increasing the laser intensity. Our work establishes the bridge between the HHG and the microscopic EDT in solids induced by the strong laser field, which paves the way to probe the ultrafast electron dynamics.

physics.optics↗

arXiv2020

Thermal Components in Gamma-ray Bursts. II. Constraining the Hybrid Jet Model

In explaining the physical origin of the jet composition of gamma-ray bursts (GRBs), a more general picture, i.e. the hybrid jet model (which introduced another magnetization parameter $σ_{0}$ on the basis of the traditional fireball model), has been well studied in Gao \& Zhang. However, it still has not yet been applied to a large GRB sample. Here, we first employ the "top-down" approach of Gao \& Zhang to diagnose the photosphere properties at the central engine to see how the hybrid model can account for the observed data as well, through applying a {\it Fermi} GRB sample (eight bursts) with the detected photosphere component, as presented in Li (our Paper I). We infer all physical parameters of a hybrid problem with three typical values of the radius of the jet base ($r_{0}$ = 10$^{7}$, 10$^{8}$, and 10$^{9}$ cm). We find that the dimensionless entropy for all the bursts shows $η\gg$ 1 while the derived (1+$σ_{0}$) for five bursts (GRB 081224, GRB 110721A, GRB 090719, GRB 100707, and GRB 100724) is larger than unity, indicating that in addition to a hot fireball component, another cold Poynting-flux component may also play an important role. Our analysis also shows that in a few time bins for all $r_{0}$ in GRB 081224 and GRB 110721A, the magnetization parameter at $\sim$ 10$^{15}$cm (1+$σ_{\rm r15}$) is greater than unity, which implies that internal-collision-induced magnetic reconnection and turbulence may be the mechanism to power the nonthermal emission, rather than internal shocks. We conclude that the majority of bursts (probably all) can be well explained by the hybrid jet problem.

astro-ph.HE↗

arXiv2020

Delay-Aware Model-Based Reinforcement Learning for Continuous Control

Action delays degrade the performance of reinforcement learning in many real-world systems. This paper proposes a formal definition of delay-aware Markov Decision Process and proves it can be transformed into standard MDP with augmented states using the Markov reward process. We develop a delay-aware model-based reinforcement learning framework that can incorporate the multi-step delay into the learned system models without learning effort. Experiments with the Gym and MuJoCo platforms show that the proposed delay-aware model-based algorithm is more efficient in training and transferable between systems with various durations of delay compared with off-policy model-free reinforcement learning methods. Codes available at: https://github.com/baimingc/dambrl.

cs.LG↗

arXiv2020

Secret Sharing based Secure Regressions with Applications

Nowadays, the utilization of the ever expanding amount of data has made a huge impact on web technologies while also causing various types of security concerns. On one hand, potential gains are highly anticipated if different organizations could somehow collaboratively share their data for technological improvements. On the other hand, data security concerns may arise for both data holders and data providers due to commercial or sociological concerns. To make a balance between technical improvements and security limitations, we implement secure and scalable protocols for multiple data holders to train linear regression and logistic regression models. We build our protocols based on the secret sharing scheme, which is scalable and efficient in applications. Moreover, our proposed paradigm can be generalized to any secure multiparty training scenarios where only matrix summation and matrix multiplications are used. We demonstrate our approach by experiments which shows the scalability and efficiency of our proposed protocols, and finally present its real-world applications.

cs.LG↗

arXiv2020

Real-world Person Re-Identification via Degradation Invariance Learning

Person re-identification (Re-ID) in real-world scenarios usually suffers from various degradation factors, e.g., low-resolution, weak illumination, blurring and adverse weather. On the one hand, these degradations lead to severe discriminative information loss, which significantly obstructs identity representation learning; on the other hand, the feature mismatch problem caused by low-level visual variations greatly reduces retrieval performance. An intuitive solution to this problem is to utilize low-level image restoration methods to improve the image quality. However, existing restoration methods cannot directly serve to real-world Re-ID due to various limitations, e.g., the requirements of reference samples, domain gap between synthesis and reality, and incompatibility between low-level and high-level methods. In this paper, to solve the above problem, we propose a degradation invariance learning framework for real-world person Re-ID. By introducing a self-supervised disentangled representation learning strategy, our method is able to simultaneously extract identity-related robust features and remove real-world degradations without extra supervision. We use low-resolution images as the main demonstration, and experiments show that our approach is able to achieve state-of-the-art performance on several Re-ID benchmarks. In addition, our framework can be easily extended to other real-world degradation factors, such as weak illumination, with only a few modifications.

cs.CV↗

arXiv2020

State-Relabeling Adversarial Active Learning

Active learning is to design label-efficient algorithms by sampling the most representative samples to be labeled by an oracle. In this paper, we propose a state relabeling adversarial active learning model (SRAAL), that leverages both the annotation and the labeled/unlabeled state information for deriving the most informative unlabeled samples. The SRAAL consists of a representation generator and a state discriminator. The generator uses the complementary annotation information with traditional reconstruction information to generate the unified representation of samples, which embeds the semantic into the whole data representation. Then, we design an online uncertainty indicator in the discriminator, which endues unlabeled samples with different importance. As a result, we can select the most informative samples based on the discriminator's predicted state. We also design an algorithm to initialize the labeled pool, which makes subsequent sampling more efficient. The experiments conducted on various datasets show that our model outperforms the previous state-of-art active learning methods and our initially sampling algorithm achieves better performance.

cs.CV↗

arXiv2020

Parsing-based View-aware Embedding Network for Vehicle Re-Identification

Vehicle Re-Identification is to find images of the same vehicle from various views in the cross-camera scenario. The main challenges of this task are the large intra-instance distance caused by different views and the subtle inter-instance discrepancy caused by similar vehicles. In this paper, we propose a parsing-based view-aware embedding network (PVEN) to achieve the view-aware feature alignment and enhancement for vehicle ReID. First, we introduce a parsing network to parse a vehicle into four different views, and then align the features by mask average pooling. Such alignment provides a fine-grained representation of the vehicle. Second, in order to enhance the view-aware features, we design a common-visible attention to focus on the common visible views, which not only shortens the distance among intra-instances, but also enlarges the discrepancy of inter-instances. The PVEN helps capture the stable discriminative information of vehicle under different views. The experiments conducted on three datasets show that our model outperforms state-of-the-art methods by a large margin.

cs.CV↗

arXiv2020

Towards Discriminability and Diversity: Batch Nuclear-norm Maximization under Label Insufficient Situations

The learning of the deep networks largely relies on the data with human-annotated labels. In some label insufficient situations, the performance degrades on the decision boundary with high data density. A common solution is to directly minimize the Shannon Entropy, but the side effect caused by entropy minimization, i.e., reduction of the prediction diversity, is mostly ignored. To address this issue, we reinvestigate the structure of classification output matrix of a randomly selected data batch. We find by theoretical analysis that the prediction discriminability and diversity could be separately measured by the Frobenius-norm and rank of the batch output matrix. Besides, the nuclear-norm is an upperbound of the Frobenius-norm, and a convex approximation of the matrix rank. Accordingly, to improve both discriminability and diversity, we propose Batch Nuclear-norm Maximization (BNM) on the output matrix. BNM could boost the learning under typical label insufficient learning scenarios, such as semi-supervised learning, domain adaptation and open domain recognition. On these tasks, extensive experimental results show that BNM outperforms competitors and works well with existing well-known methods. The code is available at https://github.com/cuishuhao/BNM.

cs.CV↗