arXiv Science⌕ Search

arXiv subjects

Jun Li

Publications and source records attributed to Jun Li.

At least 757 records · Page 42Linked to original sources
arXiv2019

Symplectic $(-2)$ spheres and the symplectomorphism group of small rational 4-manifolds, I

Let $(X,ω)$ be a symplectic rational 4 manifold. We study the space of tamed almost complex structures $\mathcal{J}_ω$ using a fine decomposition via smooth rational curves and a relative version of the infinite-dimensional Alexander duality. This decomposition provides new understandings of both the variation and stability of the symplectomorphism group $Symp(X,ω)$ when deforming $ω$. In particular, we compute the rank of $π_1(Symp(X,ω))$ with Euler number $χ(X)\leq 7$ in terms of the number $N$ of -2 symplectic sphere classes.

math.SG↗
arXiv2019

Symplectic $(-2)$-spheres and the symplectomorphism group of small rational 4-manifolds, II

For $(\mathbb{C} P^2 \# 5{\overline {\mathbb{C} P^2}},ω)$, let $N_ω$ be the number of $(-2)$-symplectic spherical homology classes.We completely determine the Torelli symplectic mapping class group (Torelli SMCG): the Torelli SMCG is trivial if $N_ω>8$; it is $π_0(Diff^+(S^2,5))$ if $N_ω=0$ (by Paul Seidel and Jonathan Evans); it is $π_0(Diff^+(S^2,4))$ in the remaining case. Further, we completely determine the rank of $π_1(Symp(\mathbb{C} P^2 \# 5{\overline {\mathbb{C} P^2}}, ω)$ for any given symplectic form. Our results can be uniformly presented regarding Dynkin diagrams of type $\mathbb{A}$ and type $\mathbb{D}$ Lie algebras. We also provide a solution to the smooth isotopy problem of rational $4$-manifolds.

math.SG↗
arXiv2019

LPRNet: Lightweight Deep Network by Low-rank Pointwise Residual Convolution

Deep learning has become popular in recent years primarily due to the powerful computing device such as GPUs. However, deploying these deep models to end-user devices, smart phones, or embedded systems with limited resources is challenging. To reduce the computation and memory costs, we propose a novel lightweight deep learning module by low-rank pointwise residual (LPR) convolution, called LPRNet. Essentially, LPR aims at using low-rank approximation in pointwise convolution to further reduce the module size, while keeping depthwise convolutions as the residual module to rectify the LPR module. This is critical when the low-rankness undermines the convolution process. We embody our design by replacing modules of identical input-output dimension in MobileNet and ShuffleNetv2. Experiments on visual recognition tasks including image classification and face alignment on popular benchmarks show that our LPRNet achieves competitive performance but with significant reduction of Flops and memory cost compared to the state-of-the-art deep models focusing on model compression.

cs.CV↗
arXiv2019

Topological magnetic-spin textures in two-dimensional van der Waals Cr2Ge2Te6

Two-dimensional (2D) van der Waals (vdW) materials show a range of profound physical properties that can be tailored through their incorporation in heterostructures and manipulated with external forces. The recent discovery of long-range ferromagnetic order down to atomic layers provides an additional degree of freedom in engineering 2D materials and their heterostructure devices for spintronics, valleytronics and magnetic tunnel junction switches. Here, using direct imaging by cryo-Lorentz transmission electron microscopy we show that topologically nontrivial magnetic-spin states, skyrmionic bubbles, can be realized in exfoliated insulating 2D vdW Cr2Ge2Te6. Due to the competition between dipolar interactions and uniaxial magnetic anisotropy, hexagonally-packed nanoscale bubble lattices emerge by field cooling with magnetic field applied along the out-of-plane direction. Despite a range of topological spin textures in stripe domains arising due to pair formation and annihilation of Bloch lines, bubble lattices with single chirality are prevalent. Our observation of topologically-nontrivial homochiral skyrmionic bubbles in exfoliated vdW materials provides a new avenue for novel quantum states in atomically-thin insulators for magneto-electronic and quantum devices.

cond-mat.mtrl-sci↗
arXiv2019

Federated Learning with Differential Privacy: Algorithms and Performance Analysis

In this paper, to effectively prevent information leakage, we propose a novel framework based on the concept of differential privacy (DP), in which artificial noises are added to the parameters at the clients side before aggregating, namely, noising before model aggregation FL (NbAFL). First, we prove that the NbAFL can satisfy DP under distinct protection levels by properly adapting different variances of artificial noises. Then we develop a theoretical convergence bound of the loss function of the trained FL model in the NbAFL. Specifically, the theoretical bound reveals the following three key properties: 1) There is a tradeoff between the convergence performance and privacy protection levels, i.e., a better convergence performance leads to a lower protection level; 2) Given a fixed privacy protection level, increasing the number $N$ of overall clients participating in FL can improve the convergence performance; 3) There is an optimal number of maximum aggregation times (communication rounds) in terms of convergence performance for a given protection level. Furthermore, we propose a $K$-random scheduling strategy, where $K$ ($1<K<N$) clients are randomly selected from the $N$ overall clients to participate in each aggregation. We also develop the corresponding convergence bound of the loss function in this case and the $K$-random scheduling strategy can also retain the above three properties. Moreover, we find that there is an optimal $K$ that achieves the best convergence performance at a fixed privacy level. Evaluations demonstrate that our theoretical results are consistent with simulations, thereby facilitating the designs on various privacy-preserving FL algorithms with different tradeoff requirements on convergence performance and privacy levels.

cs.LG↗
arXiv2019

Privacy Preserving Location Data Publishing: A Machine Learning Approach

Publishing datasets plays an essential role in open data research and promoting transparency of government agencies. However, such data publication might reveal users' private information. One of the most sensitive sources of data is spatiotemporal trajectory datasets. Unfortunately, merely removing unique identifiers cannot preserve the privacy of users. Adversaries may know parts of the trajectories or be able to link the published dataset to other sources for the purpose of user identification. Therefore, it is crucial to apply privacy preserving techniques before the publication of spatiotemporal trajectory datasets. In this paper, we propose a robust framework for the anonymization of spatiotemporal trajectory datasets termed as machine learning based anonymization (MLA). By introducing a new formulation of the problem, we are able to apply machine learning algorithms for clustering the trajectories and propose to use $k$-means algorithm for this purpose. A variation of $k$-means algorithm is also proposed to preserve the privacy in overly sensitive datasets. Moreover, we improve the alignment process by considering multiple sequence alignment as part of the MLA. The framework and all the proposed algorithms are applied to TDrive and Geolife location datasets. The experimental results indicate a significantly higher utility of datasets by anonymization based on MLA framework.

cs.LG↗
arXiv2019

User Association and Path Planning for UAV-Aided Mobile Edge Computing with Energy Restriction

Mobile edge computing (MEC) provides computational services at the edge of networks by offloading tasks from user equipments (UEs). This letter employs an unmanned aerial vehicle (UAV) as the edge computing server to execute offloaded tasks from the ground UEs. We jointly optimize user association, UAV trajectory, and uploading power of each UE to maximize sum bits offloaded from all UEs to the UAV, subject to energy constraint of the UAV and quality of service (QoS) of each UE. To address the non-convex optimization problem, we first decompose it into three subproblems that are solved with integer programming and successive convex optimization methods respectively. Then, we tackle the overall problem by the multi-variable iterative optimization algorithm. Simulations show that the proposed algorithm can achieve a better performance than other baseline schemes.

cs.IT↗
arXiv2019

Bandwidth Slicing to Boost Federated Learning in Edge Computing

Bandwidth slicing is introduced to support federated learning in edge computing to assure low communication delay for training traffic. Results reveal that bandwidth slicing significantly improves training efficiency while achieving good learning accuracy.

cs.NI↗
arXiv2019

Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement Learning

This letter studies a basic wireless caching network where a source server is connected to a cache-enabled base station (BS) that serves multiple requesting users. A critical problem is how to improve cache hit rate under dynamic content popularity. To solve this problem, the primary contribution of this work is to develop a novel dynamic content update strategy with the aid of deep reinforcement learning. Considering that the BS is unaware of content popularities, the proposed strategy dynamically updates the BS cache according to the time-varying requests and the BS cached contents. Towards this end, we model the problem of cache update as a Markov decision process and put forth an efficient algorithm that builds upon the long short-term memory network and external memory to enhance the decision making ability of the BS. Simulation results show that the proposed algorithm can achieve not only a higher average reward than deep Q-network, but also a higher cache hit rate than the existing replacement policies such as the least recently used, first-in first-out, and deep Q-network based algorithms.

cs.IT↗
arXiv2019

Weighted graphlets and deep neural networks for protein structure classification

As proteins with similar structures often have similar functions, analysis of protein structures can help predict protein functions and is thus important. We consider the problem of protein structure classification, which computationally classifies the structures of proteins into pre-defined groups. We develop a weighted network that depicts the protein structures, and more importantly, we propose the first graphlet-based measure that applies to weighted networks. Further, we develop a deep neural network (DNN) composed of both convolutional and recurrent layers to use this measure for classification. Put together, our approach shows dramatic improvements in performance over existing graphlet-based approaches on 36 real datasets. Even comparing with the state-of-the-art approach, it almost halves the classification error. In addition to protein structure networks, our weighted-graphlet measure and DNN classifier can potentially be applied to classification of other weighted networks in computational biology as well as in other domains.

stat.ML↗
arXiv2019

Subsystem-based Approach to Scalable Quantum Optimal Control

The development of quantum control methods is an essential task for emerging quantum technologies. In general, the process of optimizing quantum controls scales very unfavorably in system size due to the exponential growth of the Hilbert space dimension. Here, I present a scalable subsystem-based method for quantum optimal control on a large quantum system. The basic idea is to cast the original problem as a robust control problem on subsystems with requirement of robustness in respect of inter-subsystem couplings, thus enabling a drastic reduction of problem size. The method is in particular suitable for target quantum operations that are local, e.g., elementary quantum gates. As an illustrative example, I employ it to tackle the demanding task of pulse searching on a 12-spin coupled system, achieving substantial reduction of memory and time costs. This work has significant implications for coherent quantum engineering on near-term intermediate-scale quantum devices.

quant-ph↗
arXiv2019

Weakly Supervised Energy-Based Learning for Action Segmentation

This paper is about labeling video frames with action classes under weak supervision in training, where we have access to a temporal ordering of actions, but their start and end frames in training videos are unknown. Following prior work, we use an HMM grounded on a Gated Recurrent Unit (GRU) for frame labeling. Our key contribution is a new constrained discriminative forward loss (CDFL) that we use for training the HMM and GRU under weak supervision. While prior work typically estimates the loss on a single, inferred video segmentation, our CDFL discriminates between the energy of all valid and invalid frame labelings of a training video. A valid frame labeling satisfies the ground-truth temporal ordering of actions, whereas an invalid one violates the ground truth. We specify an efficient recursive algorithm for computing the CDFL in terms of the logadd function of the segmentation energy. Our evaluation on action segmentation and alignment gives superior results to those of the state of the art on the benchmark Breakfast Action, Hollywood Extended, and 50Salads datasets.

cs.CV↗
arXiv2019

Variable selection with false discovery rate control in deep neural networks

Deep neural networks (DNNs) are famous for their high prediction accuracy, but they are also known for their black-box nature and poor interpretability. We consider the problem of variable selection, that is, selecting the input variables that have significant predictive power on the output, in DNNs. We propose a backward elimination procedure called SurvNet, which is based on a new measure of variable importance that applies to a wide variety of networks. More importantly, SurvNet is able to estimate and control the false discovery rate of selected variables, while no existing methods provide such a quality control. Further, SurvNet adaptively determines how many variables to eliminate at each step in order to maximize the selection efficiency. To study its validity, SurvNet is applied to image data and gene expression data, as well as various simulation datasets.

stat.ML↗
arXiv2019

Fine Tuning Problem of the Cosmological Constant in a Generalized Randall-Sundrum Model

To solve the cosmological constant fine tuning problem, we investigate a $(n+1)$-dimensional generalized Randall-Sundrum brane world scenario with two $(n-1)$-branes instead of two 3-branes. Adopting an anisotropic metric ansatz, we obtain the positive effective cosmological constant $Ω_{eff}$ of order $10^{-124}$ and only require a solution $\simeq50-80$. Meanwhile, both the visible and hidden branes are stable because their tensions are positive. Therefore, the fine tuning problem can be solved quite well. Furthermore, the Hubble parameter $H_{1}(z)$ as a function of redshift $z$ is in good agreement with cosmic chronometers dataset. The evolution of the universe naturally shifts from deceleration to acceleration. This demonstrates that the evolution of the universe is intrinsically an extra-dimensional phenomenon. It can be seen as a dynamic model of dark energy which is driven by the evolution of the extra dimensions on the brane.

gr-qc↗
arXiv2019

Cross-X Learning for Fine-Grained Visual Categorization

Recognizing objects from subcategories with very subtle differences remains a challenging task due to the large intra-class and small inter-class variation. Recent work tackles this problem in a weakly-supervised manner: object parts are first detected and the corresponding part-specific features are extracted for fine-grained classification. However, these methods typically treat the part-specific features of each image in isolation while neglecting their relationships between different images. In this paper, we propose Cross-X learning, a simple yet effective approach that exploits the relationships between different images and between different network layers for robust multi-scale feature learning. Our approach involves two novel components: (i) a cross-category cross-semantic regularizer that guides the extracted features to represent semantic parts and, (ii) a cross-layer regularizer that improves the robustness of multi-scale features by matching the prediction distribution across multiple layers. Our approach can be easily trained end-to-end and is scalable to large datasets like NABirds. We empirically analyze the contributions of different components of our approach and demonstrate its robustness, effectiveness and state-of-the-art performance on five benchmark datasets. Code is available at \url{https://github.com/cswluo/CrossX}.

cs.CV↗
arXiv2019

Clustering with Outlier Removal

Cluster analysis and outlier detection are strongly coupled tasks in data mining area. Cluster structure can be easily destroyed by few outliers; on the contrary, outliers are defined by the concept of cluster, which are recognized as the points belonging to none of the clusters. Unfortunately, most existing studies do not notice the coupled relationship between these two task and handle them separately. In light of this, we consider the joint cluster analysis and outlier detection problem, and propose the Clustering with Outlier Removal (COR) algorithm. Generally speaking, the original space is transformed into the binary space via generating basic partitions in order to define clusters. Then an objective function based Holoentropy is designed to enhance the compactness of each cluster with a few outliers removed. With further analyses on the objective function, only partial of the problem can be handled by K-means optimization. To provide an integrated solution, an auxiliary binary matrix is nontrivally introduced so that COR completely and efficiently solves the challenging problem via a unified K-means-- with theoretical supports. Extensive experimental results on numerous data sets in various domains demonstrate the effectiveness and efficiency of COR significantly over state-of-the-art methods in terms of cluster validity and outlier detection. Some key factors in COR are further analyzed for practical use. Finally, an application on flight trajectory is provided to demonstrate the effectiveness of COR in the real-world scenario.

cs.LG↗
arXiv2019

Anisotropic magnetocaloric effect in Fe$_{3-x}$GeTe$_2$

We present a comprehensive study on anisotropic magnetocaloric porperties of the van der Waals weak-itinerant ferromagnet Fe$_{3-x}$GeTe$_2$ that features gate-tunable room-temperature ferromagnetism in few-layer device. Intrinsic magnetocrystalline anisotropy is observed to be temperature-dependent and most likely favors the long-range magnetic order in thin Fe$_{3-x}$GeTe$_2$ crsytal. The magnetic entropy change $-ΔS_M$ also reveals an anisotropic characteristic between $H // ab$ and $H // c$, which could be well scaled into a universal curve. The peak value $-ΔS_M^{max}$ of 1.20 J kg$^{-1}$ K$^{-1}$ and the corresponding adiabatic temperature change $ΔT_{ad}$ of 0.66 K are deduced from heat capacity with out-of-plane field change of 5 T. By fitting of the field-dependent parameters of $-ΔS_M^{max}$ and the relative cooling power RCP, it gives $-ΔS_M^{max} \propto H^n$ with $n = 0.603(6)$ and $RCP \propto H^m$ with $m = 1.20(1)$ when $H // c$. Given the high and tunable $T_c$, Fe$_{3-x}$GeTe$_2$ crystals are of interest for fabricating the heterostructure-based spintronics device.

cond-mat.str-el↗