arXiv subjects

Jie Xu

Publications and source records attributed to Jie Xu.

At least 469 records · Page 26Linked to original sources

arXiv2020

Optimized Power Control for Over-the-Air Federated Edge Learning

Over-the-air federated edge learning (Air-FEEL) is a communication-efficient solution for privacy-preserving distributed learning over wireless networks. Air-FEEL allows "one-shot" over-the-air aggregation of gradient/model-updates by exploiting the waveform superposition property of wireless channels, and thus promises an extremely low aggregation latency that is independent of the network size. However, such communication efficiency may come at a cost of learning performance degradation due to the aggregation error caused by the non-uniform channel fading over devices and noise perturbation. Prior work adopted channel inversion power control (or its variants) to reduce the aggregation error by aligning the channel gains, which, however, could be highly suboptimal in deep fading scenarios due to the noise amplification. To overcome this issue, we investigate the power control optimization for enhancing the learning performance of Air-FEEL. Towards this end, we first analyze the convergence behavior of the Air-FEEL by deriving the optimality gap of the loss-function under any given power control policy. Then we optimize the power control to minimize the optimality gap for accelerating convergence, subject to a set of average and maximum power constraints at edge devices. The problem is generally non-convex and challenging to solve due to the coupling of power control variables over different devices and iterations. To tackle this challenge, we develop an efficient algorithm by jointly exploiting the successive convex approximation (SCA) and trust region methods. Numerical results show that the optimized power control policy achieves significantly faster convergence than the benchmark policies such as channel inversion and uniform power transmission.

cs.IT↗

arXiv2020

Asymmetric Interference Cancellation for 5G Non-Public Network with Uplink-Downlink Spectrum Sharing

Different from public 4G/5G networks that are dominated by downlink traffic, emerging 5G non-public networks (NPNs) need to support significant uplink traffic to enable emerging applications such as industrial Internet of things (IIoT). The uplink-and-downlink spectrum sharing is becoming a viable solution to enhance the uplink throughput of NPNs, which allows the NPNs to perform the uplink transmission over the time-frequency resources configured for downlink transmission in coexisting public networks. To deal with the severe interference from the downlink public base station (BS) transmitter to the coexisting uplink non-public BS receiver, we propose an adaptive asymmetric successive interference cancellation (SIC) approach, in which the non-public BS receiver is enabled to have the capability of decoding the downlink signals transmitted from the public BS and successively cancelling them for interference mitigation. In particular, this paper studies a basic uplink-and-downlink spectrum sharing scenario when an uplink non-public BS and a downlink public BS coexist in the same area, each communicating with multiple users via orthogonal frequency-division multiple access (OFDMA). Under this setup, we aim to maximize the common uplink throughput of all non-public users, under the condition that the downlink throughput of each public user is above a certain threshold. The decision variables include the subcarrier allocation and user scheduling for both non-public (uplink) and public (downlink) BSs, the decoding mode of the non-public BS over each subcarrier (i.e., with or without SIC), as well as the rate and power control over subcarriers. Numerical results show that the proposed adaptive asymmetric SIC design significantly improves the common uplink throughput as compared to benchmark schemes without such design.

cs.IT↗

arXiv2020

Max-Min Fairness in IRS-Aided Multi-Cell MISO Systems with Joint Transmit and Reflective Beamforming

This paper investigates an intelligent reflecting surface (IRS)-aided multi-cell multiple-input single-output (MISO) system with several multi-antenna base stations (BSs) each communicating with a single-antenna user, in which an IRS is dedicatedly deployed for assisting the wireless transmission and suppressing the inter-cell interference. Under this setup, we jointly optimize the coordinated transmit beamforming at the BSs and the reflective beamforming at the IRS, for the purpose of maximizing the minimum weighted signal-to-interference-plus-noise ratio (SINR) at the users, subject to the individual maximum transmit power at the BSs and the reflection constraints at the IRS. To solve the non-convex problem, we first present an exact-alternating-optimization design to optimize the transmit and reflective beamforming vectors in an alternating manner, in which the transmit and reflective beamforming optimization subproblems are solved exactly by using the technique of semi-definite relaxation (SDR). However, it has high computational complexity and may lead to compromised performance due to the uncertainty of randomization in SDR. To avoid these drawbacks, we further propose an inexact-alternating-optimization design, in which the transmit and reflective beamforming optimization subproblems are solved inexactly based on the principle of successive convex approximation (SCA). In addition, to further reduce the complexity, we propose a low-complexity inexact-alternating-optimization design, in which the reflective beamforming optimization subproblem is solved more inexactly. Numerical results show that the significant performance gains achieved by the proposed three designs against benchmark schemes. Moreover, the inexact-alternating-optimization designs outperform the exact-alternating-optimization one in terms of both the achieved min-weighted-SINR value and the computational complexity.

eess.SP↗

arXiv2020

Parallel Interactive Networks for Multi-Domain Dialogue State Generation

The dependencies between system and user utterances in the same turn and across different turns are not fully considered in existing multidomain dialogue state tracking (MDST) models. In this study, we argue that the incorporation of these dependencies is crucial for the design of MDST and propose Parallel Interactive Networks (PIN) to model these dependencies. Specifically, we integrate an interactive encoder to jointly model the in-turn dependencies and cross-turn dependencies. The slot-level context is introduced to extract more expressive features for different slots. And a distributed copy mechanism is utilized to selectively copy words from historical system utterances or historical user utterances. Empirical studies demonstrated the superiority of the proposed PIN model.

cs.CL↗

arXiv2020

Impermeable Inorganic Walls Sandwiching Photoactive Layer toward Inverted Perovskite Solar and Indoor-Photovoltaic Devices

Interfaces between the perovskite active layer and the charge-transport layers (CTLs) play a critical role in both efficiency and stability of halide-perovskite photovoltaics. One of the major concerns is that surface defects of perovskite could cause detrimental nonradiative recombination and material degradation. In this work, we addressed this challenging problem by inserting ultrathin alkali-fluoride (AF) films between the tri-cation lead-iodide perovskite layer and both CTLs. This bilateral inorganic walls strategy makes use of both physical-blocking and chemical-anchoring functionalities of the continuous, uniform and compact AF framework: on the one hand, the uniformly distributed alkali-iodine coordination at the perovskite-AF interfaces effectively suppresses the formation of iodine-vacancy defects at the surfaces and grain boundaries of the whole perovskite film, thus reducing the trap-assisted recombination at the perovskite-CTL interfaces and therewith the open-voltage loss; on the other hand, the impermeable AF buffer layers effectively prevent the bidirectional ion migration at the perovskite-CTLs interfaces even under harsh working conditions. As a result, a power-conversion efficiency (PCE) of 22.02% (certified efficiency 20.4%) with low open-voltage deficit (< 0.4V) was achieved for the low-temperature processed inverted planar perovskite solar cells. Exceptional operational stability (500 h, ISOS-L-2) and thermal stability (1000 h, ISOS-D-2) were obtained. Meanwhile, a 35.7% PCE was obtained under dim-light source (1000 lux white LED light) with the optimized device, which is among the best records in perovskite indoor photovoltaics.

cond-mat.mtrl-sci↗

arXiv2020

Neural Dialogue State Tracking with Temporally Expressive Networks

Dialogue state tracking (DST) is an important part of a spoken dialogue system. Existing DST models either ignore temporal feature dependencies across dialogue turns or fail to explicitly model temporal state dependencies in a dialogue. In this work, we propose Temporally Expressive Networks (TEN) to jointly model the two types of temporal dependencies in DST. The TEN model utilizes the power of recurrent networks and probabilistic graphical models. Evaluating on standard datasets, TEN is demonstrated to be effective in improving the accuracy of turn-level-state prediction and the state aggregation.

cs.CL↗

arXiv2020

An Optimal Computing Budget Allocation Tree Policy for Monte Carlo Tree Search

We analyze a tree search problem with an underlying Markov decision process, in which the goal is to identify the best action at the root that achieves the highest cumulative reward. We present a new tree policy that optimally allocates a limited computing budget to maximize a lower bound on the probability of correctly selecting the best action at each node. Compared to widely used Upper Confidence Bound (UCB) tree policies, the new tree policy presents a more balanced approach to manage the exploration and exploitation trade-off when the sampling budget is limited. Furthermore, UCB assumes that the support of reward distribution is known, whereas our algorithm relaxes this assumption. Numerical experiments demonstrate the efficiency of our algorithm in selecting the best action at the root.

eess.SY↗

arXiv2020

A(DP)$^2$SGD: Asynchronous Decentralized Parallel Stochastic Gradient Descent with Differential Privacy

As deep learning models are usually massive and complex, distributed learning is essential for increasing training efficiency. Moreover, in many real-world application scenarios like healthcare, distributed learning can also keep the data local and protect privacy. A popular distributed learning strategy is federated learning, where there is a central server storing the global model and a set of local computing nodes updating the model parameters with their corresponding data. The updated model parameters will be processed and transmitted to the central server, which leads to heavy communication costs. Recently, asynchronous decentralized distributed learning has been proposed and demonstrated to be a more efficient and practical strategy where there is no central server, so that each computing node only communicates with its neighbors. Although no raw data will be transmitted across different local nodes, there is still a risk of information leak during the communication process for malicious participants to make attacks. In this paper, we present a differentially private version of asynchronous decentralized parallel SGD (ADPSGD) framework, or A(DP)$^2$SGD for short, which maintains communication efficiency of ADPSGD and prevents the inference from malicious participants. Specifically, R{é}nyi differential privacy is used to provide tighter privacy analysis for our composite Gaussian mechanisms while the convergence rate is consistent with the non-private version. Theoretical analysis shows A(DP)$^2$SGD also converges at the optimal $\mathcal{O}(1/\sqrt{T})$ rate as SGD. Empirically, A(DP)$^2$SGD achieves comparable model accuracy as the differentially private version of Synchronous SGD (SSGD) but runs much faster than SSGD in heterogeneous computing environments.

cs.LG↗

arXiv2020

Federated Learning for Healthcare Informatics

With the rapid development of computer software and hardware technologies, more and more healthcare data are becoming readily available from clinical institutions, patients, insurance companies and pharmaceutical industries, among others. This access provides an unprecedented opportunity for data science technologies to derive data-driven insights and improve the quality of care delivery. Healthcare data, however, are usually fragmented and private making it difficult to generate robust results across populations. For example, different hospitals own the electronic health records (EHR) of different patient populations and these records are difficult to share across hospitals because of their sensitive nature. This creates a big barrier for developing effective analytical approaches that are generalizable, which need diverse, "big data". Federated learning, a mechanism of training a shared global model with a central server while keeping all the sensitive data in local institutions where the data belong, provides great promise to connect the fragmented healthcare data sources with privacy-preservation. The goal of this survey is to provide a review for federated learning technologies, particularly within the biomedical space. In particular, we summarize the general solutions to the statistical challenges, system challenges and privacy issues in federated learning, and point out the implications and potentials in healthcare.

cs.LG↗

arXiv2020

Quasi-entropy by log-determinant covariance matrix and application to liquid crystals

A quasi-entropy is constructed for tensors averaged by a density function on $SO(3)$ using the log-determinant of a covariance matrix. It serves as a substitution of the entropy for tensors derived from a constrained minimization that involves integrals. The quasi-entropy is an elementary function that possesses the essential properties of the original entropy. It constrains the covariance matrix to be positive definite, is strictly convex, and is invariant under rotations. Moreover, when reduced by symmetries, it keeps the vanishing tensors of the symmetry zero. Explicit expressions are provided for axial symmetries up to four-fold, as well as tetrahedral and octahedral symmetries. The quasi-entropy is utilized to discuss phase transitions in several systems. The results are consistent with using the original entropy. Besides, some novel results are presented.

math-ph↗

arXiv2020

When Attackers Meet AI: Learning-empowered Attacks in Cooperative Spectrum Sensing

Defense strategies have been well studied to combat Byzantine attacks that aim to disrupt cooperative spectrum sensing by sending falsified versions of spectrum sensing data to a fusion center. However, existing studies usually assume network or attackers as passive entities, e.g., assuming the prior knowledge of attacks is known or fixed. In practice, attackers can actively adopt arbitrary behaviors and avoid pre-assumed patterns or assumptions used by defense strategies. In this paper, we revisit this security vulnerability as an adversarial machine learning problem and propose a novel learning-empowered attack framework named Learning-Evaluation-Beating (LEB) to mislead the fusion center. Based on the black-box nature of the fusion center in cooperative spectrum sensing, our new perspective is to make the adversarial use of machine learning to construct a surrogate model of the fusion center's decision model. We propose a generic algorithm to create malicious sensing data using this surrogate model. Our real-world experiments show that the LEB attack is effective to beat a wide range of existing defense strategies with an up to 82% of success ratio. Given the gap between the proposed LEB attack and existing defenses, we introduce a non-invasive method named as influence-limiting defense, which can coexist with existing defenses to defend against LEB attack or other similar attacks. We show that this defense is highly effective and reduces the overall disruption ratio of LEB attack by up to 80%.

cs.NI↗

arXiv2020

Deep Embedded Multi-view Clustering with Collaborative Training

Multi-view clustering has attracted increasing attentions recently by utilizing information from multiple views. However, existing multi-view clustering methods are either with high computation and space complexities, or lack of representation capability. To address these issues, we propose deep embedded multi-view clustering with collaborative training (DEMVC) in this paper. Firstly, the embedded representations of multiple views are learned individually by deep autoencoders. Then, both consensus and complementary of multiple views are taken into account and a novel collaborative training scheme is proposed. Concretely, the feature representations and cluster assignments of all views are learned collaboratively. A new consistency strategy for cluster centers initialization is further developed to improve the multi-view clustering performance with collaborative training. Experimental results on several popular multi-view datasets show that DEMVC achieves significant improvements over state-of-the-art methods.

cs.LG↗

arXiv2020

Real-Time Resource Allocation for Wireless Powered Multiuser Mobile Edge Computing With Energy and Task Causality

This paper considers a wireless powered multiuser mobile edge computing (MEC) system, in which a multi-antenna hybrid access point (AP) wirelessly charges multiple users, and each user relies on the harvested energy to execute computation tasks. We jointly optimize the energy beamforming and remote task execution at the AP, as well as the local computing and task offloading, aiming to minimize the total system energy consumption over a finite time horizon, subject to causality constraints for both energy harvesting and task arrival at the users. In particular, we consider a practical scenario with casual task state information (TSI) and channel state information (CSI), i.e., only the current and previous TSI and CSI are available, but the future TSI and CSI can only be predicted subject to certain errors. To solve this real-time resource allocation problem, we propose an offline-optimization inspired online design approach. First, we consider the offline optimization case by assuming that the TSI and CSI are perfectly known a-priori. In this case, the energy minimization problem corresponds to a convex problem, for which the semi-closed-form optimal solution is obtained via the Lagrange duality method. Next, inspired by the optimal offline solution, we propose a sliding-window based online resource allocation design in practical cases by integrating with the sequential optimization. Finally, numerical results show that the proposed joint wireless powered MEC designs significantly improve the system's energy efficiency, as compared with the benchmark schemes that consider a sliding window of size one or without such joint optimization.

cs.IT↗

arXiv2020

Optimized Power Control for Over-the-Air Computation in Fading Channels

In this paper, we study the power control problem for Over-the-air computation (AirComp) over fading channels. Our objective is to minimize the computation error by jointly optimizing the transmit power at the power-constrained devices and a signal scaling factor (called denoising factor) at the fusion center (FC). The problem is generally non-convex due to the coupling of the transmit power over devices and denoising factor at the FC. To tackle the challenge, we first consider the special case with static channels, for which we derive the optimal solution in closed form. The optimal power control exhibits a threshold-based structure. Specifically, for each device, if the product of the channel quality and power budget, called quality indicator, exceeds an optimized threshold, this device applies channel-inversion power control; otherwise, it performs full power transmission. Building on the results, we proceed to consider the general case with time-varying channels. To solve the more challenging non-convex power control problem, we use the Lagrange-duality method via exploiting its "time-sharing" property. The derived optimal power control exhibits a regularized channel inversion structure, where the regularization has the function of balancing the tradeoff between the signal-magnitude alignment and noise suppression. Moreover, for the special case with only one device being power limited, we show that the optimal power control for the power-limited device has an interesting channel-inversion water-filling structure, while those for other devices (with sufficient power budgets) reduce to channel-inversion power control over all fading states.

cs.IT↗

arXiv2020

Cooperative Interference Management for Over-the-Air Computation Networks

This paper considers a multi-cell AirComp network and investigates the optimal power control policies over multiple cells to regulate the effect of inter-cell interference. First, we consider the scenario of centralized multi-cell power control, where we characterize the Pareto boundary of the multi-cell MSE region by minimizing the sum MSE subject to a set of constraints on individual MSEs. Though the sum-MSE minimization problem is non-convex and its direct solution intractable, we optimally solve this problem via equivalently solving a sequence of convex second-order cone program feasibility problems together with a bisection search. Next, we consider distributed power control in the other scenario without a centralized controller, for which an alternative IT-based method is proposed to characterize the same MSE Pareto boundary, and enable a decentralized power control algorithm. Accordingly, each AP only needs to individually control the power of its associated devices, but subject to a set of IT constraints on their interference to neighboring cells, while different APs can cooperate in iteratively updating the IT levels by pairwise information exchange, to achieve a Pareto-optimal MSE tuple. Last, simulation results demonstrate that cooperative power control using the proposed algorithms can substantially reduce the sum MSE of AirComp networks.

cs.IT↗

arXiv2020

Iterative Methods for Globally Lipschitz Nonlinear Laplace Equations

We introduce an iterative method to prove the existence and uniqueness of the complex-valued nonlinear elliptic PDE of the form $ -Δu + F(u) = f $ with Dirichlet or Neumann boundary conditions on a precompact domain $ Ω\subset \mathbb{R}^{n}$, where $ F : \mathbb{C} \rightarrow \mathbb{C} $ is Lipschitz. The same method gives a solution to $ - Δ_{g} u + F(u) = f $ for these boundary conditions on a smooth, compact Riemannian manifold $ (M, g) $ with $ \mathcal{C}^{1} $ boundary, where $ - Δ_{g} $ is the Laplace-Beltrami operator. We also apply parametrix methods to discuss an integral version of these PDEs.

math.AP↗

arXiv2020

Unconditionally positivity preserving and energy dissipative schemes for Poisson--Nernst--Planck equations

We develop a set of numerical schemes for the Poisson--Nernst--Planck equations. We prove that our schemes are mass conservative, uniquely solvable and keep positivity unconditionally. Furthermore, the first-order scheme is proven to be unconditionally energy dissipative. These properties hold for various spatial discretizations. Numerical results are presented to validate these properties. Moreover, numerical results indicate that the second-order scheme is also energy dissipative, and both the first- and second-order schemes preserve the maximum principle for cases where the equation satisfies the maximum principle.

math.NA↗

arXiv2020

Adversarial Machine Learning based Partial-model Attack in IoT

As Internet of Things (IoT) has emerged as the next logical stage of the Internet, it has become imperative to understand the vulnerabilities of the IoT systems when supporting diverse applications. Because machine learning has been applied in many IoT systems, the security implications of machine learning need to be studied following an adversarial machine learning approach. In this paper, we propose an adversarial machine learning based partial-model attack in the data fusion/aggregation process of IoT by only controlling a small part of the sensing devices. Our numerical results demonstrate the feasibility of this attack to disrupt the decision making in data fusion with limited control of IoT devices, e.g., the attack success rate reaches 83\% when the adversary tampers with only 8 out of 20 IoT devices. These results show that the machine learning engine of IoT system is highly vulnerable to attacks even when the adversary manipulates a small portion of IoT devices, and the outcome of these attacks severely disrupts IoT system operations.

eess.SP↗