arXiv subjects

Rudolf Mathar

Publications and source records attributed to Rudolf Mathar.

At least 19 recordsLinked to original sources

arXiv2021

Quantization-Aided Secrecy: FD C-RAN Communications with Untrusted Radios

In this work, we study a full-duplex (FD) cloud radio access network (C-RAN) from the aspects of infrastructure sharing and information secrecy, where the central unit utilizes FD remote radio units (RU)s belonging to the same operator, i.e., the trusted RUs, as well as the RUs belonging to other operators or private owners, i.e., the untrusted RUs. Furthermore, the communication takes place in the presence of untrusted external receivers, i.e., eavesdropper nodes. The communicated uplink (UL) and downlink (DL) waveforms are quantized in order to comply with the limited capacity of the fronthaul links. In order to provide information secrecy, we propose a novel utilization of the quantization noise shaping in the DL, such that it is simultaneously used to comply with the limited capacity of the fronthaul links, as well as to degrade decoding capability of the individual eavesdropper and the untrusted RUs for both the UL and DL communications. In this regard, expressions describing the achievable secrecy rates are obtained. An optimization problem for jointly designing the DL and UL quantization and precoding strategies are then formulated, with the purpose of maximizing the overall system weighted sum secrecy rate. Due to the intractability of the formulated problem, an iterative solution is proposed, following the successive inner approximation and semi-definite relaxation frameworks, with convergence to a stationary point. Numerical evaluations indicate a promising gain of the proposed approaches for providing information secrecy against the untrusted infrastructure nodes and/or external eavesdroppers in the context of FD C-RAN communications.

cs.IT↗

arXiv2020

Asymptotic Rate Analysis for Impairments-Aware Multi-Carrier FD Massive MIMO Relay Networks utilizing MRT/MRC Strategy

In this paper, we analyze the asymptotic rate for a multi-carrier (MC) full-duplex (FD) massive multiple input multiple output (mMIMO) decode and forward (DF) relay system which serves multiple MC single-antenna half-duplex (HD) nodes. We take into account the impact of hardware distortions resulting in residual self-interference (SI) and inter-carrier leakage (ICL) as well as the impact of imperfect channel state information (CSI). We derive the asymptotic rate expression of our system employed with maximum ratio transmitting (MRT)/ maximum ratio combining (MRC) strategy when the number of the antenna becomes large (goes to $\infty$). It is noticed that the impact of hardware distortion becomes remarkable in a large-scale antenna array regime. On contrary to the effect of multi-user interference and receiver noise, which vanishes as the number of relay antenna goes to infinity, the residual SI and ICL caused by the hardware impairments remains in the MC system.

cs.IT↗

arXiv2020

Tight bounds on the mutual coherence of sensing matrices for Wigner D-functions on regular grids

Many practical sampling patterns for function approximation on the rotation group utilizes regular samples on the parameter axes. In this paper, we relate the mutual coherence analysis for sensing matrices that correspond to a class of regular patterns to angular momentum analysis in quantum mechanics and provide simple lower bounds for it. The products of Wigner d-functions, which appear in coherence analysis, arise in angular momentum analysis in quantum mechanics. We first represent the product as a linear combination of a single Wigner d-function and angular momentum coefficients, otherwise known as the Wigner 3j symbols. Using combinatorial identities, we show that under certain conditions on the bandwidth and number of samples, the inner product of the columns of the sensing matrix at zero orders, which is equal to the inner product of two Legendre polynomials, dominates the mutual coherence term and fixes a lower bound for it. In other words, for a class of regular sampling patterns, we provide a lower bound for the inner product of the columns of the sensing matrix that can be analytically computed. We verify numerically our theoretical results and show that the lower bound for the mutual coherence is larger than Welch bound. Besides, we provide algorithms that can achieve the lower bound for spherical harmonics.

quant-ph↗

arXiv2019

Rate Splitting for Massive MIMO Multi-carrier system using Full Duplex Decode and Forward Relay with Hardware Impairments

In this paper, we address the power allocation problem for a decode and forward (DF) relay system, where a massive multiple-input-multiple-output (mMIMO) multi-carrier (MC) base station (BS) node communicates with a MC single antenna node directly and also through the single antenna full duplex (FD) MC relay, using rate splitting (RS) approach. Successive interference cancellation approach is adopted at the destination. We consider orthogonal frequency division multiplexing (OFDM) as our MC strategy. We take into account the impact of hardware distortions resulting in residual self-interference and inter-carrier leakage (ICL), and also imperfect channel state information (CSI). We formulate a joint sub-carrier and power allocation problem to maximize the total sum rate. An iterative optimization method is proposed, which follows successive inner approximation (SIA) framework to reach the convergence point that satisfies the Karush-Kuhn-Tucker (KKT) conditions. Numerical results show the significance of distortion-aware design for such systems, and also the significant gain in terms of sum rate compared to its half duplex (HD) and also non-rate splitting scheme.

cs.IT↗

arXiv2019

Adversarial Risk Bounds for Neural Networks through Sparsity based Compression

Neural networks have been shown to be vulnerable against minor adversarial perturbations of their inputs, especially for high dimensional data under $\ell_\infty$ attacks. To combat this problem, techniques like adversarial training have been employed to obtain models which are robust on the training set. However, the robustness of such models against adversarial perturbations may not generalize to unseen data. To study how robustness generalizes, recent works assume that the inputs have bounded $\ell_2$-norm in order to bound the adversarial risk for $\ell_\infty$ attacks with no explicit dimension dependence. In this work we focus on $\ell_\infty$ attacks on $\ell_\infty$ bounded inputs and prove margin-based bounds. Specifically, we use a compression based approach that relies on efficiently compressing the set of tunable parameters without distorting the adversarial risk. To achieve this, we apply the concept of effective sparsity and effective joint sparsity on the weight matrices of neural networks. This leads to bounds with no explicit dependence on the input dimension, neither on the number of classes. Our results show that neural networks with approximately sparse weight matrices not only enjoy enhanced robustness, but also better generalization.

cs.LG↗

arXiv2019

A Deep Learning Wireless Transceiver with Fully Learned Modulation and Synchronization

In this paper, we present a deep learning based wireless transceiver. We describe in detail the corresponding artificial neural network architecture, the training process, and report on excessive over-the-air measurement results. We employ the end-to-end training approach with an autoencoder model that includes a channel model in the middle layers as previously proposed in the literature. In contrast to other state-of-the-art results, our architecture supports learning time synchronization without any manually designed signal processing operations. Moreover, the neural transceiver has been tested over the air with an implementation in software defined radio. Our experimental results for the implemented single antenna system demonstrate a raw bit-rate of 0.5 million bits per second. This exceeds results from comparable systems presented in the literature and suggests the feasibility of high throughput deep learning transceivers.

eess.SP↗

arXiv2019

Sensing Matrix Design and Sparse Recovery on the Sphere and the Rotation Group

In this paper, {the goal is to design deterministic sampling patterns on the sphere and the rotation group} and, thereby, construct sensing matrices for sparse recovery of band-limited functions. It is first shown that random sensing matrices, which consists of random samples of Wigner D-functions, satisfy the Restricted Isometry Property (RIP) with proper preconditioning and can be used for sparse recovery on the rotation group. The mutual coherence, however, is used to assess the performance of deterministic and regular sensing matrices. We show that many of widely used regular sampling patterns yield sensing matrices with the worst possible mutual coherence, and therefore are undesirable for sparse recovery. Using tools from angular momentum analysis in quantum mechanics, we provide a new expression for the mutual coherence, which encourages the use of regular elevation samples. We construct low coherence deterministic matrices by fixing the regular samples on the elevation and minimizing the mutual coherence over the azimuth-polarization choice. It is shown that once the elevation sampling is fixed, the mutual coherence has a lower bound that depends only on the elevation samples. This lower bound, however, can be achieved for spherical harmonics, which leads to new sensing matrices with better coherence than other representative regular sampling patterns. This is reflected as well in our numerical experiments where our proposed sampling patterns perfectly match the phase transition of random sampling patterns.

cs.IT↗

arXiv2019

Localizing an Unknown Number of mmW Transmitters Under Path Loss Model Uncertainties

This work estimates the position and the transmit power of multiple co-channel wireless transmitters under model uncertainties. The model uncertainties include the number of the targets and the parameters of the path-loss model which enable the system to cope with changes in the weather conditions and in mmW ranges. The problem is solved by an unbiased estimator. The underlying complicated optimization problem has a combinatorial nature that selects the best grid points as the location of the targets. The combinatorial problem is converted to a convex form by means of l1-regularization, which enables locating off-grid targets. Simulations show that the proposed algorithm solves the problem with very high accuracy in the absence of noise and shadowing.

cs.IT↗

arXiv2019

On the Effect of Low-Rank Weights on Adversarial Robustness of Neural Networks

Recently, there has been an abundance of works on designing Deep Neural Networks (DNNs) that are robust to adversarial examples. In particular, a central question is which features of DNNs influence adversarial robustness and, therefore, can be to used to design robust DNNs. In this work, this problem is studied through the lens of compression which is captured by the low-rank structure of weight matrices. It is first shown that adversarial training tends to promote simultaneously low-rank and sparse structure in the weight matrices of neural networks. This is measured through the notions of effective rank and effective sparsity. In the reverse direction, when the low rank structure is promoted by nuclear norm regularization and combined with sparsity inducing regularizations, neural networks show significantly improved adversarial robustness. The effect of nuclear norm regularization on adversarial robustness is paramount when it is applied to convolutional neural networks. Although still not competing with adversarial training, this result contributes to understanding the key properties of robust classifiers.

cs.LG↗

arXiv2019

The Restricted Isometry Property of Block Diagonal Matrices for Group-Sparse Signal Recovery

Group-sparsity is a common low-complexity signal model with widespread application across various domains of science and engineering. The recovery of such signal ensembles from compressive measurements has been extensively studied in the literature under the assumption that measurement operators are modeled as densely populated random matrices. In this paper, we turn our attention to an acquisition model intended to ease the energy consumption of sensing devices by splitting the measurements up into distinct signal blocks. More precisely, we present uniform guarantees for group-sparse signal recovery in the scenario where a number of sensors obtain independent partial signal observations modeled by block diagonal measurement matrices. We establish a group-sparse variant of the classical restricted isometry property for block diagonal sensing matrices acting on group-sparse vectors, and provide conditions under which subgaussian block diagonal random matrices satisfy this group-RIP with high probability. Two different scenarios are considered in particular. In the first scenario, we assume that each sensor is equipped with an independently drawn measurement matrix. We later lift this requirement by considering measurement matrices with constant block diagonal entries. In other words, every sensor is equipped with a copy of the same prototype matrix. The problem of establishing the group-RIP is cast into a form in which one needs to establish the concentration behavior of the suprema of chaos processes which involves estimating Talagrand's $\gamma_2$ functional. As a side effect of the proof, we present an extension to Maurey's empirical method to provide new bounds on the covering number of sets consisting of finite convex combinations of possibly infinite sets.

cs.IT↗

arXiv2018

Perturbation Analysis of Learning Algorithms: A Unifying Perspective on Generation of Adversarial Examples

Despite the tremendous success of deep neural networks in various learning problems, it has been observed that adding an intentionally designed adversarial perturbation to inputs of these architectures leads to erroneous classification with high confidence in the prediction. In this work, we propose a general framework based on the perturbation analysis of learning algorithms which consists of convex programming and is able to recover many current adversarial attacks as special cases. The framework can be used to propose novel attacks against learning algorithms for classification and regression tasks under various new constraints with closed form solutions in many instances. In particular we derive new attacks against classification algorithms which are shown to achieve comparable performances to notable existing attacks. The framework is then used to generate adversarial perturbations for regression tasks which include single pixel and single subset attacks. By applying this method to autoencoding and image colorization tasks, it is shown that adversarial perturbations can effectively perturb the output of regression tasks as well.

cs.LG↗

arXiv2018

Learning the Localization Function: Machine Learning Approach to Fingerprinting Localization

Considered as a data-driven approach, Fingerprinting Localization Solutions (FPSs) enjoy huge popularity due to their good performance and minimal environment information requirement. This papers addresses applications of artificial intelligence to solve two problems in Received Signal Strength Indicator (RSSI) based FPS, first the cumbersome training database construction and second the extrapolation of fingerprinting algorithm for similar buildings with slight environmental changes. After a concise overview of deep learning design techniques, two main techniques widely used in deep learning are exploited for the above mentioned issues namely data augmentation and transfer learning. We train a multi-layer neural network that learns the mapping from the observations to the locations. A data augmentation method is proposed to increase the training database size based on the structure of RSSI measurements and hence reducing effectively the amount of training data. Then it is shown experimentally how a model trained for a particular building can be transferred to a similar one by fine tuning with significantly smaller training numbers. The paper implicitly discusses the new guidelines to consider about deep learning designs when they are employed in a new application context.

cs.NI↗

arXiv2018

On Generation of Adversarial Examples using Convex Programming

It has been observed that deep learning architectures tend to make erroneous decisions with high reliability for particularly designed adversarial instances. In this work, we show that the perturbation analysis of these architectures provides a framework for generating adversarial instances by convex programming which, for classification tasks, is able to recover variants of existing non-adaptive adversarial methods. The proposed framework can be used for the design of adversarial noise under various desirable constraints and different types of networks. Moreover, this framework is capable of explaining various existing adversarial methods and can be used to derive new algorithms as well. We make use of these results to obtain novel algorithms. The experiments show the competitive performance of the obtained solutions, in terms of fooling ratio, when benchmarked with well-known adversarial methods.

cs.LG↗

arXiv2018

Sum Secrecy Rate Maximization in a Multi-Carrier MIMO Wiretap Channel with Full-Duplex Jamming

In this paper we address a sum secrecy rate maximization problem for a multi-carrier and MIMO communication system. We consider the case that the receiver is capable of full-duplex (FD) operation and simultaneously sends jamming signal to a potential eavesdropper. In particular, we simultaneously take advantage of the spatial and frequency diversity in the system in order to obtain a higher level of security in the physical layer. Due to the non-convex nature of the resulting mathematical problem, we propose an iterative solution with a guaranteed convergence, based on block coordinate descent method, by re-structuring our problem as a separately convex program. Moreover, for the special case that the transmitter is equipped with a single antenna, an optimal transmit power allocation strategy is obtained analytically, assuming a known jamming strategy. We also study a FD bidirectional secure communication system, where the jamming power can be reused to enhance the sum secrecy rate. The performance of the proposed design is then numerically evaluated compared to the other design strategies, and under different system assumptions.

cs.IT↗

arXiv2018

Environment-Aware Minimum-Cost Wireless Backhaul Network Planning with Full-Duplex Links

In this work, we address the joint design of the wireless backhauling network topology as well as the frequency/power allocation on the wireless links, where nodes are capable of full-duplex (FD) operation. The proposed joint design enables the coexistence of multiple wireless links at the same channel, resulting in an enhanced spectral efficiency. Moreover, it enables the usage of FD capability when/where it is gainful. In this regard, a mixed-integer-linear-program (MILP) is proposed, aiming at a minimum cost design for the wireless backhaul network, considering the required rate demand at each base station. Moreover, a re-tunning algorithm is proposed which reacts to the slight changes in the network condition, e.g., channel attenuation or rate demand, by adjusting the transmit power at the wireless links. In this regard, a successive inner approximation (SIA)- based design is proposed, where in each step a convex subproblem is solved. Numerical simulations show a reduction in the overall network cost via the utilization of the proposed designs, thanks to the coexistence of multiple wireless links on the same channel due to the FD capability.

cs.NI↗

arXiv2017

Secrecy Energy Efficiency of MIMOME Wiretap Channels with Full-Duplex Jamming

Full-duplex (FD) jamming transceivers are recently shown to enhance the information security of wireless communication systems by simultaneously transmitting artificial noise (AN) while receiving information. In this work, we investigate if FD jamming can also improve the systems secrecy energy efficiency (SEE) in terms of securely communicated bits-per- Joule, when considering the additional power used for jamming and self-interference (SI) cancellation. Moreover, the degrading effect of the residual SI is also taken into account. In this regard, we formulate a set of SEE maximization problems for a FD multiple-input-multiple-output multiple-antenna eavesdropper (MIMOME) wiretap channel, considering both cases where exact or statistical channel state information (CSI) is available. Due to the intractable problem structure, we propose iterative solutions in each case with a proven convergence to a stationary point. Numerical simulations indicate only a marginal SEE gain, through the utilization of FD jamming, for a wide range of system conditions. However, when SI can efficiently be mitigated, the observed gain is considerable for scenarios with a small distance between the FD node and the eavesdropper, a high Signal-to-noise ratio (SNR), or for a bidirectional FD communication setup.

cs.IT↗

arXiv2017

Hardware Impairments Aware Transceiver Design for Bidirectional Full-Duplex MIMO OFDM Systems

In this paper we address the linear precoding and decoding design problem for a bidirectional orthogonal frequencydivision multiplexing (OFDM) communication system, between two multiple-input multiple-output (MIMO) full-duplex (FD) nodes. The effects of hardware distortion as well as the channel state information error are taken into account. In the first step, we transform the available time-domain characterization of the hardware distortions for FD MIMO transceivers to the frequency domain, via a linear Fourier transformation. As a result, the explicit impact of hardware inaccuracies on the residual selfinterference (RSI) and inter-carrier leakage (ICL) is formulated in relation to the intended transmit/received signals. Afterwards, linear precoding and decoding designs are proposed to enhance the system performance following the minimum-mean-squarederror (MMSE) and sum rate maximization strategies, assuming the availability of perfect or erroneous CSI. The proposed designs are based on the application of alternating optimization over the system parameters, leading to a necessary convergence. Numerical results indicate that the application of a distortionaware design is essential for a system with a high hardware distortion, or for a system with a low thermal noise variance.

cs.IT↗

arXiv2017

Hardware Impairments Aware Transceiver Design for Full-Duplex Amplify-and-Forward MIMO Relaying

In this work we study the behavior of a full-duplex (FD) and amplify-and-forward (AF) relay with multiple antennas, where hardware impairments of the FD relay transceiver is taken into account. Due to the inter-dependency of the transmit relay power on each antenna and the residual self-interference in an FD-AF relay, we observe a distortion loop that degrades the system performance when the relay dynamic range is not high. In this regard, we analyze the relay function in presence of the hardware inaccuracies and an optimization problem is formulated to maximize the signal to distortion-plus-noise ratio (SDNR), under relay and source transmit power constraints. Due to the problem complexity, we propose a gradient-projection-based (GP) algorithm to obtain an optimal solution. Moreover, a nonalternating sub-optimal solution is proposed by assuming a rank-1 relay amplification matrix, and separating the design of the relay process into multiple stages (MuStR1). The proposed MuStR1 method is then enhanced by introducing an alternating update over the optimization variables, denoted as AltMuStR1 algorithm. It is observed that compared to GP, (Alt)MuStR1 algorithms significantly reduce the required computational complexity at the expense of a slight performance degradation. Finally, the proposed methods are evaluated under various system conditions, and compared with the methods available in the current literature. In particular, it is observed that as the hardware impairments increase, or for a system with a high transmit power, the impact of applying a distortion-aware design is significant.

cs.IT↗