arXiv subjects

Qianqian Zhang

Publications and source records attributed to Qianqian Zhang.

48 records · Page 3Linked to original sources

arXiv2020

Distributional Reinforcement Learning for mmWave Communications with Intelligent Reflectors on a UAV

In this paper, a novel communication framework that uses an unmanned aerial vehicle (UAV)-carried intelligent reflector (IR) is proposed to enhance multi-user downlink transmissions over millimeter wave (mmWave) frequencies. In order to maximize the downlink sum-rate, the optimal precoding matrix (at the base station) and reflection coefficient (at the IR) are jointly derived. Next, to address the uncertainty of mmWave channels and maintain line-of-sight links in a real-time manner, a distributional reinforcement learning approach, based on quantile regression optimization, is proposed to learn the propagation environment of mmWave communications, and, then, optimize the location of the UAV-IR so as to maximize the long-term downlink communication capacity. Simulation results show that the proposed learning-based deployment of the UAV-IR yields a significant advantage, compared to a non-learning UAV-IR, a static IR, and a direct transmission schemes, in terms of the average data rate and the achievable line-of-sight probability of downlink mmWave communications.

cs.IT↗

arXiv2020

Predictive Deployment of UAV Base Stations in Wireless Networks: Machine Learning Meets Contract Theory

In this paper, a novel framework is proposed to enable a predictive deployment of unmanned aerial vehicles (UAVs) as temporary base stations (BSs) to complement ground cellular systems in face of downlink traffic overload. First, a novel learning approach, based on the weighted expectation maximization (WEM) algorithm, is proposed to estimate the user distribution and the downlink traffic demand. Next, to guarantee a truthful information exchange between the BS and UAVs, using the framework of contract theory, an offload contract is developed, and the sufficient and necessary conditions for having a feasible contract are analytically derived. Subsequently, an optimization problem is formulated to deploy an optimal UAV onto the hotspot area in a way that the utility of the overloaded BS is maximized. Simulation results show that the proposed WEM approach yields a prediction error of around 10%. Compared with the expectation maximization and k-mean approaches, the WEM method shows a significant advantage on the prediction accuracy, as the traffic load in the cellular system becomes spatially uneven. Furthermore, compared with two event-driven deployment schemes based on the closest-distance and maximal-energy metrics, the proposed predictive approach enables UAV operators to provide efficient communication service for hotspot users in terms of the downlink capacity, energy consumption and service delay. Simulation results also show that the proposed method significantly improves the revenues of both the BS and UAV networks, compared with two baseline schemes.

cs.IT↗

arXiv2020

Symbiotic Radio: Cognitive Backscattering Communications for Future Wireless Networks

The heterogenous wireless services and exponentially growing traffic call for novel spectrum- and energy-efficient wireless communication technologies. In this paper, a new technique, called symbiotic radio (SR), is proposed to exploit the benefits and address the drawbacks of cognitive radio (CR) and ambient backscattering communications(AmBC), leading to mutualism spectrum sharing and highly reliable backscattering communications. In particular, the secondary transmitter (STx) in SR transmits messages to the secondary receiver (SRx) over the RF signals originating from the primary transmitter (PTx) based on cognitive backscattering communications, thus the secondary system shares not only the radio spectrum, but also the power, and infrastructure with the primary system. In return, the secondary transmission provides beneficial multipath diversity to the primary system, therefore the two systems form mutualism spectrum sharing. More importantly, joint decoding is exploited at SRx to achieve highly reliable backscattering communications. To exploit the full potential of SR, in this paper, we address three fundamental tasks in SR: (1) enhancing the backscattering link via active load; (2) achieving highly reliable communications through joint decoding; and (3) capturing PTx's RF signals using reconfigurable intelligent surfaces. Emerging applications, design challenges and open research problems will also be discussed.

eess.SP↗

arXiv2019

Reflections in the Sky: Millimeter Wave Communication with UAV-Carried Intelligent Reflectors

In this paper, a novel approach that uses an unmanned aerial vehicle (UAV)-carried intelligent reflector (IR) is proposed to enhance the performance of millimeter wave (mmW) networks. In particular, the UAV-IR is used to intelligently reflect mmW beamforming signals from a base station towards a mobile outdoor user, while harvesting energy from mmW signals to power the IR. To maintain a line-of-sight (LOS) channel, a reinforcement learning (RL) approach, based on Q-learning and neural networks, is proposed to model the propagation environment, such that the location and reflection coefficient of the UAV-IR can be optimized to maximize the downlink transmission capacity. Simulation results show a significant advantage for using a UAV-IR over a static IR, in terms of the average data rate and the achievable downlink LOS probability. The results also show that the RL-based deployment of the UAV-IR further improves the network performance, relative to a scheme without learning.

cs.IT↗

arXiv2019

Large Intelligent Surface/Antennas (LISA): Making Reflective Radios Smart

Large intelligent surface/antennas (LISA), a two-dimensional artificial structure with a large number of reflective-surface/antenna elements, is a promising reflective radio technology to construct programmable wireless environments in a smart way. Specifically, each element of the LISA adjusts the reflection of the incident electromagnetic waves with unnatural properties, such as negative refraction, perfect absorption, and anomalous reflection, thus the wireless environments can be software-defined according to various design objectives. In this paper, we introduce the reflective radio basics, including backscattering principles, backscatter communication, and reflective relay, and the fundamentals and implementations of LISA technology. Then, we present an overview of the state-of-the-art research on emerging applications of LISA-aided wireless networks. Finally, the limitations, challenges, and open issues associated with LISA for future wireless applications are discussed.

cs.IT↗

arXiv2019

Intelligent User Association for Symbiotic Radio Networks using Deep Reinforcement Learning

In this paper, we are interested in symbiotic radio networks, in which an Internet-of-Things (IoT) network parasitizes in a primary network to achieve spectrum-, energy-, and infrastructure-efficient communications. Specifically, the BS serves multiple cellular users using time division multiple access (TDMA) and each IoT device is associated with one cellular user for information transmission. We focus on the user association problem, whose objective is to link each IoT device to an appropriate cellular user by maximizing the sum rate of all IoT devices. However, the difficulty in obtaining the full real-time channel information makes it difficult to design an optimal policy for this problem. To overcome this issue, we propose two deep reinforcement learning (DRL) algorithms, both use the historical information to infer the current information in order to make appropriate decisions. One algorithm, centralized DRL, makes decisions for all IoT devices at one time with global information. The other algorithm, distributed DRL, makes a decision only for one IoT device at one time using local information. Finally, simulation results show that the two DRL algorithms achieve comparable performance as the optimal user association policy which requires perfect real-time information, and the distributed DRL algorithm has the advantage of scalability.

eess.SP↗

arXiv2019

An Open Source Modeling Framework for Interdependent Energy-Transportation- Communication Infrastructure in Smart and Connected Communities

Infrastructure in future smart and connected communities is envisioned as an aggregate of public services, including the energy, transportation and communication systems, all intertwined with each other. The intrinsic interdependency among these systems may exert underlying influence on both design and operation of the heterogeneous infrastructures. However, few prior studies have tapped into the interdependency among the three systems in order to quantify their potential impacts during standard operation. In response to this, this paper proposes an open source, flexible, integrated modeling framework suitable for designing coupled energy, transportation, and communication systems and for assessing the impact of their interdependencies. First, a novel multi-level, multi-layer, multi-agent approach is proposed to enable flexible modeling of the interconnected energy, transportation, and communication systems. Then, for the framework's proof-of-concept, preliminary component and system-level models for different systems are designed and implemented using Modelica, an equation-based object-oriented modeling language. Finally, three case studies of gradually increasing complexity are presented (energy, energy + transportation, energy + transportation + communication) to evaluate the interdependencies among the three systems. Quantitative analyses show that the deviation of the average velocity on the road can be 10.5\% and the deviation of the power draw from the grid can be 7\% with or without considering the transportation and communication system at the peak commute time, indicating the presence of notable interdependencies. The proposed modeling framework also has the potential to be further extended for various modeling purposes and use cases, such as dynamic modeling and optimization, resilience analysis, and integrated decision making in future connected communities.

eess.SY↗

arXiv2018

Noncoherent Multiantenna Receivers for Cognitive Backscatter System with Multiple RF Sources

Cognitive backscattering, an integration of cognitive radio and backsatter modulation, is emerging as a potential candidate for green Internet of Things (IoT). In cognitive backscatter systems, the backscatter device (BD) shares not only the same spectrum, but also the same radio-frequency (RF) source with the legacy system. In this paper, we investigate the signal transmission problem, in which a basic transmission model is considered which consists of K RF sources, one BD and one reader equipped with M antennas. A non-cooperative scenario is considered, where there is no cooperation between the legacy systems and the backscatter system, and no pilots are transmitted from the RF sources or BD to the reader. The on-off keying differential modulation is adopted to achieve noncoherent transmission. Firstly, through the capacity analyses, we point out that high-throughput backscatter transmission can be achieved when the number of the receive antennas satisfies M>K. The Chernoff Information (CI) is also derived to predict the detection performance. Next, we address the signal detection problem at the reader. The optimal soft decision (SD) and suboptimal hard decision (HD) detectors are designed based on the maximum likelihood criterion. To tackle the non-cooperation challenge, a fully blind channel estimation method is proposed to learn the detection-required parameters based on clustering. Extensive numerical results verify the effectiveness of the proposed detectors and the channel estimation method. In addition, it is illustrated that the increase of K may not necessarily lead to performance degradation when multiple receive antennas are exploited.

eess.SP↗

arXiv2018

Saikosaponins with similar structures but different mechanisms lead to combined hepatotoxicity

Radix Bupleuri is a hepatoprotective traditional Chinese medicine (TCM) used for thousands of years in clinical, which was reported to be linked with liver damage. Previous studies have revealed that saikosaponins are the major types of components that contribute to the hepatotoxicity of Radix Bupleuri. However the underlying molecular mechanism is far from being understood. In order to clarify whether these structural analogues exert toxicity effects through the same molecular targets, a systematic comparison study was done in this paper. The effects of SSa, b2, c, and d on isolated rat liver mitochondria and human hepatocyte L02 cells were explored, respectively. The collective results indicated that although saikosaponins share the similar structures but they have quite different mechanisms. SSb2 and SSd showed most serious damage on the function of mitochondria and survival rate of cell, respectively. SSb2 could cause mitochondrial permeability transition pore (mPTP) opening and collapse of mitochondrial membrane potential (ΔΨm) by impairing the mitochondrial respiratory chain complex III. While SSd destroyed plasma membrane and led to the release of lactate dehydrogenase (LDH) mainly through activating caspase-1. Furthermore, the combine index (CI) demonstrated that the combined hepatotoxicity of SSb2 and SSd could be additive. This finding might yield more in depth understanding of hepatotoxicity of Radix Bupleuri possess many different saikosaponins.

q-bio.SC↗

arXiv2018

Machine Learning for Predictive On-Demand Deployment of UAVs for Wireless Communications

In this paper, a novel machine learning (ML) framework is proposed for enabling a predictive, efficient deployment of unmanned aerial vehicles (UAVs), acting as aerial base stations (BSs), to provide on-demand wireless service to cellular users. In order to have a comprehensive analysis of cellular traffic, an ML framework based on a Gaussian mixture model (GMM) and a weighted expectation maximization (WEM) algorithm is introduced to predict the potential network congestion. Then, the optimal deployment of UAVs is studied to minimize the transmit power needed to satisfy the communication demand of users in the downlink, while also minimizing the power needed for UAV mobility, based on the predicted cellular traffic. To this end, first, the optimal partition of service areas of each UAV is derived, based on a fairness principle. Next, the optimal location of each UAV that minimizes the total power consumption is derived. Simulation results show that the proposed ML approach can reduce the required downlink transmit power and improve the power efficiency by over 20%, compared with an optimal deployment of UAVs with no ML prediction.

eess.SP↗

arXiv2018

Cooperative Ambient Backscatter Communications for Green Internet-of-Things

Ambient backscatter communication (AmBC) enables a passive backscatter device to transmit information to a reader using ambient RF signals, and has emerged as a promising solution to green Internet-of-Things (IoT). Conventional AmBC receivers are interested in recovering the information from the ambient backscatter device (A-BD) only. In this paper, we propose a cooperative AmBC (CABC) system in which the reader recovers information not only from the A-BD, but also from the RF source. We first establish the system model for the CABC system from spread spectrum and spectrum sharing perspectives. Then, for flat fading channels, we derive the optimal maximum-likelihood (ML) detector, suboptimal linear detectors as well as successive interference-cancellation (SIC) based detectors. For frequency-selective fading channels, the system model for the CABC system over ambient orthogonal frequency division multiplexing (OFDM) carriers is proposed, upon which a low-complexity optimal ML detector is derived. For both kinds of channels, the bit-error-rate (BER) expressions for the proposed detectors are derived in closed forms. Finally, extensive numerical results have shown that, when the A-BD signal and the RF-source signal have equal symbol period, the proposed SIC-based detectors can achieve near-ML detection performance for typical application scenarios, and when the A-BD symbol period is longer than the RF-source symbol period, the existence of backscattered signal in the CABC system can enhance the ML detection performance of the RF-source signal, thanks to the beneficial effect of the backscatter link when the A-BD transmits at a lower rate than the RF source.

cs.IT↗

arXiv2016

Quantum Game Theory for Beam Alignment in Millimeter Wave Device-to-Device Communications

In this paper, the problem of optimized beam alignment for wearable device-to-device (D2D) communications over millimeter wave (mmW) frequencies is studied. In particular, a noncooperative game is formulated between wearable communication pairs that engage in D2D communications. In this game, wearable devices acting as transmitters autonomously select the directions of their beams so as to maximize the data rate to their receivers. To solve the game, an algorithm based on best response dynamics is proposed that allows the transmitters to reach a Nash equilibrium in a distributed manner. To further improve the performance of mmW D2D communications, a novel quantum game model is formulated to enable the wearable devices to exploit new quantum directions during their beam alignment so as to further enhance their data rate. Simulation results show that the proposed game-theoretic approach improves the performance, in terms of data rate, of about 75% compared to a uniform beam alignment. The results also show that the quantum game model can further yield up to 20% improvement in data rates, relative to the classical game approach.

cs.IT↗