arXiv subjects

Alexandra Duel-Hallen

Publications and source records attributed to Alexandra Duel-Hallen.

16 recordsLinked to original sources

arXiv2024

Impact of Reflectors and MIMO on ML-Aided mmWave/sub-THz Blockage Prediction

The performance of millimeter-wave (mmWave) and sub-terahertz (sub-THz) communication systems is significantly impaired by sensitivity to sudden blockages. In this work, we employ machine learning (ML) and our physics-based simulation tool to warn about the upcoming blockage tens of 5G frames ahead for highway speeds, providing a sufficient time for a proactive response. Performance of this ML-aided early-warning-of-blockage (ML-EW) algorithm is analyzed for realistic outdoor mobile environments with diverse reflectors and antenna arrays placed at the base station (BS) and user equipment (UE) over a range of mmWave and sub-THz frequencies. ML accuracy of about 90% or higher is demonstrated for highway UE, blocker, and reflector speeds, multiple-input-multiple-output (MIMO) systems, and frequencies in mmWave/sub-THz range.

eess.SP↗

arXiv2022

Robust and Scalable Game-theoretic Security Investment Methods for Voltage Stability of Power Systems

We develop investment approaches to secure electric power systems against load attacks where a malicious intruder (the attacker) covertly changes reactive power setpoints of loads to push the grid towards voltage instability while the system operator (the defender) employs reactive power compensation (RPC) to prevent instability. Extending our previously reported Stackelberg game formulation for this problem, we develop a robust-defense sequential algorithm and a novel genetic algorithm that provides scalability to large-scale power system models. The proposed methods are validated using IEEE prototype power system models with time-varying load uncertainties, demonstrating that reliable and robust defense is feasible unless the operator's RPC investment resources are severely limited relative to the attacker's resources.

eess.SY↗

arXiv2021

A Distributed and Resilient Bargaining Game for Weather-Predictive Microgrid Energy Cooperation

A bargaining game is investigated for cooperative energy management in microgrids. This game incorporates a fully distributed and realistic cooperative power scheduling algorithm (CoDES) as well as a distributed Nash Bargaining Solution (NBS)-based method of allocating the overall power bill resulting from CoDES. A novel weather-based stochastic renewable generation (RG) prediction method is incorporated in the power scheduling. We demonstrate the proposed game using a 4-user grid-connected microgrid model with diverse user demands, storage, and RG profiles and examine the effect of weather prediction on day-ahead power scheduling and cost/profit allocation. Finally, the impact of users' ambivalence about cooperation and /or dishonesty on the bargaining outcome is investigated, and it is shown that the proposed game is resilient to malicious users' attempts to avoid payment of their fair share of the overall bill.

cs.MA↗

arXiv2021

A Robust Stackelberg Game for Cyber-Security Investment in Networked Control Systems

We present a resource-planning game for cyber-security of networked control systems (NCS). The NCS is assumed to be operating in closed-loop using a linear state-feedback $\mathcal{H}_2$ controller. A zero-sum, two-player Stackelberg game (SG) is developed between an attacker and a defender for this NCS. The attacker aims to disable communication of selected nodes and thereby render the feedback gain matrix to be sparse, leading to degradation of closed-loop performance, while the defender aims to prevent this loss by investing in the protection of targeted nodes. Both players trade their $\mathcal{H}_2$-performance objectives for the costs of their actions. The standard backward induction method is modified to determine a cost-based Stackelberg equilibrium (CBSE) that saves the players' costs without degrading the control performance. We analyze the dependency of a CBSE on the relative budgets of the players as well as on the node "importance" order. Moreover, a robust-defense method is developed for the realistic case when the defender is not informed about the attacker's resources. The proposed algorithms are validated using examples from wide-area control of electric power systems. It is demonstrated that reliable and robust defense is feasible unless the defender's resources are severely limited relative to the attacker's resources. We also show that the proposed methods are robust to time-varying model uncertainties and thus are suitable for long-term security investment in realistic NCSs. Finally, we employ computationally efficient genetic algorithms (GA) to compute the optimal strategies of the attacker and the defender in realistic large power systems.

math.OC↗

arXiv2020

A Stackelberg Security Investment Game for Voltage Stability of Power Systems

We formulate a Stackelberg game between an attacker and a defender of a power system. The attacker attempts to alter the load setpoints of the power system covertly and intelligently, so that the voltage stability margin of the grid is reduced, driving the entire system towards a voltage collapse. The defender, or the system operator, aims to compensate for this reduction by retuning the reactive power injection to the grid by switching on control devices, such as a bank of shunt capacitors. A modified Backward Induction method is proposed to find a cost-based Stackelberg equilibrium (CBSE) of the game, which saves the players' costs while providing the optimal allocation of both players' investment resources under budget and covertness constraints. We analyze the proposed game extensively for the IEEE 9-bus power system model and present an example of its performance for the IEEE 39-bus power system model. It is demonstrated that the defender is able to maintain system stability unless its security budget is much lower than the attacker's budget.

eess.SY↗

arXiv2019

Game-Theoretic Mixed $H_2/H_{\infty}$ Control with Sparsity Constraint for Multi-agent Networked Control Systems

Multi-agent networked control systems (NCSs) are often subject to model uncertainty and are limited by large communication cost, associated with feedback of data between the system nodes. To provide robustness against model uncertainty and to reduce the communication cost, this paper investigates the mixed $H_2/H_{\infty}$ control problem for NCS under the sparsity constraint. First, proximal alternating linearized minimization (PALM) is employed to solve the centralized social optimization where the agents have the same optimization objective. Next, we investigate a sparsity-constrained noncooperative game, which accommodates different control-performance criteria of different agents, and propose a best-response dynamics algorithm based on PALM that converges to an approximate Generalized Nash Equilibrium (GNE) of this game. A special case of this game, where the agents have the same $H_2$ objective, produces a partially-distributed social optimization solution. We validate the proposed algorithms using a network with unstable node dynamics and demonstrate the superiority of the proposed PALM-based method to a previously investigated sparsity-constrained mixed $H_2/H_{\infty}$ controller.

eess.SY↗

arXiv2019

Early Warning of mmWave Signal Blockage and AoA Transition Using sub-6 GHz Observations

The susceptibility of millimeter-wave (mmWave) signals to physical blockage and abrupt signal strength variations presents a challenge to reliable 5G communication. This work proposes and examines the feasibility of utilizing lower-frequency signals as early-warning indicators of mobile mmWave signal blockage or recovery. A physics-based channel simulation tool incorporating Fresnel diffraction and image sources is employed to demonstrate that sub-6 GHz signals "lead" mmWave signals in reaching a specific signal-strength threshold by several to tens of milliseconds at mobile speeds, suggesting early-warning systems are viable. This predictive approach stems from frequency-dependent properties of diffraction and does not assume a specific topology or mobile and obstacle speeds. Realistic simulations that include transitions from line of sight (LoS) to non-line of sight (NLoS) and reflection scenarios are employed to verify the proposed prediction capabilities. Moreover, prediction of the strongest multipath component and its angle of arrival (AoA) using sub-6 GHz observations is investigated.

eess.SP↗

arXiv2018

A Cyber-Security Investment Game for Networked Control Systems

We formulate a resource-planning game between an attacker and a defender of a network control system. We consider the network to be operating in closed-loop with a linear quadratic regulator (LQR). We construct a general-sum, two-player, mixed strategy game, where the attacker attempts to destroy communication equipment of some nodes, and thereby render the LQR feedback gain matrix to be sparse, leading to degradation of closed-loop performance. The defender, on the other hand, aims to prevent this loss. Both players trade their control performance objectives for the cost of their actions. A Mixed Strategy Nash Equilibrium (MSNE) of the game represents the allocation of the players' respective resources for attacking or protecting the network nodes. We analyze the dependence of a MSNE on the relative budgets of the players as well as on the important network nodes that must be preserved to achieve a desirable LQR performance. MSNE is computed using nonlinear programming. Results are validated using the New England power system model, and it is shown that reliable defense is feasible unless the cost of attack is very low or much smaller than the cost of protection per generator.

eess.SY↗

arXiv2018

Sparse Wide-Area Control of Power Systems using Data-driven Reinforcement Learning

In this paper we present an online wide-area oscillation damping control (WAC) design for uncertain models of power systems using ideas from reinforcement learning. We assume that the exact small-signal model of the power system at the onset of a contingency is not known to the operator and use the nominal model and online measurements of the generator states and control inputs to rapidly converge to a state-feedback controller that minimizes a given quadratic energy cost. However, unlike conventional linear quadratic regulators (LQR), we intend our controller to be sparse, so its implementation reduces the communication costs. We, therefore, employ the gradient support pursuit (GraSP) optimization algorithm to impose sparsity constraints on the control gain matrix during learning. The sparse controller is thereafter implemented using distributed communication. Using the IEEE 39-bus power system model with 1149 unknown parameters, it is demonstrated that the proposed learning method provides reliable LQR performance while the controller matched to the nominal model becomes unstable for severely uncertain systems.

eess.SY↗

arXiv2016

Distributed Multi-Step Power Scheduling and Cost Allocation for Cooperative Microgrids

Microgrids are self-sufficient small-scale power grid systems that can employ renewable generation sources and energy storage devices and can connect to the main grid or operate in a stand-alone mode. Most research on energy-storage management in microgrids does not take into account the dynamic nature of the problem and the need for fully-distributed, multi-step scheduling. First, we address these requirements by extending our previously proposed \textit{multi-step cooperative distributed energy scheduling} (CoDES) algorithm to include both purchasing power from and selling the generated power to the main grid. Second, we model the microgrid as a multi-agent system where the agents (e.g. households) act as players in a cooperative game and employ a distributed algorithm based on the Nash Bargaining Solution (NBS) to fairly allocate the costs of cooperative power management (computed using CoDES) among themselves. The dependency of the day-ahead power schedule and the costs on system parameters, e.g., the price schedule and the user activity level (measured by whether it owns storage and renewable generation devices), is analyzed for a three-agent microgrid example.

eess.SY↗

arXiv2016

A Sensing Contribution-based Two-layer Game for Channel Selection and Spectrum Access in Cognitive Radio Ad-hoc Networks

In cognitive radio (CR) networks, the secondary users (SUs) sense the spectrum licensed to the primary users (PUs) to identify and possibly transmit over temporarily unoccupied channels. Cooperative sensing was proposed to improve the sensing accuracy, but in heterogeneous scenarios SUs do not contribute equally to the cooperative sensing result because they experience different received PU signal quality at their sensors. In this paper, a two-layer coalitional game is developed for distributed sensing and access in multichannel CR ad hoc networks where the SUs' transmission opportunities are commensurate with their sensing contributions, thus fostering cooperation and eliminating free-riders. Numerical results show that the proposed two-layer game is computationally efficient and outperforms previously investigated collaborative sensing and spectrum access approaches for heterogeneous multichannel CR networks in terms of energy efficiency, throughput, SU fairness, and complexity. Moreover, it is demonstrated that this game is robust to changes in the network topology and the number of SUs in low-mobility scenarios. Finally, we propose a new physical-layer approach to distributing the network-level miss-detection (MD) constraints fairly among the interfering SUs for guaranteed PU protection and demonstrate the performance advantages of the AND-rule combining of spectrum sensing results for heterogeneous SUs.

cs.NI↗

arXiv2016

Game-Theoretic Multi-Agent Control and Network Cost Allocation under Communication Constraints

Multi-agent networked linear dynamic systems have attracted attention of researchers in power systems, intelligent transportation, and industrial automation. The agents might cooperatively optimize a global performance objective, resulting in social optimization, or try to satisfy their own selfish objectives using a noncooperative differential game. However, in these solutions, large volumes of data must be sent from system states to possibly distant control inputs, thus resulting in high cost of the underlying communication network. To enable economically-viable communication, a game-theoretic framework is proposed under the \textit{communication cost}, or \textit{sparsity}, constraint, given by the number of communicating state/control input pairs. As this constraint tightens, the system transitions from dense to sparse communication, providing the trade-off between dynamic system performance and information exchange. Moreover, using the proposed sparsity-constrained distributed social optimization and noncooperative game algorithms, we develop a method to allocate the costs of the communication infrastructure fairly and according to the agents' diverse needs for feedback and cooperation. Numerical results illustrate utilization of the proposed algorithms to enable and ensure economic fairness of wide-area control among power companies.

eess.SY↗

arXiv2013

Adaptation to the Primary User CSI in Cognitive Radio Sensing and Access

In Cognitive Radio (CR) networks, multiple secondary network users (SUs) attempt to communicate over wide potential spectrum without causing significant interference to the Primary Users (PUs). A spectrum sensing algorithm is a critical component of any sensing strategy. Performance of conventional spectrum detection methods is severely limited when the average SNR of the fading channel between the PU transmitter and the SU sensor is low. Cooperative sensing and advanced detection techniques only partially remedy this problem. A key limitation of conventional approaches is that the sensing threshold is determined from the miss detection rate averaged over the fading distribution. In this paper, the threshold is adapted to the instantaneous PU-to-SU Channel State Information (CSI) under the prescribed collision probability constraint, and a novel sensing strategy design is proposed for overlay CR network where the instantaneous false alarm probability is incorporated into the belief update and the reward computation. It is demonstrated that the proposed sensing approach improves SU confidence, randomizes sensing decisions, and significantly improves SU network throughput while satisfying the collision probability constraint to the PUs in the low average PU-to-SU SNR region. Moreover, the proposed adaptive sensing strategy is robust to mismatched and correlated fading CSI and improves significantly on conventional cooperative sensing techniques. Finally, joint adaptation to PU channel gain and SU link CSI is explored to further improve CR throughput and reduce SU collisions.

cs.NI↗

arXiv2012

Channel-Adaptive Sensing Strategy for Cognitive Radio Ad Hoc Networks

In Cognitive Radio (CR) ad hoc networks, secondary users (SU) attempt to utilize valuable spectral resources without causing significant interference to licensed primary users (PU). While there is a large body of research on spectrum opportunity detection, exploitation, and adaptive transmission in CR, most existing approaches focus only on avoiding PU activity when making sensing decisions. Since the myopic sensing strategy results in congestion and poor throughput, several collision-avoidance sensing approaches were investigated in the literature. However, they provide limited improvement. A channel-aware myopic sensing strategy that adapts the reward to the fading channel state information (CSI) of the SU link is proposed. This CSI varies over the CR spectrum and from one SU pair to another due to multipath and shadow fading, thus randomizing sensing decisions and increasing the network throughput. The proposed joint CSI adaptation at the medium access control (MAC) and physical layers provides large throughput gain over randomized sensing strategies and/or conventional adaptive transmission methods. The performance of the proposed CSI-aided sensing strategy is validated for practical network scenarios and demonstrated to be robust to CSI mismatch, sensing errors, and spatial channel correlation.

cs.NI↗

arXiv2011

CSI-aided MAC with Multiuser Diversity for Cognitive Radio Networks

Cognitive Radio (CR) aims to increase the spectrum utilization by allowing secondary users (SU) to access unused licensed spectrum bands. To maximize the throughput given limited sensing capability, SUs need to strike a balance between sensing the channels that are not heavily used by primary users (PU) and avoiding collisions with other SUs. To randomize sensing decisions without resorting to multiuser sensing policies, it is proposed to exploit the spatially-variant fading channel conditions on different links by adapting the reward to the channel state information (CSI). Moreover, the proposed channel-adaptive policy favors links with high achievable transmission rate and thus further improves the network throughput.

cs.NI↗

arXiv2011

Enabling Adaptive Rate and Relay Selection for 802.11 Mobile Ad Hoc Networks

Mobile ad hoc networks (MANETs) are self-configuring wireless networks that lack permanent infrastructure and are formed among mobile nodes on demand. Rapid node mobility results in dramatic channel variation, or fading, that degrades MANET performance. Employing channel state information (CSI) at the transmitter can improve the throughput of routing and medium access control (MAC) protocols for mobile ad hoc networks. Several routing algorithms in the literature explicitly incorporate the fading signal strength into the routing metric, thus selecting the routes with strong channel conditions. While these studies show that adaptation to the time-variant channel gain is beneficial in MANETs, they do not address the effect of the outdated fading CSI at the transmitter. For realistic mobile node speeds, the channel gain is rapidly varying, and becomes quickly outdated due the feedback delay. We analyze the link throughput of joint rate adaptation and adaptive relay selection in the presence of imperfect CSI. Moreover, for an 802.11 network that employs geographic opportunistic routing with adaptive rate and relay selection, we propose a novel method to reduce the effect of the feedback delay at the MAC layer in the presence of Rayleigh fading. This method exploits channel reciprocity and fading prediction and does not require significant modification to the existing 802.11 frame structure. Extensive network simulations demonstrate that the proposed approach significantly improves the throughput, delay, and packet delivery ratio for high mobile velocities relative to previously proposed approaches that employ outdated CSI at the transmitter.

cs.NI↗