arXiv · 1912.00331
Identifying Cognitive Radars -- Inverse Reinforcement Learning using Revealed Preferences
Abstract
We consider an inverse reinforcement learning problem involving us versus an enemy radar equipped with a Bayesian tracker. By observing the emissions of the enemy radar,how can we identify if the radar is cognitive (constrained utility maximizer)? Given the observed sequence of actions taken by the enemy's radar, we consider three problems: (i) Are the enemy radar's actions (waveform choice, beam scheduling) consistent with constrained utility maximization? If so how can we estimate the cognitive radar's utility function that is consistent with its actions. We formulate and solve the problem in terms of the spectra (eigenvalues) of the state and observation noise covariance matrices, and the algebraic Riccati equation. (ii) How to construct a statistical test for detecting a cognitive radar (constrained utility maximization) when we observe the radar's actions in noise or the radar observes our probe signal in noise? We propose a statistical detector with a tight Type-II error bound. (iii) How can we optimally probe (interrogate) the enemy's radar by choosing our state to minimize the Type-II error of detecting if the radar is deploying an economic rational strategy, subject to a constraint on the Type-I detection error? We present a stochastic optimization algorithm to optimize our probe signal. The main analysis framework used in this paper is that of revealed preferences from microeconomics.
Explore related subjects
Keep this discovery
Vikram Krishnamurthy, Daniel Angley, Robin Evans, William Moran. 2019-12-01. Identifying Cognitive Radars -- Inverse Reinforcement Learning using Revealed Preferences. https://doi.org/10.1109/tsp.2020.3013516
Cite the original work for its findings. Save a collection to share your selection of sources.