Movable-Antenna Relay Enhanced Multiuser Communications: Reinforcement Learning-Based Antenna Positioning and Power Allocation

Abstract

Movable antenna (MA) has emerged as a promising technology for enhancing wireless communication performance by flexibly reconfiguring wireless channels via antenna movement. In this paper, we propose an MA relay-enhanced multiuser communication system that adopts a half-duplex decode-and-forward (DF) relay scheme. The relay node is equipped with an MA array, and a buffer is employed to enhance the end-to-end transmission performance. Specifically, we formulate an optimization problem to maximize the minimum average achievable rate among multiple users over a given transmission period by dynamically optimizing the positions of MAs, transmit power, and beamforming matrices, subject to the constraints on antenna movement, inter-antenna spacing, and total energy budget for antenna movement and transmission. To address this non-convex problem with highly coupled variables, we propose a reinforcement learning (RL)-based algorithm, where a twin delayed deep deterministic policy gradient (TD3) algorithm is utilized to optimize the antenna positions and power allocation, while the transmit and receive beamforming solutions are obtained through closed-form expressions in each time slot. Numerical results validate the efficacy of the proposed RL-based algorithm and demonstrate the superiority of the proposed MA relay-enhanced multiuser communication system over the conventional fixed-position antenna (FPA)-based relay system and other MA-based benchmarks.