arXiv subjects

Songnam Hong

Publications and source records attributed to Songnam Hong.

At least 19 recordsLinked to original sources

arXiv2026

State-Augmented Learning for Post-Deployment Adaptation of Coexisting O-RAN Applications

Fixed control policies in Open RAN can require retraining when service requirements, traffic loads, or interacting applications change. We propose ATTUNE, a state-augmented learning method for an energy saving application that coexists with a learned mobility load balancing application under a service constraint. ATTUNE conditions the energy saving policy on a Lagrange multiplier and updates this scalar during operation using measured service degradation, while keeping both applications' network parameters fixed. To train a single policy across service requirements, ATTUNE samples target service levels uniformly and maps them to multipliers through an adaptive table. This procedure accounts for policy-dependent multiplier responses and improves energy savings compared with training over a widened fixed multiplier range. We characterize the induced distribution of service levels and the convergence and fluctuations of the online update. An exact finite-window identity establishes convergence of average measured degradation to the target when the projection corrections vanish on average. Simulations show that a single ATTUNE policy achieves energy savings comparable to policies trained separately for each service requirement. It adapts to changes in the target, load, and partner application without retraining, increases energy savings at light load, and maintains target tracking for separately trained application pairs. No statistically significant increase in cell switching is detected in the evaluated comparisons.

cs.LG↗

arXiv2026

CSI-Free Positioning of Movable Antennas for IoT Networks: A Compositional Kernelized Bandit

Movable antenna (MA) arrays reshape the propagation channel by mechanically changing the element positions, which suits Internet-of-Things access points whose devices cannot adapt on their own. Existing position optimization assumes the channel is known at every candidate configuration. In practice a configuration can be evaluated only after the array has moved there, over several slots limited by the actuator speed, during which the channel changes. We formulate the positioning of M MAs serving K < M devices without channel state information as a nonstationary kernelized bandit over the joint configuration space, driven by a single scalar rate feedback per slot under a reachability constraint and an actuation-energy cost. Since the information gain of a standard kernel grows exponentially with M , and the multiuser sum rate depends on the positions through a sum of per-antenna terms, we design a compositional kernel that retains interactions up to antenna pairs. On this kernel we propose CoMoveUCB, which selects a target configuration over the whole feasible set by coordinate ascent and retains it under a persistence rule. We prove sublinear dynamic regret with a polynomial dependence on M . Simulations show that CoMoveUCB outperforms fixed, measure-then-optimize, and reachability-confined benchmarks across loadings, confirming the value of repositioning an MA array under realistic actuation limits.

eess.SP↗

arXiv2026

Role-Adaptive Policy Optimization for Offline Reinforcement Learning

Policy regularization in offline reinforcement learning balances policy improvement against reliance on uncertain value estimates. This balance can differ between selecting actions for execution and supplying actions for critic bootstrapping, yet methods such as TD3+BC couple these roles through a shared policy. We propose Role-Adaptive Policy Optimization (RAPO), which adapts policy-update coefficients according to their roles in value learning and execution. RAPO learns these coefficients by differentiating through candidate policy updates formed using the base algorithm's actor objective. For TD3+BC, RAPO separates bootstrap and execution actors and adapts their coefficients independently: the bootstrap objective penalizes policy-induced changes in target values, while the execution objective evaluates a local policy-improvement surrogate. For IQL, whose value learning is already independent of the execution actor, RAPO preserves the original value updates and adapts only the inverse temperature in advantage-weighted policy extraction. Experiments on D4RL locomotion and AntMaze tasks show improvements over both base algorithms, with larger gains for TD3+BC, whose RAPO instantiation outperforms baselines on average.

cs.LG↗

arXiv2026

Is One Step Enough for Offline Policy Improvement?

Behavior regularization in offline reinforcement learning limits the exploitation of critic errors, but strong anchoring can also restrict policy improvement. We study how policy improvement is composed through multi-step proximal policy improvement (MPI), which re-centers each proximal objective on the preceding policy. We parameterize the procedure by a nominal total horizon $T$ and $K$ stages with local horizon $T/K$, distinguishing subdivision at a fixed total horizon from additional refinement at a common local horizon. Our analysis shows that sequential re-centering can reach endpoints unavailable to any single proximal step and characterizes how subdivision reduces the leading local discretization error of ideal updates under a fixed critic. We consider TD3+BC and IQL-based policy extraction to examine how improvement composition interacts with actor objectives and policy geometry. TD3+BC experiments on D4RL locomotion suggest that subdivision can broaden the range of useful total horizons, while adding refinement stages at a fixed small local horizon can improve return. The results identify improvement composition as a design choice alongside regularization strength, with distinct effects from horizon subdivision and additional policy extraction.

cs.LG↗

arXiv2026

Positioning a Movable Antenna Without CSI: A Kernelized Bandit Under Costly Movement

Movable antenna (MA) systems reconfigure the wireless channel by repositioning the antenna within a confined region. The position optimization behind this capability has been studied under the premise that the channel at every candidate position is known. However, acquiring that knowledge is costly: a position can be measured only after the antenna has moved there, which takes many slots at the speed of the actuator, and the channel drifts meanwhile. We formulate MA positioning as a non-stationary kernelized bandit with a reachability constraint, in which exploration, tracking, and the reward lost in transit are coupled through a single physical action. We propose MoveUCB, which addresses the reachability constraint through a global target search, a persistence rule that holds the target across slots, and a transit-aware movement cost term. We prove that MoveUCB attains sublinear dynamic regret under the standard variation-budget condition of non-stationary bandits alone, with the physical parameters entering only through constants. Simulations against a dynamic-programming oracle and movement-unaware baselines show that MoveUCB attains the lowest regret with about half the travel of the closest baseline that moves.

eess.SP↗

arXiv2026

Online Movable Antenna Repositioning Under Movement Delay and a Long-Term Energy Budget

Movable antenna (MA) systems improve the channel by repositioning antennas, but each repositioning interrupts data transmission for a time set by the largest displacement and consumes actuator energy that accumulates over all displacements. Existing designs optimize the positions within a single transmission block, whereas the movement energy is limited over the long term and the positions chosen in one slot constrain those reachable in the next. We study online throughput maximization under the movement delay and a long-term energy budget. Using the Lyapunov drift-plus-penalty framework, we convert the long-term problem into per-slot problems and solve each by a proximal minorization-maximization algorithm that requires no channel statistics and keeps an antenna stationary whenever its relocation is not worth the energy. We prove that the budget is met for every channel realization and that the algorithm attains, within a controllable penalty, the throughput gain of reallocating the budget over time. Simulations show that this reallocation improves the throughput over imposing the budget slot by slot when the demand for repositioning is concentrated in time, whereas the latter, supported by the same solver, is preferable when the channel varies continuously, at the cost of an order of magnitude more antenna actuation.

eess.SP↗

arXiv2026

Information-Theoretically Secure Aggregation for Lightweight Federated Learning: Resilient to Dropouts and Adversaries

On-device federated learning (FL) enables privacy-preserving and personalized model training on resource-constrained devices such as smartphones and IoT nodes. To reduce communication cost, sign-based methods (e.g., signSGD) transmit one-bit gradients. However, exposing gradient signs makes them vulnerable to inference attacks, while existing secure aggregation schemes are often incompatible with such methods or incur significant computational and communication overhead. We propose a lightweight and information-theoretically secure aggregation framework tailored for sign-based FL. The framework securely computes the majority vote (MV) polynomial through single-round secure multiplication, ensuring end-to-end information-theoretic security under the honest-majority assumption while revealing only the final aggregated sign to the server. To enhance efficiency and scalability, we introduce two key techniques. First, inverse-form exponent reduction halves the effective MV polynomial degree, reducing both communication and computation costs. Second, we propose single-round secure multiplication, achieving linear offline complexity and storage with only a single online communication. Together, these techniques reduce online communication by up to 99.5% and latency by up to 85.7% compared to conventional approaches. Also, by leveraging inherent MDS-code-based decoding, the framework achieves robustness against both dropouts and adversarial behaviors, yielding accuracy gains of up to 20.65% and 10.74%, respectively. Overall, the proposed framework establishes a practical foundation for large-scale, low-latency, and information-theoretically secure aggregation in sign-based FL.

cs.LG↗

arXiv2026

PathBridger: Subgoal Bridges for Offline Goal-Conditioned Reinforcement Learning

Offline goal-conditioned reinforcement learning (GCRL) aims to learn policies for reaching diverse goals entirely from fixed trajectory data. Long-horizon offline GCRL remains challenging because sparse goal-reaching signals must be propagated over many steps, while execution errors cannot be corrected through additional environment interaction. Existing methods address these challenges by improving long-range value estimation or reducing the effective decision horizon through subgoals, options, and action chunks. In several hierarchical methods, however, a selected subgoal specifies where to go, while the intervening state-space path remains implicit in an endpoint-conditioned low-level policy. To address this interface, we propose PathBridger, a hierarchical offline GCRL method that explicitly connects subgoal selection to short-horizon execution. PathBridger constructs a state-space bridge toward the selected intermediate endpoint and decodes it into a short executable action chunk using an inverse dynamics model. Experiments across the evaluated OGBench tasks demonstrate strong aggregate performance, with particularly large gains on the multi-object Cube manipulation tasks. Code: https://github.com/SChoish/PathBridger

cs.LG↗

arXiv2026

Heterogeneous Multi-Agent Reinforcement Learning for Radio Resource Management under Coupled Finite-Horizon Constraints

Maximizing throughput under proportional fairness in dense wireless networks requires jointly managing user association, scheduling, base station (BS) activation, and handover control under hard finite-horizon energy and handover budgets, which induces a fundamental tension between BS-side energy management and user-side handover regulation. While multi-agent reinforcement learning (MARL) is a natural framework for such distributed sequential control, its application here faces two difficulties: finite-horizon budget constraints cannot be evaluated at each time slot, and the nonlinear proportional fairness utility admits no principled per-slot decomposition. We propose HeLyMARL, a Lyapunov-embedded heterogeneous MARL framework that resolves both via drift-plus-penalty decomposition with virtual queues. The energy and handover constraint pressures are internalized directly into a unified per-slot reward, converting the constrained finite-horizon problem into an unconstrained MARL problem. Comparison against two Lagrangian-based alternatives reveals a timescale separation: Lagrangian relaxation regulates constraints only across training episodes, whereas the virtual queues of HeLyMARL bound cumulative budget consumption at every partial horizon within an episode, a pacing guarantee beyond the reach of greedy Lyapunov-based control. Simulations show that HeLyMARL is the only method that sustains the throughput-fairness balance together with uninterrupted service throughout the horizon, outperforming conventional MARL, Lyapunov-based, and constrained MARL benchmarks without premature budget exhaustion.

cs.LG↗

arXiv2026

Scalable Rate-Splitting Precoding via Recurrent Structure-Preserving Graph Neural Networks

Graph neural network (GNN)-based precoding has demonstrated strong potential for scalable multi-user beamforming in multi-user multiple-input single-output (MU-MISO) systems under space division multiple access (SDMA). However, direct extension to rate-splitting multiple access (RSMA) is non-trivial due to the coupled common/private-stream structure inherent to RSMA, which requires a fundamentally different graph representation and permutation equivariance structure. Motivated by this, we propose a recurrent structure-preserving graph neural network (RS-GNN) for scalable RSMA precoding. RS-GNN constructs precoder-dependent graph features at every refinement layer, enabling closed-loop interference-aware message passing, and recovers the common and private precoders through an analytically grounded structure-based reconstruction via a differentiable linear solver. This design decouples the learnable parameters from fixed system dimensions, enabling generalization to unseen system sizes without retraining. We formally prove that RS-GNN satisfies mixed permutation equivariance with respect to both user and antenna orderings, and show that RS-GNN reduces to conventional SDMA precoding as a special case by deactivating the common-stream branch. Simulation results demonstrate that RS-GNN achieves near-WMMSE sum-rate performance with significantly lower online inference time, while generalizing robustly to unseen system sizes; its SDMA special case consistently outperforms existing GNN-based precoders across unseen antenna and user configurations, SNR regimes, and channel distributions.

eess.SP↗

arXiv2026

Channel Estimation for Reconfigurable Intelligent Surface Assisted Upper Mid-Band MIMO Systems

The upper mid-band (UMB) spectrum is a key enabler for 6G systems, yet reconfigurable intelligent surface (RIS)-assisted UMB communications face severe channel estimation challenges due to near-field propagation and transitional scattering, which induce strong spatial correlation and ill-conditioned least-squares (LS) formulations. To overcome this limitation, we propose a conditioning-aware channel estimation framework that transforms the inherently ill-conditioned high-dimensional problem into multiple well-conditioned subproblems via greedy column grouping. By systematically separating highly correlated RIS elements into distinct sub-blocks via piecewise RIS phase design, the proposed method directly improves Gram matrix conditioning and stabilizes piecewise LS reconstruction without relying on sparsity assumptions. Simulation results demonstrate that the proposed method significantly outperforms conventional LS and OMP-based estimators in pilot-limited and transitional UMB regimes, achieving robust performance with low computational complexity.

eess.SP↗

arXiv2026

CSIT-Free Beamforming for Multi-Group Multicast in Overloaded mmWave Systems

We study downlink multi-group multicast (MGM) transmission in overloaded millimeter-wave (mmWave) systems, where the number of users exceeds the number of transmit antennas. We first show that, under realistic line-of-sight (LoS)-dominant user geometries, the conventional single-slot MGM scheme suffers from a fundamental collapse of the max-min fairness degrees of freedom (MMF-DoF), regardless of beamforming optimization. Although this collapse can in principle be avoided via aggressive time-division scheduling, it requires excessive time sharing and results in severe throughput loss in overloaded regimes. To address this limitation, we propose a CSIT-free multi-group multicast framework (CF-MGM) that does not rely on instantaneous channel state information at the transmitter (CSIT) and is based on a deterministic multi-slot transmission structure. By exploiting structured precoding and receiver-side combining across multiple slots, the proposed framework eliminates inter-group interference by construction. We show that CF-MGM guarantees a strictly positive MMF-DoF in overloaded LoS mmWave systems, in sharp contrast to the DoF collapse of conventional single-slot MGM. Simulation results demonstrate that CF-MGM significantly outperforms state-of-the-art CSIT-based MGM schemes while substantially reducing signaling overhead.

eess.SP↗

arXiv2025

Hi-SAFE: Hierarchical Secure Aggregation for Lightweight Federated Learning

Federated learning (FL) faces challenges in ensuring both privacy and communication efficiency, particularly in resource-constrained environments such as Internet of Things (IoT) and edge networks. While sign-based methods, such as sign stochastic gradient descent with majority voting (SIGNSGD-MV), offer substantial bandwidth savings, they remain vulnerable to inference attacks due to exposure of gradient signs. Existing secure aggregation techniques are either incompatible with sign-based methods or incur prohibitive overhead. To address these limitations, we propose Hi-SAFE, a lightweight and cryptographically secure aggregation framework for sign-based FL. Our core contribution is the construction of efficient majority vote polynomials for SIGNSGD-MV, derived from Fermat's Little Theorem. This formulation represents the majority vote as a low-degree polynomial over a finite field, enabling secure evaluation that hides intermediate values and reveals only the final result. We further introduce a hierarchical subgrouping strategy that ensures constant multiplicative depth and bounded per-user complexity, independent of the number of users n.

cs.LG↗

arXiv2025

CSIT-Free Downlink Transmission for mmWave MU-MISO Systems in High-Mobility Scenario

This paper investigates the downlink (DL) transmission in millimeter-wave (mmWave) multi-user multiple-input single-output (MU-MISO) systems especially focusing on a high speed mobile scenario. To complete the DL transmission within an extremely short channel coherence time, we propose a novel DL transmission framework that eliminates the need for channel state information at the transmitter (CSIT), of which acquisition process requires a substantial overhead, instead fully exploiting the given channel coherence time. Harnessing the characteristic of mmWave channel and uniquely designed CSIT-free unitary precoding, we propose a symbol detection method along with the simultaneous CSI at the receiver (CSIR) and Doppler shift estimation method to completely cancel the interferences while achieving a full combining gain. Via simulations, we demonstrate the effectiveness of the proposed method comparing with the existing baselines.

eess.SP↗

arXiv2025

Federated Reinforcement Learning in Heterogeneous Environments

We investigate a Federated Reinforcement Learning with Environment Heterogeneity (FRL-EH) framework, where local environments exhibit statistical heterogeneity. Within this framework, agents collaboratively learn a global policy by aggregating their collective experiences while preserving the privacy of their local trajectories. To better reflect real-world scenarios, we introduce a robust FRL-EH framework by presenting a novel global objective function. This function is specifically designed to optimize a global policy that ensures robust performance across heterogeneous local environments and their plausible perturbations. We propose a tabular FRL algorithm named FedRQ and theoretically prove its asymptotic convergence to an optimal policy for the global objective function. Furthermore, we extend FedRQ to environments with continuous state space through the use of expectile loss, addressing the key challenge of minimizing a value function over a continuous subset of the state space. This advancement facilitates the seamless integration of the principles of FedRQ with various Deep Neural Network (DNN)-based RL algorithms. Extensive empirical evaluations validate the effectiveness and robustness of our FRL algorithms across diverse heterogeneous environments, consistently achieving superior performance over the existing state-of-the-art FRL algorithms.

cs.LG↗

arXiv2025

Piecewise Beam Training and Channel Estimation for RIS-Aided Near-Field Communications

In this paper, we investigate the channel estimation challenge in reconfigurable intelligent surface (RIS)-aided near-field communication systems. Current channel estimation techniques require substantial pilot overhead and computational complexity, especially when the number of RIS elements is extremely large. To address this issue, we introduce a two-timescale channel estimation strategy that leverages the asymmetric coherence times of both the RIS-base station (BS) channel and the User-RIS channel. We derive a time-scaling property indicating that, for any two effective channels within the longer coherence time, one effective channel can be represented as the product of a vector, termed the small-timescale effective channel, and the other effective channel. By integrating the estimated effective channel from the initial time block with observations from our piecewise beam training, we present an efficient method for estimating subsequent small-timescale effective channels. We theoretically verify the efficacy of the proposed RIS design and demonstrate, through simulations, that our channel estimation method outperforms existing methods in pilot overhead and computational complexity across various realistic channel models.

eess.SP↗

arXiv2025

Moderate Actor-Critic Methods: Controlling Overestimation Bias via Expectile Loss

Overestimation is a fundamental characteristic of model-free reinforcement learning (MF-RL), arising from the principles of temporal difference learning and the approximation of the Q-function. To address this challenge, we propose a novel moderate target in the Q-function update, formulated as a convex optimization of an overestimated Q-function and its lower bound. Our primary contribution lies in the efficient estimation of this lower bound through the lower expectile of the Q-value distribution conditioned on a state. Notably, our moderate target integrates seamlessly into state-of-the-art (SOTA) MF-RL algorithms, including Deep Deterministic Policy Gradient (DDPG) and Soft Actor Critic (SAC). Experimental results validate the effectiveness of our moderate target in mitigating overestimation bias in DDPG, SAC, and distributional RL algorithms.

cs.LG↗

arXiv2025

Blind Massive MIMO for Dense IoT Networks

In this paper, we investigate the downlink communication challenges in heavy-load Internet-of-Things (IoT) networks supported by frequency-division-duplexing (FDD) millimeter-wave (mmWave) massive multiple-input multiple-output (MIMO) systems. The excessive overhead required for obtaining channel state information at the transmitter (CSIT) is essential to achieve high spectral efficiency through conventional massive MIMO techniques; however, it hinders the deployment of ultra-reliable low-latency communications (URLLC) and leads to significant energy expenditure, particularly in dense IoT networks. To address this challenge, we propose an innovative CSIT-Free MIMO precoding method, referred to as CIRculant information Classification via Linear Estimation (CIRCLE). Our major contribution is the design of a CSIT-independent (or deterministic) precoding, which is constructed by leveraging the circulant permutation of the discrete Fourier transform (DFT) matrix. This design enables interference-free signal combining at the IoT devices. Through theoretical analysis and simulations, we verify the effectiveness of the proposed CIRCLE method.

eess.SP↗