arXiv Science⌕ Search

arXiv · 2610.24348

Blackbox Performance Analysis of LLM-based Network Control

Abstract

LLMs are becoming an indispensable part of network control systems due to their impressive reasoning. Before such LLM-enabled systems can be deployed, it is imperative to develop tools that can audit their performance on previously unseen inputs. However, auditing these systems is challenging due to the inherent opacity of LLMs. LENS is the first step towards black-box performance analysis of LLM-enabled network control systems. It uses novel methods to extend deep reinforcement learning to guide the search for performance gaps and inputs that make LLMs struggle. LENS finds large gaps for LLM-based traffic engineering and GPU allocation systems, and even matches existing white-box analyzers designed for hand-crafted TE heuristics.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Mahdi Alizadeh, Pooria Namyar, Arvin Ghavidel, Ramesh Govindan. 2026-10-17. Blackbox Performance Analysis of LLM-based Network Control. https://arxiv.org/abs/2610.24348

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

SliceMapper: Intelligent Mapping of O-CU and O-DU onto O-Cloud Sites in 6G O-RAN

In this paper, we propose an rApp, named SliceMapper, to optimize the mapping process of the open centralized unit (O-CU) and open distributed unit (O-DU) of an open radio access network (O-RAN) slice subnet onto the underlying open cloud (O-Cloud) sites in sixth-generation (6G) O-RAN. To accomplish this, we first design a system model for SliceMapper and introduce its mathematical framework. Next, we formulate the mapping process addressed by SliceMapper as a sequential decision-making optimization problem. To solve this problem, we implement both on-policy and off-policy variants of the Q-learning algorithm, employing tabular representation as well as function approximation methods for each variant. To evaluate the effectiveness of these approaches, we conduct a series of simulations under various scenarios. We proceed further by performing a comparative analysis of all four variants. The results demonstrate that the on-policy function approximation method outperforms the alternative approaches in terms of stability and lower standard deviation across all random seeds. However, the on-policy and off-policy tabular representation methods achieve higher average rewards, with values of 5.42 and 5.12, respectively. Finally, we conclude the paper and introduce several directions for future research.

cs.NI↗

Mobile Embodied Agent Network (MEAN): Integrated Framework, Enabling Technologies, and Task-Driven Deployment

Mobile networks are evolving from human-centered, data-oriented communication infrastructures toward machine- and/or agent-dominant, task-oriented platforms that are to serve the rapidly increasing networked machines and embodied agents. In order to fulfill the newly arose complex task objectives, the framework of future mobile network is to be innovated to reflect and facilitate the intrinsic interplay and integration of the underlying processes of perception, communication, computation, decision, action, and feedback, etc. This survey establishes the mobile embodied agent network (MEAN) as a task-oriented networking paradigm in which networking and distributed intelligence are jointly organized around closed-loop embodied task execution. We first establish a unified MEAN framework that explains how network resources and intelligent functions jointly support embodied task execution, and extend its performance indicators from conventional communication metrics to embodied task outcomes and cross-layer system effects. With this framework, we analyze three complementary enabling mechanisms that form a cognition-interaction-adaption loop. Large artificial intelligence (AI) models provide high-level cognition, token communication connects this cognition with distributed agents through shared semantic representations, and reinforcement learning closes the loop by adapting system operation to network, task, and physical feedback. We further investigate the bidirectional interplay between MEAN and emerging technologies, showing how they mutually extend system capabilities and reshape task-oriented network design. Finally, we discuss open challenges and future research directions toward the practical realization of MEAN over real joint communication and computation platform.

cs.NI↗

On the Allocation of Transmit Power for Coordinated Spatial Reuse in IEEE 802.11bn Multi-Access Point Coordination

IEEE 802.11bn (11bn) introduces Coordinated Spatial Reuse (Co-SR), a Multi-Access Point Coordination (MAPC) scheme where two APs coordinate to control the transmit power for a simultaneous transmission. This letter proposes a Proportional Fairness (PF)-driven framework for allocating Co-SR transmit power on a per-Transmission Opportunity (TXOP) basis. We prove that any Pareto-optimal power pair keeps at least one AP at its maximum power, reducing the joint two-dimensional search to two cheap one-dimensional line searches that fit within TXOP timing, and show that this collapses to an exact closed-form expression in a discrete-rate system. We validate these policies and a low-complexity selfish baseline against a brute-force oracle, using packet-level simulations in Kom8ndor, an 11bn simulator. Results show that jointly evaluating both APs' links is key to unlocking Co-SR's gains, that the coordinated AP's fairness-optimal power depends critically on whether the rate is modeled continuously or through discrete Modulation and Coding Scheme (MCS) steps, and that current 11bn signaling supports the selfish policy but not the fairness-optimal ones, which would need additional per-TXOP channel reporting.

cs.NI↗