arXiv Science⌕ Search

arXiv subjects

Arno Troch

Publications and source records attributed to Arno Troch.

4 recordsLinked to original sources

Flux: Optimal Scheduling of Optical Circuit Switches for LLM Training

Optical Circuit Switching (OCS) offers high bandwidth density and energy efficiency for LLM training, but incurs a non-negligible reconfiguration delay. Prior work typically schedules optical circuit switches independently of compute, using aggregate traffic demand to determine which circuits to provision and when. We argue that this separation creates a fundamental inefficiency: reconfigurations that ignore the compute timeline can stall communication, resulting in low circuit utilization and large buffer requirements. In this paper, we present Flux, a scheduler that optimally schedules optical circuit switches based on the structure of the entire workload. Flux remains effective across a wide range of switching speeds by reusing circuits and amortizing reconfiguration delay behind compute and communication. We show that Flux reduces training iteration time by up to $10\times$ and peak NIC buffer requirements by more than three orders of magnitude compared to traditional periodic schedulers.

cs.NI↗

Disaggregated LLM Inference in Space: A Communication Feasibility Study

Orbital data centers could enable large-scale AI inference, but efficiently serving a frontier language model to many users may require several compute satellites to cooperate over optical links. While disaggregated inference, which splits large language model (LLM) serving across machines, is well established in terrestrial data centers, its viability under the unique constraints of orbital deployments remains an open question. This article investigates how link capacity and satellite separation affect two types of disaggregated LLM serving, in both compact satellite formations and distributed constellations. Prefill-decode disaggregation (PDD) migrates a large KV cache once per request, while attention-FFN disaggregation (AFD) exchanges small activations at every mixture-of-experts layer for every generated token. The two respond to distance in different ways. PDD is limited mainly by link capacity and, with fast enough links, tolerates separations of up to a thousand kilometers. AFD is limited mainly by propagation delay, which accumulates layer by layer and forces attention and expert instances within about a kilometer of each other. Based on these results, we propose a hierarchical orbital inference architecture and provide network design guidelines for future orbital data centers, including the role of ground access latency.

cs.NI↗

CALIPER: Calibrating HPC/AI Network Simulators

Network simulation plays an important role in HPC/AI system research by enabling exploration of network architectures, communication strategies, and system configurations at scales that may be impractical to study experimentally. Existing approaches to network simulator calibration and validation lack a principled methodology that combines parameter alignment, constrained inference, and independent validation for collective-centric HPC/AI networks. We present CALIPER, a methodology for systematic calibration and validation of HPC/AI network simulators. CALIPER distinguishes directly observable system parameters from auxiliary parameters which are configured via calibration and constrains the latter to feasible domains consistent with the target system. We evaluate CALIPER's hierarchical, scale-aware calibration and its effects on parameter identifiability and generalization using collective communication benchmarks on a reference system with up to 64-nodes at the Jülich Supercomputing Centre. Validation results show that the calibrated parameter configurations identified by CALIPER predict system performance with less than 5% mean errors across scale-up and scale-out network domains. CALIPER demonstrates that hierarchical, constrained calibration can produce simulator configurations whose predictive accuracy persists beyond the observations used for fitting.

cs.NI↗

Toward Interactive Multi-User Extended Reality Using Millimeter-Wave Networking

Extended Reality (XR) enables a plethora of novel interactive shared experiences. Ideally, users are allowed to roam around freely, while audiovisual content is delivered wirelessly to their Head-Mounted Displays (HMDs). Therefore, truly immersive experiences will require massive amounts of data, in the range of tens of gigabits per second, to be delivered reliably at extremely low latencies. We identify Millimeter-Wave (mmWave) communications, at frequencies between 24 and 300 GHz, as a key enabler for such experiences. In this article, we show how the mmWave state of the art does not yet achieve sufficient performance, and identify several key active research directions expected to eventually pave the way for extremely-high-quality mmWave-enabled interactive multi-user XR.

cs.NI↗