arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2610.23383

Data-Driven Prediction of Optimal MPI Rank Placement and Node Count for Memory-Bound CFD on AMD EPYC Clusters

Marcin Lawenda·Łukasz Szustak·Aleksandra Krasicka
View original source ↗Read source document ↗Export metadata ↓

Abstract

Users who run a memory-bound OpenFOAM case on an AMD EPYC cluster must decide how many nodes to use and how many MPI ranks to place on each core complex. The fastest choice is often not the cheapest one. This paper revisits our earlier analytical model of this performance and energy trade-off with 560 measured configurations of the motorBike case on five Zen 4 and Zen 5 EPYC processors, including socket power from processor telemetry. On up to four nodes, small meshes are both fastest and cheapest on a single node on most processors. For the largest mesh the largest node count is both the fastest and the cheapest option, because its speedup is superlinear. A genuine trade-off arises only for medium meshes, where full speed costs a median of 20 to 97% more node hours than the cheapest option. The L3 miss rate and the halo traffic per cell are consistent with this pattern. For a new mesh of the same case, the configuration that was optimal on the nearest measured mesh is near optimal in 75 to 85% of the decisions. Running the two configurations it recommends for speed and for cost raises this share to 85 to 90% for runtime and node hours and determines the trade-off with median errors of 3 to 5 percentage points. Neither gradient boosted trees trained on the same data nor the earlier polynomial model improves on this simple procedure.

Explore related subjects

cs.PFcs.LG

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Marcin Lawenda, Łukasz Szustak, Aleksandra Krasicka. 2026-10-16. Data-Driven Prediction of Optimal MPI Rank Placement and Node Count for Memory-Bound CFD on AMD EPYC Clusters. https://arxiv.org/abs/2610.23383

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

HybridQC: Hardware-Grounded Simulation of Tightly Integrated Hybrid Quantum-Classical Systems

Hybrid quantum-classical performance depends on how quantum processors share classical compute, controllers, memory, and communication links. Circuit simulators and provider measurements expose kernel and job behavior, but leave topology-level questions about controller bottlenecks, quantum capacity, and mixed-workload contention unanswered. We present HybridQC, a discrete-event simulator for configurable hybrid compute units (HCUs). Users specify resource graphs containing classical compute, memory, controllers, quantum annealing (QA) and digital quantum computing (DQC) devices, and links. Jobs become dependent stages for preparation, quantum execution, transfers, reconstruction, and postprocessing. Finite capacities and selectable scheduling policies determine where stages wait and overlap. Service profiles use measurements from D-Wave Advantage 1 and Advantage 2 and IBM Kingston, Marrakesh, and Fez, separating physical quantum-processor occupancy from cloud wall time. Mean absolute percentage errors are 3.92%-8.04% for D-Wave access time and 5.26%-19.01% for IBM quantum seconds. Balanced 10x HCU scaling improves makespan by 2.19x-3.42x, while policy choice changes makespan by 1.80x for a mixed workload with 20 jobs per workload family. Scaling depends on which inputs grow: 100x data growth yields median runtime near 306 s, while 100x joint growth in circuits, shots, and depth reaches 4.806 x 10^7 s on the fixed HCU. HybridQC enables designers to study topology, scheduling, and workload growth before tightly integrated quantum-classical machines exist physically.

cs.PF↗
arXiv2026

Discrete Phase-Shift Optimization of Reconfigurable Intelligent Surfaces using Uniform Reference Directions

Reconfigurable Intelligent Surfaces (RISs) enable programmable control of the wireless propagation environment through adjustable reflecting elements. A fundamental challenge in RIS-assisted communications is the optimization of discrete phase shifts to maximize the received signal power. While recently developed algorithms can obtain optimal solutions with linear complexity, their computational cost may still be excessive in applications requiring large-scale simulations, real-time adaptation, or repeated optimization over numerous channel realizations. This paper proposes a low-complexity discrete phase-shift optimization algorithm based on multiple reference directions within the feasible optimality sector. By evaluating candidate phase configurations generated from uniformly distributed reference directions, the proposed method systematically improves upon existing approximation approaches that rely on a fixed set of reference directions. The number of reference directions serves as a design parameter that enables a controllable trade-off between computational complexity and optimality. Extensive simulations demonstrate that the proposed algorithm achieves substantial computational speedups while maintaining a small optimality gap relative to the optimal solution. The results further show that increasing the number of reference directions progressively reduces the optimality gap, providing flexible operating points that can be tailored to application-specific complexity and performance requirements.

cs.PF↗
arXiv2026

PairSight: Characterizing and Predicting Operator-Level Interference in GPU Sharing for DNN Inference

Serving DNN inference is costly, yet a single task seldom saturates both the compute units and the memory bandwidth of a GPU. GPU sharing raises utilization by co-locating several tasks on one GPU, at the cost of interference among them. Existing systems estimate this interference with binary compute-memory rules, standalone scaling curves, or model-level predictors. However, these estimates rest on a limited understanding of interference. They leave the software and hardware properties of co-located operators largely unexplored and give no slowdown prediction that is both interpretable and accurate. We conduct an operator-level study of interference under SM partitioning and use hardware counters to trace it to contention on the shared memory path, where the slowdown depends jointly on both co-located operators. Based on these findings, we propose PairSight, a hardware-aware interference predictor that learns how the hardware behaviors of co-located tasks interact and predicts the latency of each task before co-location. On six DNN models including LLMs, PairSight predicts latency under sharing with 4.3% mean error, against 19.0% for a compute-memory intensity rule, and adapts to unseen models and inputs with a few samples.

cs.PF↗