arXiv · 2606.13266
Seamless Execution of Malleable Applications in Controlled and Production HPC Environments
Abstract
Many large-scale scientific applications exhibit time-varying behavior, yet production HPC clusters still rely on rigid, fixed-size allocations, and most dynamic techniques remain confined to laboratory prototypes. This work presents a practical MPI malleability methodology that integrates with state-of-the-art high-performance computing (HPC) software stacks and operational practices. The methodology is implemented in the Dynamic Management of Resources (DMR) framework and is designed to ease adoption by existing applications without requiring intrusive code changes or scheduler modifications. We evaluate our approach by integrating the DMR API into two large-scale scientific applications and deploying them on three TOP500 supercomputers under realistic production configurations. Our non-invasive malleability solution achieves performance comparable to static baselines in controlled environments while substantially reducing node-hour consumption for identical workloads. These results show that malleability can be effectively exploited on production systems using vanilla resource managers, lowering the barrier to adoption of dynamic resource management in HPC.
Explore related subjects
Keep this discovery
Petter Sandås, Sergio Iserte, Guillaume Houzeaux, Antonio J. Peña. 2026-06-11. Seamless Execution of Malleable Applications in Controlled and Production HPC Environments. https://arxiv.org/abs/2606.13266
Cite the original work for its findings. Save a collection to share your selection of sources.