arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 1512.02194

FabSim: facilitating computational research through automation on large-scale and distributed e-infrastructures

Derek Groen·Agastya Bhati·James Suter·James Hetherington·Stefan Zasada·Peter Coveney
View original source ↗Read source document ↗Export metadata ↓

Abstract

We present FabSim, a toolkit developed to simplify a range of computational tasks for researchers in diverse disciplines. FabSim is flexible, adaptable, and allows users to perform a wide range of tasks with ease. It also provides a systematic way to automate the use of resourcess, including HPC and distributed resources, and to make tasks easier to repeat by recording contextual information. To demonstrate this, we present three use cases where FabSim has enhanced our research productivity. These include simulating cerebrovascular bloodflow, modelling clay-polymer nanocomposites across multiple scales, and calculating ligand-protein binding affinities.

Explore related subjects

cs.DCphysics.comp-ph

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Derek Groen, Agastya Bhati, James Suter, James Hetherington, Stefan Zasada, Peter Coveney. 2015-12-07. FabSim: facilitating computational research through automation on large-scale and distributed e-infrastructures. https://doi.org/10.1016/j.cpc.2016.05.020

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Libra: Taming Attention Workload Skew in Long-Context LLM Training with Bounded Sequence Pool

Long-context LLM training suffers from a load-balancing problem that sequence packing does not solve. Packing samples into fixed-token sequences balances memory and linear-cost operators, but the dominant attention cost scales with the sum of squared sequence lengths. Thus, equally sized packed sequences drawn from a long-tailed corpus can carry substantially different attention workloads, creating data-parallel stragglers and pipeline bubbles. Existing approaches either balance at the granularity of sequences or microbatches, where an outlier can dominate an assignment, or disaggregate attention over a global worker pool whose communication domain grows with the data-parallel (DP) degree. We present Libra, which operationalizes the law of large numbers (LLN) as a scaling principle for load balancing: the attention-balancing pool need not grow with the DP degree. Libra groups packed sequences and their CP groups into fixed-size sequence pools. As DP scales out, Libra adds pools rather than enlarging each one, bounding every attention exchange. Variance-Reduced Sequence Placement makes this effective for finite, long-tailed workloads by co-locating sequences with complementary attention workloads to reduce residual inter-pool skew. Within each pool, Tiled Attention Pooling dispatches sequence-head SH-Tiles across GPUs, while a pipelined runtime overlaps tile exchange with attention. Libra exposes a drop-in context-parallel attention operator and a pluggable data sampler, requiring no changes to model layers, optimizers, or pipeline schedules. On three production Qwen3 models (8B, 30B, 235B) and 256K- and 1M-token production workloads, Libra improves end-to-end training throughput over the strongest evaluated baseline (WLB-LLM) by 44% on average and up to 68% at 256 GPUs. Libra has run for hundreds of thousands of GPU-hours in production on jobs spanning 32K to 1M tokens.

cs.DC↗
arXiv2026

Co-Skill: A Collaborative Communication Framework for Skill Evolution

Agent evolution through skills becomes critical for LLM-based agents to iteratively improve task success rate. Hybrid evolution is a cost-efficient paradigm where a cloud LLM analyzes and generates skills while an edge SLM executes and internalizes them. However, existing hybrid methods, such as SkillRL, still suffer from low success rate and high token usage. We find this stems from blind communication: the cloud cannot perceive the edge's execution capability, while the edge does not understand the cloud's analysis needs. We thus propose the Collaborative Communication Framework (CCF) to achieve effective edge-cloud evolution. CCF is realized via three techniques: (1) a cloud-aware prefix-merged trajectory trie where the edge compresses trajectories by merging shared prefixes and pinpointing divergence points for efficient cloud analysis, (2) an edge-aware progressive skill tree where the cloud progressively builds a hierarchical skill tree to match edge SLM execution capability, and (3) a collaborative skill evolution scheme upon these two trees that evolves cloud LLM and edge SLM in a separated way to jointly improve task success rate. Experiments across ALFWorld and WebShop show that CCF reduces LLM+SLM tokens by 15.6%--41.9% over state-of-the-art hybrid methods while consistently improving 25.8%--76.4% task success rate.

cs.DC↗
arXiv2026

PatchyBFT: Automating Diversification of Fault-Tolerant Systems using LLMs

Fault-tolerant agreement protocols fail if replicas share a common flaw that simultaneously affects more replicas than the tolerable threshold. Therefore replicas should ideally fail independently, which can be achieved through diversification. However, in practice, often the same protocol implementation is shared by all replicas which is not surprising given that the provision of multiple diverse implementations is difficult and highly laborious. This poses a major risk, as a shared protocol implementation is a prime candidate for common bugs due to its complexity. With PatchyBFT, we demonstrate how, given a reference implementation, Large Language Models (LLMs) can be utilised for the automated and scalable generation of code that compiles, passes tests, and crucially differs semantically/binary-wise, that can re- place code in the reference implementation, thereby significantly reducing diversification costs. We demonstrate the feasibility of diversification of replication protocol implementations using LLMs by diversifying three implementations: PBFT, HotStuff, and Raft, showing how up to 65% of the codebase can be diversified.

cs.DC↗