arXiv ScienceSearch

arXiv subjects

Mathis Bode

Publications and source records attributed to Mathis Bode.

At least 19 recordsLinked to original sources

LongVU-TTT: Causal Test-Time Training for Visual Resampling in Long Video Understanding

Long-video MLLMs must model temporal change before a limited visual-token budget removes most frame evidence. We introduce LongVU-TTT, which inserts a convolutional Test-Time Training (TTT) resampler with causal fast-weight updates between the vision encoder and the LLM. Its grouped 2D fast weights adapt to each video and contextualize frame features before compression, while a hybrid uniform-and-change-aware selector retains explicit visual evidence for downstream reasoning. Under controlled conditions, TTT-Conv improves over TTT-MLP by up to +2.12 and bidirectional Mamba2 by up to +3.04 on MLVU, and it is stronger than attention- and fixed-state recurrent resamplers across three benchmarks. Analysis shows that the fast weights behave as a temporal aggregation state rather than a reliable long-horizon episodic memory: their benefit attenuates as evidence becomes more distant, motivating explicit frame retention. LongVU-TTT processes up to 512 frames before reducing them to 128 LLM frames and achieves competitive performance across five video understanding benchmarks.

cs.CV

Cross-Layer Energy Analysis of Multimodal Training on Grace Hopper Superchips

Multimodal deep learning models enable joint learning across heterogeneous data sources, including text, images, and video, but their rapid scaling introduces significant memory and communication bottlenecks. As model sizes and sequence lengths increase, training performance becomes increasingly impacted by data movement rather than computation. Frameworks such as DeepSpeed mitigate these challenges through CPU offloading, activation checkpointing, and communication optimizations. However, these techniques introduce additional system activity, which may affect energy efficiency. Meanwhile, tightly integrated heterogeneous architectures, such as the NVIDIA Grace Hopper (GH200) superchip, provide high-bandwidth CPU-GPU interconnects and unified memory, thereby reducing data transfer overhead. In this work, we present a cross-layer analysis of energy and performance trade-offs in multimodal training on GH200 systems, explicitly characterizing the interactions between application, runtime, and hardware layers. Leveraging high-bandwidth CPU-GPU interconnects, our results show that energy efficiency is primarily governed by data movement and overlap rather than raw compute utilization, and that configurations optimized for runtime are not necessarily optimal for energy. Based on these findings, we distill a set of actionable guidelines for practitioners that demonstrate how to balance offloading strategies, sequence parallelism, and hardware-aware scheduling to achieve energy-efficient training. Our results demonstrate that leveraging high-bandwidth CPU-GPU interconnects enables offloading strategies and sequence parallelism, achieving a strong balance among energy efficiency, runtime performance, and computational throughput, providing practical guidelines for efficient multimodal training on modern heterogeneous systems.

cs.DC

Nucleon strange electromagnetic form factors using $N_f=2+1+1$ twisted-mass fermions at the physical point

We present the strange electromagnetic form factors of the nucleon using lattice QCD with $N_f=2+1+1$ twisted mass clover-improved fermions and quark masses tuned to their physical values. Using four ensembles with lattice spacings of $a=0.080$ fm, $0.068$ fm, $0.057$ fm and $0.049$ fm, and similar physical volume, we obtain the continuum limit directly at the physical pion mass. The disconnected strange contributions are computed using high statistics two-point functions combined with stochastic noise mitigation techniques, such as spin-color dilution and hierarchical probing in the estimation of the quark loop. From the momentum dependence of the form factors, we provide the strange electric and magnetic radii, as well as the strange magnetic moment in the continuum limit.

hep-lat

From Clinical Intent to Clinical Model: Autonomous Coding-Agents for Clinician-driven AI Development

Developing AI models that are useful in clinical practice, requires efficient collaboration between clinicians and AI developers. This poses a practical challenge: clinicians must repeatedly communicate and refine their requirements with AI developers before those requirements can be translated into executable model development. This iterative process is time-consuming, and even after repeated discussion, misalignment may still exist because the two sides do not fully share each other's expertise. Coding agents may help close this gap. They can write and refine code on their own, and they carry working knowledge of both medicine and AI to understand commands formulated by both medical experts and developers. We present a prototype that lets clinicians drive AI development directly. A clinician describes the task in plain language, and the system turns the description into a working pipeline, refines it through repeated experiments together with the clinician, and returns a model that meets the stated clinical objective. Across five clinical tasks, the system reliably produces models that matched the clinician's request and reached competitive performance. Most notably, on chest radiographs the system sharply reduced the model's reliance on chest drains, a well-known shortcut for pneumothorax classification, from 60% to 31% on one dataset and from 50% to 18% on another. Our results suggest that coding agents can shift clinical AI development toward a more clinician-driven mode, allowing domain experts to shape models directly instead of relaying requirements through specialized AI teams.

cs.CV

Physics-guided surrogate learning enables zero-shot control of turbulent wings

Turbulent boundary layers over aerodynamic surfaces are a major source of aircraft drag, yet their control remains challenging due to multiscale dynamics and spatial variability, particularly under adverse pressure gradients. Reinforcement learning has outperformed state-of-the-art strategies in canonical flows, but its application to realistic geometries is limited by computational cost and transferability. Here we show that these limitations can be overcome by exploiting local structures of wall-bounded turbulence. Policies are trained in turbulent channel flows matched to wing boundary-layer statistics and deployed directly onto a NACA4412 wing at $Re_c=2\times10^5$ without further training, being the so-called zero-shot control. This achieves a 28.7% reduction in skin-friction drag and a 10.7% reduction in total drag, outperforming the state-of-the-art opposition control by 40% in friction drag reduction and 5% in total drag. Training cost is reduced by four orders of magnitude relative to on-wing training, enabling scalable flow control.

physics.flu-dyn

Nucleon strange electromagnetic form factors from $N_f=2+1+1$ lattice QCD

We present the nucleon strange electromagnetic form factors using four lattice QCD ensembles with $N_f=2+1+1$ twisted mass clover-improved fermions and quark masses tuned to approximately their physical values. The four ensembles have similar physical volume and lattice spacings of $a=0.080$ fm, $0.068$ fm, $0.057$ fm and $0.049$ fm allowing us to take the continuum limit directly at the physical pion mass point. We compute nucleon three-point correlation functions with high statistics, where the disconnected fermion loops are evaluated stochastically with spin-color dilution and hierarchical probing. We find non-zero values for both electric and magnetic form factors. We extract the strange electric and magnetic radii, as well as the strange magnetic moment in the continuum limit by studying the momentum dependence of the form factors. We also compute the charm electromagnetic form factors within the same setup, which we find to be consistent with zero within the statistical precision of our data.

hep-lat

Strangeness of nucleons from $N_f=2+1+1$ lattice QCD

We present the strange electromagnetic form factors of the nucleon using lattice QCD simulations with degenerate light, a strange, and a charm quark in the sea with masses tuned to their physical values. For the first time, the strange electromagnetic form factors are computed at the continuum limit using only ensembles simulated with physical quark masses, eliminating the need for chiral extrapolations and their associated systematic uncertainty. We obtain the momentum transfer dependence of the form factors using the $z$-expansion and provide the strange electric and magnetic radii, as well as the strange magnetic moment. When combining our statistical errors and systematic uncertainties stemming from the momentum transfer dependence fit, our errors are an order of magnitude smaller than those associated with experimental determinations of the strange electromagnetic form factor.

hep-lat

exaCB: Reproducible Continuous Benchmark Collections at Scale Leveraging an Incremental Approach

The increasing heterogeneity of high-performance computing (HPC) systems and the transition to exascale architectures require systematic and reproducible performance evaluation across diverse workloads. While continuous integration (CI) ensures functional correctness in software engineering, performance and energy efficiency in HPC are typically evaluated outside CI workflows, motivating continuous benchmarking (CB) as a complementary approach. Integrating benchmarking into CI workflows enables reproducible evaluation, early detection of regressions, and continuous validation throughout the software development lifecycle. We present exaCB, a framework for continuous benchmarking developed in the context of the JUPITER exascale system. exaCB enables application teams to integrate benchmarking into their workflows while supporting large-scale, system-wide studies through reusable CI/CD components, established harnesses, and a shared reporting protocol. The framework supports incremental adoption, allowing benchmarks to be onboarded easily and to evolve from basic runnability to more advanced instrumentation and reproducibility. The approach is demonstrated in JUREAP, the early-access program for JUPITER, where exaCB enabled continuous benchmarking of over 70 applications at varying maturity levels, supporting cross-application analysis, performance tracking, and energy-aware studies. These results illustrate the practicality using exaCB for continuous benchmarking for exascale HPC systems across large, diverse collections of scientific applications.

cs.DC

Modeling subgrid scale production rates on complex meshes using graph neural networks

Large-eddy simulations (LES) require closures for filtered production rates because the resolved fields do not contain all correlations that govern chemical source terms. We develop a graph neural network (GNN) that predicts filtered species production rates on non-uniform meshes from inputs of filtered mass fractions and temperature. Direct numerical simulations of turbulent premixed hydrogen-methane jet flames with hydrogen fractions of 10%, 50%, and 80% provide the dataset. All fields are Favre filtered with the filter width matched to the operating mesh, and learning is performed on subdomain graphs constructed from mesh-point connectivity. A compact set of reactants, intermediates, and products is used, and their filtered production rates form the targets. The model is trained on 10% and 80% blends and evaluated on the unseen 50% blend to test cross-composition generalization. The GNN is compared against an unclosed reference that evaluates rates at the filtered state, and a convolutional neural network baseline that requires remeshing. Across in-distribution and out-of-distribution cases, the GNN yields lower errors and closer statistical agreement with the reference data. Furthermore, the model demonstrates robust generalization across varying filter widths without retraining, maintaining bounded errors at coarser spatial resolutions. A backward facing step configuration further confirms prediction efficacy on a practically relevant geometry. These results highlight the capability of GNNs as robust data-driven closure models for LES on complex meshes.

physics.flu-dyn

Super-resolution of turbulent reacting flows on complex meshes using graph neural networks

State-of-the-art deep learning models have been extensively utilized to reconstruct small-scale structures from coarse-grained data in turbulent flows. However, their application has predominantly been restricted to structured uniform meshes, limiting their applicability to data associated with complex geometries that are typically simulated on structured non-uniform or unstructured meshes. Machine learning (ML) models based on graph neural networks (GNNs), known for their ability to process unstructured data, offer a promising alternative. In this study, we leverage the inherent flexibility of GNNs featuring message passing layers to develop a methodology for reconstructing unresolved small-scale structures from low-resolution data on complex meshes. The accuracy of the proposed approach is demonstrated using two cases: a reacting channel flow on a structured non-uniform mesh, and a reacting hydrogen fueled internal combustion (IC) engine featuring an unstructured mesh. Evaluation of results based on visual agreement, statistical metrics, and cumulative error reduction indicates the effectiveness of the method in accurately reconstructing fine-scale features. Overall, this study provides a pathway for integrating data-driven small-scale reconstruction and subgrid-scale modeling to enhance the accuracy of coarse-grained simulations on complex meshes.

physics.flu-dyn

Universal Quantum Computer Simulation of 50 Qubits on Europe`s First Exascale Supercomputer Harnessing Its Heterogeneous CPU-GPU Architecture

We have developed a new version of the high-performance J\"ulich universal quantum computer simulator (JUQCS-50) that leverages key features of the GH200 superchips as used in the JUPITER supercomputer, enabling simulations of a 50-qubit universal quantum computer for the first time. JUQCS-50 achieves this through three key innovations: (1) extending usable memory beyond GPU limits via high-bandwidth CPU-GPU interconnects and LPDDR5 memory; (2) adaptive data encoding to reduce memory footprint with acceptable trade-offs in precision and compute effort; and (3) an on-the-fly network traffic optimizer. These advances result in a 16.6-fold speedup over the previous 48-qubit record on the K computer

quant-ph

Computing the Full Earth System at 1 km Resolution

We present the first-ever global simulation of the full Earth system at 1.25 km grid spacing, achieving highest time compression with an unseen number of degrees of freedom. Our model captures the flow of energy, water, and carbon through key components of the Earth system: atmosphere, ocean, and land. To achieve this landmark simulation, we harness the power of 8192 GPUs on Alps and 20480 GPUs on JUPITER, two of the world's largest GH200 superchip installations. We use both the Grace CPUs and Hopper GPUs by carefully balancing Earth's components in a heterogeneous setup and optimizing acceleration techniques available in ICON's codebase. We show how separation of concerns can reduce the code complexity by half while increasing performance and portability. Our achieved time compression of 145.7 simulated days per day enables long studies including full interactions in the Earth system and even outperforms earlier atmosphere-only simulations at a similar resolution.

physics.ao-ph

CytoNet: A Foundation Model for the Human Cerebral Cortex at Cellular Resolution

Studying the cellular architecture of the human cerebral cortex is essential for understanding how the brain is organized from the micro to the macro level, and how it functions. However, investigating complex texture patterns in histological images using automatic methods that can be scaled across whole brains remains a challenge. Here we introduce CytoNet, a foundation model trained on 1 million unlabeled microscopic image patches from over 4,000 histological sections from nine postmortem brains, and evaluated on over 2,000 sections from five additional brains excluded from self-supervised pretraining. Using co-localization in the cortical sheet for self-supervision, CytoNet learns to encode complex cellular patterns into expressive and anatomically meaningful feature representations. CytoNet supports multiple downstream applications, including area classification, laminar segmentation, quantification of microarchitectural variation, and exploratory mapping of cortical subdivisions. Functional parcellation analyses provided parcellation-dependent evidence for links between cytoarchitecture and macroscale functional organization. Together, these results establish CytoNet as a unified framework for scalable analysis of cortical microarchitecture and for testing links between cellular architecture and structure-function organization in the human cerebral cortex.

q-bio.NC

Lattice calculation of the Sn isotopes near the proton dripline

We present the first $\textit{ab initio}$ lattice calculations of the proton-rich tin isotopes $^{99}$Sn to $^{102}$Sn using nuclear lattice effective field theory with high-fidelity two- and three-nucleon forces. For a given set of three-nucleon couplings, we reproduce binding energies with $\sim 1\%$ accuracy for the even-even systems, and obtain energy splitting and two-nucleon separation energies in agreement with experiment. Our results confirm the $N=50$ shell closure and reveal that the binding energy of $^{99}$Sn lies below values extrapolated from heavier isotopes.

nucl-th

Scaled Block Vecchia Approximation for High-Dimensional Gaussian Process Emulation on GPUs

Emulating computationally intensive scientific simulations is crucial for enabling uncertainty quantification, optimization, and informed decision-making at scale. Gaussian Processes (GPs) offer a flexible and data-efficient foundation for statistical emulation, but their poor scalability limits applicability to large datasets. We introduce the Scaled Block Vecchia (SBV) algorithm for distributed GPU-based systems. SBV integrates the Scaled Vecchia approach for anisotropic input scaling with the Block Vecchia (BV) method to reduce computational and memory complexity while leveraging GPU acceleration techniques for efficient linear algebra operations. To the best of our knowledge, this is the first distributed implementation of any Vecchia-based GP variant. Our implementation employs MPI for inter-node parallelism and the MAGMA library for GPU-accelerated batched matrix computations. We demonstrate the scalability and efficiency of the proposed algorithm through experiments on synthetic and real-world workloads, including a 50M point simulation from a respiratory disease model. SBV achieves near-linear scalability on up to 512 A100 and GH200 GPUs, handles 2.56B points, and reduces energy use relative to exact GP solvers, establishing SBV as a scalable and energy-efficient framework for emulating large-scale scientific models on GPU-based distributed systems.

cs.DC

Direct Numerical Simulation of Hydrogen Combustion in a Real-Size IC Engine

This study presents the first Direct Numerical Simulation (DNS) of hydrogen combustion in a real-size internal combustion engine, investigating the complex dynamics of ignition, flame propagation, and flame-wall interaction under engine-relevant conditions. The simulation focuses on ultra-lean hydrogen operation at equivalence ratio $\phi=0.4$ and 800 rpm, utilizing a state-of-the-art spectral element solver optimized for GPU architectures. The computational domain encompasses the full engine geometry. Results highlight the strong coupling between the flame dynamics and the coherent flow structures during early flame kernel development, while differential diffusion effects lead to increased reactivity at positive flame curvatures, a phenomenon that has only been studied in canonical configurations of freely propagating hydrogen/air flames. As the flame approaches the walls, distinct behavior is observed during head-on and side-wall quenching scenarios, characterized by different spatial distributions of wall heat flux. The findings provide insights into hydrogen combustion in real engines, essential for the development of clean and efficient hydrogen-fueled powertrains.

physics.flu-dyn

Analysis of In-cylinder Flow Structures and Turbulence in a Laboratory Scale Engine using Direct Numerical Simulations

In-cylinder flow structures and turbulence characteristics are investigated using direct numerical simulations (DNS) in a laboratory-scale engine at technically relevant engine speeds (1500 and 2500 rpm at full load). The data is computed for 12 compression-expansion cycles at each engine speed with initial conditions derived from precursor large eddy simulations (LES) validated against experimental data. Analysis of the tumble ratio indicates significant cycle-to-cycle variation, with lower variability found at higher engine speed. The process of tumble breakdown, quantified by the evolution of mean and turbulent kinetic energy, reveals distinct features between operating conditions, with delayed turbulence peaks observed at lower engine speed. Analysis of the Reynolds stress tensor demonstrates higher stress values at higher engine speed, with pronounced anisotropy near the walls and higher values around the tumble vortex core. Examination of the anisotropic Reynolds stress invariants through Lumley triangles reveals predominantly isotropic turbulence during mid-compression, transitioning to distinct anisotropic states near top dead center (TDC). The lower engine speed exhibits a stronger tendency toward one-component turbulence due to partial tumble dissipation, while the higher speed maintains a more balanced anisotropy. These findings extend previous numerical and experimental studies on turbulence development and in-cylinder flow structures during the compression stroke, providing insights for improving turbulence modeling in practical engine simulations.

physics.flu-dyn

Deciphering boundary layer dynamics in high-Rayleigh-number convection using 3360 GPUs and a high-scaling in-situ workflow

Turbulent heat and momentum transfer processes due to thermal convection cover many scales and are of great importance for several natural and technical flows. One consequence is that a fully resolved three-dimensional analysis of these turbulent transfers at high Rayleigh numbers, which includes the boundary layers, is possible only using supercomputers. The visualization of these dynamics poses an additional hurdle since the thermal and viscous boundary layers in thermal convection fluctuate strongly. In order to track these fluctuations continuously, data must be tapped at high frequency for visualization, which is difficult to achieve using conventional methods. This paper makes two main contributions in this context. First, it discusses the simulations of turbulent Rayleigh-B\'enard convection up to Rayleigh numbers of $Ra=10^{12}$ computed with NekRS on GPUs. The largest simulation was run on 840 nodes with 3360 GPU on the JUWELS Booster supercomputer. Secondly, an in-situ workflow using ASCENT is presented, which was successfully used to visualize the high-frequency turbulent fluctuations.

physics.flu-dyn