arXiv ScienceSearch

arXiv subjects

Joseph K. L. Lee

Publications and source records attributed to Joseph K. L. Lee.

12 recordsLinked to original sources

Python in the front, party in the Backline: compiling quantum workloads across CPUs, GPUs, and FPGAs

Moving from quantum research and development to production-grade, fault-tolerant quantum workload execution remains one of the most significant challenges facing quantum platform builders. While Python frameworks have enabled an easy entry point for quantum algorithm design, the low-latency requirements for real-time quantum error correction (QEC) demand performance that traditional interpreted environments cannot provide. FPGAs and ASICs play a central role at these layers, but their specialized programming models make development rigid and time-consuming. CPUs, GPUs, and other accelerators introduce a different challenge: as infrastructure becomes increasingly heterogeneous, programming across different devices and their associated abstractions becomes more complex. Allowing researchers to write workloads in high-level languages that map to low-latency execution across diverse distributed target platforms will enable the development of key infrastructure for utility-scale quantum systems. For this, we introduce $\textit{Backline}$, a heterogeneous compilation and runtime framework built within PennyLane and Catalyst. Backline allows us to design and build quantum-classical workloads for high-performance and low-latency devices, with compilation directly from a Python interface through MLIR. We demonstrate the compilation and execution of several quantum workloads with low-latency data movement across a mix of CPUs, GPUs, and FPGAs, for both local and distributed remote hardware targets, all from a vendor-agnostic Python frontend. With an AMD VPK120 FPGA board as the controller, issuing each round from its hardware-handshake engine, we measured median steady-state round-trip latencies over RoCE v2 of $2.305~\mu$s to an AMD Ryzen Threadripper PRO CPU and $4.5~\mu$s to an AMD Instinct MI210 GPU across $10^6-1$ rounds per path, demonstrating microsecond-scale synchronous co-processing.

quant-ph

2BP: 2-Stage Backpropagation

As Deep Neural Networks (DNNs) grow in size and complexity, they often exceed the memory capacity of a single accelerator, necessitating the sharding of model parameters across multiple accelerators. Pipeline parallelism is a commonly used sharding strategy for training large DNNs. However, current implementations of pipeline parallelism are being unintentionally bottlenecked by the automatic differentiation tools provided by ML frameworks. This paper introduces 2-stage backpropagation (2BP). By splitting the backward propagation step into two separate stages, we can reduce idle compute time. We tested 2BP on various model architectures and pipelining schedules, achieving increases in throughput in all cases. Using 2BP, we were able to achieve a 1.70x increase in throughput compared to traditional methods when training a LLaMa-like transformer with 7 billion parameters across 4 GPUs.

cs.LG

Benchmarking Machine Learning Applications on Heterogeneous Architecture using Reframe

With the rapid increase in machine learning workloads performed on HPC systems, it is beneficial to regularly perform machine learning specific benchmarks to monitor performance and identify issues. Furthermore, as part of the Edinburgh International Data Facility, EPCC currently hosts a wide range of machine learning accelerators including Nvidia GPUs, the Graphcore Bow Pod64 and Cerebras CS-2, which are managed via Kubernetes and Slurm. We extended the Reframe framework to support the Kubernetes scheduler backend, and utilise Reframe to perform machine learning benchmarks, and we discuss the preliminary results collected and challenges involved in integrating Reframe across multiple platforms and architectures.

cs.DC

Quantum Task Offloading with the OpenMP API

Most of the widely used quantum programming languages and libraries are not designed for the tightly coupled nature of hybrid quantum-classical algorithms, which run on quantum resources that are integrated on-premise with classical HPC infrastructure. We propose a programming model using the API provided by OpenMP to target quantum devices, which provides an easy-to-use and efficient interface for HPC applications to utilize quantum compute resources. We have implemented a variational quantum eigensolver using the programming model, which has been tested using a classical simulator. We are in the process of testing on the quantum resources hosted at the Leibniz Supercomputing Centre (LRZ).

cs.DC

Experiences of running an HPC RISC-V testbed

Funded by the UK ExCALIBUR H\&ES exascale programme, in early 2022 a RISC-V testbed for HPC was stood up to provide free access for scientific software developers to experiment with RISC-V for their workloads. Here we report on successes, challenges, and lessons learnt from this activity with a view to better understanding the suitability of RISC-V for HPC and important areas to focus RISC-V HPC community efforts upon.

cs.DC

Test-driving RISC-V Vector hardware for HPC

Whilst the RISC-V Vector extension (RVV) has been ratified, at the time of writing both hardware implementations and open source software support are still limited for vectorisation on RISC-V. This is important because vectorisation is crucial to obtaining good performance for High Performance Computing (HPC) workloads and, as of April 2023, the Allwinner D1 SoC, containing the XuanTie C906 processor, is the only mass-produced and commercially available hardware supporting RVV. This paper surveys the current state of RISC-V vectorisation as of 2023, reporting the landscape of both the hardware and software ecosystem. Driving our discussion from experiences in setting up the Allwinner D1 as part of the EPCC RISC-V testbed, we report the results of benchmarking the Allwinner D1 using the RAJA Performance Suite, which demonstrated reasonable vectorisation speedup using vendor-provided compiler, as well as favourable performance compared to the StarFive VisionFive V2 with SiFive's U74 processor.

cs.DC

Backporting RISC-V Vector assembly

Leveraging vectorisation, the ability for a CPU to apply operations to multiple elements of data concurrently, is critical for high performance workloads. However, at the time of writing, commercially available physical RISC-V hardware that provides the RISC-V vector extension (RVV) only supports version 0.7.1, which is incompatible with the latest ratified version 1.0. The challenge is that upstream compiler toolchains, such as Clang, only target the ratified v1.0 and do not support the older v0.7.1. Because v1.0 is not compatible with v0.7.1, the only way to program vectorised code is to use a vendor-provided, older compiler. In this paper we introduce the rvv-rollback tool which translates assembly code generated by the compiler using vector extension v1.0 instructions to v0.7.1. We utilise this tool to compare vectorisation performance of the vendor-provided GNU 8.4 compiler (supports v0.7.1) against LLVM 15.0 (supports only v1.0), where we found that the LLVM compiler is capable of auto-vectorising more computational kernels, and delivers greater performance than GNU in most, but not all, cases. We also tested LLVM vectorisation with vector length agnostic and specific settings, and observed cases with significant difference in performance.

cs.DC

Position-Space Renormalisation of the Energy-Momentum Tensor

There is increasing interest in the study of nonperturbative aspects of three-dimensional quantum field theories (QFT). They appear as holographic dual to theories of (strongly coupled) gravity. For instance, in Holographic Cosmology, the two-point function of the Energy-Momentum Tensor (EMT) of a particular class of three-dimensional QFTs can be mapped into the power spectrum of the Cosmic Microwave Background in the gravitational theory. However, the presence of divergent contact terms poses challenges in extracting a renormalised EMT two-point function on the lattice. Using a $\phi^4$ theory of adjoint scalars valued in the $\mathfrak{su}(N)$ Lie Algebra as a proof-of-concept motivated by Holographic Cosmology, we apply a novel method for filtering out such contact terms by making use of infinitely differentiable "bump" functions which enforce a smooth window that excludes contributions at zero spatial separation. The process effectively removes the local contact terms and allows us to extract the continuum limit behaviour of the renormalised EMT two-point function.

hep-lat

Renormalization of the $3D$ $SU(N)$ scalar energy-momentum tensor using the Wilson flow

In the holographic approach to cosmology, cosmological observables are described in terms of correlators of a three-dimensional boundary quantum field theory. As a concrete model, we study the $3D$ massless $SU(N)$ scalar matrix field theory with a $\phi^4$ interaction. On the lattice, the energy-momentum tensor (EMT) in this theory can mix with the operator $\phi^2$. We utilize the Wilson Flow to renormalize the EMT on the lattice, and present numerical results for the mixing coefficient for $N = 2$. Obtaining the renormalized EMT will allow us to make predictions for the CMB power spectra in the regime where the dual QFT is non-perturbative.

hep-lat

Renormalization of the energy-momentum tensor in three-dimensional scalar $SU(N)$ theories using the Wilson flow

A nonperturbative determination of the energy-momentum tensor is essential for understanding the physics of strongly coupled systems. The ability of the Wilson flow to eliminate divergent contact terms makes it a practical method for renormalizing the energy-momentum tensor on the lattice. In this paper, we utilize the Wilson flow to define a procedure to renormalize the energy-momentum tensor for a three-dimensional massless scalar field in the adjoint of $SU(N)$ with a $\varphi^4$ interaction on the lattice. In this theory the energy-momentum tensor can mix with $\varphi^2$ and we present numerical results for the mixing coefficient for the $N=2$ theory.

hep-lat

Nonperturbative infrared finiteness in super-renormalisable scalar quantum field theory

We present a study of the IR behaviour of a three-dimensional super-renormalisable quantum field theory (QFT) consisting of a scalar field in the adjoint of $SU(N)$ with a $\varphi^4$ interaction. A bare mass is required for the theory to be massless at the quantum level. In perturbation theory the critical mass is ambiguous due to infrared (IR) divergences and we indeed find that at two-loops in lattice perturbation theory the critical mass diverges logarithmically. It was conjectured long ago in [Jackiw 1980, Appelquist 1981] that super-renormalisable theories are nonperturbatively IR finite, with the coupling constant playing the role of an IR regulator. Using a combination of Markov-Chain-Monte-Carlo simulations of the lattice-regularised theory, both frequentist and Bayesian data analysis, and considerations of a corresponding effective theory we gather evidence that this is indeed the case.

hep-lat

Towards a holographic description of cosmology: Renormalisation of the energy-momentum tensor of the dual QFT

In the holographic approach to cosmology, cosmological observables are described in terms of correlators of a three-dimensional boundary quantum field theory. As a concrete model, we study the 3$d$ massless $SU(N)$ scalar matrix field theory. In this work, we focus on the renormalisation of the energy-momentum tensor 2-point function, which can be related to the CMB power spectra. Here we present a non-perturbative procedure to remove divergences resulting from the loss of translational invariance on the lattice, by imposing Ward identities. This will allow us to make predictions for the CMB power spectra in the regime where the dual QFT is non-perturbative.

hep-lat