arXiv Science⌕ Search

arXiv subjects

Peter Caday

Publications and source records attributed to Peter Caday.

6 recordsLinked to original sources

Providing Accuracy Guarantees for the Fixed-Point Emulation of Matrix Multiplication

Fixed-point methods such as Ozaki-II emulate double-precision matrix multiplication (GEMM) on fast low-precision hardware. Software that chooses the mantissa bit count automatically is numerically safe when the emulated product keeps the error guarantee of the floating-point GEMM it replaces. We analyze the worst-case and average-case error of fixed-point and floating-point dot products, define exponent span capacities that determine the extra mantissa bits an input requires, and approximate them with a low-precision GEMM. We prove that 53 bits plus such a capacity and a small constant preserve the classical worst-case error bound for a floating-point dot product, and we demonstrate this guarantee in software on several test cases. In a developer build of cuBLAS on an NVIDIA B200, each implemented bit-count rule earns grade~A on Test~2c of ``Grading the BLAS'' at every size and exponent range tested, falling back to double precision at the widest ranges; in exact arithmetic, the bound holds on every adversarial and random input tested.

cs.MS↗

The 2M Multiplication Algorithm for Complex Matrices

Complex matrix multiplication is typically computed using 4 real matrix multiplications (GEMMs) of the same size. The well-known 3M multiplication algorithm reduces this cost to 3 real GEMMs, together with quadratic time pre- and post-processing steps. In this paper, we reduce 3M to 2M for matrices with integer real and imaginary parts, performing complex GEMM with only 2 real GEMMs of the same size, along with quadratic time pre- and post-processing. For floating-point matrices, 2M multiplication combines naturally with the Ozaki-II scheme, yielding a practical, high-performance algorithm for computing a complex floating-point GEMM in roughly twice the time of a real GEMM of the same size. As corollaries, we derive new algorithms for symmetric rank-$k$ updates (SYRK/HERK) that internally use full rectangular GEMMs.

cs.DC↗

The Missing Fourth Term for the Emulation Tensor Memory Equilibrium (TME) Model: The Residue Deconstruction Cost

The Tensor-Memory Equilibrium (TME) model of "FP8 is All You Need (Part 1)" calculates the execution time of Ozaki Scheme II emulation of fp64 as the maximum of a tensor-core term and a High-Bandwidth Memory (HBM) traffic term, plus a per-output reconstruction term. However, it omits the per-input deconstruction cost: every streamed fp64 operand must be scaled, rounded, and reduced modulo each of the $r$ moduli on SIMT pipes before any matrix multiply can issue. In this note we add this fourth term, calibrate its constant from the cuBLAS emulation path, and derive a closed-form operational-intensity threshold $\mathrm{OI}^{*} = c_q r P_{\mathrm{fp64}}/(8P_{\mathrm{int}})$ below which emulation cannot match native fp64 regardless of tensor-core throughput. On the NVIDIA B300 GPU the threshold is $\mathrm{OI}^{*}\approx 0.56$ FLOP/B. As a result, GEMV, SpMV, and low-batch GEMV, which are the memory-bound kernels the original paper claims to accelerate, are limited to 0.3-0.9x of native performance, and the 7-point stencil to 1.8x rather than the claimed 3.1x. Dense GEMM is unaffected as expected. We also show that precomputing and storing the residues moves the same cost into the bandwidth term, and we state the instruction count that an implementation would have to achieve to invalidate the bound.

cs.AR↗

Recovery of discontinuous Lamé parameters from local dynamic boundary data

Consider an isotropic elastic medium $Ω\subset \mathbb{R}^3$ whose Lamé parameters are piecewise smooth. In the elastic wave initial value inverse problem, we are given the solution operator for the elastic wave equation, but only outside $Ω$ and only for initial data supported outside $Ω$. Using the recently introduced scattering control series in the acoustic case, we prove that piecewise smooth Lamé parameters are uniquely determined by this map under certain geometric conditions. We also show the extent that multiple scattering in the interior may be suppressed and eliminated with access to only this partial solution map, which is akin to the dynamic Dirichlet-to-Neumann map.

math.AP↗

Scattering Control for the Wave Equation with Unknown Wave Speed

Consider the acoustic wave equation with unknown, not necessarily smooth, wave speed $c$. We propose and study an iterative control procedure that erases the history of a wave field up to a given depth in a medium, without any knowledge of $c$. In the context of seismic or ultrasound imaging, this can be viewed as removing multiple reflections from normal-directed wavefronts.

math.AP↗

Reconstruction of piecewise smooth wave speeds using multiple scattering

Let $c$ be a piecewise smooth wave speed on $\mathbb R^n$, unknown inside a domain $Ω$. We are given the solution operator for the scalar wave equation $(\partial_t^2-c^2Δ)u=0$, but only outside $Ω$ and only for initial data supported outside $Ω$. Using our recently developed scattering control method, we prove that piecewise smooth wave speeds are uniquely determined by this map, and provide a reconstruction formula. In other words, the wave imaging problem is solvable in the piecewise smooth setting under mild conditions. We also illustrate a separate method, likewise constructive, for recovering the locations of interfaces in broken geodesic normal coordinates using scattering control.

math.AP↗