The Missing Fourth Term for the Emulation Tensor Memory Equilibrium (TME) Model: The Residue Deconstruction Cost
The Tensor-Memory Equilibrium (TME) model of"FP8 is All You Need (Part 1)"calculates the execution time of Ozaki Scheme II emulation of fp64 as the maximum of a tensor-core term and a High-Bandwidth Memory (HBM) traffic term, plus a per-output reconstruction term. However, it omits the per-input deconstruction cost: ev...
Harun Bayraktar, John A. Gunnels, Peter Caday
· 0 citations