In this work, we perform an in-depth characterization of the microarchitectural performance of modern datacenter workloads. Google recently released hundreds of gigabytes of trace data from production, offering a unique view into current-day warehouse-scale workload behavior. Through simulating 359 cores spanning 12 wo...
Matthew Giordano, Akanksha Jain, E. Deiana et al.· IEEE International Symposium...· 1 citation
This paper first analyzes how context length affects the accuracy of long-context ASR models and finds that an intermediate chunk size of about five minutes matches single-pass accuracy while avoiding repetition loops, and proposes Murmur, an inference system for long-form ASR based on hierarchical chunking.
Wei-Tzu Lee, Keisuke Kamahori, Baris Kasikci· 1 citation
LeapQuant is proposed, a training-free method that achieves near-lossless performance under 8-bit recurrent-state quantization and substantially reduces memory and compute costs during inference.
It is shown that semantic understanding and reasoning about a program is a vital component in inserting effective software prefetches, and that prefetching at the scale of large codebases poses new challenges, including prefetch codependence and interference.
Matthew Giordano, Parthasarathy Ranganathan, Baris Kasikci et al.· 0 citations
NEMO is presented, a nimble and expressive hardware memory telemetry engine for server memory controllers (MCs) that gives OS subsystems policy-specific views of memory behavior and provides higher-fidelity signals at substantially lower CPU overhead across a range of state-of-the-art memory management systems.
Shi-Hang Li, Matthew Giordano, Tushar Garg et al.· 1 citation
Themis is a profile-guided hardware prefetching solution that implements a novel hardware-software interface for data prefetching: the software directs the hardware on where to prefetch, and the hardware identifies and issues prefetches in the regions of interest.
Keisuke Kamahori, Neil Adit, Kan Zhu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.