PUMA: A PMU-Guided Multi-Domain Layer-Aware DVFS Framework for Low-Power Mobile AI on Smartphones
PUMA combines offline layer/layer-chain PMU characterization with online GPU PMU observations to identify execution characteristics associated with compute-bound, memory-bound, and bursty phases and achieves a lower energy-delay product than the existing governor across all evaluated workloads.