When Misprediction is Cheap: Rethinking Host-Side Power Management for NVMe SSDs
Unknown authors
Aug 2026· IEEE Non-Volatile Memory System and Applications Symposium· pp. 1-6· 0 citations· 10 references
Abstract
NVMe SSDs operate in a low-misprediction-cost regime: transitions are millisecond-scale, transition energy is modest, and the gap between active-idle and deep-sleep power remains large. Fixed idle timeouts are therefore the wrong abstraction for host-side dynamic power management (DPM), yet current operating systems still largely rely on them. We present a host-side DPM framework centered on a device-calibrated control abstraction. From NVMe power-state descriptors and measured power parameters, we formulate an energy-latency utility model and derive single-state break-even and crossover anchors that organize the timeout/state-selection space into a small set of threshold-anchored operating modes whose meaning carries across SSDs. A lightweight runtime realizes this abstraction online and enables a controlled comparison of reactive and reinforcement-learning (RL) controllers under the same action space. On an instrumented testbed, the framework reduces average SSD-rail power by up to 34.9% and exit-latency rate by up to 61.5% relative to a fixed-timeout baseline. Most of the gain comes from structuring the control space itself; RL mainly helps when hidden firmware-managed state makes one-step evaluation unreliable.
Large language model (LLM) inference is often constrained by both computation and memory, especially in offloading-based deployments where model weights are transferred across memory hierarchies during autoregressive decoding. In this setting, reducing the number of executed layers can lower per-token latency while als...
Preliminary but compelling evidence that MC-aware scheduling is a practical operating system/runtime direction for deployable embodied AI on unified memory edge devices is provided.
Teng Mei, Cheng-Xuan Pei, Marco Canini et al.· Proceedings of the 17th ACM...· 1 citation
FLINT is proposed, a workload-driven HBF substrate for capacity-scalable LLM inference that integrates HBF as a memory-capacity tier alongside HBM while addressing three adoption challenges.
Geraldo F. Oliveira, Arash Tavakkol, Xiang-Yu Zhu et al.· 1 citation
On-device mobile Large Language Model (LLM) inference is gaining significant attention. However, mobile devices operate in highly dynamic multitasking environments where users frequently switch between applications. This creates memory pressure, forcing LLM memory (model weights and KV cache) to be evicted by the opera...
Hong Yu, Minsung Kim, Jongseok Park et al.· 0 citations
A controlled measurement study of self-hosted LLM inference across edge and near-edge deployment nodes: an NVIDIA Jetson AGX Orin and a near-edge server with CPU-only and GPU-enabled inference modes, highlighting that compute-side inference metrics alone can lead to suboptimal placement for latency-sensitive interactiv...
Maysam Khatib, Moysis Symeonides, Demetris Trihinas et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.