Skip to content

When Misprediction is Cheap: Rethinking Host-Side Power Management for NVMe SSDs

Unknown authors
Aug 2026 · IEEE Non-Volatile Memory System and Applications Symposium · pp. 1-6 · 0 citations · 10 references

Abstract

NVMe SSDs operate in a low-misprediction-cost regime: transitions are millisecond-scale, transition energy is modest, and the gap between active-idle and deep-sleep power remains large. Fixed idle timeouts are therefore the wrong abstraction for host-side dynamic power management (DPM), yet current operating systems still largely rely on them. We present a host-side DPM framework centered on a device-calibrated control abstraction. From NVMe power-state descriptors and measured power parameters, we formulate an energy-latency utility model and derive single-state break-even and crossover anchors that organize the timeout/state-selection space into a small set of threshold-anchored operating modes whose meaning carries across SSDs. A lightweight runtime realizes this abstraction online and enables a controlled comparison of reactive and reinforcement-learning (RL) controllers under the same action space. On an instrumented testbed, the framework reduces average SSD-rail power by up to 34.9% and exit-latency rate by up to 61.5% relative to a fixed-timeout baseline. Most of the gain comes from structuring the control space itself; RL mainly helps when hidden firmware-managed state makes one-step evaluation unreliable.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

FlexEE: Self-Speculative and KV-Compatible Early Exiting for Offloading-Aware LLM Inference

Large language model (LLM) inference is often constrained by both computation and memory, especially in offloading-based deployments where model weights are transferred across memory hierarchies during autoregressive decoding. In this setting, reducing the number of executed layers can lower per-token latency while als...

Qi-Hu Xie, Zi-Wei Li, Yi Kang · 0 citations
Book Open access Sep 2026

MCSched: Memory-Controller-Aware Scheduling for Embodied LLM Workloads on NVIDIA Jetson

Preliminary but compelling evidence that MC-aware scheduling is a practical operating system/runtime direction for deployable embodied AI on unified memory edge devices is provided.

Teng Mei, Cheng-Xuan Pei, Marco Canini et al. · 1 citation
#machine learning Preprint Sep 2026

mzCache: On-Device LLM Memory Management under Multitasking

On-device mobile Large Language Model (LLM) inference is gaining significant attention. However, mobile devices operate in highly dynamic multitasking environments where users frequently switch between applications. This creates memory pressure, forcing LLM memory (model weights and KV cache) to be evicted by the opera...

Hong Yu, Minsung Kim, Jongseok Park et al. · 0 citations
#artificial intelligence Preprint Sep 2026

A Measurement Study of LLM Inference Trade-offs Across Edge Continuum Hardware

A controlled measurement study of self-hosted LLM inference across edge and near-edge deployment nodes: an NVIDIA Jetson AGX Orin and a near-edge server with CPU-only and GPU-enabled inference modes, highlighting that compute-side inference metrics alone can lead to suboptimal placement for latency-sensitive interactiv...

Maysam Khatib, Moysis Symeonides, Demetris Trihinas et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.