Skip to content
Conference

CODA: Breaking CPU Bottlenecks for Scalable Ceph with DPU-Based OSD Decoupling

Jul 2026 · IEEE International Conference on Cloud Computing · pp. 257-267 · 0 citations · 44 references

Abstract

Ceph, a widely used distributed storage system, underutilizes NVMe SSD bandwidth due to CPU bottlenecks, even in high-performance environments. This inefficiency is amplified in resource-constrained settings such as edge clouds and small-scale clusters. Prior work offloads the transport layer (e.g., TCP/IP) to DPUs, but fails to address the dominant overheads arising from OSD-level logic, including message handling and replication coordination. We present CODA, a Ceph OSD Decoupling Architecture that separates the OSD stack and offloads CPU-intensive front-end logic to the DPU. It runs Messenger and OSD core on the DPU while keeping BlueStore on the host, enabling a disaggregated OSD across heterogeneous devices. We further design: (i) Flow-Direct for split execution, (ii) Flow-Adapt for batching and pipelining under DMA constraints, and (iii) Flow-Sync for low-overhead synchronization under OSD scaling. We implement CODA on a Ceph cluster with NVIDIA BlueField-3 DPUs. CODA reduces host CPU usage by up to 88% and improves throughput by up to 49% without replication and 94% with 3-way replication.

View source

Similar papers

Book Open access Aug 2026

Spillway: Orchestrating DPU and Host into a Unified vSwitching Fabric

Spillway introduces a DPU-host hybrid data plane that repurposes idle host CPU resources to process spillover traffic when the DPU becomes the bottleneck, and decouples virtual switching capacity from static DPU hardware limits.

Xiaochong Jiang, Dian Fan, Yilong Lv et al. · 0 citations
Preprint Aug 2026

OpScale: Operator-level Provisioning and Autoscaling for LLM Serving

OpScale is presented, a practical operator-level orchestration framework of profiling, provisioning, placement, and runtime serving that attains SLOs with up to 36.3% fewer GPUs and 28% less power, or achieves 44% higher throughput under fixed cost budgets.

Xingqi Cui, Chieh-Jan Mike Liang, Ziang T. Tang et al. · 0 citations
Aug 2026

Achieving High-Performance Erasure Code Repair Through DPU Offloading

Erasure coding provides efficient fault tolerance for large-scale distributed storage systems. However, its data repair process is well-known to be resource-intensive. We find that conventional host-centric, TCP-based repair architectures suffer from severe resource contention. Even in high-bandwidth networks, such int...

Xiangyu Yao, Yina Lv, Tianyu Ren et al. · 0 citations
Conference Aug 2026

QoS Guarantees and Performance Isolation for Multi-tenant SSDs in Cloud Environments

With the widespread adoption of cloud computing and virtualization, multi-tenant architecture has become the mainstream deployment model for data center storage. Solid-state drives (SSDs), leveraging high IOPS, low latency, and high parallelism, serve as the core storage medium. Nevertheless, internal resource contenti...

Dan-Dan Su, Qi-Hao Liu, Xin-Ming Li et al. · 0 citations
Book Open access Aug 2026

XFir: Accelerating New-Flow Setup on Host Servers of a Large Cloud Network

XFir is the first hardware-accelerated new-flow setup system for cloud host servers that delivers high CPS throughput while preserving sufficient flexibility, and is cost-effective to deploy, requiring only a single DPU per host.

Shihan Lin, Shunqiao Jiang, Liang Wang et al. · 1 citation

T !" : E ! icient Drop-in Networking for Database Systems

This work presents Tux, a kernel-bypass networking stack designed for database systems that achieves high performance without giving up compatibility and robustness, and implements T !" in a library called T !".

Xin-Jing Zhou, Viktor Leis, Xiang-Yao Yu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.