Shotaro Takahashi

Ptarmigan: Zero-Code GPU Tensor Virtualization for Memory-Constrained LLM Inference

Serving large language models (LLMs) on commodity edge and enterprise accelerators is fundamentally constrained by high-bandwidth device memory capacity. Existing parameter offloading solutions either mandate intrusive model code refactoring and custom computational kernel integration, or suffer from severe pipeline st...