Cascadia: A Control-Plane-Free Alternative to Hyperconverged AI Infrastructure
We present Cascadia, a system for serving large language models on fleets of commodity Intel AIPCs using their CPU, integrated-GPU, and NPU resources. Every node embeds ingress, scheduling, and execution; inference requests require no dedicated routing control plane. Nodes join a libp2p QUIC mesh using CA-issued ed2551...
Matias Parij, Pawan Paudel, Tate Berenbaum et al.
· 1 citation