Maverick: Private and Verifiable LLM Inference Made Practical via Matrix-Vector Multiplication Delegation
This paper presents Maverick, a novel approach to private and verifiable LLM inference based on a protocol for delegating matrix-vector multiplication, a dominant operation in LLMs, and combines this verification primitive with LPN-based pseudorandom masking to provide input privacy.
Ben Merbaum, M. Raeisi, Wenhao Wang et al.
· 0 citations