HEAT: Faster Fully Homomorphic Inference via Approximations-Weights Co-Adaptation
Fully homomorphic encryption (FHE) allows a server to run a language model directly on encrypted user prompts, but current approaches remain prohibitively slow. Ciphertexts natively support only addition, multiplication, and rotation, and multiplications may be composed only to a bounded depth before a costly bootstrap...
Alessandro Zirilli, Davide Marincione, Evgenios M. Kornaropoulos et al.
· 0 citations