2025
LoRO: Real-Time on-Device Secure Inference for LLMs via TEE-Based Low Rank Obfuscation
LoRO can solve the concerns regarding model thefts on edge devices in an efficient and secure manner, facilitating the wide edge application of LLMs and identifying a statistical vulnerability in existing protection methods.
Gao-Jian Xiong, Yu Sun, Jian-Hua Liu et al.
· Neural Information Processin... · 6 citations