SpliTEE: Fast and Private LLM Inference by Coupling GPU-Assisted Trusted Execution Environments with Differential Privacy
This paper demonstrates that prompt reconstruction, even with knowledge of the DP mechanism, cannot recover more information than is contained in an unrelated prompt, and derives an upper bound on the floating-point error from masking and subsequent noise cancellation as a function of the privacy parameter epsilon.