Efficient Decoding Methods for Language Models on Encrypted Data

Large language models LLMs power modern AI applications, but processing sensitive data on untrusted servers raises privacy concerns. Homomorphic encryption HE enables computation on encrypted data for secure inference. However, neural text generation requires decoding methods like argmax and...