TEE-based LLM inference is slow because GPUs handle most compute; new work proposes splitting inference with DP-protected intermediate representations to balance privacy and speed. Authors show 80% prompt-reconstruction accuracy…
#semiconductors #AI #GPU #privacy
https://arxiv.org/abs/2609.15039
