This page may contain stale information. Last updated: 2026-08-15
Definition
Inference pipelines that use privacy proxies (oblivious-http, masque, TEEs, etc.) so model hosts or relays cannot jointly observe user identity and query content — increasingly relevant for health/finance and agent-mediated access.
Key Points
- 2026-08-14: google open-sourced heir-compiler — compiles pretrained models for homomorphic-encryption inference on encrypted inputs without server-side decryption; four demo apps shipped (2026-08-14-google-heir-homomorphic-encryption)
- Tooling gap: debugging privacy relays without breaking the threat model
- pvcli targets developer/agent debugging of OHTTP paths
- Complements confidential-computing and edge-ai local inference
HE/FHE inference typically carries 100x–1000x+ latency overhead vs plaintext — suited for regulated niches, not general LLM chat at scale.
Related
- heir-compiler
- homomorphic-encryption
- oblivious-http
- pvcli
- confidential-computing
- cloudflare
- ai-inference