// Inference
MODELS
Configure which models route through the Latensgate enclave.
Amazon Bedrock
Claude 3.5 Sonnet
200K ctx · 45ms
Claude 3 Opus
200K ctx · 67ms
Llama 3.1 70B Instruct
128K ctx · 38ms
Mistral Large 2
128K ctx · 52ms
Self-Hosted
OpenAI
Proxy mode: your OpenAI key is wrapped to the enclave's KMS public key and never visible to the parent host. Inference egresses from the enclave only.