Standard Vault Overview
A Standard Vault is a Cohere-managed, single-tenant inference environment. You get dedicated infrastructure with full control over model selection, scaling, and performance monitoring, without operating the underlying serving stack. Your data is protected in transit and at rest, and Cohere manages maintenance, deployments, updates, and scaling.
Choose Standard Vault when you want dedicated inference and don’t require hardware-backed protection of data in use or verifiable remote attestation. If you do, see Encrypted Vaults.
Deploying and using a Standard Vault
Standard vaults use the shared vault flow:
What’s specific to Standard Vault
Architecture
These are a Standard Vault’s core architectural components:
- Logically isolated: Isolates all infrastructure components, including the network load balancer, reverse proxy, serving middleware, inference servers, and GPU accelerators.
- Minimal shared components: Shared infrastructure is limited to authentication and underlying Kubernetes/compute resources (nodes, CPU, and memory).
- Cohere-managed operations: Cohere handles maintenance, deployments, updates, and scaling.
When Zero Data Retention (ZDR) is enabled for a Standard Vault (Standalone) deployment, Cohere processes inputs and outputs for inference but does not retain any prompts or responses.