Private Deployment – Setting Up

Getting Access

When you sign up for private deployment, you will receive two key pieces of information:

1. A license key for authenticating and pulling model containers
2. A list of artifacts (docker containers) that you can pull using the license key

You can then use the license to pull and run the images, as described in the provisioning guide.

Infrastructure Requirements

Different models require different hardware requirements, depending on the model types (for example, Command, Embed, and Rerank) and their different versions.

During the engagement, you will be provided with the specific requirements, which will include:

• GPU model, count, and interconnect requirements
• System requirements
• Software and driver versions

Available Models

Visit the [Models Reference]([[todo - link to reference page]]) page to see the models available for private deployments.

Cohere has a monthly cadence for model releases and updates.

Cohere also support model customization through fine-tuning.