docsIf you’re looking to scale use cases in production, Cohere models are some of the most cost-efficient options on the market today. This page contains information about how Cohere’s pricing model operates, for each of our major model offerings.
You can find up-to-date prices for each of our generation, rerank, and embed models on the dedicated pricing page.
Our generative models, such as Command A+, Command A, Command R7B, Command R, and Command R+, are priced on a per-token basis. Be aware that input tokens (i.e. tokens generated from text sent to the model) and output tokens (i.e. text generated by the model) are priced differently.
Our Rerank models are priced based on the quantity of searches, and our Embedding models are priced based on the number of tokens embedded.
When using the Chat API endpoint, the response will contain the total count of input and output tokens, as well as the count of billed tokens. Here’s an example:
The rerank and embed models have their own, slightly different versions, and it may not be obvious why there are separate input and output values under billed_units. To clarify, the billed input and output tokens are the tokens that you’re actually billed for. The reason these values can be different from the overall "tokens" value is that there are situations in which Cohere adds tokens under the hood, and there are others in which a particular model has been trained to do so (i.e. when outputting special tokens). Since these are tokens you don’t have control over, you are not charged for them.
Cohere makes a distinction between “trial” and “production” usage of an API key.
With respect to pricing, the key thing to understand is that trial API key usage is free, but limited. Developers wanting to test different applications or build proofs of concept can use all of Cohere’s models and APIs can do so with a trial key by simply signing up for a Cohere account here.
