improved

Pricing Update and New Dashboard UI

  • Free, rate limited Trial Keys for experimentation, testing, and playground usage
  • Production keys with no rate limit for serving Cohere in production applications
  • Flat rate pricing for Generate and Embed endpoints
  • Reduced pricing for Classify endpoint
  • New UI for dashboard including sign up and onboarding - everything except playground
  • New use-case specific Quickstart Guides to learn about using Cohere API
  • Replacing "Finetune" nomenclature with "Custom Model"
  • Inviting team members is now more intuitive. Teams enable users to share custom models with each other
  • Generative custom models now show accuracy and loss metrics alongside logs
  • Embed and Classify custom models now show logs alongside accuracy, loss, precision, f1, recall
  • Custom model details now show number of each label in dataset
added

Introducing Moderate (Beta)!

Use Moderate (Beta) to classify harmful text across the following categories: profane, hate speech, violence, self-harm, sexual, sexual (non-consenual), harassment, spam, information hazard (e.g., pii). Moderate returns an array containing each category and its associated confidence score. Over the coming weeks, expect performance to improve significantly as we optimize the underlying model.

improved

Model parameter now optional.

Our APIs no longer require a model to be specified. Each endpoint comes with great defaults. For more control, a model can still be specified by adding a model param in the request.

improved

Updated Small, Medium, and Large Generation Models

Updated small, medium, and large models are more stable and resilient against abnormal inputs due to a FP16 quantization fix. We also fixed a bug in generation presence & frequency penalty, which will result in more effective penalties.

added

New Extremely Large Model!

Our new and improved xlarge has better generation quality and a 4x faster prediction speed. This model now supports a maximum token length of 2048 tokens and frequency and presence penalties.

improved

New & Improved Generation and Representation Models

We've retrained our small, medium, and large generation and representation models. Updated representation models now support contexts up to 4096 tokens (previously 1024 tokens). We recommend keeping text lengths below 512 tokens for optimal performance; for any text longer than 512 tokens, the text is spliced and the resulting embeddings of each component are then averaged and returned.

improved

Finetuning Available + Policy Updates

Finetuning is Generally Available

New & Improved Generation Models

We’ve shipped updated small, medium, and large generation models. You’ll find significant improvements in performance that come from our newly assembled high quality dataset.

added

Classification Endpoint

Classification is now available via our classification endpoint. This endpoint is currently powered by our generation models (small and medium) and supports few-shot classification. We will be deprecating support for Choose Best by May 18th. To learn more about classification at Cohere check out the docs here.

added

Extremely Large (Beta) Release

Our biggest and most performant generation model is now available. Extremely Large (Beta) outperforms our previous large model on a variety of downstream tasks including sentiment analysis, named entity recognition (NER) and common sense reasoning, as measured by our internal benchmarks. You can access Extremely Large (Beta) as xlarge-20220301. While in Beta, note that this model will have a maximum token length of 1024 tokens and maximum num_generations of 1.