In October, Cohere updated our embeddings models to be able to process images in addition to text.
These enhanced models have been available through the Cohere API, but today we’re pleased to announce that they can also be utilized through the powerful Amazon Bedrock cloud computing platform!
You can find more information about using Cohere’s embedding models on Bedrock here.
Aya Expanse is a multilingual large language model that is designed to expand the number of languages covered by generative AI. It is optimized to perform well in 23 languages, including Arabic, Chinese (simplified & traditional), Czech, Dutch, English, French, German, Greek, Hebrew, Russian, Spanish, and more.
Now, you can talk to Aya Expanse directly in the popular messaging service WhatsApp! All of Aya’s functionality is avaible through the app, and you can find more details here.
We’re thrilled to announce the release of Command R7B, the smallest, fastest, and final model in our R family of enterprise-focused large language models (LLMs). With a context window of 128K, Command R7B offers state-of-the-art performance across a variety of real-world tasks, and is designed for use cases in which speed, cost, and compute are important. Specifically, Command R7B is excellent for retrieval-augmented generation, tool use, and agentic applications where complex reasoning, multiple actions, and information-seeking are important for success.
Command R7B is available today on the Cohere Platform as well as accessible on HuggingFace, or you can access it in the SDK with command-r7b-12-2024. For more information, check out our dedicated blog post.
We’re pleased to announce the release of Rerank 3.5 our newest and most performant foundational model for ranking. Rerank 3.5 has a context length of 4096, SOTA performance on Multilingual Retrieval tasks and Reasoning Capabilities. In addition, Rerank 3.5 has SOTA performance on BEIR and domains such as Finance, E-commerce, Hospitality, Project Management, and Email/Messaging Retrieval tasks.
In the rest of these release notes, we’ll provide more details about changes to the api.
Along with the model, we are releasing V2 of the Rerank API. It includes the following major changes:
model is now a required parametermax_chunks_per_doc has been replaced by max_tokens_per_doc; max_tokens_per_doc will determine the maximum amount of tokens a document can have before truncation. The default value for max_tokens_per_doc is 4096.documents parameter has been removed - if your documents contain structured data, for best performance we recommend formatting them as YAML strings.Example request
1 POST https://api.cohere.ai/v2/rerank 2 { 3 "model": "rerank-v3.5", 4 "query": "What is the capital of the United States?", 5 "top_n": 3, 6 "documents": ["Carson City is the capital city of the American state of Nevada.", 7 "The Commonwealth of the Northern Mariana Islands is a group of islands in the Pacific Ocean. Its capital is Saipan.", 8 "Washington, D.C. (also known as simply Washington or D.C., and officially as the District of Columbia) is the capital of the United States. It is a federal district.", 9 "Capitalization or capitalisation in English grammar is the use of a capital letter at the start of a word. English usage varies from capitalization in other languages.", 10 "Capital punishment has existed in the United States since beforethe United States was a country. As of 2017, capital punishment is legal in 30 of the 50 states."] 11 }
Today, we’re pleased to announce that we have added Structured Outputs support for tool use in the Chat API.
In addition to supporting Structured Outputs with JSON generation via the response_format parameter, Structured Outputs will be available with Tools as well via the strict_tools parameter.
Setting strict_tools to true ensures that tool calls will follow the provided tool schema exactly. This means the tool calls are guaranteed to adhere to the tool names, parameter names, parameter data types, and required parameters, without the risk of hallucinations.
See the Structured Outputs documentation to learn more.
Today we’re announcing updates to our embed-v3.0 family of models. These models now have the ability to process images into embeddings. There is no change to existing text capabilities which means there is no need to re-embed texts you have already processed with our embed-v3.0 models.
In the rest of these release notes, we’ll provide more details about technical enhancements, new features, and new pricing.
The Embed API has two major changes:
input_type called imageimagesExample request on how to process
1 POST https://api.cohere.ai/v1/embed 2 { 3 "model": "embed-multilingual-v3.0", 4 "input_type": "image", 5 "embedding_types": ["float"], 6 "images": [enc_img] 7 }
png, jpeg,Webp, and gif5mbimages parameter only accepts a base64 encoded image formatted as a Data UrlToday, we’re pleased to announce that fine-tuning is now available for Command R 08-2024!
We’re also introducing other chat fine-tuning features:
See the Chat fine-tuning documentation to learn more about creating a fine-tuned model.
We’re excited to introduce improvements to our Chat, Classify, Embed, and Rerank APIs in a major version upgrade, making it easier and faster to build with Cohere. We are also releasing new versions of our Python, TypeScript, Java, and Go SDKs which feature cohere.ClientV2 for access to the new API.
model is a required parameterembedding_types is a required parametermessages arraytool_call_ids to match tool calls with tool resultsdocuments supports a list of strings or a list of objects with document metadataWe are simplifying the Chat API by removing support for the following parameters available in V1:
search_queries_only, which generates only a search query given a user’s message input. search_queries_only is not supported in the V2 Chat API today, but will be supported at a later date.connectors, which enables users to register a data source with Cohere for RAG queries. To use the Chat V2 API with web search, see our migration guide for instructios to implement a web search tool.conversation_id, used to manage chat history on behalf of the developer. This will not be supported in the V2 Chat API.prompt_truncation, used to automatically rerank and remove documents if the query did not fit in the model’s context limit. This will not be supported in the V2 Chat API.force_single_step, which forced the model to finish tool calling in one set of turns. This will not be supported in the V2 Chat API.preamble, used for giving the model task, context, and style instructions. Use a system turn at the beginning of your messages array in V2.citation_quality, for users to select between fast citations, accurate citations (slightly higher latency than fast), or citations off. In V2 Chat, we are introducing a top level citation_options parameter for all citation settings. citation_quality will be replaced by a mode parameter within citation_options.See our Chat API migration guide for detailed instructions to update your implementation.
These APIs are in Beta and are subject to updates. We welcome feedback in our Discord channel.
You’ll recall that we released refreshed models of Command R and Command R+ in August.
Today, we’re pleased to announce that these models are available on the Azure cloud computing platform!
You can find more information about using Cohere’s Command models on Azure here.
Today we’re announcing updates to our flagship generative AI model series: Command R and Command R+. These models demonstrate improved performance on a variety of tasks.
The latest model versions are designated with timestamps, as follows:
command-r-08-2024 on the API.command-r-plus-08-2024 on the API.In the rest of these release notes, we’ll provide more details about technical enhancements, new features, and new pricing.
command-r-08-2024 shows improved performance for multilingual retrieval-augmented generation (RAG) and tool use. More broadly, command-r-08-2024 is better at math, code and reasoning and is competitive with the previous version of the larger Command R+ model.
command-r-08-2024 delivers around 50% higher throughput and 20% lower latencies as compared to the previous Command R version, while cutting the hardware footprint required to serve the model by half. Similarly, command-r-plus-08-2024 delivers roughly 50% higher throughput and 25% lower latencies as compared to the previous Command R+ version, while keeping the hardware footprint the same.
Both models include the following feature improvements:
command-r-08-2024 and command-r-plus-08-2024 have demonstrated improved decision-making around which tool to use in which context, and whether or not to use a tool.command-r-08-2024 there are meaningful improvements on length and formatting control.The primary new feature available in both command-r-08-2024 and command-r-plus-08-2024 is Safety Modes (in beta). For our enterprise customers building with our models, what is considered safe depends on their use case and the context the model is deployed in. To support diverse enterprise applications, we have developed safety modes, acknowledging that safety and appropriateness are context-dependent, and that predictability and control are critical in building confidence in Cohere models.
Safety guardrails have traditionally been reactive and binary, and we’ve observed that users often have difficulty defining what safe usage means to them for their use case. Safety Modes introduce a nuanced approach that is context sensitive.
(Note: Command R/R+ have built-in protections against core harms, such as content that endangers child safety. These types of harm are always blocked and cannot be adjusted.)
Safety modes are activated through a safety_mode parameter, which can (currently) be in one of two modes:
"STRICT": Encourages avoidance of all sensitive topics. Strict content guardrails provide an extra safe experience by prohibiting inappropriate responses or recommendations. Ideal for general and enterprise use."CONTEXTUAL": (enabled by default): For wide-ranging interactions with fewer constraints on output while maintaining core protections. The model responds as instructed while still rejecting harmful or illegal suggestions. Well-suited for entertainment, creative, educational use.You can also opt out of the safety modes beta by setting safety_mode="NONE". For more information, check out our dedicated guide to Safety Modes.
Here’s a breakdown the pricing structure for the new models:
command-r-plus-08-2024, input tokens are priced at $2.50/M and output tokens at $10.00/M.command-r-08-2024, input tokens are priced at $0.15/M and output tokens at $0.60/M.