Release Notes January 22, 2024
Apply Cohere’s AI with Connectors!
One of the most exciting applications of generative AI is known as “retrieval augmented generation” (RAG). This refers to the practice of grounding the outputs of a large language model (LLM) by offering it resources — like your internal technical documentation, chat logs, etc. — from which to draw as it formulates its replies.
Cohere has made it much easier to utilize RAG in bespoke applications via Connectors. As the name implies, Connectors allow you to connect Cohere’s generative AI platform up to whatever resources you’d like it to ground on, facilitating the creation of a wide variety of applications — customer service chatbots, internal tutors, or whatever else you want to build.
Our docs cover how to create and deploy connectors, how to manage your connectors , how to handle authentication, and more!
Expanded Fine-tuning Functionality
Cohere’s ready-to-use LLMs, such as Command, are very good at producing responses to natural language prompts. However, there are many cases in which getting the best model performance requires performing an additional round of training on custom user data. This is process known as fine-tuning, and we’ve dramatically revamped our fine-tuning documentation.
The new docs are organized according to the major endpoints, and we support fine-tuning for Generate, Classify, Rerank, and Chat.
But wait, there’s more: many developers work with generative AI through popular cloud-compute platforms like Amazon Web Services (AWS), and we support fine-tuning on AWS Bedrock. We also support fine-tuning with Sagemaker, and the relevant documentation will be published in the coming weeks.
A new Embed Jobs API Endpoint Has Been Released
The Embed Jobs API was designed for users who want to leverage the power of retrieval over large corpuses of information. Encoding a large volume of documents with an API can be tedious and difficult, but the Embed Jobs API makes it a breeze to handle encoding workflows involving 100,000 documents, or more!
The API works in conjunction with co.embed(). For more information, consult the docs.
Our SDK now Supports More Languages
Throughout our documentation you’ll find code-snippets for performing common tasks with Python. Recently, we made the decision to expand these code snippets to include Typescript and Go, and are working to include several other popular languages as well.