For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
DASHBOARDPLAYGROUNDDOCSCOMMUNITYLOG IN
Guides and conceptsAPI ReferenceRelease NotesLLMUCookbooks
Guides and conceptsAPI ReferenceRelease NotesLLMUCookbooks
  • Get Started
    • Introduction
    • Installation
    • Creating a client
    • Playground
    • FAQs
  • Models
    • An Overview of Cohere's Models
    • Embed
    • Rerank
    • Aya
  • Text Generation
    • Introduction to Text Generation at Cohere
    • Using the Chat API
    • Streaming Responses
    • Structured Outputs
    • Predictable Outputs
    • Advanced Generation Parameters
    • Retrieval Augmented Generation (RAG)
      • Overview of RAG Connectors
    • Tool Use
    • Tokens and Tokenizers
    • Migrating from the Generate API to the Chat API
    • Summarizing Text
    • Safety Modes
  • Embeddings (Vectors, Search, Retrieval)
    • Introduction to Embeddings at Cohere
    • Semantic Search with Embeddings
    • Multimodal Embeddings
    • Batch Embedding Jobs
  • Going to Production
    • API Keys and Rate Limits
    • Going Live
    • Deprecations
    • How Does Cohere's Pricing Work?
  • Integrations
    • Integrating Embedding Models with Other Tools
    • Cohere and LangChain
    • LlamaIndex and Cohere
  • Deployment Options
    • Overview
    • SDK Compatibility
  • Tutorials
    • Cookbooks
    • LLM University
    • Build Things with Cohere!
  • Responsible Use
    • Security
    • Usage Policy
    • Command A Technical Report
    • Command R and Command R+ Model Card
  • Cohere Labs
    • Cohere Labs Acceptable Use Policy
  • More Resources
    • Cohere Toolkit
    • Datasets
    • Improve Cohere Docs
LogoLogodocs
DASHBOARDPLAYGROUNDDOCSCOMMUNITYLOG IN
On this page
  • Using Connectors to Create Grounded Generations
  • A Caveat on Deploying Connectors
Text GenerationRAG Connectors

An Overview of Cohere's RAG Connectors

Was this page helpful?
Edit this page
Previous

An Overview of Tool Use with Cohere

Next
Built with

Cohere’s connector parameter was deprecated on September 15, 2025. For information on how to get connector-like functionality, check out our documentation on multi-step tool use.

As the name implies, Connectors are ways of connecting to data sources. They enable you to combine Cohere large language models (LLMs), which power the Chat API endpoint, with data sources such as internal documents, document databases, the broader internet, or any other source of context which can inform the replies generated by the model.

Connectors enhance Cohere retrieval augmented generation (RAG) offering and can respond to user questions and prompts with substantive, grounded generations that contain citations to external public or private knowledge bases. To see an example of grounded generations with citations, try out the Cohere dashboard after enabling web search grounding.

The following graphic demonstrates the flow of information when using a connector:

Using Connectors to Create Grounded Generations

Connectors are specified when calling the Chat endpoint, which you can read more about here. An example request specifying the managed web-search connector would look like this:

1import cohere
2
3co = cohere.Client(api_key="Your API key")
4
5response = co.chat(
6 model="command-a-03-2025",
7 message="What is the chemical formula for glucose?",
8 connectors=[{"id": "web-search"}],
9)

If you or an administrator at your organization has created a new connector, you can add this connector id to the list. Here’s an example:

PYTHON
1connectors = [{"id": "web-search"}, {"id": "customer-connector-id"}]

The response will then contain the generated text with citation elements that link to the documents returned from the connector. For example, the formula C6H12O6 below has a citation element that links to three websites.

Example Response JSON
1{
2 "text": "The chemical formula for glucose is C6H12O6.",
3 "generation_id": "667f0844-e5c9-4108-8624-45b7687ca6f3",
4 "citations": [
5 {
6 "start": 36,
7 "end": 44,
8 "text": "C6H12O6.",
9 "document_ids": [
10 "web-search_3:0",
11 "web-search_3:4",
12 "web-search_4:0",
13 "web-search_4:1"
14 ]
15 }
16 ],
17 "documents": [
18 {
19 "id": "web-search_3:0",
20 "snippet": "Chemical Compound Formulas\n\nGlucose is a simple sugar with six carbon atoms and one aldehyde group. This monosaccharide has a chemical formula C6H12O6.\n\nIt is also known as dextrose. It is referred to as aldohexose as it contains 6 carbon atoms and an aldehyde group. It exists in two forms, open-chain or ring structure. It is synthesized in the liver and kidneys of animals. In plants, it is found in fruits and in different parts of plants. D- glucose is the naturally occurring form of glucose. It can occur either in solid or liquid form. It is water-soluble and is also soluble in acetic acid.",
21 "title": "Glucose C6H12O6 - Chemical Formula, Structure, Composition, Properties, uses and FAQs of Glucose.",
22 "url": "https://byjus.com/chemistry/glucose/"
23 },
24 {
25 "id": "web-search_3:4",
26 "snippet": "\n\nFrequently Asked Questions- FAQs\n\nHow do you represent glucose?\n\nThe chemical formula of Glucose is C6H12O6. Glucose is a monosaccharide containing an aldehyde group (-CHO). It is made of 6 carbon atoms, 12 hydrogen atoms and 6 oxygen atoms. Glucose is an aldohexose.\n\nIs glucose a reducing sugar?\n\nGlucose is a reducing sugar because it belongs to the category of an aldose meaning its open-chain form contains an aldehyde group. Generally, an aldehyde is quite easily oxidized to carboxylic acids.\n\nWhat are the 5 reducing sugars?\n\nThe 5 reducing sugars are ribose, glucose, galactose, glyceraldehyde, xylose.\n\nWhat are the elements of glucose?",
27 "title": "Glucose C6H12O6 - Chemical Formula, Structure, Composition, Properties, uses and FAQs of Glucose.",
28 "url": "https://byjus.com/chemistry/glucose/"
29 },
30 {
31 "id": "web-search_4:0",
32 "snippet": "Science, Tech, Math › Science\n\nGlucose Molecular Formula and Facts\n\nChemical or Molecular Formula for Glucose\n\nScience Photo Library - MIRIAM MASLO. / Getty Images\n\nProjects & Experiments\n\nChemistry In Everyday Life\n\nAbbreviations & Acronyms\n\nAnne Marie Helmenstine, Ph.D.\n\nAnne Marie Helmenstine, Ph.D.\n\nPh.D., Biomedical Sciences, University of Tennessee at Knoxville\n\nB.A., Physics and Mathematics, Hastings College\n\nDr. Helmenstine holds a Ph.D. in biomedical sciences and is a science writer, educator, and consultant. She has taught science courses at the high school, college, and graduate levels.\n\nLearn about our Editorial Process\n\nUpdated on November 03, 2019\n\nThe molecular formula for glucose is C6H12O6 or H-(C=O)-(CHOH)5-H. Its empirical or simplest formula is CH2O, which indicates there are two hydrogen atoms for each carbon and oxygen atom in the molecule.",
33 "title": "Know the Chemical or Molecular Formula for Glucose",
34 "url": "https://www.thoughtco.com/glucose-molecular-formula-608477"
35 },
36 ],
37 "search_results": [
38 {
39 "search_query": {
40 "text": "chemical formula for glucose",
41 "generation_id": "66e388c8-d9a8-4d43-a711-0f17c3f0f82a"
42 },
43 "document_ids": [
44 "web-search_3:0",
45 "web-search_3:4",
46 "web-search_4:0",
47 ],
48 "connector": {
49 "id": "web-search"
50 }
51 }
52 ],
53 "search_queries": [
54 {
55 "text": "chemical formula for glucose",
56 "generation_id": "66e388c8-d9a8-4d43-a711-0f17c3f0f82a"
57 }
58 ]
59}

A Caveat on Deploying Connectors

Connector registration only works natively on the Cohere platform. You can, however, register a connector for e.g. Azure or another platform using the Cohere toolkit (more technical detail is available here.) You might also find it useful to read about Cohere deployments on Amazon, Azure, and single-container cloud environments.