List Datasets | Cohere

import cohere
co = cohere.Client()
# get list of datasets
response = co.datasets.list()
print(response)

{
  "datasets": [
    {
      "id": "dset-9f8b7c6a5e4d3f21",
      "name": "Customer Support Chat Logs",
      "created_at": "2024-01-15T09:30:00Z",
      "updated_at": "2024-04-10T12:45:00Z",
      "dataset_type": "chat-finetune-input",
      "validation_status": "validated",
      "validation_error": "",
      "schema": "{\"type\":\"record\",\"name\":\"ChatExample\",\"fields\":[{\"name\":\"prompt\",\"type\":\"string\"},{\"name\":\"response\",\"type\":\"string\"}]}",
      "required_fields": [
        "prompt",
        "response"
      ],
      "preserve_fields": [
        "metadata",
        "timestamp"
      ],
      "dataset_parts": [
        {
          "id": "part-001",
          "name": "chat_logs_part1.csv",
          "url": "https://storage.cohere.com/datasets/dset-9f8b7c6a5e4d3f21/part1.csv",
          "index": 0,
          "size_bytes": 2048576,
          "num_rows": 50000,
          "original_url": "https://originalsource.com/chat_logs_part1.csv",
          "samples": [
            "How can I reset my password?,To reset your password, click on 'Forgot Password' at login.",
            "What are your support hours?,Our support team is available 24/7."
          ]
        }
      ],
      "validation_warnings": [
        "Some entries missing optional metadata fields"
      ],
      "parse_info": {},
      "metrics": {
        "finetune_dataset_metrics": {
          "trainable_token_count": 1250000,
          "total_examples": 50000,
          "train_examples": 40000,
          "train_size_bytes": 1638400,
          "eval_examples": 10000,
          "eval_size_bytes": 409600,
          "reranker_data_metrics": {
            "num_train_queries": 0,
            "num_train_relevant_passages": 0,
            "num_train_hard_negatives": 0,
            "num_eval_queries": 0,
            "num_eval_relevant_passages": 0,
            "num_eval_hard_negatives": 0
          },
          "chat_data_metrics": {
            "num_train_turns": 120000,
            "num_eval_turns": 30000,
            "preamble": "Customer support chat logs for fine-tuning conversational AI."
          },
          "classify_data_metrics": {
            "label_metrics": [
              {
                "total_examples": 25000,
                "label": "billing",
                "samples": [
                  "I was charged twice for my subscription.",
                  "How do I update my billing information?"
                ]
              },
              {
                "total_examples": 25000,
                "label": "technical_support",
                "samples": [
                  "My app crashes when I open it.",
                  "How do I reset my device?"
                ]
              }
            ]
          }
        }
      }
    }
  ]
}

List datasets that have been created.

Authentication

AuthorizationBearer

Bearer authentication of the form Bearer <token>, where token is your auth token.

Query parameters

datasetTypestringOptional

optional filter by dataset type

beforestringOptionalformat: "date-time"

optional filter before a date

afterstringOptionalformat: "date-time"

optional filter after a date

limitdoubleOptional

optional limit to number of results

offsetdoubleOptional

optional offset to start of results

validationStatusenumOptional

optional filter by validation status

Response

A successful response.

datasetslist of objects

Errors

400

Bad Request Error

401

Unauthorized Error

403

Forbidden Error

404

Not Found Error

422

Unprocessable Entity Error

429

Too Many Requests Error

498

Invalid Token Error

499

Client Closed Request Error

500

Internal Server Error

501

Not Implemented Error

503

Service Unavailable Error

504

Gateway Timeout Error

Authentication

Headers

Query parameters

Response

Errors