> This page is for version v1 API. > For other versions, use one of these documentation indexes: > - v2 API (default): https://docs.cohere.com/v2/llms.txt > - v1 API: https://docs.cohere.com/v1/llms.txt > For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://docs.cohere.com/llms.txt. > For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.cohere.com/_mcp/server. # Create a Dataset POST https://api.cohere.com/v1/datasets Content-Type: multipart/form-data Create a dataset by uploading a file. See ['Dataset Creation'](https://docs.cohere.com/docs/datasets#dataset-creation) for more information. Reference: https://docs.cohere.com/reference/create-dataset ## Authentication - `Authorization` header (bearer token, required) — Bearer authentication of the form `Bearer `, where token is your auth token. ## Request ### Query parameters - `name` (string, required) — The name of the uploaded dataset. - `type` (enum, required) — The dataset type, which is used to validate the data. The only valid type is `embed-input` used in conjunction with the Embed Jobs API. - Allowed values: `embed-input`, `embed-result`, `cluster-result`, `cluster-outliers`, `reranker-finetune-input`, `single-label-classification-finetune-input`, `chat-finetune-input`, `multi-label-classification-finetune-input`, `batch-chat-input`, `batch-openai-chat-input`, `batch-embed-v2-input`, `batch-chat-v2-input` - `keep_original_file` (boolean, optional) — Indicates if the original file should be stored. - `skip_malformed_input` (boolean, optional) — Indicates whether rows with malformed input should be dropped (instead of failing the validation check). Dropped rows will be returned in the warnings field. - `keep_fields` (list of string, optional) — List of names of fields that will be persisted in the Dataset. By default the Dataset will retain only the required fields indicated in the [schema for the corresponding Dataset type](https://docs.cohere.com/docs/datasets#dataset-types). For example, datasets of type `embed-input` will drop all fields other than the required `text` field. If any of the fields in `keep_fields` are missing from the uploaded file, Dataset validation will fail. - `optional_fields` (list of string, optional) — List of names of fields that will be persisted in the Dataset. By default the Dataset will retain only the required fields indicated in the [schema for the corresponding Dataset type](https://docs.cohere.com/docs/datasets#dataset-types). For example, Datasets of type `embed-input` will drop all fields other than the required `text` field. If any of the fields in `optional_fields` are missing from the uploaded file, Dataset validation will pass. - `text_separator` (string, optional) — Raw .txt uploads will be split into entries using the text_separator value. - `csv_delimiter` (string, optional) — The delimiter used for .csv uploads. ### Headers - `X-Client-Name` (string, optional) — The name of the project that is making the request. ### Body (multipart/form-data) This endpoint expects a multipart form with multiple files. - `data` (file, required) — The file to upload - `eval_data` (file, optional) — An optional evaluation file to upload ## Response ### 200 A successful response. - `id` (string, optional) — The dataset ID ## Errors ### 400 Bad Request Error This error is returned when the request is not well formed. This could be because: - JSON is invalid - The request is missing required fields - The request contains an invalid combination of fields - `message` (string, optional) - `id` (string, optional) ### 401 Unauthorized Error This error indicates that the operation attempted to be performed is not allowed. This could be because: - The api token is invalid - The user does not have the necessary permissions - `message` (string, optional) - `id` (string, optional) ### 403 Forbidden Error This error indicates that the operation attempted to be performed is not allowed. This could be because: - The api token is invalid - The user does not have the necessary permissions - `message` (string, optional) - `id` (string, optional) ### 404 Not Found Error This error is returned when a resource is not found. This could be because: - The endpoint does not exist - The resource does not exist eg model id, dataset id - `message` (string, optional) - `id` (string, optional) ### 422 Unprocessable Entity Error This error is returned when the request is not well formed. This could be because: - JSON is invalid - The request is missing required fields - The request contains an invalid combination of fields - `message` (string, optional) - `id` (string, optional) ### 429 Too Many Requests Error Too many requests - `message` (string, optional) - `id` (string, optional) ### 498 Invalid Token Error This error is returned when a request or response contains a deny-listed token. - `message` (string, optional) - `id` (string, optional) ### 499 Client Closed Request Error This error is returned when a request is cancelled by the user. - `message` (string, optional) - `id` (string, optional) ### 500 Internal Server Error This error is returned when an uncategorised internal server error occurs. - `message` (string, optional) - `id` (string, optional) ### 501 Not Implemented Error This error is returned when the requested feature is not implemented. - `message` (string, optional) - `id` (string, optional) ### 503 Service Unavailable Error This error is returned when the service is unavailable. This could be due to: - Too many users trying to access the service at the same time - `message` (string, optional) - `id` (string, optional) ### 504 Gateway Timeout Error This error is returned when a request to the server times out. This could be due to: - An internal services taking too long to respond - `message` (string, optional) - `id` (string, optional) ## Examples **Request** ```json { "data": "", "eval_data": "" } ``` **Response** ```json { "id": "ds_123e4567-e89b-12d3-a456-426614174000" } ``` **SDK Code** ```go Cohere Go SDK package main import ( "context" "io" "log" "os" "strings" cohere "github.com/cohere-ai/cohere-go/v2" client "github.com/cohere-ai/cohere-go/v2/client" ) type MyReader struct { io.Reader name string } func (m *MyReader) Name() string { return m.name } func main() { co := client.NewClient(client.WithToken(os.Getenv("CO_API_KEY"))) resp, err := co.Datasets.Create( context.TODO(), &cohere.DatasetsCreateRequest{ Name: "embed-dataset", Type: cohere.DatasetTypeEmbedInput, Data: &MyReader{Reader: strings.NewReader(`{"text": "The quick brown fox jumps over the lazy dog"}`), name: "test.jsonl"}, EvalData: &MyReader{Reader: strings.NewReader(""), name: "a.jsonl"}, }, ) if err != nil { log.Fatal(err) } log.Printf("%+v", resp) } ``` ```python Sync import cohere co = cohere.Client() # upload a dataset my_dataset = co.datasets.create( name="embed-dataset", data=open("./embed.jsonl", "rb"), type="embed-input", ) # wait for validation to complete response = co.wait(my_dataset) print(response) ``` ```python Async import cohere import asyncio co = cohere.AsyncClient() async def main(): # upload a dataset response = await co.datasets.create( name="embed-dataset", data=open("./embed.jsonl", "rb"), type="embed-input", ) # wait for validation to complete response = await co.wait(response) print(response) asyncio.run(main()) ``` ```java Cohere java SDK /* (C)2024 */ import com.cohere.api.Cohere; import com.cohere.api.resources.datasets.requests.DatasetsCreateRequest; import com.cohere.api.resources.datasets.types.DatasetsCreateResponse; import com.cohere.api.types.DatasetType; import java.util.Optional; public class DatasetPost { public static void main(String[] args) { Cohere cohere = Cohere.builder().clientName("snippet").build(); DatasetsCreateResponse response = cohere .datasets() .create( null, Optional.empty(), DatasetsCreateRequest.builder() .name("embed-dataset") .type(DatasetType.EMBED_INPUT) .build()); System.out.println(response); } } ``` ```typescript Cohere TypeScript SDK import { CohereClient } from 'cohere-ai'; const fs = require('fs'); const cohere = new CohereClient({}); (async () => { const file = fs.createReadStream('embed_jobs_sample_data.jsonl'); // {"text": "The quick brown fox jumps over the lazy dog"} const dataset = await cohere.datasets.create({ name: 'my-dataset', type: 'embed-input' }, file); console.log(dataset); })(); ``` ```ruby require 'uri' require 'net/http' url = URI("https://api.cohere.com/v1/datasets?name=name&type=embed-input") http = Net::HTTP.new(url.host, url.port) http.use_ssl = true request = Net::HTTP::Post.new(url) request["X-Client-Name"] = 'my-cool-project' request["Authorization"] = 'Bearer ' request["Content-Type"] = 'multipart/form-data; boundary=---011000010111000001101001' request.body = "-----011000010111000001101001\r\nContent-Disposition: form-data; name=\"data\"; filename=\"embed_dataset.jsonl\"\r\nContent-Type: application/octet-stream\r\n\r\n\r\n-----011000010111000001101001\r\nContent-Disposition: form-data; name=\"eval_data\"; filename=\"eval_dataset.jsonl\"\r\nContent-Type: application/octet-stream\r\n\r\n\r\n-----011000010111000001101001--\r\n" response = http.request(request) puts response.read_body ``` ```php request('POST', 'https://api.cohere.com/v1/datasets?name=name&type=embed-input', [ 'multipart' => [ [ 'name' => 'data', 'filename' => 'embed_dataset.jsonl', 'contents' => null ], [ 'name' => 'eval_data', 'filename' => 'eval_dataset.jsonl', 'contents' => null ] ] 'headers' => [ 'Authorization' => 'Bearer ', 'X-Client-Name' => 'my-cool-project', ], ]); echo $response->getBody(); ``` ```csharp using RestSharp; var client = new RestClient("https://api.cohere.com/v1/datasets?name=name&type=embed-input"); var request = new RestRequest(Method.POST); request.AddHeader("X-Client-Name", "my-cool-project"); request.AddHeader("Authorization", "Bearer "); request.AddParameter("multipart/form-data; boundary=---011000010111000001101001", "-----011000010111000001101001\r\nContent-Disposition: form-data; name=\"data\"; filename=\"embed_dataset.jsonl\"\r\nContent-Type: application/octet-stream\r\n\r\n\r\n-----011000010111000001101001\r\nContent-Disposition: form-data; name=\"eval_data\"; filename=\"eval_dataset.jsonl\"\r\nContent-Type: application/octet-stream\r\n\r\n\r\n-----011000010111000001101001--\r\n", ParameterType.RequestBody); IRestResponse response = client.Execute(request); ``` ```swift import Foundation let headers = [ "X-Client-Name": "my-cool-project", "Authorization": "Bearer ", "Content-Type": "multipart/form-data; boundary=---011000010111000001101001" ] let parameters = [ [ "name": "data", "fileName": "embed_dataset.jsonl" ], [ "name": "eval_data", "fileName": "eval_dataset.jsonl" ] ] let boundary = "---011000010111000001101001" var body = "" var error: NSError? = nil for param in parameters { let paramName = param["name"]! body += "--\(boundary)\r\n" body += "Content-Disposition:form-data; name=\"\(paramName)\"" if let filename = param["fileName"] { let contentType = param["content-type"]! let fileContent = String(contentsOfFile: filename, encoding: String.Encoding.utf8) if (error != nil) { print(error as Any) } body += "; filename=\"\(filename)\"\r\n" body += "Content-Type: \(contentType)\r\n\r\n" body += fileContent } else if let paramValue = param["value"] { body += "\r\n\r\n\(paramValue)" } } let request = NSMutableURLRequest(url: NSURL(string: "https://api.cohere.com/v1/datasets?name=name&type=embed-input")! as URL, cachePolicy: .useProtocolCachePolicy, timeoutInterval: 10.0) request.httpMethod = "POST" request.allHTTPHeaderFields = headers request.httpBody = postData as Data let session = URLSession.shared let dataTask = session.dataTask(with: request as URLRequest, completionHandler: { (data, response, error) -> Void in if (error != nil) { print(error as Any) } else { let httpResponse = response as? HTTPURLResponse print(httpResponse) } }) dataTask.resume() ```