Retrieves metrics measured during the training of a fine-tuned model.

GET

Path parameters

finetuned_model_idstringRequired

The parent fine-tuned model ID.

Headers

X-Client-NamestringOptional

The name of the project that is making the request.

Query parameters

page_sizeintegerOptional

Maximum number of results to be returned by the server. If 0, defaults to 50.

page_tokenstringOptional

Request a specific page of the list results.

Response

This endpoint returns an object.

step_metricslist of objectsOptional

The metrics for each step the evaluation was run on.

next_page_tokenstringOptional

Pagination token to retrieve the next page of results. If the value is "", it means no further results for the request.

GET

1 import cohere
2 
3 co = cohere.Client("<<apiKey>>")
4 train_step_metrics = co.finetuning.list_training_step_metrics(
5     finetuned_model_id="test-id")
6 print(train_step_metrics)

200Retrieved

1 {
2   "step_metrics": [
3     {
4       "created_at": "2024-01-17T20:24:26Z",
5       "step_number": 1,
6       "metrics": {
7         "accuracy": 0.4557601809501648,
8         "cross_entropy": 4.264331340789795,
9         "generation_accuracy": 0.4557601809501648,
10         "generation_cross_entropy": 4.264331340789795,
11         "step": 0
12       }
13     },
14     {
15       "created_at": "2024-01-17T20:25:19Z",
16       "step_number": 9,
17       "metrics": {
18         "accuracy": 0.7393720149993896,
19         "cross_entropy": 0.7702581286430359,
20         "generation_accuracy": 0.7393720149993896,
21         "generation_cross_entropy": 0.7702581286430359,
22         "step": 9
23       }
24     }
25   ],
26   "next_page_token": "next_page_token"
27 }

Release Notes

Up Next

Built with

1	import cohere
2
3	co = cohere.Client("<<apiKey>>")
4	train_step_metrics = co.finetuning.list_training_step_metrics(
5	finetuned_model_id="test-id")
6	print(train_step_metrics)

1	{
2	"step_metrics": [
3	{
4	"created_at": "2024-01-17T20:24:26Z",
5	"step_number": 1,
6	"metrics": {
7	"accuracy": 0.4557601809501648,
8	"cross_entropy": 4.264331340789795,
9	"generation_accuracy": 0.4557601809501648,
10	"generation_cross_entropy": 4.264331340789795,
11	"step": 0
12	}
13	},
14	{
15	"created_at": "2024-01-17T20:25:19Z",
16	"step_number": 9,
17	"metrics": {
18	"accuracy": 0.7393720149993896,
19	"cross_entropy": 0.7702581286430359,
20	"generation_accuracy": 0.7393720149993896,
21	"generation_cross_entropy": 0.7702581286430359,
22	"step": 9
23	}
24	}
25	],
26	"next_page_token": "next_page_token"
27	}