> ## Documentation Index
> Fetch the complete documentation index at: https://docs.mithunai.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Keep an eval set

> Keep up to 200 eval cases under a name for an assistant, so the same questions can be run again.

Keeps a set of eval cases under a name for one assistant. See [Answer quality evals](https://docs.mithunai.com/assistants/answer-quality.md) for what a case checks. Requires the owner, admin or editor role.

> [!NOTE]
>
> Off by default. These routes answer `404` unless the deployment has switched on
> `ARUKZ_EVAL_HISTORY`. See [Answer quality
> evals](https://docs.mithunai.com/assistants/answer-quality.md#kept-sets-and-runs-beta).

**assistant\_id** `string` *required*

The assistant the set tests (UUID). Another organization's assistant returns `404`.

**name** `string` *required*

The set's name, at most 120 characters.

**cases** `object[]` *required*

One to 200 cases.

**case**

**question** `string` *required*

A question someone would ask, at most 500 characters.

**expected\_facts** `string[]`

Up to 10 phrases a right answer states.

**expected\_sources** `string[]`

Up to 5 strings found in the title or address of a source it should cite.

**should\_abstain** `boolean` (default: false)

`true` when the right answer is to decline.

## Response

`201` with the kept set.

**id** `string` *required*

The set.

**assistant\_id** `string` *required*

The assistant it tests (UUID).

**name** `string` *required*

Its name.

**cases** `object[]` *required*

The cases, as sent.

**created\_by** `string` *required*

Who kept it.

**created\_at** `string` *required*

When, RFC 3339.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.