> ## Documentation Index
> Fetch the complete documentation index at: https://docs.hymalaia.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Braintrust

> Index prompts, datasets and experiments from Braintrust

The Braintrust connector indexes the prompts, datasets and experiments of your Braintrust organization,
so an evaluation result can be found from Hymalaia search.

## How it works

| Content | Behavior |
| - | - |
| Prompts | One document per prompt, named `Prompt: <name>`. |
| Datasets | One document per dataset, named `Dataset: <name>`, holding its rows as a table. |
| Experiments | One document per experiment, named `Experiment: <name>`. The summary is always indexed; the per-row results depend on the lookback below. |
| Permissions | Not available. **Auto Sync Permissions** is not offered for Braintrust, so the access type can only be **Public** or **Private**. |

Hymalaia indexes prompts first, then datasets, then experiments,
and keeps its place between runs so a large organization is indexed across several attempts.

A dataset or experiment table is truncated to its **10,000 most recent rows**. When that happens,
Hymalaia adds a line to the document saying the table was truncated, so the limit is visible in search rather than silent.

## Before you begin

You need:

* A Braintrust account with access to the organization you want to index
* A Braintrust API key
* An Hymalaia administrator account

> [!NOTE]
>
> The connector reads the Braintrust API at `https://api.braintrust.dev` and indexes only what the API key can read.

## Configure Hymalaia

**1. Open the Braintrust connector**

In Hymalaia, go to **Admin Panel → Add Connector** and select **Braintrust**.

**2. Create a credential**

Paste the key into **Braintrust API Key**.

![Create a Braintrust credential with a name and the Braintrust API key](https://mintcdn.com/hymalaia/8ykKHOjeXvJ7RJZr/images/connectors/braintrust/BraintrustCredential.png?fit=max\&auto=format\&n=8ykKHOjeXvJ7RJZr\&q=85\&s=49305b7f11255f5eb153dac4e649b55b)

**3. Choose the scope**

Give the connector a name. In **Project Name**, enter a single Braintrust project to index only its prompts,
datasets and experiments. Leave it empty to index the whole organization.

Hymalaia checks the name when you save the connector and refuses a project it cannot find.

**4. Choose the access type**

**Public** makes all indexed Braintrust content visible to every Hymalaia user.
**Private** limits the connector to selected Hymalaia user groups, and is a paid feature, available in the Enterprise Edition.

**5. Connect and verify**

Select **Create Connector**. Then open **Admin Panel → Existing Connectors**, select the connector,
and confirm its first indexing attempt completes.

### Advanced settings

| Setting | Default | Purpose |
| - | - | - |
| Experiment Row Lookback (days) | 30 | Index the per-row results only of experiments created within this many days. Experiment summaries are always indexed. Set it to `0` to index the rows of every experiment. |

Raise the lookback, or set it to `0`, when you need to search the rows of older experiments.
Both make each indexing run read more from Braintrust.

## Limits

| Limit | Value | Notes |
| - | - | - |
| Rows per table | 10,000 | The most recent rows are kept and the document says it was truncated. |
| Braintrust API call | 60s | |
| Retries per request | 5 | |
| Request rate | 4 per second | Hymalaia throttles itself to stay within the Braintrust API's limits. |

The connector downloads no files, so it has no file-size cap.

## Troubleshooting

> **The API key is rejected**
>
> `Braintrust API rejected the API key` with HTTP 401 or 403 means the key is wrong, revoked,
> or belongs to an organization you did not intend. Create a new key in Braintrust and update the Hymalaia credential.

> **The project is not found**
>
> `Braintrust project '<name>' was not found` means **Project Name** does not match a project the key can read.
> The name must match exactly. Leave the field empty to index the whole organization.

> **Braintrust cannot be reached**
>
> `Failed to reach the Braintrust API` means the request did not complete.
> Check that the Hymalaia server can reach `https://api.braintrust.dev`, then retry.

> **Experiment rows are missing**
>
> Only experiments created within **Experiment Row Lookback (days)** have their rows indexed;
> older experiments keep their summary only. Raise the lookback, or set it to `0`, then re-index.

> **A large table is incomplete**
>
> A table stops at its 10,000 most recent rows, and the document says so. This limit is not configurable.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.