Braintrust

Braintrust is an AI engineering platform for managing prompts, datasets, experiments, evaluations, observability, and production AI applications.

17 actionsAPI key

What your bot can do in Braintrust

Fetch EventsFetch one newest-to-oldest page of project log, experiment, or dataset events.
Get Braintrust ResourceGet one project, experiment, dataset, prompt, or function by UUID.
List Braintrust ResourcesList and filter one page of projects, experiments, datasets, prompts, or functions visible to the connected Braintrust API key.
Query Braintrust DataRun one bounded synchronous read-only BTQL query over Braintrust project logs, an experiment, or a dataset.
Summarize Experiment or DatasetReturn metadata and optional aggregate summaries for one Braintrust experiment or dataset.

Create DatasetCreate a named dataset under a Braintrust project, or return the existing dataset unchanged when its name already exists in that project.
Create ExperimentCreate an experiment under a Braintrust project.
Create ProjectCreate a Braintrust project, or return the existing project unchanged when its name already exists.
Create PromptUpsert a versioned prompt configuration under a Braintrust project without invoking it.
Delete Experiment, Dataset, or PromptDelete one Braintrust experiment, dataset, or prompt by UUID for explicit lifecycle cleanup.
Delete ProjectSoft-delete a Braintrust project and return its deletion state.
Insert Dataset EventsUpsert a batch of examples into an existing Braintrust dataset.
Insert Experiment EventsUpsert a batch of result events into an existing Braintrust experiment.
Update DatasetUpdate the name, description, tags, or metadata of a Braintrust dataset.
Update ExperimentUpdate selected metadata and linkage fields on a Braintrust experiment.

Show 2 more

Update ProjectUpdate selected fields of a Braintrust project.
Update PromptUpdate a Braintrust prompt's metadata or configuration without invoking it.