Skip to content
PensievePensievePensieve

List an experiment's runs

GET
/v1/experiments/{experiment_id}/runs
curl --request GET \
  --url https://api.pensievelabs.co/v1/experiments/exp_0420/runs \
  --header 'Authorization: Bearer <token>'

Its prep step, A and B on every seed, and the last check, with each run’s progress and score.

Authorizations

Section titled “Authorizations”

Parameters

Section titled “Parameters”

Path Parameters

Section titled “Path Parameters”
experiment_id
required
string

Example 

exp_0420

Responses

Section titled “Responses”

200

Section titled “200”

The runs, in order.

Media typeapplication/json
object
object
required
Allowed value: list
has_more
required
boolean
next_cursor
required
string | null
data
required
Array<object>

One step of an experiment. B’s data is built once (prep), A and B are each trained on every seed (train), and a change that held on every seed gets a last check on cases neither has seen (check).

object
id
required
string
object
required
Allowed value: experiment_run
experiment
required
string
kind
required
string
Allowed values: prep train check
arm
required

A, the current recipe, or B, the change; null for prep and the check.

string | null
Allowed values: A B
seed
required
integer | null
label
required
string
steps_done
required

Training steps done, for a training run.

integer | null
steps_total
required
integer | null
score
required

The run’s score on your test, 0 to 1, once it is done.

number | null
lead_points
required

For the check: B’s lead over A on cases neither has seen.

number | null
gpu_hours
required
number
status
required
string
Allowed values: queued running done skipped

Example 

{
  "object": "list",
  "data": [
    {
      "id": "run_0420_b1",
      "object": "experiment_run",
      "experiment": "exp_0420",
      "kind": "prep",
      "arm": "A",
      "status": "queued"
    }
  ]
}

default

Section titled “default”

Something went wrong; error.type says what.

Media typeapplication/json
object
error
required
object
type
required
string
Allowed values: invalid_request authentication permission not_found conflict rate_limit not_available server
message
required
string
param

The request field the error is about.

string | null
request_id
required
string

Example 

{
  "error": {
    "type": "invalid_request"
  }
}