The model's test and every score on it

GET

/v1/models/{model}/test

const url = 'https://api.pensievelabs.co/v1/models/grade-audit/test';
const options = {method: 'GET', headers: {Authorization: 'Bearer <token>'}};

try {
  const response = await fetch(url, options);
  const data = await response.json();
  console.log(data);
} catch (error) {
  console.error(error);
}

curl --request GET \
  --url https://api.pensievelabs.co/v1/models/grade-audit/test \
  --header 'Authorization: Bearer <token>'

Authorizations

bearer

Parameters

Path Parameters

model

required

string

The model’s slug, such as grade-audit, or its mdl_ id.

Example

grade-audit

Responses

200

The test.

application/json

object

object

required

Allowed value: test

model

required

string

metric

required

string

cases

required

Held-out cases; no model ever trains on them.

integer

scores

required

Array<object>

object

subject

required

A version such as v7, or a frontier or general model’s name.

string

kind

required

string

Allowed values: version frontier general

score

required

On the test’s metric, 0 to 1.

number

scored_at

required

string format: date-time

updated_at

required

string format: date-time

Example

{
  "object": "test",
  "scores": [
    {
      "kind": "version"
    }
  ]
}

default

Something went wrong; error.type says what.

application/json

object

error

required

object

type

required

string

Allowed values: invalid_request authentication permission not_found conflict rate_limit not_available server

message

required

string

param

The request field the error is about.

string | null

request_id

required

string

Example

{
  "error": {
    "type": "invalid_request"
  }
}