Evaluations

List Production Eval Definitions

get

Authorizations

BearerAuth

AuthorizationstringRequired

API key issued via POST /v1/{workspace_id}/api-keys. Pass the returned api_key value as a Bearer token.

Path parameters

workspace_idstring · uuidRequired

Query parameters

service_idstring · uuid · nullableOptional

activeboolean · nullableOptional

limitinteger · max: 100OptionalDefault: 10

continuation_tokenintegerOptionalDefault: 0

Responses

200

Successful Response

application/json

has_morebooleanRequired

continuation_tokeninteger · nullableOptional

totalinteger · nullableOptional

422

Validation Error

application/json

get/v1/{workspace_id}/production-eval-definitions

HTTPcURLJavaScriptPython

GET /v1/{workspace_id}/production-eval-definitions HTTP/1.1
Host: api.platform.amigo.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

{
  "items": [
    {
      "id": "123e4567-e89b-12d3-a456-426614174000",
      "workspace_id": "123e4567-e89b-12d3-a456-426614174000",
      "service_id": "123e4567-e89b-12d3-a456-426614174000",
      "eval_key": "text",
      "eval_type": "assertion",
      "assertion_kind": "text",
      "metric_key": "text",
      "expected": null,
      "params": {
        "ANY_ADDITIONAL_PROPERTY": "anything"
      },
      "active": true,
      "created_at": "2026-07-10T21:49:11.459Z",
      "updated_at": "2026-07-10T21:49:11.459Z"
    }
  ],
  "has_more": true,
  "continuation_token": 1,
  "total": 1
}

Create Production Eval Definition

post

Authorizations

BearerAuth

AuthorizationstringRequired

API key issued via POST /v1/{workspace_id}/api-keys. Pass the returned api_key value as a Bearer token.

Path parameters

workspace_idstring · uuidRequired

Body

application/json

eval_keystring · min: 1 · max: 128Required

eval_typestring · enumRequiredPossible values:

service_idstring · uuid · nullableOptional

assertion_kindstring · max: 128 · nullableOptional

metric_keystring · max: 128 · nullableOptional

expectedanyOptional

activebooleanOptionalDefault: true

Responses

201

Successful Response

application/json

An eval (assertion or metric-eval) that runs against a workspace's live calls — the production analogue of a sim case's evals. service_id None applies to every service in the workspace. expected is JSON: a phrase string for assertions, or a {gte|lte|equals|...} threshold for metric-evals.

idstring · uuidOptional

workspace_idstring · uuidRequired

service_idstring · uuid · nullableOptional

eval_keystring · max: 128Required

eval_typestring · enumRequiredPossible values:

assertion_kindstring · max: 128 · nullableOptional

metric_keystring · max: 128 · nullableOptional

expectedanyOptional

activebooleanOptionalDefault: true

created_atstring · date-time · nullableOptional

updated_atstring · date-time · nullableOptional

422

Validation Error

application/json

post/v1/{workspace_id}/production-eval-definitions

HTTPcURLJavaScriptPython

POST /v1/{workspace_id}/production-eval-definitions HTTP/1.1
Host: api.platform.amigo.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Content-Type: application/json
Accept: */*
Content-Length: 217

{
  "eval_key": "text",
  "eval_type": "assertion",
  "service_id": "123e4567-e89b-12d3-a456-426614174000",
  "assertion_kind": "text",
  "metric_key": "text",
  "expected": null,
  "params": {
    "ANY_ADDITIONAL_PROPERTY": "anything"
  },
  "active": true
}

{
  "id": "123e4567-e89b-12d3-a456-426614174000",
  "workspace_id": "123e4567-e89b-12d3-a456-426614174000",
  "service_id": "123e4567-e89b-12d3-a456-426614174000",
  "eval_key": "text",
  "eval_type": "assertion",
  "assertion_kind": "text",
  "metric_key": "text",
  "expected": null,
  "params": {
    "ANY_ADDITIONAL_PROPERTY": "anything"
  },
  "active": true,
  "created_at": "2026-07-10T21:49:11.459Z",
  "updated_at": "2026-07-10T21:49:11.459Z"
}

Get Production Eval Definition

get

Authorizations

BearerAuth

AuthorizationstringRequired

API key issued via POST /v1/{workspace_id}/api-keys. Pass the returned api_key value as a Bearer token.

Path parameters

workspace_idstring · uuidRequired

definition_idstring · uuidRequired

Responses

200

Successful Response

application/json

An eval (assertion or metric-eval) that runs against a workspace's live calls — the production analogue of a sim case's evals. service_id None applies to every service in the workspace. expected is JSON: a phrase string for assertions, or a {gte|lte|equals|...} threshold for metric-evals.

idstring · uuidOptional

workspace_idstring · uuidRequired

service_idstring · uuid · nullableOptional

eval_keystring · max: 128Required

eval_typestring · enumRequiredPossible values:

assertion_kindstring · max: 128 · nullableOptional

metric_keystring · max: 128 · nullableOptional

expectedanyOptional

activebooleanOptionalDefault: true

created_atstring · date-time · nullableOptional

updated_atstring · date-time · nullableOptional

422

Validation Error

application/json

get/v1/{workspace_id}/production-eval-definitions/{definition_id}

HTTPcURLJavaScriptPython

GET /v1/{workspace_id}/production-eval-definitions/{definition_id} HTTP/1.1
Host: api.platform.amigo.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

{
  "id": "123e4567-e89b-12d3-a456-426614174000",
  "workspace_id": "123e4567-e89b-12d3-a456-426614174000",
  "service_id": "123e4567-e89b-12d3-a456-426614174000",
  "eval_key": "text",
  "eval_type": "assertion",
  "assertion_kind": "text",
  "metric_key": "text",
  "expected": null,
  "params": {
    "ANY_ADDITIONAL_PROPERTY": "anything"
  },
  "active": true,
  "created_at": "2026-07-10T21:49:11.459Z",
  "updated_at": "2026-07-10T21:49:11.459Z"
}

Delete Production Eval Definition

delete

Authorizations

BearerAuth

AuthorizationstringRequired

API key issued via POST /v1/{workspace_id}/api-keys. Pass the returned api_key value as a Bearer token.

Path parameters

workspace_idstring · uuidRequired

definition_idstring · uuidRequired

Responses

204

Successful Response

No content

422

Validation Error

application/json

delete/v1/{workspace_id}/production-eval-definitions/{definition_id}

HTTPcURLJavaScriptPython

DELETE /v1/{workspace_id}/production-eval-definitions/{definition_id} HTTP/1.1
Host: api.platform.amigo.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

No content

Update Production Eval Definition

patch

Authorizations

BearerAuth

AuthorizationstringRequired

API key issued via POST /v1/{workspace_id}/api-keys. Pass the returned api_key value as a Bearer token.

Path parameters

workspace_idstring · uuidRequired

definition_idstring · uuidRequired

Body

application/json

service_idstring · uuid · nullableOptional

eval_keystring · min: 1 · max: 128 · nullableOptional

eval_typestring · enum · nullableOptionalPossible values:

assertion_kindstring · max: 128 · nullableOptional

metric_keystring · max: 128 · nullableOptional

expectedanyOptional

activeboolean · nullableOptional

Responses

200

Successful Response

application/json

An eval (assertion or metric-eval) that runs against a workspace's live calls — the production analogue of a sim case's evals. service_id None applies to every service in the workspace. expected is JSON: a phrase string for assertions, or a {gte|lte|equals|...} threshold for metric-evals.

idstring · uuidOptional

workspace_idstring · uuidRequired

service_idstring · uuid · nullableOptional

eval_keystring · max: 128Required

eval_typestring · enumRequiredPossible values:

assertion_kindstring · max: 128 · nullableOptional

metric_keystring · max: 128 · nullableOptional

expectedanyOptional

activebooleanOptionalDefault: true

created_atstring · date-time · nullableOptional

updated_atstring · date-time · nullableOptional

422

Validation Error

application/json

patch/v1/{workspace_id}/production-eval-definitions/{definition_id}

HTTPcURLJavaScriptPython

PATCH /v1/{workspace_id}/production-eval-definitions/{definition_id} HTTP/1.1
Host: api.platform.amigo.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Content-Type: application/json
Accept: */*
Content-Length: 217

{
  "service_id": "123e4567-e89b-12d3-a456-426614174000",
  "eval_key": "text",
  "eval_type": "assertion",
  "assertion_kind": "text",
  "metric_key": "text",
  "expected": null,
  "params": {
    "ANY_ADDITIONAL_PROPERTY": "anything"
  },
  "active": true
}

{
  "id": "123e4567-e89b-12d3-a456-426614174000",
  "workspace_id": "123e4567-e89b-12d3-a456-426614174000",
  "service_id": "123e4567-e89b-12d3-a456-426614174000",
  "eval_key": "text",
  "eval_type": "assertion",
  "assertion_kind": "text",
  "metric_key": "text",
  "expected": null,
  "params": {
    "ANY_ADDITIONAL_PROPERTY": "anything"
  },
  "active": true,
  "created_at": "2026-07-10T21:49:11.459Z",
  "updated_at": "2026-07-10T21:49:11.459Z"
}

Evaluate Call

post

Run the workspace's active eval definitions against one completed call and persist the verdicts. Synchronous (the caller waits on the judge); the eager post-call trigger is a separate change.

Authorizations

BearerAuth

AuthorizationstringRequired

API key issued via POST /v1/{workspace_id}/api-keys. Pass the returned api_key value as a Bearer token.

Path parameters

workspace_idstring · uuidRequired

conversation_idstring · uuidRequired

Responses

200

Successful Response

application/json

conversation_idstring · uuidRequired

422

Validation Error

application/json

post/v1/{workspace_id}/calls/{conversation_id}/evaluate

HTTPcURLJavaScriptPython

POST /v1/{workspace_id}/calls/{conversation_id}/evaluate HTTP/1.1
Host: api.platform.amigo.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

{
  "conversation_id": "123e4567-e89b-12d3-a456-426614174000",
  "results": [
    {
      "id": "123e4567-e89b-12d3-a456-426614174000",
      "workspace_id": "123e4567-e89b-12d3-a456-426614174000",
      "service_id": "123e4567-e89b-12d3-a456-426614174000",
      "conversation_id": "123e4567-e89b-12d3-a456-426614174000",
      "call_sid": "text",
      "eval_key": "text",
      "eval_type": "assertion",
      "assertion_kind": "text",
      "metric_key": "text",
      "status": "passed",
      "passed": true,
      "score": 1,
      "expected": null,
      "actual": null,
      "rationale": "text",
      "justification": "text",
      "cited_turns": [],
      "computed_at": "2026-07-10T21:49:11.459Z",
      "created_at": "2026-07-10T21:49:11.459Z"
    }
  ]
}

Get Call Eval Results

get

Authorizations

BearerAuth

AuthorizationstringRequired

API key issued via POST /v1/{workspace_id}/api-keys. Pass the returned api_key value as a Bearer token.

Path parameters

workspace_idstring · uuidRequired

conversation_idstring · uuidRequired

Responses

200

Successful Response

application/json

conversation_idstring · uuidRequired

422

Validation Error

application/json

get/v1/{workspace_id}/calls/{conversation_id}/eval-results

HTTPcURLJavaScriptPython

GET /v1/{workspace_id}/calls/{conversation_id}/eval-results HTTP/1.1
Host: api.platform.amigo.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

{
  "conversation_id": "123e4567-e89b-12d3-a456-426614174000",
  "results": [
    {
      "id": "123e4567-e89b-12d3-a456-426614174000",
      "workspace_id": "123e4567-e89b-12d3-a456-426614174000",
      "service_id": "123e4567-e89b-12d3-a456-426614174000",
      "conversation_id": "123e4567-e89b-12d3-a456-426614174000",
      "call_sid": "text",
      "eval_key": "text",
      "eval_type": "assertion",
      "assertion_kind": "text",
      "metric_key": "text",
      "status": "passed",
      "passed": true,
      "score": 1,
      "expected": null,
      "actual": null,
      "rationale": "text",
      "justification": "text",
      "cited_turns": [],
      "computed_at": "2026-07-10T21:49:11.459Z",
      "created_at": "2026-07-10T21:49:11.459Z"
    }
  ]
}