Need help with your APIs? I offer API discovery, governance & evangelism services. Explore services →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Agenta Evaluators API

Configure evaluators used to score variants.

Agenta Evaluators API is one of 7 APIs that Agenta publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

Tagged areas include Evaluators. The published artifact set on APIs.io includes an OpenAPI specification, API documentation, and an API reference.

This API exposes 3 operations across 3 paths, and defines 7 schemas. It is described by OpenAPI 3.0.1, at version 1.0.

Requests are made against 2 base URLs: https://cloud.agenta.ai/api, https://eu.cloud.agenta.ai/api.

3 operations 3 paths 7 schemas 1 GET2 POST

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.0.1
API Version
1.0
Base URL
https://cloud.agenta.ai/api
Authentication
HTTP Bearer
License
Terms of Service
Resource Areas
1

Authentication & Security 1

Agenta Evaluators API declares 1 security scheme for authenticating requests. It accepts HTTP bearer tokens (ApiKeyAuth). By default, every request must be authenticated.

  • ApiKeyAuth — Agenta API key sent in the Authorization header. Generate keys from the Agenta web app under Settings API keys. The value is passed as Authorization: ApiKey (B…

Paths & Operations 3

Across 3 paths, the API surfaces 3 operations — 1 GET, 2 POST. Each is listed below with its method, path, parameters, and response codes.

Evaluators 3

Configure evaluators used to score variants.

POST
/evaluators/query
List and filter evaluators.
queryEvaluators body → 200401
POST
/evaluators/
Create an evaluator.
createEvaluator body → 200401
GET
/evaluators/catalog/templates/
List the built-in evaluator catalog templates.
listEvaluatorCatalogTemplates → 200401

Schemas 7

The contract defines 7 schemas that model the data the API accepts and returns. The most detailed are Windowing (5 properties), Evaluator (5 properties), EvaluatorTemplate (4 properties), Lifecycle (4 properties). Each schema is shown below with its type and property counts.

EvaluatorCreateRequest
object
1 property 1 required
EvaluatorQueryRequest
object
2 properties
Evaluator
object
5 properties
Lifecycle
object
Audit metadata attached to most Agenta resources.
4 properties
EvaluatorTemplate
object
4 properties
Windowing
object
Cursor / time-window pagination controls.
5 properties
Error
object
1 property

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

agenta-evaluators-api-openapi.yml Raw ↑

Other APIs Agenta publishes across the network.

Agenta Applications API
Agenta Configs API
Agenta Evaluations API
Agenta OpenTelemetry API
Agenta Testsets API
Agenta Traces API