How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

ArthurAI Continuous Evals API

The Continuous Evals API from ArthurAI — 6 operation(s) for continuous evals.

ArthurAI Continuous Evals API is one of 98 APIs that ArthurAI publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

Tagged areas include Continuous Evals. The published artifact set on APIs.io includes an OpenAPI specification.

This API exposes 9 operations across 6 paths, and defines 19 schemas. It is described by OpenAPI 3.2.0, at version 2.1.688.

Requests are made against a single base URL, https://platform.arthur.ai/api.

9 operations 6 paths 19 schemas 1 DELETE5 GET1 PATCH2 POST

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.2.0
API Version
2.1.688
Base URL
https://platform.arthur.ai/api
Authentication
HTTP Bearer
Resource Areas
1

Authentication & Security 1

ArthurAI Continuous Evals API declares 1 security scheme for authenticating requests. It accepts HTTP bearer tokens (API_Key).

  • API_Key — Bearer token authentication with an API key

Paths & Operations 9

Across 6 paths, the API surfaces 9 operations — 1 DELETE, 5 GET, 1 PATCH, 2 POST. Each is listed below with its method, path, parameters, and response codes.

Continuous Evals 9
GET
/api/v1/continuous_evals/{eval_id}
Get a continuous eval by id
get_continuous_eval_by_id_api_v1_continuous_evals__eval_id__get 1 param → 200422
PATCH
/api/v1/continuous_evals/{eval_id}
Update a continuous eval
update_continuous_eval_api_v1_continuous_evals__eval_id__patch 1 param body → 200422
DELETE
/api/v1/continuous_evals/{eval_id}
Delete a continuous eval
delete_continuous_eval_api_v1_continuous_evals__eval_id__delete 1 param → 204422
GET
/api/v1/tasks/{task_id}/continuous_evals
Get all continuous evals for a specific task
list_continuous_evals_api_v1_tasks__task_id__continuous_evals_get 12 params → 200422
POST
/api/v1/tasks/{task_id}/continuous_evals
Create a continuous eval
create_continuous_eval_api_v1_tasks__task_id__continuous_evals_post 1 param body → 200422
GET
/api/v1/tasks/{task_id}/continuous_evals/results
Get all continuous eval run results for a specific task
list_continuous_eval_run_results_api_v1_tasks__task_id__continuous_evals_results_get 13 params → 200422
GET
/api/v1/tasks/{task_id}/continuous_evals/transforms/{transform_id}/llm_evals/{eval_name}/versions/{eval_version}/variables
Get all variables and mappings for a continuous eval
get_continuous_eval_variables_and_mappings_api_v1_tasks__task_id__continuous_evals_transforms__transform_id__llm_evals__eval_name__versions__eval_version__variables_get 4 params → 200422
POST
/api/v1/continuous_evals/results/{run_id}/rerun
Rerun a failed continuous eval
rerun_continuous_eval_api_v1_continuous_evals_results__run_id__rerun_post 1 param → 200422
GET
/api/v1/tasks/{task_id}/continuous_evals/analytics/daily
Get daily aggregated analytics for agentic annotations
get_daily_annotation_analytics_api_v1_tasks__task_id__continuous_evals_analytics_daily_get 3 params → 200422

Schemas 19

The contract defines 19 schemas that model the data the API accepts and returns. The most detailed are AgenticAnnotationResponse (15 properties), ContinuousEvalResponse (13 properties), ContinuousEvalCreateRequest (9 properties), UpdateContinuousEvalRequest (8 properties). Each schema is shown below with its type and property counts.

ListContinuousEvalsResponse
object
2 properties 2 required
ContinuousEvalCreateRequest
object
Request schema for creating a continuous eval
9 properties 4 required
AgenticAnnotationAnalyticsResponse
object
Response containing daily aggregated statistics.
2 properties 2 required
AgenticAnnotationType
string
ListAgenticAnnotationsResponse
object
2 properties 2 required
PaginationSortMethod
string
VariableTemplateValue
object
2 properties 2 required
ContinuousEvalResponse
object
13 properties 6 required
ValidationError
object
5 properties 3 required
AgenticAnnotationResponse
object
15 properties 5 required
HTTPValidationError
object
1 property
ContinuousEvalRunStatus
string
ContinuousEvalTransformVariableMappingRequest
object
2 properties 2 required
ContinuousEvalTransformVariableMappingResponse
object
2 properties 2 required
ContinuousEvalVariableMappingResponse
object
3 properties 3 required
ContinuousEvalRerunResponse
object
2 properties 2 required
UpdateContinuousEvalRequest
object
Request schema for creating a continuous eval
8 properties
DailyAgenticAnnotationStats
object
Statistics for a single day of agentic annotations.
7 properties 7 required
EvalType
string

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

arthurai-continuous-evals-api-openapi.yml Raw ↑

Other APIs ArthurAI publishes across the network.

ArthurAI Agent Discovery API
ArthurAI Agentic Experiments API
ArthurAI Agentic Notebooks API
ArthurAI Agents V1 API
ArthurAI Alert Rules V1 API
ArthurAI Alerts V1 API
ArthurAI API Keys API
ArthurAI Authorization V1 API
ArthurAI Chatbot API
ArthurAI Configuration API
ArthurAI Connector Schemas V1 API
ArthurAI Connectors V1 API
Where this information came from

This is an independent, third-party profile of ArthurAI Continuous Evals API, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.

The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.

Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.

info@apievangelist.com · Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.