How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

ArthurAI Continuous Eval Test Runs API

The Continuous Eval Test Runs API from ArthurAI — 3 operation(s) for continuous eval test runs.

ArthurAI Continuous Eval Test Runs API is one of 98 APIs that ArthurAI publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

Tagged areas include Continuous Eval Test Runs. The published artifact set on APIs.io includes an OpenAPI specification.

This API exposes 5 operations across 3 paths, and defines 13 schemas. It is described by OpenAPI 3.2.0, at version 2.1.688.

Requests are made against a single base URL, https://platform.arthur.ai/api.

5 operations 3 paths 13 schemas 1 DELETE3 GET1 POST

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.2.0
API Version
2.1.688
Base URL
https://platform.arthur.ai/api
Authentication
HTTP Bearer
Resource Areas
1

Authentication & Security 1

ArthurAI Continuous Eval Test Runs API declares 1 security scheme for authenticating requests. It accepts HTTP bearer tokens (API_Key).

  • API_Key — Bearer token authentication with an API key

Paths & Operations 5

Across 3 paths, the API surfaces 5 operations — 1 DELETE, 3 GET, 1 POST. Each is listed below with its method, path, parameters, and response codes.

Continuous Eval Test Runs 5
POST
/api/v1/continuous_evals/{eval_id}/test_runs
Create and start a test run for a continuous eval
create_test_run_api_v1_continuous_evals__eval_id__test_runs_post 1 param body → 200422
GET
/api/v1/continuous_evals/{eval_id}/test_runs
List test runs for a continuous eval
list_test_runs_api_v1_continuous_evals__eval_id__test_runs_get 4 params → 200422
GET
/api/v1/continuous_evals/test_runs/{test_run_id}
Get a test run by id
get_test_run_api_v1_continuous_evals_test_runs__test_run_id__get 1 param → 200422
DELETE
/api/v1/continuous_evals/test_runs/{test_run_id}
Delete a test run
delete_test_run_api_v1_continuous_evals_test_runs__test_run_id__delete 1 param → 204422
GET
/api/v1/continuous_evals/test_runs/{test_run_id}/results
Get individual test case results for a test run
get_test_run_results_api_v1_continuous_evals_test_runs__test_run_id__results_get 4 params → 200422

Schemas 13

The contract defines 13 schemas that model the data the API accepts and returns. The most detailed are AgenticAnnotationResponse (15 properties), ContinuousEvalTestRunResponse (12 properties), ValidationError (5 properties), VariableTemplateValue (2 properties). Each schema is shown below with its type and property counts.

ValidationError
object
5 properties 3 required
ListAgenticAnnotationsResponse
object
2 properties 2 required
PaginationSortMethod
string
TestRunStatus
string
ListContinuousEvalTestRunsResponse
object
2 properties 2 required
CreateTestRunRequest
object
Request schema for creating a continuous eval test run
1 property 1 required
ContinuousEvalTestRunResponse
object
12 properties 12 required
AgenticAnnotationResponse
object
15 properties 5 required
EvalType
string
VariableTemplateValue
object
2 properties 2 required
HTTPValidationError
object
1 property
ContinuousEvalRunStatus
string
AgenticAnnotationType
string

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

arthurai-continuous-eval-test-runs-api-openapi.yml Raw ↑

Other APIs ArthurAI publishes across the network.

ArthurAI Agent Discovery API
ArthurAI Agentic Experiments API
ArthurAI Agentic Notebooks API
ArthurAI Agents V1 API
ArthurAI Alert Rules V1 API
ArthurAI Alerts V1 API
ArthurAI API Keys API
ArthurAI Authorization V1 API
ArthurAI Chatbot API
ArthurAI Configuration API
ArthurAI Connector Schemas V1 API
ArthurAI Connectors V1 API
Where this information came from

This is an independent, third-party profile of ArthurAI Continuous Eval Test Runs API, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.

The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.

Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.

info@apievangelist.com · Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.