How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Need help?

Contact us
Altimate AI

Altimate AI EVALS API

The EVALS API from Altimate AI — 18 operation(s) for evals.

Documentation Provider Profile APIs.io OpenAPI GitHub

Altimate AI EVALS API is one of 123 APIs that Altimate AI publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

Tagged areas include Evals. The published artifact set on APIs.io includes an OpenAPI specification, API documentation, and an API reference.

This API exposes 23 operations across 18 paths, and defines 27 schemas. It is described by OpenAPI 3.2.0, at version 0.1.0.

Requests are made against a single base URL, https://api.myaltimate.com.

23 operations 18 paths 27 schemas 3 DELETE12 GET8 POST

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.2.0
API Version
0.1.0
Base URL
https://api.myaltimate.com
Authentication
HTTP Bearer
Resource Areas
1

Authentication & Security 1

Altimate AI EVALS API declares 1 security scheme for authenticating requests. It accepts HTTP bearer tokens (HTTPBearer).

Paths & Operations 23

Across 18 paths, the API surfaces 23 operations — 3 DELETE, 12 GET, 8 POST. Each is listed below with its method, path, parameters, and response codes.

EVALS 23
GET
/evals/test-cases
List Test Cases
list_test_cases_evals_test_cases_get → 200
POST
/evals/test-casesdeprecated
Create Test Case
create_test_case_evals_test_cases_post body → 200422
GET
/evals/test-cases/{test_case_id}deprecated
Get Test Case
get_test_case_evals_test_cases__test_case_id__get 1 param → 200422
DELETE
/evals/test-cases/{test_case_id}deprecated
Delete Test Case
delete_test_case_evals_test_cases__test_case_id__delete 1 param → 200422
POST
/evals/test-cases/{test_case_id}/updatedeprecated
Update Test Case
update_test_case_evals_test_cases__test_case_id__update_post 1 param body → 200422
POST
/evals/run
Run Eval
run_eval_evals_run_post 1 param body → 200422
POST
/evals/batch-rundeprecated
Batch Run Eval
batch_run_eval_evals_batch_run_post 1 param body → 200422
GET
/evals/results
List Results
list_results_evals_results_get 3 params → 200422
GET
/evals/results/{result_id}
Get Result
get_result_evals_results__result_id__get 1 param → 200422
DELETE
/evals/results/{result_id}deprecated
Delete Result
delete_result_evals_results__result_id__delete 1 param → 200422
GET
/evals/criterions
List Criterions
list_criterions_evals_criterions_get → 200
POST
/evals/criterionsdeprecated
Create Criterion
create_criterion_evals_criterions_post body → 200422
GET
/evals/criterions/{criterion_id}deprecated
Get Criterion
get_criterion_evals_criterions__criterion_id__get 1 param → 200422
DELETE
/evals/criterions/{criterion_id}deprecated
Delete Criterion
delete_criterion_evals_criterions__criterion_id__delete 1 param → 200422
POST
/evals/criterions/{criterion_id}/updatedeprecated
Update Criterion
update_criterion_evals_criterions__criterion_id__update_post 1 param body → 200422
GET
/evals/agents
Get Playground Agents
get_playground_agents_evals_agents_get → 200
GET
/evals/agents/{agent_name}
Get Playground Agent Details
get_playground_agent_details_evals_agents__agent_name__get 2 params → 200422
POST
/evals/agents/{agent_name}/update
Update Playground Agent
update_playground_agent_evals_agents__agent_name__update_post 1 param body → 200422
GET
/evals/agents/{agent_name}/versionsdeprecated
Get Agent Versions
get_agent_versions_evals_agents__agent_name__versions_get 1 param → 200422
GET
/evals/agents/{agent_name}/versions/{version}deprecated
Get Agent Version
get_agent_version_evals_agents__agent_name__versions__version__get 2 params → 200422
GET
/evals/models
Get Available Models
get_available_models_evals_models_get → 200
POST
/evals/evaluatedeprecated
Run Batch Evaluation
run_batch_evaluation_evals_evaluate_post 1 param body → 200422
GET
/evals/jobs/{job_id}/statusdeprecated
Get Job Status
get_job_status_evals_jobs__job_id__status_get 1 param → 200422

Schemas 27

The contract defines 27 schemas that model the data the API accepts and returns. The most detailed are EvalResultResponse (15 properties), TestCaseResponse (13 properties), EvaluationJobStatus (9 properties), PlaygroundAgentInfo (9 properties). Each schema is shown below with its type and property counts.

BatchRunResponse
object
5 properties 4 required
BatchEvaluationRequest
object
Request for running evaluations across agents, test cases, and criteria This request contains agent and criteria data, with test case IDs for reference. - Agen…
7 properties 3 required
EvalResultResponse
object
15 properties 5 required
TestTurn
object
2 properties 2 required
PlaygroundAgentsResponse
object
Response for GET /evals/agents endpoint
2 properties 2 required
TestCaseStatus
object
Status of a single test case in an evaluation job
5 properties 3 required
HTTPValidationError
object
1 property
CriterionResponse
object
8 properties 5 required
EvaluationJobStatus
object
Current status of an evaluation job
9 properties 9 required
CustomAgent
object
3 properties 3 required
CriterionCreate
object
3 properties 2 required
PlaygroundAgentInfo
object
Response for GET /evals/agents/{agentname} endpoint
9 properties 8 required
EvaluationJobResponse
object
Response for batch evaluation submission
7 properties 6 required
PaginatedEvalResultsResponse
object
Paginated response for eval results.
7 properties 7 required
ValidationError
object
3 properties 3 required
TestCaseResponse
object
13 properties 6 required
AgentContextOverride
object
Per-agent context override for specific agents
3 properties 1 required
BatchRunEvalRequest
object
3 properties 1 required
UpdateAgentConfigRequest
object
Request for POST /evals/agents/{agentname}/update endpoint
3 properties 3 required
GlobalContext
object
Global context applied to all agents in evaluation
2 properties
app__schemas__evals__AgentConfig
object
Agent configuration for evaluation - can be local or backend agent
6 properties 5 required
AgentVersionsResponse
object
Response for GET /evals/agents/{agentname}/versions endpoint
3 properties 3 required
PlaygroundAgentDetails
object
Details of a playground agent from Langfuse
7 properties 7 required
TestCaseCreate
object
9 properties 2 required
RunEvalRequest
object
2 properties 1 required
AgentVersionInfo
object
Version information for an agent
6 properties 6 required
TurnResult
object
6 properties 5 required

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

altimate-ai-evals-api-openapi.yml Raw ↑

Other APIs Altimate AI publishes across the network.

Altimate AI ACCOUNT_COSTS API
AE Profile APIs.io
Altimate AI ade-bench API
AE Profile APIs.io
Altimate AI AGENTS API
AE Profile APIs.io
Altimate AI AI_PLAYGROUND API
AE Profile APIs.io
Altimate AI AI_SERVICES API
AE Profile APIs.io
Altimate AI AI_STUDIO API
AE Profile APIs.io
Altimate AI ALERTS_V1 API
AE Profile APIs.io
Altimate AI AUDIT_TRAIL API
AE Profile APIs.io
Altimate AI AUTH API
AE Profile APIs.io
Altimate AI Auth Health API
AE Profile APIs.io
Altimate AI AZURE_DATABRICKS_CONNECTIONS API
AE Profile APIs.io
Altimate AI Business Intelligence API
AE Profile APIs.io
#Evals
← Back to A APIs
API Details
ID
altimate-ai:altimate-ai-evals-api
Base URL
https://api.myaltimate.com
Docs
https://help.altimate.ai/
Provider
Altimate AI
APIs.io →  GitHub →
Explore more
All APIs Providers APIs.io Network
Work with this as data

Every API here is available over the API and to AI agents over MCP. APIs is not yet its own endpoint on the v1 API. Reach this content through network search and the tag graph, or the MCP server below.

Installs https://mcp.apievangelist.com/mcp in Claude, Cursor, VS Code and the rest — one button, every client.

MCP tools for apis
4 tools reach this content
  • search_api_evangelistSearch every content type across the network at once.
  • find_relatedThe shared-tag relevance graph — what else covers this.
  • get_tagEverything one tag labels, across all content types.
  • guide_topicPRO — a curated bundle for a topic: area, guidance, rules, papers, stories, services.
All tools & prompts
Call it yourself
curl for this page
Search the network for this 
curl "https://api.apievangelist.com/v1/search?q=altimate-ai-evals-api&limit=10"
Everything under a tag 
curl "https://api.apievangelist.com/v1/tags/altimate-ai-evals-api"

Discovery needs no key. Full bodies and the synthesis endpoints are Pro.

Get an API key

Free tier, no email required. Sign in with whichever identity you already have.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have. Your account

Where this information came from

This is an independent, third-party profile of Altimate AI EVALS API, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.

The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.

Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.

info@apievangelist.com · Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.