How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Need help?

Contact us
ArthurAI

ArthurAI LLMEvals API

The LLMEvals API from ArthurAI — 8 operation(s) for llmevals.

Documentation Provider Profile APIs.io OpenAPI GitHub

ArthurAI LLMEvals API is one of 98 APIs that ArthurAI publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

Tagged areas include LLMEvals. The published artifact set on APIs.io includes an OpenAPI specification.

This API exposes 10 operations across 8 paths, and defines 22 schemas. It is described by OpenAPI 3.2.0, at version 2.1.688.

Requests are made against a single base URL, https://platform.arthur.ai/api.

10 operations 8 paths 22 schemas 3 DELETE4 GET2 POST1 PUT

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.2.0
API Version
2.1.688
Base URL
https://platform.arthur.ai/api
Authentication
HTTP Bearer
Resource Areas
1

Authentication & Security 1

ArthurAI LLMEvals API declares 1 security scheme for authenticating requests. It accepts HTTP bearer tokens (API_Key).

  • API_Key — Bearer token authentication with an API key

Paths & Operations 10

Across 8 paths, the API surfaces 10 operations — 3 DELETE, 4 GET, 2 POST, 1 PUT. Each is listed below with its method, path, parameters, and response codes.

LLMEvals 10
GET
/api/v1/tasks/{task_id}/llm_evals/{eval_name}/versions/{eval_version}
Get an llm eval
get_llm_eval_api_v1_tasks__task_id__llm_evals__eval_name__versions__eval_version__get 3 params → 200422
DELETE
/api/v1/tasks/{task_id}/llm_evals/{eval_name}/versions/{eval_version}
Delete an llm eval version
soft_delete_llm_eval_version_api_v1_tasks__task_id__llm_evals__eval_name__versions__eval_version__delete 3 params → 204422
GET
/api/v1/tasks/{task_id}/llm_evals/{eval_name}/versions
List all versions of an llm eval
get_all_llm_eval_versions_api_v1_tasks__task_id__llm_evals__eval_name__versions_get 12 params → 200422
GET
/api/v1/tasks/{task_id}/llm_evals
Get all llm evals
get_all_llm_evals_api_v1_tasks__task_id__llm_evals_get 11 params → 200422
POST
/api/v1/tasks/{task_id}/llm_evals/{eval_name}/versions/{eval_version}/completions
Run a saved llm eval
run_saved_llm_eval_api_v1_tasks__task_id__llm_evals__eval_name__versions__eval_version__completions_post 3 params body → 200422
POST
/api/v1/tasks/{task_id}/llm_evals/{eval_name}
Save an llm eval
save_llm_eval_api_v1_tasks__task_id__llm_evals__eval_name__post 2 params body → 200422
DELETE
/api/v1/tasks/{task_id}/llm_evals/{eval_name}
Delete an llm eval
delete_llm_eval_api_v1_tasks__task_id__llm_evals__eval_name__delete 2 params → 204422
GET
/api/v1/tasks/{task_id}/llm_evals/{eval_name}/versions/tags/{tag}
Get an llm eval by name and tag
get_llm_eval_by_tag_api_v1_tasks__task_id__llm_evals__eval_name__versions_tags__tag__get 3 params → 200422
PUT
/api/v1/tasks/{task_id}/llm_evals/{eval_name}/versions/{eval_version}/tags
Add a tag to an llm eval version
add_tag_to_llm_eval_version_api_v1_tasks__task_id__llm_evals__eval_name__versions__eval_version__tags_put 3 params body → 200422
DELETE
/api/v1/tasks/{task_id}/llm_evals/{eval_name}/versions/{eval_version}/tags/{tag}
Remove a tag from an llm eval version
delete_tag_from_llm_eval_version_api_v1_tasks__task_id__llm_evals__eval_name__versions__eval_version__tags__tag__delete 4 params → 204422

Schemas 22

The contract defines 22 schemas that model the data the API accepts and returns. The most detailed are LLMRequestConfigSettings (14 properties), LLMBaseConfigSettings (14 properties), Eval (11 properties), LLMGetAllMetadataResponse (7 properties). Each schema is shown below with its type and property counts.

LLMVersionResponse
object
7 properties 3 required
AnthropicThinkingParam-Output
object
2 properties
LLMGetAllMetadataListResponse
object
2 properties 2 required
BaseCompletionRequest
object
1 property
ModelProvider
string
PaginationSortMethod
string
CreateEvalRequest
object
4 properties 3 required
EvalRunResponse
object
3 properties 3 required
LLMBaseConfigSettings
object
14 properties
VariableTemplateValue
object
2 properties 2 required
AnthropicThinkingParam-Input
object
2 properties
ValidationError
object
5 properties 3 required
EvalKind
string
Discriminator for all eval types stored in the llmevals table.
LLMGetAllMetadataResponse
object
7 properties 5 required
LLMEvalsVersionListResponse
object
2 properties 2 required
HTTPValidationError
object
1 property
LLMMetadataSortField
string
Sort field options for the LLM evals/prompts metadata list endpoints.
LogitBiasItem
object
2 properties 2 required
Body_add_tag_to_llm_eval_version_api_v1_tasks__task_id__llm_evals__eval_name__versions__eval_version__tags_put
object
1 property 1 required
ReasoningEffortEnum
string
Eval
object
11 properties 2 required
LLMRequestConfigSettings
object
14 properties

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

arthurai-llmevals-api-openapi.yml Raw ↑

Other APIs ArthurAI publishes across the network.

ArthurAI Agent Discovery API
AE Profile APIs.io
ArthurAI Agentic Experiments API
AE Profile APIs.io
ArthurAI Agentic Notebooks API
AE Profile APIs.io
ArthurAI Agents V1 API
AE Profile APIs.io
ArthurAI Alert Rules V1 API
AE Profile APIs.io
ArthurAI Alerts V1 API
AE Profile APIs.io
ArthurAI API Keys API
AE Profile APIs.io
ArthurAI Authorization V1 API
AE Profile APIs.io
ArthurAI Chatbot API
AE Profile APIs.io
ArthurAI Configuration API
AE Profile APIs.io
ArthurAI Connector Schemas V1 API
AE Profile APIs.io
ArthurAI Connectors V1 API
AE Profile APIs.io
#LLMEvals
← Back to A APIs
API Details
ID
arthurai:arthurai-llmevals-api
Base URL
https://platform.arthur.ai/api
Docs
https://docs.arthur.ai
Provider
ArthurAI
APIs.io →  GitHub →
Explore more
All APIs Providers APIs.io Network
Work with this as data

Every API here is available over the API and to AI agents over MCP. APIs is not yet its own endpoint on the v1 API. Reach this content through network search and the tag graph, or the MCP server below.

Installs https://mcp.apievangelist.com/mcp in Claude, Cursor, VS Code and the rest — one button, every client.

MCP tools for apis
4 tools reach this content
  • search_api_evangelistSearch every content type across the network at once.
  • find_relatedThe shared-tag relevance graph — what else covers this.
  • get_tagEverything one tag labels, across all content types.
  • guide_topicPRO — a curated bundle for a topic: area, guidance, rules, papers, stories, services.
All tools & prompts
Call it yourself
curl for this page
Search the network for this 
curl "https://api.apievangelist.com/v1/search?q=arthurai-llmevals-api&limit=10"
Everything under a tag 
curl "https://api.apievangelist.com/v1/tags/arthurai-llmevals-api"

Discovery needs no key. Full bodies and the synthesis endpoints are Pro.

Get an API key

Free tier, no email required. Sign in with whichever identity you already have.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have. Your account

Where this information came from

This is an independent, third-party profile of ArthurAI LLMEvals API, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.

The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.

Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.

info@apievangelist.com · Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.