How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Need help?

Contact us
ArthurAI

ArthurAI Prompt Experiments API

Endpoints for managing prompt experiments

Documentation Provider Profile APIs.io OpenAPI GitHub

ArthurAI Prompt Experiments API is one of 98 APIs that ArthurAI publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

Tagged areas include Prompt Experiments. The published artifact set on APIs.io includes an OpenAPI specification.

This API exposes 7 operations across 5 paths, and defines 38 schemas. It is described by OpenAPI 3.2.0, at version 2.1.688.

Requests are made against a single base URL, https://platform.arthur.ai/api.

7 operations 5 paths 38 schemas 1 DELETE4 GET1 PATCH1 POST

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.2.0
API Version
2.1.688
Base URL
https://platform.arthur.ai/api
Authentication
HTTP Bearer
Resource Areas
1

Authentication & Security 1

ArthurAI Prompt Experiments API declares 1 security scheme for authenticating requests. It accepts HTTP bearer tokens (API_Key).

  • API_Key — Bearer token authentication with an API key

Paths & Operations 7

Across 5 paths, the API surfaces 7 operations — 1 DELETE, 4 GET, 1 PATCH, 1 POST. Each is listed below with its method, path, parameters, and response codes.

Prompt Experiments 7

Endpoints for managing prompt experiments

GET
/api/v1/tasks/{task_id}/prompt_experiments
List prompt experiments
list_prompt_experiments_api_v1_tasks__task_id__prompt_experiments_get 6 params → 200422
POST
/api/v1/tasks/{task_id}/prompt_experiments
Create and run a prompt experiment
create_prompt_experiment_api_v1_tasks__task_id__prompt_experiments_post 1 param body → 200422
GET
/api/v1/prompt_experiments/{experiment_id}
Get prompt experiment details
get_prompt_experiment_api_v1_prompt_experiments__experiment_id__get 1 param → 200422
DELETE
/api/v1/prompt_experiments/{experiment_id}
Delete prompt experiment
delete_prompt_experiment_api_v1_prompt_experiments__experiment_id__delete 1 param → 204422
GET
/api/v1/prompt_experiments/{experiment_id}/test_cases
Get experiment test cases
get_experiment_test_cases_api_v1_prompt_experiments__experiment_id__test_cases_get 4 params → 200422
GET
/api/v1/prompt_experiments/{experiment_id}/prompts/{prompt_key}/results
Get prompt results
get_prompt_version_results_api_v1_prompt_experiments__experiment_id__prompts__prompt_key__results_get 5 params → 200422
PATCH
/api/v1/prompt_experiments/{experiment_id}/notebook
Attach notebook to experiment
attach_notebook_to_experiment_api_v1_prompt_experiments__experiment_id__notebook_patch 2 params → 200422

Schemas 38

The contract defines 38 schemas that model the data the API accepts and returns. The most detailed are PromptExperimentDetail (17 properties), PromptExperimentSummary (14 properties), UnsavedPromptConfig (8 properties), CreatePromptExperimentRequest (7 properties). Each schema is shown below with its type and property counts.

EvalExecution
object
Details of an eval execution
4 properties 3 required
ExperimentOutputSource
object
Reference to experiment output
1 property
DatasetRefInput
object
Reference to a dataset and version for input (without name)
2 properties 2 required
PromptOutput
object
Output from a prompt execution
3 properties 2 required
SavedPromptConfig
object
Configuration for a saved prompt
3 properties 2 required
CreatePromptExperimentRequest
object
Request to create a new prompt experiment
7 properties 5 required
NewDatasetVersionRowColumnItemRequest
object
Represents a single column-value pair in a dataset row.
2 properties 2 required
PromptExperimentSummary
object
Summary of a prompt experiment
14 properties 11 required
DatasetColumnSource
object
Reference to a dataset column
1 property 1 required
ModelProvider
string
PromptEvalResultSummaries
object
Summary of evaluation results for a prompt version
5 properties 1 required
EvalRef-Output
object
Reference to an evaluation configuration
3 properties 3 required
ExperimentOutputVariableSource
object
Variable source from experiment output
2 properties 2 required
PaginationSortMethod
string
PromptExperimentDetail
object
Detailed information about a prompt experiment
17 properties 12 required
TestCase
object
Individual test case result
5 properties 4 required
SummaryResults
object
Summary results across all prompt versions and evaluations
1 property 1 required
PromptVariableMapping-Input
object
Mapping of a prompt variable to a dataset column source
2 properties 2 required
ValidationError
object
5 properties 3 required
TestCaseStatus
string
Status of a test case
ChatCompletionMessageToolCall
object
EvalResultSummary
object
Results for a single eval
4 properties 4 required
InputVariable
object
Input variable for a test case
2 properties 2 required
DatasetColumnVariableSource
object
Variable source from a dataset column
2 properties 2 required
EvalVariableMapping-Output
object
Mapping of an eval variable to its source (dataset column or experiment output)
2 properties 2 required
HTTPValidationError
object
1 property
EvalRef-Input
object
Reference to an evaluation configuration
3 properties 3 required
EvalExecutionResult
object
Results from an eval execution
3 properties 3 required
PromptVariableMapping-Output
object
Mapping of a prompt variable to a dataset column source
2 properties 2 required
PromptExperimentListResponse
object
Paginated list of prompt experiments
5 properties 5 required
DatasetRef
object
Reference to a dataset and version (with name)
3 properties 3 required
ExperimentStatus
string
Status of an experiment
PromptResult
object
Results from a prompt execution with evals
7 properties 4 required
PromptVersionResult
object
Result for a specific prompt version within a test case
7 properties 5 required
EvalVariableMapping-Input
object
Mapping of an eval variable to its source (dataset column or experiment output)
2 properties 2 required
UnsavedPromptConfig
object
Configuration for an unsaved prompt
8 properties 3 required
PromptVersionResultListResponse
object
Paginated list of results for a specific prompt version
5 properties 5 required
TestCaseListResponse
object
Paginated list of test cases
5 properties 5 required

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

arthurai-prompt-experiments-api-openapi.yml Raw ↑

Other APIs ArthurAI publishes across the network.

ArthurAI Agent Discovery API
AE Profile APIs.io
ArthurAI Agentic Experiments API
AE Profile APIs.io
ArthurAI Agentic Notebooks API
AE Profile APIs.io
ArthurAI Agents V1 API
AE Profile APIs.io
ArthurAI Alert Rules V1 API
AE Profile APIs.io
ArthurAI Alerts V1 API
AE Profile APIs.io
ArthurAI API Keys API
AE Profile APIs.io
ArthurAI Authorization V1 API
AE Profile APIs.io
ArthurAI Chatbot API
AE Profile APIs.io
ArthurAI Configuration API
AE Profile APIs.io
ArthurAI Connector Schemas V1 API
AE Profile APIs.io
ArthurAI Connectors V1 API
AE Profile APIs.io
#Prompt Experiments
← Back to A APIs
API Details
ID
arthurai:arthurai-prompt-experiments-api
Base URL
https://platform.arthur.ai/api
Docs
https://docs.arthur.ai
Provider
ArthurAI
APIs.io →  GitHub →
Explore more
All APIs Providers APIs.io Network
Work with this as data

Every API here is available over the API and to AI agents over MCP. APIs is not yet its own endpoint on the v1 API. Reach this content through network search and the tag graph, or the MCP server below.

Installs https://mcp.apievangelist.com/mcp in Claude, Cursor, VS Code and the rest — one button, every client.

MCP tools for apis
4 tools reach this content
  • search_api_evangelistSearch every content type across the network at once.
  • find_relatedThe shared-tag relevance graph — what else covers this.
  • get_tagEverything one tag labels, across all content types.
  • guide_topicPRO — a curated bundle for a topic: area, guidance, rules, papers, stories, services.
All tools & prompts
Call it yourself
curl for this page
Search the network for this 
curl "https://api.apievangelist.com/v1/search?q=arthurai-prompt-experiments-api&limit=10"
Everything under a tag 
curl "https://api.apievangelist.com/v1/tags/arthurai-prompt-experiments-api"

Discovery needs no key. Full bodies and the synthesis endpoints are Pro.

Get an API key

Free tier, no email required. Sign in with whichever identity you already have.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have. Your account

Where this information came from

This is an independent, third-party profile of ArthurAI Prompt Experiments API, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.

The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.

Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.

info@apievangelist.com · Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.