How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Need help?

Contact us
Omni

Omni AI Eval API

AI evaluation: manage prompt sets and runs used to score AI quality against curated prompt suites.

Documentation Provider Profile APIs.io OpenAPI GitHub

Omni AI Eval API is one of 38 APIs that Omni publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

Tagged areas include AI Eval. The published artifact set on APIs.io includes an OpenAPI specification, API documentation, and an API reference.

This API exposes 12 operations across 7 paths, and defines 24 schemas. It is described by OpenAPI 3.1.0, at version 1.0.0.

Requests are made against 2 base URLs: https://{instance}.omniapp.co/api, https://{instance}.playground.exploreomni.dev/api.

12 operations 7 paths 24 schemas 2 DELETE4 GET1 PATCH5 POST

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.1.0
API Version
1.0.0
Base URL
https://blobsrus.omniapp.co/api
Authentication
HTTP Bearer, HTTP Bearer
Contact
Omni Support
Resource Areas
1

Authentication & Security 2

Omni AI Eval API declares 2 security schemes for authenticating requests. It accepts HTTP bearer tokens (JWT) (bearerAuth). It accepts HTTP bearer tokens (JWT) (orgApiKey). By default, every request must be authenticated.

  • bearerAuth — Can be either an [Organization API Key](/api/authenticationorganization-api-keys) or [Personal Access Token (PAT)](/api/authenticationtoken-types). Include in…
  • orgApiKey — Requires an [Organization API Key](/api/authenticationorganization-api-keys). Personal Access Tokens (PATs) are not supported for this endpoint. Include in the…

Paths & Operations 12

Across 7 paths, the API surfaces 12 operations — 2 DELETE, 4 GET, 1 PATCH, 5 POST. Each is listed below with its method, path, parameters, and response codes.

AI Eval 12

AI evaluation: manage prompt sets and runs used to score AI quality against curated prompt suites.

GET
/v1/ai/eval/prompt-sets
List eval prompt sets
aiEvalPromptSetsList 2 params → 200400401403404
POST
/v1/ai/eval/prompt-sets
Create an eval prompt set
aiEvalPromptSetsCreate body → 201400401403
GET
/v1/ai/eval/prompt-sets/{promptSetId}
Get an eval prompt set
aiEvalPromptSetsGet 1 param → 200400401403404
PATCH
/v1/ai/eval/prompt-sets/{promptSetId}
Update an eval prompt set
aiEvalPromptSetsUpdate 1 param body → 200400401403404422
DELETE
/v1/ai/eval/prompt-sets/{promptSetId}
Archive an eval prompt set
aiEvalPromptSetsArchive 1 param → 200400401403404500
POST
/v1/ai/eval/prompt-sets/{promptSetId}/unarchive
Restore an archived eval prompt set
aiEvalPromptSetsUnarchive 1 param → 200400401403404
GET
/v1/ai/eval/runs
List eval runs
aiEvalRunsList 2 params → 200400401403404
POST
/v1/ai/eval/runs
Start an eval run
aiEvalRunsCreate body → 201400401403404422429503
GET
/v1/ai/eval/runs/{runId}
Get an eval run
aiEvalRunsGet 1 param → 200400401403404
DELETE
/v1/ai/eval/runs/{runId}
Archive an eval run
aiEvalRunsArchive 1 param → 200400401403404
POST
/v1/ai/eval/runs/{runId}/cancel
Cancel an eval run
aiEvalRunsCancel 1 param → 200400401403404
POST
/v1/ai/eval/runs/{runId}/unarchive
Restore an archived eval run
aiEvalRunsUnarchive 1 param → 200400401403404

Schemas 24

The contract defines 24 schemas that model the data the API accepts and returns. The most detailed are EvalRunListItem (12 properties), EvalRunDetail (12 properties), EvalPromptSetListItem (10 properties), EvalPromptSet (9 properties). Each schema is shown below with its type and property counts.

EvalPromptSetsCreateBody
object
5 properties 3 required
EvalRunStats
object
2 properties 2 required
EvalPromptSetsCreateResponse
object
1 property 1 required
EvalPromptSetListItem
object
10 properties 10 required
EvalPromptSetsUpdateBody
object
3 properties
EvalRunsDeleteResponse
object
1 property 1 required
EvalRunsListResponse
object
1 property 1 required
EvalRunsCreateBody
object
3 properties 1 required
EvalRunsCancelResponse
object
3 properties 3 required
EvalPromptSetsGetResponse
object
1 property 1 required
EvalRunsCreateResponse
object
2 properties 2 required
EvalRunResultAgenticJob
object
3 properties 3 required
EvalPromptSetsDeleteResponse
object
2 properties 2 required
EvalPromptSet
object
9 properties 9 required
EvalPromptSetsListResponse
object
1 property 1 required
EvalPrompt
object
5 properties 5 required
EvalRunResult
object
8 properties 8 required
EvalPromptSetsUpdateResponse
object
1 property 1 required
EvalRunsGetResponse
object
1 property 1 required
EvalRunDetail
object
The newly created run with its initial results.
12 properties 12 required
EvalRunListItem
object
12 properties 12 required
EvalRunsUnarchiveResponse
object
1 property 1 required
EvalPromptSetsUnarchiveResponse
object
1 property 1 required
EvalApiError
object
Error response returned by the AI Eval endpoints.
2 properties 2 required

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

omni-ai-eval-api-openapi.yml Raw ↑

Other APIs Omni publishes across the network.

Omni AI API
AE Profile APIs.io
Omni AI Credit Controls API
AE Profile APIs.io
Omni AI Model Suggestions API
AE Profile APIs.io
Omni AI Routines API
AE Profile APIs.io
Omni API Tokens API
AE Profile APIs.io
Omni Connection environments API
AE Profile APIs.io
Omni Connections API
AE Profile APIs.io
Omni Content API
AE Profile APIs.io
Omni Content migration API
AE Profile APIs.io
Omni Content validator API
AE Profile APIs.io
Omni Dashboard downloads API
AE Profile APIs.io
Omni Dashboard filters API
AE Profile APIs.io
#AI Eval
← Back to O APIs
API Details
ID
omni:omni-ai-eval-api
Base URL
https://blobsrus.omniapp.co/api
Docs
https://docs.omni.co/api
Provider
Omni
APIs.io →  GitHub →
Explore more
All APIs Providers APIs.io Network
Work with this as data

Every API here is available over the API and to AI agents over MCP. APIs is not yet its own endpoint on the v1 API. Reach this content through network search and the tag graph, or the MCP server below.

Installs https://mcp.apievangelist.com/mcp in Claude, Cursor, VS Code and the rest — one button, every client.

MCP tools for apis
4 tools reach this content
  • search_api_evangelistSearch every content type across the network at once.
  • find_relatedThe shared-tag relevance graph — what else covers this.
  • get_tagEverything one tag labels, across all content types.
  • guide_topicPRO — a curated bundle for a topic: area, guidance, rules, papers, stories, services.
All tools & prompts
Call it yourself
curl for this page
Search the network for this 
curl "https://api.apievangelist.com/v1/search?q=omni-ai-eval-api&limit=10"
Everything under a tag 
curl "https://api.apievangelist.com/v1/tags/omni-ai-eval-api"

Discovery needs no key. Full bodies and the synthesis endpoints are Pro.

Get an API key

Free tier, no email required. Sign in with whichever identity you already have.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have. Your account

Where this information came from

This is an independent, third-party profile of Omni AI Eval API, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.

The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.

Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.

info@apievangelist.com · Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.