How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Need help?

Contact us
Helicone

Helicone Evaluator API

The Evaluator API from Helicone — 10 operation(s) for evaluator.

Documentation Provider Profile APIs.io OpenAPI GitHub

Helicone Evaluator API is one of 33 APIs that Helicone publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

Tagged areas include Evaluator. The published artifact set on APIs.io includes an OpenAPI specification, API documentation, a getting-started guide, pricing, an API reference, and an engineering blog.

This API exposes 13 operations across 10 paths, and defines 35 schemas. It is described by OpenAPI 3.2.0, at version 1.0.0.

Requests are made against 2 base URLs: https://api.helicone.ai/, http://localhost:8585/.

13 operations 10 paths 35 schemas 2 DELETE4 GET6 POST1 PUT

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.2.0
API Version
1.0.0
Base URL
https://ai-gateway.helicone.ai
Authentication
API Key
License
MIT
Resource Areas
1

Authentication & Security 1

Helicone Evaluator API declares 1 security scheme for authenticating requests. An API key is passed in the header as Authorization (api_key).

  • api_key — Bearer token authentication. Format: 'Bearer YOURAPIKEY'

Paths & Operations 13

Across 10 paths, the API surfaces 13 operations — 2 DELETE, 4 GET, 6 POST, 1 PUT. Each is listed below with its method, path, parameters, and response codes.

Evaluator 13
POST
/v1/evaluator
CreateEvaluator body → 200
GET
/v1/evaluator/{evaluatorId}
GetEvaluator 1 param → 200
PUT
/v1/evaluator/{evaluatorId}
UpdateEvaluator 1 param body → 200
DELETE
/v1/evaluator/{evaluatorId}
DeleteEvaluator 1 param → 200
POST
/v1/evaluator/query
QueryEvaluators body → 200
GET
/v1/evaluator/{evaluatorId}/experiments
GetExperimentsForEvaluator 1 param → 200
GET
/v1/evaluator/{evaluatorId}/onlineEvaluators
GetOnlineEvaluators 1 param → 200
POST
/v1/evaluator/{evaluatorId}/onlineEvaluators
CreateOnlineEvaluator 1 param body → 200
DELETE
/v1/evaluator/{evaluatorId}/onlineEvaluators/{onlineEvaluatorId}
DeleteOnlineEvaluator 2 params → 200
POST
/v1/evaluator/python/test
TestPythonEvaluator body → 200
POST
/v1/evaluator/llm/test
TestLLMEvaluator body → 200
POST
/v1/evaluator/lastmile/test
TestLastMileEvaluator body → 200
GET
/v1/evaluator/{evaluatorId}/stats
GetEvaluatorStats 1 param → 200

Schemas 35

The contract defines 35 schemas that model the data the API accepts and returns. The most detailed are EvaluatorResult (9 properties), CreateEvaluatorParams (5 properties), UpdateEvaluatorParams (5 properties), EvaluatorStats (5 properties). Each schema is shown below with its type and property counts.

ResultSuccess__score-number--input-string--output-string--ground_truth_63_-string__
object
2 properties 2 required
TestInput
object
4 properties 3 required
EvaluatorExperiment
object
3 properties 3 required
LastMileConfigForm
Result_EvaluatorExperiment-Array.string_
Record_string.string_
object
Construct a type with a set of properties K of type T
Result_EvaluatorResult.string_
ResultSuccess_EvaluatorScore_
object
2 properties 2 required
UpdateEvaluatorParams
object
5 properties
ResultSuccess_EvaluatorExperiment-Array_
object
2 properties 2 required
ResultSuccess_EvaluatorStats_
object
2 properties 2 required
ResultSuccess_null_
object
2 properties 2 required
Result_EvaluatorStats.string_
ResultSuccess__output-string--traces-string-Array--statusCode_63_-number__
object
2 properties 2 required
Record_string.any_
object
Construct a type with a set of properties K of type T
EvaluatorStats
object
5 properties 5 required
EvaluatorScore
object
1 property 1 required
ResultSuccess_OnlineEvaluatorByEvaluatorId-Array_
object
2 properties 2 required
Result_EvaluatorScore.string_
Result__score-number--input-string--output-string--ground_truth_63_-string_.string_
EvaluatorResult
object
9 properties 9 required
ResultError_string_
object
2 properties 2 required
Result_null.string_
DataEntry
CreateOnlineEvaluatorParams
object
1 property 1 required
EvaluatorConfig
object
3 properties 1 required
Result_OnlineEvaluatorByEvaluatorId-Array.string_
CreateEvaluatorParams
object
5 properties 2 required
ResultSuccess_EvaluatorResult_
object
2 properties 2 required
BaseLastMileConfigForm
object
3 properties 3 required
OnlineEvaluatorByEvaluatorId
object
2 properties 2 required
Result__output-string--traces-string-Array--statusCode_63_-number_.string_
EvaluatorScoreResult
ResultSuccess_EvaluatorResult-Array_
object
2 properties 2 required
Result_EvaluatorResult-Array.string_

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

helicone-evaluator-api-openapi.yml Raw ↑

Other APIs Helicone publishes across the network.

Helicone Agent API
AE Profile APIs.io
Helicone API Key API
AE Profile APIs.io
Helicone Comparison API
AE Profile APIs.io
Helicone Credits API
AE Profile APIs.io
Helicone Customer API
AE Profile APIs.io
Helicone Dashboard API
AE Profile APIs.io
Helicone Dataset API
AE Profile APIs.io
Helicone Evals API
AE Profile APIs.io
Helicone Experiment API
AE Profile APIs.io
Helicone HeliconeSql API
AE Profile APIs.io
Helicone Integration API
AE Profile APIs.io
Helicone Metrics API
AE Profile APIs.io
#Evaluator
← Back to H APIs
API Details
ID
helicone:helicone-evaluator-api
Base URL
https://ai-gateway.helicone.ai
Docs
https://www.helicone.ai/
Provider
Helicone
APIs.io →  GitHub →
Explore more
All APIs Providers APIs.io Network
Work with this as data

Every API here is available over the API and to AI agents over MCP. APIs is not yet its own endpoint on the v1 API. Reach this content through network search and the tag graph, or the MCP server below.

Installs https://mcp.apievangelist.com/mcp in Claude, Cursor, VS Code and the rest — one button, every client.

MCP tools for apis
4 tools reach this content
  • search_api_evangelistSearch every content type across the network at once.
  • find_relatedThe shared-tag relevance graph — what else covers this.
  • get_tagEverything one tag labels, across all content types.
  • guide_topicPRO — a curated bundle for a topic: area, guidance, rules, papers, stories, services.
All tools & prompts
Call it yourself
curl for this page
Search the network for this 
curl "https://api.apievangelist.com/v1/search?q=helicone-evaluator-api&limit=10"
Everything under a tag 
curl "https://api.apievangelist.com/v1/tags/helicone-evaluator-api"

Discovery needs no key. Full bodies and the synthesis endpoints are Pro.

Get an API key

Free tier, no email required. Sign in with whichever identity you already have.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have. Your account

Where this information came from

This is an independent, third-party profile of Helicone Evaluator API, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.

The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.

Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.

info@apievangelist.com · Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.