How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Need help?

Contact us
Traceloop

Traceloop evaluators API

The evaluators API from Traceloop — 36 operation(s) for evaluators.

Documentation Provider Profile APIs.io OpenAPI GitHub

Traceloop evaluators API is one of 4 APIs that Traceloop publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

This API exposes 1 JSON Schema definition.

Tagged areas include Evaluators. The published artifact set on APIs.io includes an OpenAPI specification, API documentation, and 1 JSON Schema.

This API exposes 36 operations across 36 paths, and defines 123 schemas. It is described by OpenAPI 3.2.0, at version 1.0.0.

Requests are made against a single base URL, https://api.traceloop.com.

36 operations 36 paths 123 schemas 36 POST

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.2.0
API Version
1.0.0
Base URL
https://api.traceloop.com
Authentication
API Key
Resource Areas
1

Authentication & Security 1

Traceloop evaluators API declares 1 security scheme for authenticating requests. An API key is passed in the header as Authorization (BearerAuth).

  • BearerAuth — Type "Bearer" followed by a space and JWT token.

Paths & Operations 36

Across 36 paths, the API surfaces 36 operations — 36 POST. Each is listed below with its method, path, parameters, and response codes.

evaluators 36
POST
/v2/evaluators
Create a custom LLM-as-a-judge evaluator
body → 200400500
POST
/v2/evaluators/agent-efficiency/execute
Execute agent-efficiency evaluator
body → 200400500
POST
/v2/evaluators/agent-flow-quality/execute
Execute agent-flow-quality evaluator
body → 200400500
POST
/v2/evaluators/agent-goal-accuracy/execute
Execute agent-goal-accuracy evaluator
body → 200400500
POST
/v2/evaluators/agent-goal-completeness/execute
Execute agent-goal-completeness evaluator
body → 200400500
POST
/v2/evaluators/agent-tool-error-detector/execute
Execute agent-tool-error-detector evaluator
body → 200400500
POST
/v2/evaluators/agent-tool-trajectory/execute
Execute agent-tool-trajectory evaluator
body → 200400500
POST
/v2/evaluators/answer-completeness/execute
Execute answer-completeness evaluator
body → 200400500
POST
/v2/evaluators/answer-correctness/execute
Execute answer-correctness evaluator
body → 200400500
POST
/v2/evaluators/answer-relevancy/execute
Execute answer-relevancy evaluator
body → 200400500
POST
/v2/evaluators/char-count/execute
Execute char-count evaluator
body → 200400500
POST
/v2/evaluators/char-count-ratio/execute
Execute char-count-ratio evaluator
body → 200400500
POST
/v2/evaluators/context-relevance/execute
Execute context-relevance evaluator
body → 200400500
POST
/v2/evaluators/conversation-quality/execute
Execute conversation-quality evaluator
body → 200400500
POST
/v2/evaluators/faithfulness/execute
Execute faithfulness evaluator
body → 200400500
POST
/v2/evaluators/html-comparison/execute
Execute html-comparison evaluator
body → 200400500
POST
/v2/evaluators/instruction-adherence/execute
Execute instruction-adherence evaluator
body → 200400500
POST
/v2/evaluators/intent-change/execute
Execute intent-change evaluator
body → 200400500
POST
/v2/evaluators/json-validator/execute
Execute json-validator evaluator
body → 200400500
POST
/v2/evaluators/perplexity/execute
Execute perplexity evaluator
body → 200400500
POST
/v2/evaluators/pii-detector/execute
Execute pii-detector evaluator
body → 200400500
POST
/v2/evaluators/placeholder-regex/execute
Execute placeholder-regex evaluator
body → 200400500
POST
/v2/evaluators/profanity-detector/execute
Execute profanity-detector evaluator
body → 200400500
POST
/v2/evaluators/prompt-injection/execute
Execute prompt-injection evaluator
body → 200400500
POST
/v2/evaluators/prompt-perplexity/execute
Execute prompt-perplexity evaluator
body → 200400500
POST
/v2/evaluators/regex-validator/execute
Execute regex-validator evaluator
body → 200400500
POST
/v2/evaluators/secrets-detector/execute
Execute secrets-detector evaluator
body → 200400500
POST
/v2/evaluators/semantic-similarity/execute
Execute semantic-similarity evaluator
body → 200400500
POST
/v2/evaluators/sexism-detector/execute
Execute sexism-detector evaluator
body → 200400500
POST
/v2/evaluators/sql-validator/execute
Execute sql-validator evaluator
body → 200400500
POST
/v2/evaluators/tone-detection/execute
Execute tone-detection evaluator
body → 200400500
POST
/v2/evaluators/topic-adherence/execute
Execute topic-adherence evaluator
body → 200400500
POST
/v2/evaluators/toxicity-detector/execute
Execute toxicity-detector evaluator
body → 200400500
POST
/v2/evaluators/uncertainty-detector/execute
Execute uncertainty-detector evaluator
body → 200400500
POST
/v2/evaluators/word-count/execute
Execute word-count evaluator
body → 200400500
POST
/v2/evaluators/word-count-ratio/execute
Execute word-count-ratio evaluator
body → 200400500

Schemas 123

The contract defines 123 schemas that model the data the API accepts and returns. The most detailed are request.CreateCustomEvaluatorInput (16 properties), response.CreateEvaluatorResponse (5 properties), request.RegexValidatorConfigRequest (5 properties), evaluator.Property (5 properties). Each schema is shown below with its type and property counts.

response.CharCountResponse
object
1 property
request.ProfanityDetectorInput
object
1 property 1 required
response.PerplexityResponse
object
1 property
response.AgentToolTrajectoryResponse
object
3 properties
request.RegexValidatorConfigRequest
object
5 properties
request.AgentFlowQualityInput
object
2 properties 2 required
response.PlaceholderRegexResponse
object
1 property
request.HtmlComparisonRequest
object
1 property 1 required
request.SexismDetectorInput
object
1 property 1 required
request.WordCountRatioRequest
object
1 property 1 required
request.AgentToolTrajectoryConfigRequest
object
4 properties
request.AnswerCompletenessRequest
object
1 property 1 required
request.JSONValidatorRequest
object
2 properties 1 required
request.UncertaintyDetectorRequest
object
1 property 1 required
response.FaithfulnessResponse
object
1 property
request.SQLValidatorInput
object
1 property 1 required
request.ToxicityDetectorConfigRequest
object
1 property
request.AnswerRelevancyInput
object
2 properties 2 required
request.InstructionAdherenceRequest
object
1 property 1 required
request.JSONValidatorConfigRequest
object
2 properties
request.JSONValidatorInput
object
1 property 1 required
response.PIIDetectorResponse
object
1 property
response.ContextRelevanceResponse
object
1 property
types.EvaluatorType
string
response.AgentToolErrorDetectorResponse
object
2 properties
request.AnswerRelevancyRequest
object
1 property 1 required
request.AgentGoalAccuracyInput
object
3 properties 3 required
request.IntentChangeRequest
object
1 property 1 required
request.AnswerCorrectnessInput
object
3 properties 3 required
request.WordCountRatioInput
object
2 properties 2 required
request.CharCountRatioRequest
object
1 property 1 required
request.PromptInjectionRequest
object
2 properties 1 required
request.ToneDetectionRequest
object
1 property 1 required
request.RegexValidatorRequest
object
2 properties 1 required
response.ProfanityDetectorResponse
object
1 property
response.WordCountResponse
object
1 property
request.PIIDetectorConfigRequest
object
1 property
request.SemanticSimilarityRequest
object
1 property 1 required
request.ContextRelevanceInput
object
3 properties 3 required
request.AgentGoalCompletenessInput
object
2 properties 2 required
request.AgentFlowQualityRequest
object
2 properties 2 required
request.PlaceholderRegexInput
object
3 properties 3 required
response.AgentFlowQualityResponse
object
3 properties
request.PIIDetectorInput
object
1 property 1 required
request.CharCountRatioInput
object
2 properties 2 required
response.UncertaintyDetectorResponse
object
2 properties
request.ConversationQualityInput
object
2 properties 2 required
request.CharCountInput
object
1 property 1 required
request.InstructionAdherenceInput
object
2 properties 2 required
request.FaithfulnessInput
object
3 properties 3 required
request.RegexValidatorInput
object
1 property 1 required
request.HtmlComparisonInput
object
2 properties 2 required
response.HtmlComparisonResponse
object
1 property
request.ToneDetectionInput
object
1 property 1 required
response.TopicAdherenceResponse
object
1 property
request.PIIDetectorRequest
object
2 properties 1 required
response.InstructionAdherenceResponse
object
1 property
request.SecretsDetectorRequest
object
1 property 1 required
request.AgentGoalCompletenessConfigRequest
object
1 property 1 required
request.PromptInjectionConfigRequest
object
1 property
request.CharCountRequest
object
1 property 1 required
response.ToneDetectionResponse
object
2 properties
request.AgentToolTrajectoryInput
object
2 properties 2 required
request.TopicAdherenceRequest
object
1 property 1 required
request.AgentFlowQualityConfigRequest
object
2 properties 2 required
response.PromptPerplexityResponse
object
1 property
request.AgentToolErrorDetectorRequest
object
1 property 1 required
response.SecretsDetectorResponse
object
1 property
response.AnswerCompletenessResponse
object
1 property
request.PromptPerplexityInput
object
1 property 1 required
response.AnswerRelevancyResponse
object
1 property
request.AnswerCorrectnessRequest
object
1 property 1 required
request.SQLValidatorRequest
object
1 property 1 required
response.CharCountRatioResponse
object
1 property
request.ContextRelevanceConfigRequest
object
1 property
request.TopicAdherenceInput
object
3 properties 3 required
request.FaithfulnessRequest
object
1 property 1 required
response.AgentGoalAccuracyResponse
object
1 property
request.ToxicityDetectorRequest
object
2 properties 1 required
response.PromptInjectionResponse
object
1 property
request.AgentEfficiencyRequest
object
1 property 1 required
response.ErrorResponse
object
Standard error response structure
1 property
response.SexismDetectorResponse
object
1 property
request.PerplexityRequest
object
1 property 1 required
response.AgentEfficiencyResponse
object
4 properties
request.CreateCustomEvaluatorInput
object
16 properties 6 required
request.WordCountInput
object
1 property 1 required
request.SexismDetectorConfigRequest
object
1 property
response.RegexValidatorResponse
object
1 property
evaluator.PropertyType
string
request.PerplexityInput
object
1 property 1 required
request.PlaceholderRegexConfigRequest
object
4 properties
request.PlaceholderRegexRequest
object
2 properties 1 required
request.ToxicityDetectorInput
object
1 property 1 required
model.LLMMessage
object
3 properties
request.SemanticSimilarityInput
object
2 properties 2 required
response.SemanticSimilarityResponse
object
1 property
response.AnswerCorrectnessResponse
object
1 property
request.AgentGoalAccuracyRequest
object
1 property 1 required
request.PromptInjectionInput
object
1 property 1 required
response.WordCountRatioResponse
object
1 property
response.JSONValidatorResponse
object
1 property
request.PromptPerplexityRequest
object
1 property 1 required
request.UncertaintyDetectorInput
object
1 property 1 required
response.AgentGoalCompletenessResponse
object
3 properties
response.ToxicityDetectorResponse
object
1 property
request.AgentEfficiencyInput
object
2 properties 2 required
request.SecretsDetectorInput
object
1 property 1 required
request.ConversationQualityRequest
object
1 property 1 required
response.CreateEvaluatorResponse
object
5 properties
request.AgentToolTrajectoryRequest
object
2 properties 1 required
response.SQLValidatorResponse
object
1 property
request.ProfanityDetectorRequest
object
1 property 1 required
response.ConversationQualityResponse
object
1 property
request.IntentChangeInput
object
2 properties 2 required
request.WordCountRequest
object
1 property 1 required
evaluator.Property
object
5 properties 2 required
request.AgentGoalCompletenessRequest
object
2 properties 1 required
request.AgentToolErrorDetectorInput
object
2 properties 2 required
request.ContextRelevanceRequest
object
2 properties 1 required
request.AnswerCompletenessInput
object
3 properties 3 required
request.SexismDetectorRequest
object
2 properties 1 required
response.IntentChangeResponse
object
3 properties

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

traceloop-evaluators-api-openapi.yml Raw ↑

Other APIs Traceloop publishes across the network.

Traceloop auto-monitor-setups API
AE Profile APIs.io
Traceloop metrics API
AE Profile APIs.io
Traceloop organizations API
AE Profile APIs.io
#Evaluators
← Back to T APIs
API Details
ID
traceloop:traceloop-evaluators-api
Base URL
https://api.traceloop.com
Docs
https://www.traceloop.com/docs/api-reference/introduction
Provider
Traceloop
APIs.io →  GitHub →
Explore more
All APIs Providers APIs.io Network
Work with this as data

Every API here is available over the API and to AI agents over MCP. APIs is not yet its own endpoint on the v1 API. Reach this content through network search and the tag graph, or the MCP server below.

Installs https://mcp.apievangelist.com/mcp in Claude, Cursor, VS Code and the rest — one button, every client.

MCP tools for apis
4 tools reach this content
  • search_api_evangelistSearch every content type across the network at once.
  • find_relatedThe shared-tag relevance graph — what else covers this.
  • get_tagEverything one tag labels, across all content types.
  • guide_topicPRO — a curated bundle for a topic: area, guidance, rules, papers, stories, services.
All tools & prompts
Call it yourself
curl for this page
Search the network for this 
curl "https://api.apievangelist.com/v1/search?q=traceloop-evaluators-api&limit=10"
Everything under a tag 
curl "https://api.apievangelist.com/v1/tags/traceloop-evaluators-api"

Discovery needs no key. Full bodies and the synthesis endpoints are Pro.

Get an API key

Free tier, no email required. Sign in with whichever identity you already have.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have. Your account

Where this information came from

This is an independent, third-party profile of Traceloop evaluators API, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.

The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.

Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.

info@apievangelist.com · Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.