How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

PromptLayer Evaluations & Datasets API

Create, run, and score evaluation reports against datasets.

PromptLayer Evaluations & Datasets API is one of 4 APIs that PromptLayer publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

Tagged areas include Evaluations & Datasets. The published artifact set on APIs.io includes an OpenAPI specification, API documentation, and an API reference.

This API exposes 6 operations across 5 paths, and defines 7 schemas. It is described by OpenAPI 3.2.0, at version 1.0.

Requests are made against a single base URL, https://api.promptlayer.com.

6 operations 5 paths 7 schemas 4 GET2 POST

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.2.0
API Version
1.0
Base URL
https://api.promptlayer.com
Authentication
API Key
Terms of Service
Resource Areas
1

Authentication & Security 1

PromptLayer Evaluations & Datasets API declares 1 security scheme for authenticating requests. An API key is passed in the header as X-API-KEY (ApiKeyAuth). By default, every request must be authenticated.

Paths & Operations 6

Across 5 paths, the API surfaces 6 operations — 4 GET, 2 POST. Each is listed below with its method, path, parameters, and response codes.

Evaluations & Datasets 6

Create, run, and score evaluation reports against datasets.

GET
/evaluations
List evaluation reports
listEvaluations 3 params → 200401
POST
/evaluations
Create an evaluation report
createEvaluation body → 201401422
GET
/evaluations/{id}
Get an evaluation report
getEvaluation 1 param → 200401404
POST
/evaluations/{id}/run
Run an evaluation report
runEvaluation 1 param → 200401404
GET
/evaluations/{id}/score
Get an evaluation report score
getEvaluationScore 1 param → 200401404
GET
/datasets
List datasets
listDatasets 1 param → 200401

Schemas 7

The contract defines 7 schemas that model the data the API accepts and returns. The most detailed are Evaluation (6 properties), Dataset (4 properties), EvaluationScore (4 properties), CreateEvaluationRequest (3 properties). Each schema is shown below with its type and property counts.

Evaluation
object
6 properties
SuccessMessage
object
2 properties
EvaluationScore
object
4 properties
CreateEvaluationRequest
object
3 properties 1 required
DatasetList
object
2 properties
Dataset
object
4 properties
EvaluationList
object
2 properties

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

promptlayer-evaluations-datasets-api-openapi.yml Raw ↑

Other APIs PromptLayer publishes across the network.

PromptLayer Logging & Tracking API
PromptLayer Prompt Registry API
PromptLayer Spans & Traces API
Where this information came from

This is an independent, third-party profile of PromptLayer Evaluations & Datasets API, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.

The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.

Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.

info@apievangelist.com · Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.