How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Aleph Alpha Benchmarks API

Endpoints for handling benchmarks. A Benchmark provides a way to compare and evaluate the quality of your task results for a specific dataset.

Aleph Alpha Benchmarks API is one of 37 APIs that Aleph Alpha publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

Tagged areas include Benchmarks. The published artifact set on APIs.io includes an OpenAPI specification and API documentation.

This API exposes 5 operations across 2 paths, and defines 10 schemas. It is described by OpenAPI 3.2.0, at version 0.1.0.

Requests are made against a single base URL, {host}/v1/studio.

5 operations 2 paths 10 schemas 1 DELETE2 GET1 PATCH1 POST

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.2.0
API Version
0.1.0
Base URL
https://api.aleph-alpha.com
Authentication
HTTP Bearer
Resource Areas
1

Authentication & Security 1

Aleph Alpha Benchmarks API declares 1 security scheme for authenticating requests. It accepts HTTP bearer tokens (JWT) (BearerAuth). By default, every request must be authenticated.

Paths & Operations 5

Across 2 paths, the API surfaces 5 operations — 1 DELETE, 2 GET, 1 PATCH, 1 POST. Each is listed below with its method, path, parameters, and response codes.

Benchmarks 5

Endpoints for handling benchmarks. A Benchmark provides a way to compare and evaluate the quality of your task results for a specific dataset.

POST
/projects/{project_id}/evaluation/benchmarks
Create Benchmark
create_benchmark_projects__project_id__evaluation_benchmarks_post 1 param body → 201422
GET
/projects/{project_id}/evaluation/benchmarks
Get Many Benchmarks
get_many_benchmarks_projects__project_id__evaluation_benchmarks_get 6 params → 200422
GET
/projects/{project_id}/evaluation/benchmarks/{benchmark_id}
Get Benchmark
get_benchmark_projects__project_id__evaluation_benchmarks__benchmark_id__get 2 params → 200422
DELETE
/projects/{project_id}/evaluation/benchmarks/{benchmark_id}
Delete Benchmark
delete_benchmark_projects__project_id__evaluation_benchmarks__benchmark_id__delete 2 params → 204422
PATCH
/projects/{project_id}/evaluation/benchmarks/{benchmark_id}
Patch Benchmark
patch_benchmark_projects__project_id__evaluation_benchmarks__benchmark_id__patch 2 params body → 204422

Schemas 10

The contract defines 10 schemas that model the data the API accepts and returns. The most detailed are GetBenchmarkResponse (14 properties), PostBenchmarkRequest (6 properties), PagedResponse_GetBenchmarkResponse_ (5 properties), EvaluationLogic (5 properties). Each schema is shown below with its type and property counts.

AggregationLogic
object
3 properties 3 required
GetBenchmarkResponse
object
14 properties 13 required
EvaluationLogic
object
5 properties 5 required
PostBenchmarkRequest
object
6 properties 4 required
PatchBenchmarkRequest
object
3 properties
PagedResponse_GetBenchmarkResponse_
object
5 properties 4 required
HTTPValidationError
object
1 property
SortDirection
string
BenchmarkSortableColumns
string
ValidationError
object
5 properties 3 required

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

aleph-alpha-benchmarks-api-openapi.yml Raw ↑

Other APIs Aleph Alpha publishes across the network.

Aleph Alpha API description API
Aleph Alpha Application Traces API
Aleph Alpha Benchmark Executions API
Aleph Alpha Cluster API
Aleph Alpha Collection API
Aleph Alpha Connectors API
Aleph Alpha Conversations API
Aleph Alpha Datasets API
Aleph Alpha Document API
Aleph Alpha Downloads API
Aleph Alpha Evaluation Datasets API
Aleph Alpha Events API
Where this information came from

This is an independent, third-party profile of Aleph Alpha Benchmarks API, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.

The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.

Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.

info@apievangelist.com · Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.