How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

LangSmith annotation-queues API

The annotation-queues API from LangSmith — 17 operation(s) for annotation-queues.

LangSmith annotation-queues API is one of 73 APIs that LangSmith publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

Tagged areas include Annotation Queues. The published artifact set on APIs.io includes an OpenAPI specification, API documentation, and an API reference.

This API exposes 23 operations across 17 paths, and defines 26 schemas. It is described by OpenAPI 3.1.0, at version 0.1.0.

Requests are made against a single base URL, /.

23 operations 17 paths 26 schemas 4 DELETE9 GET2 PATCH8 POST

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.1.0
API Version
0.1.0
Base URL
https://api.smith.langchain.com
Authentication
API Key, API Key, HTTP Bearer, API Key
Resource Areas
1

Authentication & Security 4

LangSmith annotation-queues API declares 4 security schemes for authenticating requests. An API key is passed in the header as X-API-Key (API Key). An API key is passed in the header as X-Tenant-Id (Tenant ID). It accepts HTTP bearer tokens (Bearer Auth). An API key is passed in the header as X-Organization-Id (Organization ID).

  • Bearer Auth — Bearer tokens are used to authenticate from the UI. Must also specify x-tenant-id or x-organization-id (for org scoped apis).

Paths & Operations 23

Across 17 paths, the API surfaces 23 operations — 4 DELETE, 9 GET, 2 PATCH, 8 POST. Each is listed below with its method, path, parameters, and response codes.

annotation-queues 23
GET
/api/v1/annotation-queues
Get Annotation Queues
get_annotation_queues_api_v1_annotation_queues_get 11 params → 200422
POST
/api/v1/annotation-queues
Create Annotation Queue
create_annotation_queue_api_v1_annotation_queues_post body → 200422
DELETE
/api/v1/annotation-queues
Delete Annotation Queues
delete_annotation_queues_api_v1_annotation_queues_delete 1 param → 200422
POST
/api/v1/annotation-queues/populate
Populate Annotation Queue
populate_annotation_queue_api_v1_annotation_queues_populate_post body → 200422
DELETE
/api/v1/annotation-queues/{queue_id}
Delete Annotation Queue
delete_annotation_queue_api_v1_annotation_queues__queue_id__delete 1 param → 200422
PATCH
/api/v1/annotation-queues/{queue_id}
Update Annotation Queue
update_annotation_queue_api_v1_annotation_queues__queue_id__patch 1 param body → 200422
GET
/api/v1/annotation-queues/{queue_id}
Get Annotation Queue
get_annotation_queue_api_v1_annotation_queues__queue_id__get 1 param → 200422
POST
/api/v1/annotation-queues/{queue_id}/runs
Add Runs To Annotation Queue
add_runs_to_annotation_queue_api_v1_annotation_queues__queue_id__runs_post 1 param body → 200422
GET
/api/v1/annotation-queues/{queue_id}/runs
Get Runs From Annotation Queue
get_runs_from_annotation_queue_api_v1_annotation_queues__queue_id__runs_get 6 params → 200422
POST
/api/v1/annotation-queues/{queue_id}/runs/by-key
Add Runs To Annotation Queue By Key
add_runs_to_annotation_queue_by_key_api_v1_annotation_queues__queue_id__runs_by_key_post 1 param body → 200422
POST
/api/v1/annotation-queues/{queue_id}/export
Export Annotation Queue Archived Runs
export_annotation_queue_archived_runs_api_v1_annotation_queues__queue_id__export_post 1 param body → 200422
GET
/api/v1/annotation-queues/{queue_id}/run/{index}
Get Run From Annotation Queue
get_run_from_annotation_queue_api_v1_annotation_queues__queue_id__run__index__get 3 params → 200422
GET
/api/v1/annotation-queues/{run_id}/queues
Get Annotation Queues For Run
get_annotation_queues_for_run_api_v1_annotation_queues__run_id__queues_get 1 param → 200422
PATCH
/api/v1/annotation-queues/{queue_id}/runs/{queue_run_id}
Update Run In Annotation Queue
update_run_in_annotation_queue_api_v1_annotation_queues__queue_id__runs__queue_run_id__patch 2 params body → 200422
DELETE
/api/v1/annotation-queues/{queue_id}/runs/{queue_run_id}
Delete Run From Annotation Queue
delete_run_from_annotation_queue_api_v1_annotation_queues__queue_id__runs__queue_run_id__delete 2 params → 200422
POST
/api/v1/annotation-queues/{queue_id}/runs/delete
Delete Runs From Annotation Queue
delete_runs_from_annotation_queue_api_v1_annotation_queues__queue_id__runs_delete_post 1 param body → 200422
GET
/api/v1/annotation-queues/{queue_id}/total_size
Get Total Size From Annotation Queue
get_total_size_from_annotation_queue_api_v1_annotation_queues__queue_id__total_size_get 1 param → 200422
GET
/api/v1/annotation-queues/{queue_id}/total_archived
Get Total Archived From Annotation Queue
get_total_archived_from_annotation_queue_api_v1_annotation_queues__queue_id__total_archived_get 3 params → 200422
GET
/api/v1/annotation-queues/{queue_id}/size
Get Size From Annotation Queue
get_size_from_annotation_queue_api_v1_annotation_queues__queue_id__size_get 2 params → 200422
POST
/api/v1/annotation-queues/status/{annotation_queue_run_id}
Create Identity Annotation Queue Run Status
create_identity_annotation_queue_run_status_api_v1_annotation_queues_status__annotation_queue_run_id__post 1 param body → 200422
GET
/api/v1/annotation-queues/{queue_id}/runs/resolve/{queue_run_id}
Resolve Annotation Queue Run
resolve_annotation_queue_run_api_v1_annotation_queues__queue_id__runs_resolve__queue_run_id__get 2 params → 200422
POST
/v1/platform/annotation-queues/{queue_id}/reviewers
Add a reviewer to an annotation queue
1 param body → 201400404500
DELETE
/v1/platform/annotation-queues/{queue_id}/reviewers/{identity_id}
Remove a reviewer from an annotation queue
2 params → 204400404500

Schemas 26

The contract defines 26 schemas that model the data the API accepts and returns. The most detailed are RunSchemaWithAnnotationQueueInfo (62 properties), AnnotationQueueSchemaWithRubric (18 properties), AnnotationQueueSchemaWithSize (17 properties), AnnotationQueueSchema (16 properties). Each schema is shown below with its type and property counts.

RunTypeEnum
string
Enum for run types.
annotationqueues.AddReviewerResponse
object
1 property
ValidationError
object
3 properties 3 required
AddRunToQueueByKeyRequest
object
Add run to AQ by SmithDB key. isroot derived server-side (LSAQ-141).
4 properties 3 required
AnnotationQueueRunUpdateSchema
object
2 properties
AnnotationQueueUpdateSchema
object
AnnotationQueue update schema.
10 properties
AnnotationQueueRubricItemSchema
object
6 properties 1 required
AnnotationQueueSizeSchema
object
Size of an Annotation Queue
1 property 1 required
Missing
object
1 property 1 required
RunSchemaWithAnnotationQueueInfo
object
Run schema with annotation queue info.
62 properties 9 required
AnnotationQueueCreateSchema
object
AnnotationQueue schema.
14 properties 1 required
annotationqueues.AddReviewerRequest
object
1 property 1 required
AddRunToQueueRequest
object
Add a single run to AQ (CH path) with an optional back-pointer to the issues-agent proposal that seeded this add. Use when bulk-adding runs that come from diff…
2 properties 1 required
AnnotationQueueSchemaWithRubric
object
AnnotationQueue schema with rubric.
18 properties 4 required
TraceTier
string
HTTPValidationError
object
1 property
AnnotationQueueRunSchema
object
6 properties 3 required
AssignedReviewerSchema
object
Identity info for an assigned reviewer on an annotation queue.
3 properties 1 required
AnnotationQueueRunAddSchema
object
Deprecated: use plain UUID list or AddRunToQueueByKeyRequest instead.
6 properties 1 required
ResolvedAnnotationQueueRunSchema
object
Resolved annotation queue run position for deep linking.
2 properties 2 required
IdentityAnnotationQueueRunStatusCreateSchema
object
Identity annotation queue run status create schema.
2 properties
AnnotationQueueSchema
object
AnnotationQueue schema.
16 properties 4 required
AnnotationQueueBulkDeleteRunsRequest
object
3 properties
ExportAnnotationQueueRunsRequest
object
Export annotation queue runs request schema.
3 properties
AnnotationQueueSchemaWithSize
object
AnnotationQueue schema with size.
17 properties 5 required
PopulateAnnotationQueueSchema
object
2 properties 2 required

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

langsmith-annotation-queues-api-openapi.yml Raw ↑

Other APIs LangSmith publishes across the network.

LangSmith access_policies API
LangSmith ace API
LangSmith agents API
LangSmith alert_rules API
LangSmith api-key API
LangSmith audit-logs API
LangSmith auth API
LangSmith aws_marketplace API
LangSmith backfills API
LangSmith beacon API
LangSmith bulk-exports API
LangSmith charts API
Where this information came from

This is an independent, third-party profile of LangSmith annotation-queues API, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.

The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.

Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.

info@apievangelist.com · Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.