How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

LangSmith run API

The run API from LangSmith — 19 operation(s) for run.

LangSmith run API is one of 73 APIs that LangSmith publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

Tagged areas include Run. The published artifact set on APIs.io includes an OpenAPI specification, API documentation, and an API reference.

This API exposes 24 operations across 19 paths, and defines 47 schemas. It is described by OpenAPI 3.1.0, at version 0.1.0.

Requests are made against a single base URL, /.

24 operations 19 paths 47 schemas 2 DELETE7 GET2 PATCH12 POST1 PUT

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.1.0
API Version
0.1.0
Base URL
https://api.smith.langchain.com
Authentication
API Key, API Key, HTTP Bearer, API Key
Resource Areas
1

Authentication & Security 4

LangSmith run API declares 4 security schemes for authenticating requests. An API key is passed in the header as X-API-Key (API Key). An API key is passed in the header as X-Tenant-Id (Tenant ID). It accepts HTTP bearer tokens (Bearer Auth). An API key is passed in the header as X-Organization-Id (Organization ID).

  • Bearer Auth — Bearer tokens are used to authenticate from the UI. Must also specify x-tenant-id or x-organization-id (for org scoped apis).

Paths & Operations 24

Across 19 paths, the API surfaces 24 operations — 2 DELETE, 7 GET, 2 PATCH, 12 POST, 1 PUT. Each is listed below with its method, path, parameters, and response codes.

run 24
GET
/api/v1/runs/rules
List Rules
list_rules_api_v1_runs_rules_get 8 params → 200422
POST
/api/v1/runs/rules
Create Rule
create_rule_api_v1_runs_rules_post body → 200422
POST
/api/v1/runs/rules/validate
Validate Rule
validate_rule_api_v1_runs_rules_validate_post body → 200422
PATCH
/api/v1/runs/rules/{rule_id}
Update Rule
update_rule_api_v1_runs_rules__rule_id__patch 1 param body → 200422
DELETE
/api/v1/runs/rules/{rule_id}
Delete Rule
delete_rule_api_v1_runs_rules__rule_id__delete 1 param → 200422
GET
/api/v1/runs/threads/{thread_id}
Thread Preview
thread_preview_api_v1_runs_threads__thread_id__get 4 params → 200422
GET
/api/v1/runs/rules/{rule_id}/logs
List Rule Logs
list_rule_logs_api_v1_runs_rules__rule_id__logs_get 6 params → 200422
GET
/api/v1/runs/rules/{rule_id}/logs/v2
List Rule Logs V2
list_rule_logs_v2_api_v1_runs_rules__rule_id__logs_v2_get 7 params → 200422
GET
/api/v1/runs/rules/{rule_id}/last_applied
Get Last Applied Rule
get_last_applied_rule_api_v1_runs_rules__rule_id__last_applied_get 2 params → 200422
POST
/api/v1/runs/rules/{rule_id}/trigger
Trigger Rule
trigger_rule_api_v1_runs_rules__rule_id__trigger_post 1 param → 200422
POST
/api/v1/runs/rules/trigger
Trigger Rules
trigger_rules_api_v1_runs_rules_trigger_post body → 200422
GET
/api/v1/runs/{run_id}
Read Run
read_run_api_v1_runs__run_id__get 6 params → 200422
PATCH
/api/v1/runs/{run_id}
Update Run
update_run_api_v1_runs__run_id__patch 1 param → 200422
GET
/api/v1/runs/{run_id}/share
Read Run Share State
read_run_share_state_api_v1_runs__run_id__share_get 1 param → 200422
PUT
/api/v1/runs/{run_id}/share
Share Run
share_run_api_v1_runs__run_id__share_put 1 param → 200422
DELETE
/api/v1/runs/{run_id}/share
Unshare Run
unshare_run_api_v1_runs__run_id__share_delete 1 param → 200422
POST
/api/v1/runs/query/validate
Validate Runs Query
validate_runs_query_api_v1_runs_query_validate_post body → 200422
POST
/api/v1/runs/query
Query Runs
query_runs_api_v1_runs_query_post body → 200422
POST
/api/v1/runs/generate-query
Generate Query For Runs
generate_query_for_runs_api_v1_runs_generate_query_post body → 200422
POST
/api/v1/runs/stats
Stats Runs
stats_runs_api_v1_runs_stats_post body → 200422
POST
/api/v1/runs/group
Group Runs
group_runs_api_v1_runs_group_post 1 param body → 200422
POST
/api/v1/runs/group/stats
Stats Group Runs
stats_group_runs_api_v1_runs_group_stats_post body → 200422
POST
/api/v1/runs/delete/traces
Delete Runs Abac
delete_runs_abac_api_v1_runs_delete_traces_post body → 200422
POST
/api/v1/runs/delete
Delete Runs
delete_runs_api_v1_runs_delete_post body → 200422

Schemas 47

The contract defines 47 schemas that model the data the API accepts and returns. The most detailed are RunSchema (55 properties), RunRulesSchema (40 properties), RunRulesValidateSchema (30 properties), RunGroupStats (29 properties). Each schema is shown below with its type and property counts.

RunTypeEnum
string
Enum for run types.
RunsGenerateQueryFeedbackKeys
string
ThreadPreviewResponse
object
Response to preview a thread.
2 properties 2 required
ValidationError
object
3 properties 3 required
RunRuleSpendLimitSchema-Input
object
2 properties 2 required
RequestBodyForRunsGenerateQuery
object
2 properties 1 required
RunsFilterDataSourceTypeEnum
string
Enum for run data source types.
RunRuleSpendLimitSchema-Output
object
2 properties 2 required
EvaluatorTopLevel
object
1 property 1 required
RunSelect
string
Enum for available run columns.
ResponseBodyForRunsGenerateQuery
object
2 properties 2 required
RunRulesValidateSchema
object
Schema for validating rules without creating them. Extends RunRulesCreateSchema with test data fields for validation. Only LLM-as-judge rules (evaluators) are…
30 properties 2 required
RunShareSchema
object
2 properties 2 required
EvaluatorStructuredOutput
object
Evaluator structured output schema.
6 properties
ListRunsResponse
object
4 properties 2 required
PagerdutySeverity
string
Enum for severity.
RunDateOrder
string
Enum for run start date order.
CodeEvaluatorTopLevel
object
2 properties 1 required
RuleLogActionResponse
object
2 properties 1 required
RunRuleSpendLimitWindow
string
RunStatsGroupBy
object
Group by param for run stats.
3 properties 1 required
RunRulesWebhookSchema
object
2 properties 1 required
Body_delete_runs_api_v1_runs_delete_post
object
2 properties 2 required
BodyParamsForRunsQuerySchema
object
Query params for runs query endpoint.
24 properties
RunStatsQueryParams
object
Query params for run stats.
22 properties
RunsQueryValidationError
object
A single validation error for the runs query validate endpoint.
2 properties 2 required
RunGroupStats
object
29 properties 1 required
RuleLogsPaginatedResponse
object
Paginated response for rule logs with cursor-based pagination.
3 properties 2 required
RunRulesSchema
object
Run rules schema.
40 properties 8 required
TraceTier
string
HTTPValidationError
object
1 property
RunStats
object
28 properties
RunSchema
object
Run schema.
55 properties 8 required
RunStatsSelect
string
Metrics you can select from run stats endpoint.
RuleLogSchema
object
Run rules log schema.
14 properties 4 required
RunRulesPagerdutyAlertSchema
object
4 properties 1 required
RuleLogActionOutcome
string
CodeEvaluatorLanguage
string
RunsQueryValidationResponse
object
Response for POST /runs/query/validate.
2 properties 1 required
TriggerRulesRequest
object
2 properties
RunRulesUpdateSchema
object
25 properties 2 required
Body_delete_runs_abac_api_v1_runs_delete_traces_post
object
2 properties 2 required
RunGroupRequest
object
7 properties 2 required
RunGroupBy
string
RunRulesAlertType
string
Enum for alert types.
RunRulesCreateSchema
object
26 properties 2 required
ThreadMessagesFormatType
string
Enum for thread messages format types.

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

langsmith-run-api-openapi.yml Raw ↑

Other APIs LangSmith publishes across the network.

LangSmith access_policies API
LangSmith ace API
LangSmith agents API
LangSmith alert_rules API
LangSmith annotation-queues API
LangSmith api-key API
LangSmith audit-logs API
LangSmith auth API
LangSmith aws_marketplace API
LangSmith backfills API
LangSmith beacon API
LangSmith bulk-exports API
Where this information came from

This is an independent, third-party profile of LangSmith run API, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.

The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.

Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.

info@apievangelist.com · Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.