How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Need help?

Contact us
LangSmith

LangSmith Datasets API

The datasets API from LangSmith — 28 operation(s) for datasets.

Documentation Provider Profile APIs.io OpenAPI GitHub

LangSmith Datasets API is one of 73 APIs that LangSmith publishes on the APIs.io network, described by a machine-readable OpenAPI specification.

Tagged areas include Datasets. The published artifact set on APIs.io includes an OpenAPI specification, API documentation, and an API reference.

This API exposes 35 operations across 28 paths, and defines 62 schemas. It is described by OpenAPI 3.2.0, at version 0.1.0.

Requests are made against a single base URL, /.

35 operations 28 paths 62 schemas 4 DELETE13 GET1 PATCH14 POST3 PUT

Metadata

The identity and technical contract details declared by the specification.

Specification
OpenAPI 3.2.0
API Version
0.1.0
Base URL
https://api.smith.langchain.com
Authentication
API Key, API Key, HTTP Bearer, API Key
Resource Areas
1

Authentication & Security 4

LangSmith Datasets API declares 4 security schemes for authenticating requests. An API key is passed in the header as X-API-Key (API_Key). An API key is passed in the header as X-Tenant-Id (Tenant_ID). It accepts HTTP bearer tokens (Bearer_Auth). An API key is passed in the header as X-Organization-Id (Organization_ID).

  • Bearer_Auth — Bearer tokens are used to authenticate from the UI. Must also specify x-tenant-id or x-organization-id (for org scoped apis).

Paths & Operations 35

Across 28 paths, the API surfaces 35 operations — 4 DELETE, 13 GET, 1 PATCH, 14 POST, 3 PUT. Each is listed below with its method, path, parameters, and response codes.

Datasets 35
GET
/api/v1/datasets
Read Datasets
read_datasets_api_v1_datasets_get 12 params → 200422
POST
/api/v1/datasets
Create Dataset
create_dataset_api_v1_datasets_post body → 200422
DELETE
/api/v1/datasets
Delete Datasets
delete_datasets_api_v1_datasets_delete 1 param → 200422
GET
/api/v1/datasets/stream
Read Datasets Stream
read_datasets_stream_api_v1_datasets_stream_get 11 params → 200422
GET
/api/v1/datasets/{dataset_id}
Read Dataset
read_dataset_api_v1_datasets__dataset_id__get 1 param → 200422
DELETE
/api/v1/datasets/{dataset_id}
Delete Dataset
delete_dataset_api_v1_datasets__dataset_id__delete 1 param → 200422
PATCH
/api/v1/datasets/{dataset_id}
Update Dataset
update_dataset_api_v1_datasets__dataset_id__patch 1 param body → 200422
POST
/api/v1/datasets/upload
Upload Csv Dataset
upload_csv_dataset_api_v1_datasets_upload_post body → 200422
POST
/api/v1/datasets/upload-experiment
Upload Experiment
upload_experiment_api_v1_datasets_upload_experiment_post body → 200422
GET
/api/v1/datasets/{dataset_id}/versions
Get Dataset Versions
get_dataset_versions_api_v1_datasets__dataset_id__versions_get 5 params → 200422
GET
/api/v1/datasets/{dataset_id}/versions/diff
Diff Dataset Versions
diff_dataset_versions_api_v1_datasets__dataset_id__versions_diff_get 3 params → 200422
GET
/api/v1/datasets/{dataset_id}/version
Get Dataset Version
get_dataset_version_api_v1_datasets__dataset_id__version_get 3 params → 200422
PUT
/api/v1/datasets/{dataset_id}/tags
Update Dataset Version
update_dataset_version_api_v1_datasets__dataset_id__tags_put 1 param body → 200422
GET
/api/v1/datasets/{dataset_id}/openai
Download Dataset Openai
download_dataset_openai_api_v1_datasets__dataset_id__openai_get 2 params → 200422
GET
/api/v1/datasets/{dataset_id}/openai_ft
Download Dataset Openai Ft
download_dataset_openai_ft_api_v1_datasets__dataset_id__openai_ft_get 2 params → 200422
GET
/api/v1/datasets/{dataset_id}/csv
Download Dataset Csv
download_dataset_csv_api_v1_datasets__dataset_id__csv_get 2 params → 200422
GET
/api/v1/datasets/{dataset_id}/jsonl
Download Dataset Jsonl
download_dataset_jsonl_api_v1_datasets__dataset_id__jsonl_get 2 params → 200422
POST
/api/v1/datasets/{dataset_id}/runs
Read Examples With Runs
read_examples_with_runs_api_v1_datasets__dataset_id__runs_post 2 params body → 200422
POST
/api/v1/datasets/{dataset_id}/group/runs
Read Examples With Runs Grouped
read_examples_with_runs_grouped_api_v1_datasets__dataset_id__group_runs_post 1 param body → 200422
POST
/api/v1/datasets/{dataset_id}/runs/delta
Read Delta
read_delta_api_v1_datasets__dataset_id__runs_delta_post 1 param body → 200422
POST
/api/v1/datasets/{dataset_id}/runs/delta/stream
Read Delta Stream
read_delta_stream_api_v1_datasets__dataset_id__runs_delta_stream_post 1 param body → 200422
POST
/api/v1/datasets/{dataset_id}/experiments/grouped
Read Grouped Experiments
read_grouped_experiments_api_v1_datasets__dataset_id__experiments_grouped_post 1 param body → 200422
GET
/api/v1/datasets/{dataset_id}/share
Read Dataset Share State
read_dataset_share_state_api_v1_datasets__dataset_id__share_get 1 param → 200422
PUT
/api/v1/datasets/{dataset_id}/share
Share Dataset
share_dataset_api_v1_datasets__dataset_id__share_put 2 params → 200422
DELETE
/api/v1/datasets/{dataset_id}/share
Unshare Dataset
unshare_dataset_api_v1_datasets__dataset_id__share_delete 1 param → 200422
GET
/api/v1/datasets/{dataset_id}/comparative
Read Comparative Experiments
read_comparative_experiments_api_v1_datasets__dataset_id__comparative_get 8 params → 200422
POST
/api/v1/datasets/comparative
Create Comparative Experiment
create_comparative_experiment_api_v1_datasets_comparative_post body → 200422
DELETE
/api/v1/datasets/comparative/{comparative_experiment_id}
Delete Comparative Experiment
delete_comparative_experiment_api_v1_datasets_comparative__comparative_experiment_id__delete 1 param → 200422
POST
/api/v1/datasets/clone
Clone Dataset
clone_dataset_api_v1_datasets_clone_post body → 200422
GET
/api/v1/datasets/{dataset_id}/splits
Get Dataset Splits
get_dataset_splits_api_v1_datasets__dataset_id__splits_get 2 params → 200422
PUT
/api/v1/datasets/{dataset_id}/splits
Update Dataset Splits
update_dataset_splits_api_v1_datasets__dataset_id__splits_put 1 param body → 200422
POST
/api/v1/datasets/{dataset_id}/generate
Generate
generate_api_v1_datasets__dataset_id__generate_post 1 param body → 200422
POST
/api/v1/datasets/playground_experiment/batch
Dataset Handler
dataset_handler_api_v1_datasets_playground_experiment_batch_post body → 200422
POST
/api/v1/datasets/playground_experiment/stream
Stream Dataset Handler
stream_dataset_handler_api_v1_datasets_playground_experiment_stream_post body → 200422
POST
/api/v1/datasets/studio_experiment
Studio Experiment
studio_experiment_api_v1_datasets_studio_experiment_post body → 200422

Schemas 62

The contract defines 62 schemas that model the data the API accepts and returns. The most detailed are RunSchemaComparisonView (37 properties), GroupedRunsSessionStats (33 properties), TracerSession (29 properties), PlaygroundRunOverDatasetBatchRequestSchema (21 properties). Each schema is shown below with its type and property counts.

ExampleWithRunsCH
object
Example schema with list of runs from ClickHouse. For non-grouped endpoint (/datasets/{datasetid}/runs): runs from single session. For grouped endpoint (/datas…
11 properties 5 required
FeedbackCategory
object
Specific value and label pair for feedback
2 properties 1 required
QueryExampleSchemaWithRunsRequest
object
Request DTO for querying examples with runs - used for API input. This is separate from the internal schema to cleanly handle optional limit values. When limit…
9 properties 1 required
DataType
string
Enum for dataset data types.
QueryFeedbackDeltaBatch
object
Request schema for batched feedback delta queries with multiple feedback keys.
4 properties 3 required
AppFeedbackSource
object
Feedback from the LangChainPlus App.
2 properties
Body_upload_csv_dataset_api_v1_datasets_upload_post
object
13 properties 2 required
SortByDatasetColumn
string
Enum for available dataset columns to sort by.
ModelFeedbackSource
object
Model feedback source.
2 properties
RunSchemaComparisonView
object
Run schema for comparison view.
37 properties 6 required
ValidationError
object
3 properties 3 required
TracerSession
object
TracerSession schema.
29 properties 2 required
DatasetVersion
object
Dataset version schema.
2 properties 1 required
FeedbackSchema
object
Schema for getting feedback.
18 properties 2 required
PutDatasetVersionsSchema
object
2 properties 2 required
ExampleGroupWithSessions
object
Group of examples with a specific metadata value across multiple sessions. Extends RunGroupBase with: - groupkey: metadata value that defines this group - sess…
18 properties 5 required
DatasetTransformation
object
2 properties 2 required
AutoEvalFeedbackSource
object
Auto eval feedback source.
2 properties
FeedbackDelta
object
Feedback key with number of improvements and regressions.
2 properties 2 required
APIFeedbackSource
object
API feedback source.
2 properties
DatasetCreate
object
Create class for Dataset.
10 properties 1 required
DatasetUpdate
object
Update class for Dataset.
8 properties
SortByComparativeExperimentColumn
string
Enum for available comparative experiment columns to sort by.
ExperimentResultsUpload
object
Class for uploading the results of an already-run experiment.
10 properties 4 required
ExperimentResultRow
object
Class for a single row in the uploaded experiment results.
10 properties 3 required
RunnableConfig
object
Configuration for a Runnable. !!! note Custom values The TypedDict has total=False set intentionally to: - Allow partial configs to be created and merged toget…
8 properties
GroupedExperimentsRequest
object
Schema for grouped experiment (tracer session) query.
8 properties 1 required
QueryFeedbackDelta
object
7 properties 3 required
RunTypeEnum
string
Enum for run types.
DatasetTransformationType
string
Enum for dataset transformation types. Ordering determines the order in which transformations are applied if there are multiple transformations on the same pat…
ComparativeExperimentBase
object
ComparativeExperiment schema.
8 properties 5 required
GroupedExamplesWithRunsResponse
object
Response for grouped comparison view of dataset examples. Returns dataset examples grouped by a run metadata value (e.g., model='gpt-4'). Optional filters are…
1 property 1 required
ExperimentResultsUploadResult
object
Class for uploading the results of an already-run experiment.
2 properties 2 required
PlaygroundRunOverDatasetBatchRequestSchema
object
21 properties 5 required
Body_clone_dataset_api_v1_datasets_clone_post
object
5 properties 2 required
DatasetDiffInfo
object
Dataset diff schema.
3 properties 3 required
ComparativeExperimentCreate
object
Create class for ComparativeExperiment.
8 properties 1 required
SessionFeedbackDelta
object
List of feedback keys with number of improvements and regressions for each.
1 property 1 required
GetDatasetsSelect
string
GroupedRunsSessionStats
object
TracerSession stats filtered to runs matching a specific metadata value. Extends TracerSession with: - examplecount: unique examples (vs runcount = total runs…
33 properties 3 required
SortParamsForRunsComparisonView
object
2 properties 1 required
Body_update_dataset_splits_api_v1_datasets__dataset_id__splits_put
object
3 properties 2 required
RunnerContextEnum
string
AttachmentsOperations
object
2 properties
DatasetShareSchema
object
2 properties 2 required
ExampleUpdate
object
Update class for Example.
7 properties
QueryGroupedExamplesWithRuns
object
8 properties 3 required
PlaygroundRunOverDatasetRequestSchema
object
20 properties 5 required
Dataset
object
Dataset schema.
16 properties 5 required
Missing
object
1 property 1 required
GroupExampleRunsByField
string
SimpleExperimentInfo
object
Simple experiment info schema for use with comparative experiments
2 properties 2 required
StudioRunOverDatasetRequestSchema
object
4 properties 2 required
FeedbackType
string
Enum for feedback types.
HTTPValidationError
object
1 property
DatasetSchemaForUpdate
object
10 properties 3 required
TraceTier
string
FeedbackConfig
object
4 properties 1 required
GenerateSyntheticExamplesBody
object
2 properties 1 required
FeedbackCreateCoreSchema
object
Schema used for creating feedback without run id or session id.
13 properties 1 required
ComparativeExperiment
object
ComparativeExperiment schema.
10 properties 6 required
FeedbackSource
object
The feedback source loaded from the database.
5 properties

Specification

The full machine-readable OpenAPI contract behind this narrative.

Source

langsmith-datasets-api-openapi.yml Raw ↑

Other APIs LangSmith publishes across the network.

LangSmith Access Policies API
AE Profile APIs.io
LangSmith Ace API
AE Profile APIs.io
LangSmith Agents API
AE Profile APIs.io
LangSmith Alert Rules API
AE Profile APIs.io
LangSmith Annotation Queues API
AE Profile APIs.io
LangSmith API Key API
AE Profile APIs.io
LangSmith Audit Logs API
AE Profile APIs.io
LangSmith Auth API
AE Profile APIs.io
LangSmith Aws Marketplace API
AE Profile APIs.io
LangSmith Backfills API
AE Profile APIs.io
LangSmith Beacon API
AE Profile APIs.io
LangSmith Bulk Exports API
AE Profile APIs.io
#Datasets
← Back to L APIs
API Details
ID
langsmith:langsmith-datasets-api
Base URL
https://api.smith.langchain.com
Docs
https://docs.langchain.com/langsmith/tracing
Provider
LangSmith
APIs.io →  GitHub →
Explore more
All APIs Providers APIs.io Network
Work with this as data

Every API here is available over the API and to AI agents over MCP. APIs is not yet its own endpoint on the v1 API. Reach this content through network search and the tag graph, or the MCP server below.

Installs https://mcp.apievangelist.com/mcp in Claude, Cursor, VS Code and the rest — one button, every client.

MCP tools for apis
4 tools reach this content
  • search_api_evangelistSearch every content type across the network at once.
  • find_relatedThe shared-tag relevance graph — what else covers this.
  • get_tagEverything one tag labels, across all content types.
  • guide_topicPRO — a curated bundle for a topic: area, guidance, rules, papers, stories, services.
All tools & prompts
Call it yourself
curl for this page
Search the network for this 
curl "https://api.apievangelist.com/v1/search?q=langsmith-datasets-api&limit=10"
Everything under a tag 
curl "https://api.apievangelist.com/v1/tags/langsmith-datasets-api"

Discovery needs no key. Full bodies and the synthesis endpoints are Pro.

Get an API key

Free tier, no email required. Sign in with whichever identity you already have.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have. Your account

Where this information came from

This is an independent, third-party profile of LangSmith Datasets API, published by API Evangelist. We do not operate, host, resell, or support these APIs, and we are not affiliated with or endorsed by the company unless stated above. Everything here is built from publicly available information — the company's own site, developer portal, documentation, public repositories, and the specifications it publishes for public use. Nothing is obtained by breaching a system, defeating an access control, or using credentials.

The Kin Score and Agent Readiness rating are independently calculated assessments of a company's public API artifacts, scored against a published rubric. They are not certifications, endorsements, security assessments, or audits.

Corrections, re-scores, and removal are free — no partnership or purchase required, and you do not need to justify the request. A removed company is recorded as unrated, never scored zero for having asked. Acknowledgement within one business day; removal within two.

info@apievangelist.com · Read the full data-sourcing policy →
On a security or compliance team? Put security in the subject line and you will get a person, not a form — we will tell you exactly which public URLs this profile was built from.