The identity and technical contract details declared by the specification.
FormatConfig
object
Data format specification used to parse raw data received from the endpoint or to encode data sent to the endpoint.
2 properties
1 required
FileInputConfig
object
Configuration for reading data from a file with FileInputTransport
3 properties
1 required
SyncConfig
object
22 properties
1 required
Version
integer
Version number.
SqlCompilationInfo
object
SQL compilation information.
2 properties
2 required
PipelineId
string
Pipeline identifier.
ProgramStatus
string
Program compilation status.
HttpInputConfig
object
Configuration for data input via HTTP. HTTP input adapters cannot be usefully configured as part of pipeline configuration. Instead, instantiate them through t…
1 property
1 required
CheckpointResponse
object
Response to a checkpoint request.
1 property
1 required
DatagenInputConfig
object
Configuration for generating random data for a table.
4 properties
SqlType
string
The available SQL column type names. Each value is the platform's wire encoding of the type (e.g. BIGINT, INTEGER, INTERVALDAY), not valid SQL type syntax.
DynamoDBWriteMode
string
DynamoDB write API used by the output connector.
StorageCompression
string
Storage compression algorithm.
S3InputConfig
object
Configuration for reading data from AWS S3.
10 properties
2 required
ObjectStorageConfig
object
1 property
1 required
RuntimeStatusDetails
object
Details about the current runtime status. The fields in this struct should all be optional and set only by a runtime status when they are known. Otherwise, the…
3 properties
PropertyValue
object
3 properties
3 required
GlueCatalogConfig
object
AWS Glue catalog config.
8 properties
DatagenStrategy
string
Strategy used to generate values.
CheckpointMetadata
object
Holds meta-data about a checkpoint that was taken for persistent storage and recovery of a circuit's state.
6 properties
2 required
KafkaHeader
object
Kafka message header.
2 properties
1 required
ProgramError
object
Log, warning and error information about the program compilation.
3 properties
UrlInputConfig
object
Configuration for reading data from an HTTP or HTTPS URL with UrlInputTransport.
2 properties
1 required
IcebergIngestMode
string
Iceberg table read mode. Three options are available: snapshot - read a snapshot of the table and stop. follow - continuously ingest changes to the table, star…
TransportConfig
Transport-specific endpoint configuration passed to crate::OutputTransport::newendpoint and crate::InputTransport::newendpoint.
StorageStatus
string
Storage status. The storage status can only transition when the resources status is Stopped. text Cleared ───┐ ▲ │ /clear │ │ │ │ Clearing │ ▲ │ │ │ InUse ◄───┘
PipelineInfo
Pipeline information. It both includes fields which are user-provided and system-generated.
FileBackendConfig
object
Configuration for local file system access.
3 properties
ResourceConfig
object
8 properties
NatsInputConfig
object
5 properties
3 required
RuntimeConfig
object
Global pipeline configuration settings. This is the publicly exposed type for users to configure pipelines.
24 properties
CheckpointSyncFailure
object
Information about a failed checkpoint sync.
2 properties
2 required
CheckpointStatus
object
Checkpoint status returned by the /checkpointstatus endpoint.
2 properties
ConnectOptions
object
Options for connecting to a NATS server.
4 properties
1 required
StartTransactionResponse
object
Response to a /starttransaction request.
1 property
1 required
ProgramConfig
object
Program configuration.
4 properties
DeltaTableWriteMode
string
Delta table write mode. Determines how the Delta table connector handles an existing table at the target location.
ProgramSchema
object
A struct containing the tables (inputs) and views for a program. Parse from the JSON data-type of the DDL generated by the SQL compiler.
2 properties
2 required
AdHocInputConfig
object
Configuration for inserting data with ad-hoc queries An ad-hoc input adapters cannot be usefully configured as part of pipeline configuration. Instead, use ad-…
1 property
1 required
PostgresReaderConfig
Postgres input connector configuration.
SqlCompilerMessage
object
A SQL compiler error. The SQL compiler returns a list of errors in the following JSON format if it's invoked with the -je option. ignore [ { "startlinenumber"…
8 properties
7 required
KafkaOutputConfig
object
Configuration for writing data to a Kafka topic with OutputTransport.
7 properties
1 required
ColumnType
object
A SQL column type description. Matches the Calcite JSON format.
8 properties
1 required
StorageStatusDetails
object
Details about pipeline storage, which are returned as part of the regular runtime status polling by the runner.
1 property
1 required
MergerType
string
Which merger to use.
IcebergCatalogType
string
FtConfig
object
Fault-tolerance configuration. The default [FtConfig] (via [FtConfig::default]) disables fault tolerance, which is the configuration that one gets if [RuntimeC…
2 properties
DeltaTableWriterConfig
object
Delta table output connector configuration.
7 properties
1 required
ConsumerConfig
object
11 properties
1 required
StorageOptions
object
Storage configuration for a pipeline.
5 properties
BufferCacheAllocationStrategy
string
Controls how caches are shared across a foreground/background worker pair.
PartialProgramInfo
object
Program information is the result of the SQL compilation.
4 properties
4 required
CheckpointSyncStatus
object
Checkpoint status returned by the /checkpoint/syncstatus endpoint.
3 properties
RedisOutputConfig
object
Redis output connector configuration.
2 properties
1 required
UserAndPassword
object
2 properties
2 required
PostgresWriteMode
string
PostgreSQL write mode. Determines how the PostgreSQL output connector writes data to the target table.
PostgresWriterConfig
Postgres output connector configuration.
KafkaHeaderValue
string
Kafka header value encoded as a UTF-8 string or a byte array.
PostprocessorConfig
object
Configuration for describing a postprocessor
2 properties
2 required
CombinedDesiredStatus
string
AdHocResultFormat
string
URL-encoded format argument to the /query endpoint.
DeltaTableReaderConfig
object
Delta table input connector configuration.
16 properties
2 required
RestCatalogConfig
object
Iceberg REST catalog config.
10 properties
StorageBackendConfig
Backend storage configuration.
RemoteCheckpoint
object
A checkpoint that exists in remote object storage.
1 property
1 required
DynamoDBWriterConfig
object
DynamoDB output connector configuration.
13 properties
2 required
ErrorResponse
object
Information returned by REST API endpoints on error.
3 properties
3 required
IcebergReaderConfig
Iceberg input connector configuration.
PipelineTemplateConfig
object
Configuration for supplying a custom pipeline StatefulSet template via a Kubernetes ConfigMap. Operators can provide a custom StatefulSet YAML that the Kuberne…
2 properties
1 required
OutputBufferConfig
object
3 properties
Field
A SQL field. Matches the SQL compiler JSON format.
DevTweaks
object
Optional settings for tweaking Feldera internals. These settings reflect experiments that may come and go and change from version to version. Users should not…
26 properties
HttpOutputConfig
object
Configuration for data output via HTTP. HTTP output adapters cannot be usefully configured as part of pipeline configuration. Instead, instantiate them through…
1 property
RngFieldSettings
object
Configuration for generating random data for a field of a table.
9 properties
CompilationProfile
string
Enumeration of possible compilation profiles that can be passed to the Rust compiler as an argument via cargo build --profile <. A compilation profile affects…
ConnectorStats
object
Statistics across all connectors.
1 property
1 required
RustCompilationInfo
object
Rust compilation information.
3 properties
3 required
OutputEndpointConfig
Describes an output connector configuration
ClockConfig
object
3 properties
1 required
PubSubInputConfig
object
Google Pub/Sub input connector configuration.
10 properties
1 required
DeltaTableTransactionMode
string
Delta table transaction mode. Determines how the connector breaks up its input into transactions. none - the connector does not break up its input into transac…
HeaderFilter
A boolean filter over the headers of a Kafka message. The Kafka input connector uses this to drop messages whose headers do not satisfy a predicate. It is a tr…
PostgresCdcReaderConfig
Postgres CDC input connector configuration. Uses logical replication to capture ongoing changes from a Postgres database. Requires a pre-created publication an…
NexmarkInputConfig
object
Configuration for generating Nexmark input data. This connector must be used exactly three times in a pipeline if it is used at all, once for each [NexmarkTabl…
2 properties
1 required
PreprocessorConfig
object
Configuration for describing a preprocessor
3 properties
3 required
S3TablesCatalogConfig
object
Amazon S3 Tables catalog config.
7 properties
CheckpointSyncResponse
object
Response to a sync checkpoint request.
1 property
1 required
ClientMetadata
object
Client-generated data stored alongside a pipeline. The fields are stored together as a single JSON object in the clientmetadata text column, so adding a field…
2 properties
CheckpointFailure
object
Information about a failed checkpoint.
3 properties
3 required
ResourcesStatus
string
Pipeline resources status. text /start (early start or provision check failed) ┌───┐ │ ▼ Stopped ◄────────── Stopping /start │ ▲ │ │ /stop?force=true │ │ OR: t…
FtModel
string
Fault tolerance model. The ordering is significant: we consider [Self::ExactlyOnce] to be a "higher level" of fault tolerance than [Self::AtLeastOnce].
SourcePosition
object
4 properties
4 required
InputEndpointConfig
Describes an input connector configuration
KafkaInputConfig
object
Configuration for reading data from Kafka topics with InputTransport.
15 properties
2 required
KafkaLogLevel
string
Kafka logging levels.
HeaderMatch
object
A leaf of a [HeaderFilter]: a regular expression tested against the value of a named Kafka header.
2 properties
2 required
KafkaStartFromConfig
Where to begin reading a Kafka topic.
BufferCacheStrategy
string
Selects which eviction strategy backs a cache instance.
ResourcesDesiredStatus
string
SqlIdentifier
object
An SQL identifier. This struct is used to represent SQL identifiers in a canonical form. We store table names or field names as identifiers in the schema.
2 properties
2 required
GenerationPlan
object
A random generation plan for a table that generates either a limited amount of rows or runs continuously.
4 properties
Relation
A SQL table or view. It has a name and a list of fields. Matches the Calcite JSON format.
NexmarkInputOptions
object
Configuration for generating Nexmark input data.
4 properties
RuntimeStatus
string
Runtime status of the pipeline. Of the statuses, only Unavailable is determined by the runner. All other statuses are determined by the pipeline and taken over…
RuntimeDesiredStatus
string
DeltaTableIngestMode
string
Delta table read mode. Three options are available: snapshot - read a snapshot of the table and stop. follow - continuously ingest changes to the table, starti…
NexmarkTable
string
Table in Nexmark.
FileOutputConfig
object
Configuration for writing data to a file with FileOutputTransport.
1 property
1 required
KafkaOutputFtConfig
object
Fault tolerance configuration for Kafka output connector.
2 properties
The full machine-readable OpenAPI contract behind this narrative.
Other APIs Feldera publishes across the network.