Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.streamkap.com/llms.txt

Use this file to discover all available pages before exploring further.

All resources are documented with full attribute details and examples on the HashiCorp Registry.

Sources

ResourceTerraform TypeRegistry Docs
PostgreSQLstreamkap_source_postgresqlView →
MySQLstreamkap_source_mysqlView →
MongoDBstreamkap_source_mongodbView →
DynamoDBstreamkap_source_dynamodbView →
SQL Serverstreamkap_source_sqlserverView →
Kafka Directstreamkap_source_kafkadirectView →
AlloyDBstreamkap_source_alloydbView →
DB2streamkap_source_db2View →
DocumentDBstreamkap_source_documentdbView →
Elasticsearchstreamkap_source_elasticsearchView →
MariaDBstreamkap_source_mariadbView →
MongoDB Hostedstreamkap_source_mongodbhostedView →
Oraclestreamkap_source_oracleView →
Oracle AWSstreamkap_source_oracleawsView →
PlanetScalestreamkap_source_planetscaleView →
Redisstreamkap_source_redisView →
S3streamkap_source_s3View →
Supabasestreamkap_source_supabaseView →
Vitessstreamkap_source_vitessView →
Webhookstreamkap_source_webhookView →

Adding Tables to an Existing Source

To add tables to an existing CDC source via Terraform, use the table_include_list_user_defined attribute. This corresponds to the table.include.list.user.defined API parameter and lets you append tables without modifying the original table_include_list. When you apply the updated configuration, Streamkap adds the specified tables to the source. If the pipeline has snapshot_new_tables = true, the new tables are automatically snapshotted.
resource "streamkap_source_postgresql" "example" {
  name              = "my-postgres-source"
  database_hostname = var.hostname
  database_port     = 5432
  database_user     = var.username
  database_password = var.password
  database_dbname   = "mydb"
  database_sslmode  = "require"

  schema_include_list = "public"
  table_include_list  = "public.orders,public.customers"

  # Add new tables to an existing source without modifying the original list
  table_include_list_user_defined = "public.products,public.inventory"

  signal_data_collection_schema_or_database = "streamkap.streamkap_signal"
  slot_name        = "streamkap_slot"
  publication_name = "streamkap_pub"
}
The same approach works for MySQL, SQL Server, Oracle, and Db2 sources — use table_include_list_user_defined on the corresponding resource type. For Kafka Direct sources, use topic_include_list_user_defined instead.

Destinations

ResourceTerraform TypeRegistry Docs
Snowflakestreamkap_destination_snowflakeView →
Databricksstreamkap_destination_databricksView →
ClickHousestreamkap_destination_clickhouseView →
PostgreSQLstreamkap_destination_postgresqlView →
S3streamkap_destination_s3View →
Icebergstreamkap_destination_icebergView →
Kafkastreamkap_destination_kafkaView →
Azure Blobstreamkap_destination_azblobView →
BigQuerystreamkap_destination_bigqueryView →
CockroachDBstreamkap_destination_cockroachdbView →
DB2streamkap_destination_db2View →
GCSstreamkap_destination_gcsView →
HTTP Sinkstreamkap_destination_httpsinkView →
Kafka Directstreamkap_destination_kafkadirectView →
Motherduckstreamkap_destination_motherduckView →
MySQLstreamkap_destination_mysqlView →
Oraclestreamkap_destination_oracleView →
Pineconestreamkap_destination_pineconeView →
R2streamkap_destination_r2View →
Redisstreamkap_destination_redisView →
Redshiftstreamkap_destination_redshiftView →
SQL Serverstreamkap_destination_sqlserverView →
Starburststreamkap_destination_starburstView →
Weaviatestreamkap_destination_weaviateView →

Transforms

ResourceTerraform TypeRegistry Docs
Map Filterstreamkap_transform_map_filterView →
Enrichstreamkap_transform_enrichView →
Enrich Asyncstreamkap_transform_enrich_asyncView →
SQL Joinstreamkap_transform_sql_joinView →
Rollupstreamkap_transform_rollupView →
Fan Outstreamkap_transform_fan_outView →

Pipelines & Topics

ResourceTerraform TypeRegistry Docs
Pipelinestreamkap_pipelineView →
Topicstreamkap_topicView →
Tagstreamkap_tagView →

Data Sources

Data SourceTerraform TypeRegistry Docs
Tagdata.streamkap_tagView →
Transformdata.streamkap_transformView →
Topicdata.streamkap_topicView →
Topics (list)data.streamkap_topicsView →
Topic Metricsdata.streamkap_topic_metricsView →