Transforms
Transform Types
Below are the current and upcoming transform types Streamkap offers for data transformation:
Transform Name | Description | Supported Languages | Status |
---|---|---|---|
Transform / Filter Records | Apply custom logic to modify or filter records. | JavaScript | ✅ Available |
Enrich | Lookup values from a cached topic to enrich records. Handles schema evolution and pass-through fields. | SQL | ✅ Available |
Join | Join multiple topics. Supports schema evolution and pass-through fields. | SQL | ✅ Available |
Enrich (Async) | Asynchronously call REST APIs to enrich incoming records using dynamic payloads. | JavaScript | ✅ Available |
Un Nesting | Break nested objects or arrays into separate topics. Ideal for unrolling deeply nested documents. | JavaScript, Python | 🛠️ Coming Soon |
Fan Out | Route a single record to multiple output topics based on custom logic. | JavaScript | ✅ Available |
Toast Handling | Replace PostgreSQL TOAST placeholders with cached, encrypted original values to avoid costly re-selects. | TBC | 🛠️ Coming Soon |
Development Tools
Professional development environments and starter kits for building transforms:
Tool Name | Description | Transform Types Supported | Status |
---|---|---|---|
TypeScript Development Kit | Professional development environment with TypeScript, npm dependencies, comprehensive testing, and production bundling. | Map/Filter, Fan Out, Enrich (Async), Un-nesting | ✅ Available |
If you don't see a transform listed, please contact us as we're happy to help find and provide the transform you need.
Updated about 10 hours ago