Transforms

Transform Types

Below are the current and upcoming transform types Streamkap offers for data transformation:

Transform NameDescriptionSupported LanguagesStatus
Transform / Filter RecordsApply custom logic to modify or filter records.JavaScript✅ Available
EnrichLookup values from a cached topic to enrich records. Handles schema evolution and pass-through fields.SQL✅ Available
JoinJoin multiple topics. Supports schema evolution and pass-through fields.SQL✅ Available
Enrich (Async)Asynchronously call REST APIs to enrich incoming records using dynamic payloads.JavaScript✅ Available
Un NestingBreak nested objects or arrays into separate topics. Ideal for unrolling deeply nested documents.JavaScript, Python🛠️ Coming Soon
Fan OutRoute a single record to multiple output topics based on custom logic.JavaScript✅ Available
Toast HandlingReplace PostgreSQL TOAST placeholders with cached, encrypted original values to avoid costly re-selects.TBC🛠️ Coming Soon

Development Tools

Professional development environments and starter kits for building transforms:

Tool NameDescriptionTransform Types SupportedStatus
TypeScript Development KitProfessional development environment with TypeScript, npm dependencies, comprehensive testing, and production bundling.Map/Filter, Fan Out, Enrich (Async), Un-nesting✅ Available

If you don't see a transform listed, please contact us as we're happy to help find and provide the transform you need.