Streaming Transforms

On this page you can create new transforms and manage existing ones.

Functionality

• Create
• Search
• View existing Transforms & Quick Actions

The tabular list gives you an overview of your existing transforms:

• Name: The user-given name of a transform e.g. filter out empty records.
• Type: The type of transform e.g. Join, Enrich.
• Status: Current status of the transform job e.g. RUNNING, RESTARTING.
• Start Time: When the last transform job started.
• Duration: How long the last transform job has been running.
• End Time: When the last transform job finished.
• Latency: The time it takes for records to be processed by this transform.
• Tasks: The number of tasks this transform will use when executing the transform logic. This represents the transform's degree of parallelism.

Quick Actions

• View the transform settings and implementation
• Copy ID to include in support tickets
• Delete the transform

View Transform

You can manage a particular transform by clicking on its name from the tabular list or via Quick Actions > View.

Status

This tab gives you an overview of the selected transform and its health.

Functionality

• View status, stats and basic information

• Alter settings and transform logic i.e. the implementation

• Delete

Stats

• Status: Current status of the transform job e.g. RUNNING, RESTARTING.
• Tasks: The number of tasks this transform is using while executing the transform logic. This represents the transform's degree of parallelism.
• Latency: The time it takes for records to be processed by this transform.
• Duration: How long this transform's job has been running.
• Transform Name: The user-given name of this transform.
• Type: The type of transform e.g. Jogn, Enrich.
• Job: The job name. Currently a copy of the Transform name.

Topics

This section lists the transform's output topics as well as several transformation stats.

• Name: The output topic's name.
• Volume: The total volume (in MB/GB/TB) of data output by this transform.
• Errors: The total number of errors during processing.
• Written: The total number of records written out by the transform.

Settings

This tab has the settings that are usually available for all types of transforms, including advanced parameters.

Please refer to the relevant Transforms documentation for more details.

Implementation

This tab has the settings for defining the transform's logic.

Please refer to the relevant Transforms documentation for more details.