ETLPipeline

Pipelines gather and group cursors and commands together into related units, becoming the defining blocks of your ETL activities.

Description

Use the pipeline element to collect your steps together into these cohesive groups.

Properties

description : string

Description of this pipeline.

layout : string

GUI layout data.

name : string

The pipeline name. This name is displayed on the ETL diagram.

Content

• Choice of:

  • ReadCursor [1..1] - Use the Object cursor to read and batch data from the model class instances.

  • AggregateCursor [1..1] - Use the Aggregate cursor to read and batch data from the model class instances.

  • CreateCommand [1..1] - Use the Create Object command to create a new object from the data that you are processing.

  • DeleteCommand [1..1] - Use the Delete Object command to delete an object from the data that you are processing.

  • LogCursor [1..1] - An ETL logging cursor.

  • ScriptCursor [1..1] - An ETL script cursor.

  • RollupCursor [1..1] - An ETL rollup cursor.

  • TransformationCursor [1..1] - An ETL transformation cursor.

  • MergeJoinCursor [1..1] - An ETL MergeJoin cursor.

  • UnionAllCursor [1..1] - An ETL UnionAll cursor.

  • ConditionalSplitCursor [1..1] - An ETL ConditionalSplit cursor.

  • ChannelOutputCommand [1..1] - An ETL ChannelOutput command.

  • MulticastCursor [1..1] - An ETL Multicast cursor.

  • FileOutputCommand [1..1] - An ETL FileOutput command.

  • MessageCursor [1..1] - An ETL Message cursor.

  • DiscardCommand [1..1] - Use the Discard command to pull rows and discard them with no further processing.

  • UpsertCommand [1..1] - Use the Upsert command to update an existing object or create a new one from the data that you are processing.

Parents

• ETLActivity - An ETL activity.
• Try
• Sequence - Step within a Join of a Service. e.g. Script, Transform, Try, Branch...
• Catch