Creating a Pipeline
Create a pipeline to define how data flows from origin to destination systems and how the data is processed along the way.
To create a pipeline, click Create New
Pipeline icon: .
Then, complete the following steps in the pipeline wizard:
Define the Pipeline
Define the pipeline essentials, including the pipeline name, the type of engine for the pipeline, and how to start building the pipeline.
Important: Before you can define a Data Collector
or Transformer
pipeline, you must deploy and launch an engine. Transformer for Snowflake pipelines
use a hosted engine by default, which do not require deploying an engine. If
your organization uses deployed Transformer for Snowflake engines, you
must deploy and launch an engine before defining a pipeline. For more information,
see Deployments Overview.
Configure the Pipeline
Configure the initial content for the pipeline and the authoring engine to use for designing pipelines.
Important: Before you can select an authoring engine, you must deploy
and launch an engine. Transformer for Snowflake pipelines
use a hosted engine by default, which do not require deploying an engine. If
your organization uses deployed Transformer for Snowflake engines, you
must deploy and launch an engine before defining a pipeline. For more information,
see Deployments Overview.
Share the Pipeline
By default, the pipeline can only be seen by you. Share the pipeline with other users and groups to grant them access to it.