Matillion
Matillion is a modern ETL/ELT closed source tool specifically designed for data loading and transformation on cloud database platforms such as Snowflake, Amazon Redshift, Google BigQuery, Microsoft Azure Synapse, and Delta Lake.
IBM Manta Data Lineage currently scans:
-
Projects and their versions
-
Environments
-
Orchestration, transformation, and shared jobs
-
Scalar and grid variables
-
Components
-
Connectors
-
Expressions
Check out the guides below for more details on setting up this scanner.
Extraction and Analysis Phase Scenarios
Extraction Phase
For the extraction phase for Matillion servers, there is only one scenario.
-
Matillion extractor scenario — connects to each configured Matillion server and extracts the configured jobs and environments
-
Matillion ingestion scenario - pulls inputs from git Manta Flow Agent Configuration for Extraction:Git Source or a remote agent filesystem location Manta Flow Agent Configuration for Extraction:Agent Source
Analysis Phase
For the analysis phase for the Matillion servers, there is only one scenario.
- Matillion dataflow scenario — harvests metadata and lineage from the extracted Matillion jobs and environments and saves it in your Manta Data Lineage metadata repository