Manta Flow Alation: Export Execution

Execution by Using a Shell Script

To export metadata from the Manta Flow metadata repository and upload it to Alation Data Catalog:

  1. Perform an initial configuration based on the descriptions in the article Manta Flow Alation: Manta Configuration.

  2. Once all the necessary metadata is in the Manta Flow Server, run _run_export_alation.bat (on Windows) or _run_export_alation.sh (on Linux); otherwise, execute the whole extraction, analysis, and export process by running _run_alation.bat (on Windows) or _run_alation.sh (on Linux).

  3. After the export is completed:

    1. The temporary output files used for upload are stored in the ${manta.dir.temp}/<technology>/${<technology>.dictionary.id}/alation folder, where <technology> represents the exported technology. For details about the directory variables, see Manta Flow Client Configuration.

    2. The lineage metadata is available in Alation.

Execution by Using Manta Orchestration API

To export metadata from the Manta Flow metadata repository and upload it to Alation Data Catalog:

  1. Perform an initial configuration based on the descriptions in the article Manta Flow Alation: Manta Configuration.

  2. Once all the necessary metadata is in the Manta Flow Server, execute Manta Workflow to execute the export.

    • A workflow with the same definition as the run_export_alation workflow template can be used (see http://<MANTA_ADMIN_GUI_BASE_URL>/public/process-manager/v1/workflow/templates/run_export_alation).

  3. Or, if the metadata is not accessible in Manta Flow Server yet, execute Manta Workflow to execute the whole extraction, analysis, and export process.

    • A workflow with the same definition as the run_alation workflow template can be used (see http://<MANTA_ADMIN_GUI_BASE_URL>/public/process-manager/v1/workflow/templates/run_alation).

  4. After the export is completed:

    1. The temporary output files used for upload are stored in the ${manta.dir.temp}/<technology>/${<technology>.dictionary.id}/alation folder, where <technology> represents the exported technology. The output can also be obtained by using the Get Workflow Execution Output API endpoint ( http://<MANTA_ADMIN_GUI_BASE_URL>/public/process-manager/v1/executions/{executionId}/output).

    2. The lineage metadata is available in Alation.