Open Manta Direct Link Usage
If it is only necessary to link existing objects in the Manta Flow repository because data is moved between them by processes that are not supported by Manta Flow out of the box, you can list the links in a comma-separated CSV file.
Structure of the CSV file for listing links
The CSV file must have the following structure:
- Full path to the source object, delimited by slashes:
"Source_Resource_Name/Source_Level_1_Name/Source_Level_2_Name/.../Source_Level_N_Name"
. - Full path to the target object, delimited by slashes:
"Target_Resource_Name/Target_Level_1_Name/Target_Level_2_Name/.../Target_Level_N_Name"
.
A leading slash is possible but optional.
If there is a slash, backslash, or quotation mark character (/\"
) in any part of the full path, you must enclose the whole path in quotation marks. For example: "path"
.
Then, enclose the affected part in quotation marks that are escaped by backslashes. For example, "\"part/1\"/part2"
.
Backslash and quotation mark characters must be double escaped by double backslashes. For example, "\"part\\\"1\"/\"part\\\\2\""
.
Consider the following examples.
Examples
Original path | Escaped path |
---|---|
/part1/part2 |
/part1/part2 or "/part1 part2" |
/part 1/part2 |
/part 1/part2 or "/part 1/part2" |
/part-1/part2 |
/part-1/part2 or "/part-1/part2" |
/part_1/part2 |
/part_1/part2 or "/part_1/part2" |
/part/1/part2 |
"/\"part/1\"/part2" |
/part"1/part2 |
"/\"part\\\"1\"/part2" |
/part\1/part2 |
"/\"part\\\\1\"/part2" |
/Sybase\DBX/part2 |
"/\"Sybase\\\\DBX\"/part2" |
/DB2/coreprd002\db2p1/IPRD1/STG/STG_SAP_PTNR_ATTR |
"/DB2/\"coreprd002\\\\db2p1\"/IPRD1/STG/STG_SAP_PTNR_ATTR" |
/PowerBI/powerbi/Demo/Order Demo Extension.pbix/Datamodel/#"Query1"/Extended_Order_Line_Gross_Dollar_Amount |
"/PowerBI/powerbi/Demo/Order Demo Extension.pbix/Datamodel/\"#\"Query1\"\"/Extended_Order_Line_Gross_Dollar_Amount" |
You can specify links on different levels.
-
Column to column links—If neither the source objects nor the target objects contain any children (like columns, column flows, ports, attributes, etc.), a direct edge is created from the source object to the target object (case insensitive).
Examples:
"Oracle/OracleDB/SourceSchema/SourceTable/SourceColumn","Teradata/TeradataServer/TargetDB/TargetTable/TargetColumn" "\"Oracle PL/SQL\"/Connection/Dir/query.txt/<1,1>MasterResultSet/1 SourceColumn","MSSQL/Server/TargetDB/dbo/TargetTable/TargetColumn" "Filesystem/Dir/Subdir/sourceFile.csv/1","Netezza/SERVER/DB/ADMIN/TARGET_TABLE/TargetColumn"
-
Table to table links—If both the source and target objects contain children that do not contain any further children (like tables, views, synonyms, statements, transformations, reports, etc.), a direct edge is created from each source's child to the target's child that has the same name (case insensitive) or order (based on the ORDER attribute; only applied if no child with the same name exists). If the column name is structured
"<order> <name>"
(for example, column flow"3 first_name"
), both the name and order are determined automatically according to this pattern. If the column name consists of only an order (e.g., file column"3"
), the order is determined automatically according to the name.Examples:
"Oracle/OracleDB/SourceSchema/SourceTable","Teradata/TeradataServer/TargetDB/TargetTable" "\"Oracle PL/SQL\"/Connection/Dir/query.txt/<1,1>MasterResultSet","MSSQL/Server/TargetDB/dbo/TargetTable" "Filesystem/Dir/Subdir/sourceFile.csv","Netezza/SERVER/DB/ADMIN/TARGET_TABLE"
-
Schema to schema links—If both the source and target objects are of a type specified in the Schema-level Node Types (
manta.import.links.schemaNodes
) property (by default Schema, Database, Directory), the above table-to-table link process is applied to each source's child and the corresponding target's child with the same name (case insensitive) where both children are of a type specified in the Table-level Node Types (manta.import.links.schemaConnectNodes
) property (by default Table, View, Synonym, File).The properties are configurable in Admin UI. Default settings for all connections can be configured in Configuration/CLI/Direct Links/Direct Links Common page. These settings can be overridden for each Direct Links connection.
Examples:
"Oracle/OracleDB/SourceSchema","Teradata/TeradataServer/TargetDB" "Filesystem/Dir/SourceDir","Filesystem/Dir/TargetDir"
Connections are used for Open Manta direct links. For more information, see Open Manta Direct Link Configuration
The input file might contain a header on the first line in this format: Source, Target
.