MS SQL Server, Azure SQL, SAP ASE

This is a scanner for MS SQL Server-based or related technologies. It supports SQL Server (version 2016 or newer, remote), Analytic Platform System (formerly known as Parallel Data Warehouse), Azure SQL Database, Azure SQL Managed Instance, Azure Synapse Analytics (formerly known as Azure SQL Data Warehouse), Amazon RDS for SQL Server, and SAP ASE.

IBM Automatic Data Lineage offers a powerful scanner for Microsoft SQL Server technologies. Once configured, Automatic Data Lineage can automatically connect to the MS SQL resource for extracting and analyzing the pertinent metadata within the selected databases. This metadata includes but is not limited to tables, views, indexes, SQL procedures, schemas, databases, columns, and triggers. Then, Automatic Data Lineage can parse all the SQL programming code and logic stored within. This allows Automatic Data Lineage to generate lineage down to the column level while showing all transformation logic associated with individual column elements.

Automatic Data Lineage currently scans:

Check out the guides below for more details on setting up this scanner.

Extraction and Analysis Phase Scenarios

Extraction Phase

For the extraction phase for MS SQL servers, there are two scenarios.

  1. MS SQL dictionary mapping scenario — connects to each configured MS SQL server and stores the mapping between these values: dictionary ID, subdialect, server name, instance name, host name, port, include and exclude filters

  2. MS SQL extractor scenario — connects to each configured MS SQL server and extracts the database dictionary and DDL scripts from the configured databases and their schemas

  3. IBM Automatic Data Lineage supports Git Ingest connections from version 42.4, for the download of files from a Git repository to the MS SQL workflow. For more information, see Manta Flow Agent Configuration for Extraction:Git Source

Analysis Phase

For the analysis phase for MS SQL servers, there are three scenarios.

  1. MS SQL dictionary dataflow scenario — analyzes metadata from the extracted MS SQL database dictionaries and saves it in your Automatic Data Lineage metadata repository.

  2. MS SQL DDL dataflow scenario — harvests metadata and lineage from the extracted MS SQL DDL scripts and saves it in your Automatic Data Lineage metadata repository.

  3. MS SQL Transact-SQL dataflow scenario — harvests metadata and lineage from the provided Transact-SQL scripts and saves it in your Automatic Data Lineage metadata repository.