Release 42
Releases are listed in reverse chronological order so that the latest release is at the beginning of the page.
Release 42.14.13
Date: 20 January 2026
Fixed in this release
Scanners
SAS
- manta-tracker-3104 - Fixed an issue where multi-line comments in SAS code weren't recognized correctly
Release 42.14.12
Date: 9 January 2026
Fixed in this release
General
- manta-tracker-3049 - You can now configure the Extraction Processor logs. Important Additional Information: To configure the logging, create a file named
parser-log4j2.xmlwith the desired logging configuration. Then, add a new propertyparser.logging.configto the Admin UI configuration file located atserviceutility/manta-admin-ui-dir/conf/application.properties. The property must contain an absolute path pointing to theparser-log4j2.xmlfile.
Release 42.14.11
Date: 19 November 2025
Fixed in this release
General
- manta-tracker-2895 - The performance issues when working with big amount of connections in Admin UI is now fixed
Scanners
MSSQL
- manta-tracker-2917 - CVE-2025-59250 related to MSSQL-JDBC driver is now fixed. Important Additional Information: Due to driver limitations, support for SQL Server 2014 has been deprecated. Automatic Data Lineage connections to SQL Server 2014 and earlier versions are no longer guaranteed.
Release 42.14.8
Date: 5 November 2025
Fixed in this release
Scanners
SAS
- manta-tracker-2877 -
replace.csvreplacement now also applies to the SAS macro include directory. Important Additional Information: See Common Properties for more details.
Release 42.14.7
Date: 4 November 2025
Fixed in this release
Scanners
Cognos
- manta-tracker-2739 -
StackOverflowExceptionthat caused lineage analysis to get stuck is now fixed
Release 42.14.2
Date: 17 October 2025
Fixed in this release
Scanners
IBM Data Virtualization
- manta-tracker-2794 - Issue with extraction of remote table columns of virtual tables during the scan of Data Virtualization is now fixed
Release 42.14.1
Date: 10 October 2025
Fixed in this release
Scanners
General
- wdp-gov-271308 - Metadata Import jobs are now located under one top level node
PostgreSQL
- wdp-gov-270986 - Importing Redshift connection configuration from previous Automatic Data Lineage versions no longer fails
Release 42.14
Date: 10 October 2025
New in this release
General
- manta-tracker-2629 - JDK25 is now supported (as a preview feature) due to Keycloak upgrade. Important Additional Information: Support of JDK 17 is planned to be deprecated. It is recommended to upgrade to JDK 21 or 25.
Scanners
DataStage
- 200332 - you can now configure Automatic Data Lineage Agent to connect to Datastage to overcome potential issues with internal company networks
Google BigQuery
-
manta-tracker-19682 - BigQuery Agent extraction and dictionary mapping are now available
-
manta-tracker-2182 - column type is now presented for table columns
-
manta-tracker-2578 - Google BigQuery connection now sets user defined name of the root server node instead of BigQuery API service URL. Important Additional Information: See Source System Properties for more information.
-
manta-tracker-2590 - Operators
LIKE ALL,LIKE ANYandLIKE SOMEare now supported -
manta-tracker-2591 - Parsing support for
GROUP BY ALLhas been introduced -
manta-tracker-2599 - Standalone RETURN statement is now supported
Hive
- manta-tracker-2592 - Hive now shows standardized data type (based on extracted column type), column length, scale, and precision attributes
IBM Data Virtualization
- manta-tracker-2128 - Extraction of virtual tables uses new IBM DV API when retrieving virtual tables from IBM DV version 3.3 and higher
Informatica PowerCenter
- manta-tracker-2243 - IFPC scanner now gets metadata on default Snowflake database and schema name from "Additional JDBC parameters" section
MSSQL
- manta-tracker-2502 - Inline constraints with computed columns are now supported
Netezza
- manta-tracker-1830 - Netezza connection configuration parameter Default path enabling SQL Extension toolkit functions is now also used when analyzing Netezza code called from other technologies. Important Additional Information: For more details, see Netezza Resource Configuration.
PostgreSQL
- manta-tracker-2473 - PostgreSQL scanner now connects to Amazon Redshift using Identity and Access Management permanent credentials (Access Key ID and Secret Access Key). Important Additional Information: See PostgreSQL Integration Requirements and Source System Properties for more information.
SAP BO
- manta-tracker-2342 - Automatic Data Lineage now supports SAP BO version 4.3 Service Pack 4 using a few workarounds. Service Packs 1 and 2 are no longer supported Important Additional Information: See SAP BO Resource Configuration and SAP BO Integration Requirements for more information.
SAP HANA
- manta-tracker-695 - Initial lineage for calculation views including union, projection, join, and rank view inner calculation views, table, view, and other calculation views as data sources is now supported
Snowflake
- manta-tracker-2348 - Username-password authentication has been removed from the Snowflake scanner, as a single-factor authentication has been revoked by Snowflake itself. Important Additional Information: See Configure the Connection for more details.
Talend
-
manta-tracker-2331 - Talend scanner now represents joblets in all places they are used, resulting in more complete lineage
-
manta-tracker-2377 - Talend scanner now captures DB connections even if they are defined in joblets
Fixed in this release
Security issues fixed in this release
CVE-2025-5914, CVE-2025-6395, CVE-2025-7458, CVE-2025-8194, CVE-2025-32414, CVE-2025-32415, CVE-2025-32988, CVE-2025-32989, CVE-2025-32990, CVE-2025-41242, CVE-2025-48989, CVE-2025-52520, CVE-2025-53506
CVE-2024-0397, CVE-2024-7592
CVE-2023-45960
CVE-2022-3857
RHSA-2025:13428
General
-
manta-tracker-2443 - Dataflow graph now displays indirect lineage tables when viewing lineage of associated view asset
-
manta-tracker-2483 - Manta UI `Out of Memory' error during expanding a node with a very large number of children is now fixed
-
manta-tracker-2523 - It is now not possible to delete connection that is currently used in a workflow
-
manta-tracker-2557 - Issue where AdminUI failed to start on RHEL-based Linux platforms due to conflicts caused by exported functions in Bash is now fixed
-
manta-tracker-2583 - You can now opt not to create data backup during Automatic Data Lineage upgrade to speed up the upgrade process
-
manta-tracker-2602 - Startup of Output Parser used in Agent extractions is now fixed
-
manta-tracker-2603 - FlowServer startup issues on Linux systems caused by incorrect native libraries path are now fixed
-
manta-tracker-2644 - Authentication error page in FlowServer is now updated to point you back to Keycloak
-
manta-tracker-2692 - Batching in Log Viewer now prevents
Out Of Memorycrashes in case of large Log Viewer databases
Dataflow Viewer
- manta-tracker-2057 - Issue in Dataflow Viewer where "Show Context" was unavailable for certain elements is now fixed
Open Manta
- manta-tracker-2524 - Issue with Open Manta extension import failing with certificate error is now fixed
Open Manta Designer
-
manta-tracker-2426 - Support for MySQL is now fixed
-
manta-tracker-2723 - Timezone discrepancy is now fixed
Integrations
Alation
- manta-tracker-2392-2528-2610- SAS tables export into Alation is now fixed and articial loops are configurable. Important Additional Information: See Alation Data Catalog Common Configuration and SAS resource mapping configuration for more information.
Scanners
Cobol
- manta-tracker-2530 - Lower-case characters in hexadecimal values are now allowed
DataStage
- manta-tracker-2511 - Issues where metadata extraction was getting stuck due to cyclic dependencies between extracted objects have now been fixed
DB2
-
manta-tracker-893 -
EXCEPTION,FINAL,GO,HANDLER,LONG,PARAMETER,ROW,USER,ZONEare now accepted as a name or an alias -
manta-tracker-2653 - Agent temporary directory no longer contains any uncleared data for DB2
-
manta-tracker-2662 - DB2 connection validation now properly evaluates role- and group- based grants on
DB2LOOK_INFOtable
Erwin
- manta-tracker-2435 - Erwin scanner now correctly leverages known physical name of objects in order to prevent schema name being included in names of "child" objects such as table
IBM Data Virtualization
- manta-tracker-2677 - Potential
AmbiguousNameExceptionandConcurrentModificationExceptionin virtual tables dataflow analysis are now prevented
Netezza
- manta-tracker-2400 - Netezza dictionary mapping scenario no longer fails when hostname isn't set on Netezza. Important Additional Information: If the hostname property isn't set in the environment, the dictionary mapping scenario doesn't fail. Instead,it parses the JDBC URL provided in the connection.
Oracle Data Integrator
- manta-tracker-2503 - Issues where metadata extraction was getting stuck due to cyclic dependencies between ODI mappings have now been fixed
PowerBI
- manta-tracker-2440 - Large reports (over 1GB) are now correctly extracted even if their names contain space characters
SAP HANA
- manta-tracker-2548 - Trigger extraction: 'INSTEAD OF' value from
SYS.TRIGGERSis now correctly supported
SAS
-
manta-tracker-2367 - multi line comments are now better supported
-
manta-tracker-2544 - @ Line Hold separator of output fields in PUT statement is now supported
-
manta-tracker-2551 -
_ALL_output fields in PUT statement are now supported -
manta-tracker-2552 -
$VARYINGformat of output fields in PUT statement is now supported
Snowflake
- manta-tracker-2654 - Unintended sharing of variant datatype instance in function result is now fixed
SSAS
- manta-tracker-1997 - SSAS scanner now correctly reflects the source column name when trying to connect lineage to databases
Tableau
- manta-tracker-2606 - Tableau can now successfully connect to BigQuery in case the internal identifier is called
googlebigqueryas well
Talend
- manta-tracker-2498 - Improved handling of Java expressions in Talend connection configuration
Release 42.13.6
Date: 13 August 2025
New in this release
General
-
manta-tracker-2506 - Process Manager circuit breaker and auto-refresh introduced. Important Additional Information: The Process Manager workflow handling was optimized to make performance independent of the number of created connections. For more details, see: Process Manager circuit breaker introduction and Process Manager auto-refresh introduction.
-
manta-tracker-2523 - Deleting a connection used in a workflow is prevented. Important Additional Information: When deleting a connection the backend checks if the connection is used in any workflows. If the connection is used, the deletion doesn't proceed and informative error message appears. This prevents invalid workflows from being left in the Process Manager.
Fixed in this release
Scanners
DataStage
- manta-tracker-2512 - Fixed Datastage endless loop that prevented the scan from finishing
Snowflake
- manta-tracker-2468 - Fixed inconsistent library version for Snowflake and Hive preventing cross-system lineage
Release 42.13
Date: 28 July 2025
New in this release
Integrations
Alation
- manta-tracker-2021 - SAS tables can be exported to Alation. Important Additional information: For more information, see SAS resource mapping configuration.
Scanners
Cobol
- manta-tracker-issues-1759 - The ++INCLUDE statement is supported for the Cobol scanner.
DB2
-
manta-tracker-1913 - DB2 module functions and procedures are supported for analysis.
-
manta-tracker-1915 - Extraction and analysis of DB2 Materialized Query Tables (shown as Materialized Views in Manta) is supported.
-
manta-tracker-2237 - Host variables can be used as a target in the DB2 SET statement.
Informatica PowerCenter
-
manta-tracker-2179 - Components with SQL queries inside, where the SQL statements end with the backslash character, are now processed.
-
manta-tracker-2307 - Lineage for Teradata Fast Export component is now supported.
-
manta-tracker-2308 - Lineage for MQ Reader component is now supported.
Kafka
- manta-tracker-1415 - Kafka deployments with Kerberos authentication enabled are now supported. Important Additional Information: For more information, see Kafka Resource Configuration.
Microstrategy
- tracker-212121 - Dossiers with prompts are supported.
Openlineage
- manta-tracker-1960 - OpenLineage scanner can now process events which have only output and job metadata (input metadata is missing).
Oracle Data Integrator
- manta-tracker-1934 - Empty values can be used for parameters in TNS names in alias mappings.
SAS
-
manta-tracker-878 - SAS scanner now processes multiple paths passed to the FILENAME statement.
-
manta-tracker-1650 - The
FILEstatement can be parsed and the lineage is supported for thePUTstatement.
Teradata
- manta-tracker-2274 - New extractor and dictionary is introduced. Important Additional Information: Rescanning of Teradata assets is required for query service to work properly.
Fixed in this release
Security issues fixed in this release
CVE-2025-0395, CVE-2025-0725, CVE-2025-0938, CVE-2025-22223, CVE-2025-22228, CVE-2025-24528, CVE-2025-24813, CVE-2025-24928, CVE-2025-24970, CVE-2025-25193, CVE-2025-25724, CVE-2025-27427
CVE-2024-2511, CVE-2024-4741, CVE-2024-5535, CVE-2024-6197, CVE-2024-8096, CVE-2024-8176, CVE-2024-9143, CVE-2024-12133, CVE-2024-12243, CVE-2024-27316, CVE-2024-28182, CVE-2024-45490, CVE-2024-45491, CVE-2024-52616, CVE-2024-56171, CVE-2024-57699
CVE-2023-2953, CVE-2023-27535, CVE-2023-27536, CVE-2023-27538, CVE-2023-28320, CVE-2023-36191, CVE-2023-44487, CVE-2023-45853, CVE-2023-45918, CVE-2023-52425
CVE-2022-4899, CVE-2022-37967, CVE-2022-40897, CVE-2022-49043
CVE-2021-3200, CVE-2021-3997, CVE-2021-22922, CVE-2021-22923, CVE-2021-23336, CVE-2021-36217
CVE-2019-3822, CVE-2019-3823, CVE-2019-5436
CVE-2018-0732, CVE-2018-0737, CVE-2018-16839, CVE-2018-16840, CVE-2018-16842, CVE-2018-16890
CVE-2017-0663, CVE-2017-3731, CVE-2017-3732, CVE-2017-3738, CVE-2017-7375, CVE-2017-9047, CVE-2017-9048, CVE-2017-9050, CVE-2017-18258
CVE-2016-0702, CVE-2016-0703, CVE-2016-0704, CVE-2016-0705, CVE-2016-0797, CVE-2016-0799, CVE-2016-0800, CVE-2016-1762, CVE-2016-1833, CVE-2016-1834, CVE-2016-1835, CVE-2016-1836, CVE-2016-1837, CVE-2016-1838, CVE-2016-1839, CVE-2016-1840, CVE-2016-2105,CVE-2016-2106, CVE-2016-2107, CVE-2016-2108, CVE-2016-2109, CVE-2016-2178, CVE-2016-2842, CVE-2016-4447, CVE-2016-4448, CVE-2016-4449, CVE-2016-4472, CVE-2016-4658, CVE-2016-5131, CVE-2016-5419, CVE-2016-5420, CVE-2016-6302, CVE-2016-6306, CVE-2016-7056, CVE-2016-7141, CVE-2016-8610,CVE-2016-8615, CVE-2016-8616, CVE-2016-8617, CVE-2016-8618, CVE-2016-8619, CVE-2016-8621, CVE-2016-8622, CVE-2016-8623, CVE-2016-8624, CVE-2016-8625, CVE-2016-9318
CVE-2015-0204, CVE-2015-0205, CVE-2015-0206, CVE-2015-0209, CVE-2015-0293, CVE-2015-3194, CVE-2015-3195, CVE-2015-3196, CVE-2015-3216, CVE-2015-4000, CVE-2015-7497,CVE-2015-7941, CVE-2015-7942, CVE-2015-8241
Scanners
BigQuery
-
manta-tracker-2050 - Extending support for array access via brackets
-
manta-tracker-2126 - Improved support for dashes in names of BigQuery datasets in nested selects
-
manta-tracker-2376 - Improved logging for extractor
COBOL
-
manta-tracker-1760 - Support for Lineage for
FETCH / DECLAREin separate EXEC statements -
manta-tracker-2355 - Cobol code can now have multiple ending periods
.after statements in a row. Important Additional Information: Can be seen in a code as a line containing only a period.
DataStage
-
manta-tracker-2092 - Configuration screen of a Datastage connection now shows correct tooltip for the property that filters jobs to be processed based on time
-
manta-tracker-2406 - Fixed a
NullPointerExceptionin Datastage scanner, which resulted from incorrectly handled situation where mandatory input files were missing
Db2
-
manta-tracker-1880 - Fixed Connection Validation error when permissions granted through groups
-
manta-tracker-1926 - Fix Agent extraction statistics for SERVER objects
-
manta-tracker-2183 - For DB2 z/OS, the EBCDIC characters
!!and]]are now supported as concatenation operators -
manta-tracker-2184 - Scanner no longer fails on use of
CCSID,PSID,PATH,VARIANT,AUDIT,DOCUMENT,WLM,PROGRAM,CONTENTkeywords as aliases/object names -
manta-tracker-2316 - Support for formatting functions
RANKandROW_NUMBER -
manta-tracker-2273 - DB2 is now tolerant to missing global namespace name when referenced as source technology
MicroStrategy
- manta-tracker-2204 - Lineage scanner no longer produces false extra lineage
OpenLineage
-
manta-tracker-2054 - Fixed an issue with ABFSS driver/protocol that caused missing lineage
-
manta-tracker-2208 - Fixed multiple existing columns in an OpenLineage event data source to be represented as one object. Important Additional Information: There is now correct number of columns shown.
SSIS
-
manta-tracker-2216 - Fixed an issue with unexpectedly empty Filesystem Task in SSIS causing the whole ispac file analysis to fail
-
manta-tracker-2413 - Fixed an issue with top-level object (node) being "System" in lineage visualization of SSIS connections. Important Additional Information: Now the top-level object (node) is back to Server.
Snowflake
- manta-tracker-2214 - Support for subexpressions in
VALUESclause inMERGEstatement
Tableau
-
manta-tracker-935 - Missing information in relationships between logical tables should no longer produce errors and the effect should be limited
-
manta-tracker-2167 - Fixed an issue that prevented processing of Tableau workbooks that used more than 1 shared data source
-
manta-tracker-2220 - Restored support of personal projects
Release 42.12.10
Date: 5 June 2025
Fixed in this release
Scanners
Snowflake
- manta-tracker-2332 - fixed
NullPointerExceptionthrown sometimes by the Snowflake driver during extraction
Release 42.12.7
Date: 4 June 2025
Fixed in this release
Scanners
DB2
- manta-tracker-2296 - Enabling extraction of some objects without proper db2look configuration where possible (VIEW, PROCEDURE, FUNCTION, TRIGGER)
IBM Data Virtualization
-
manta-tracker-2225 - Column flow nodes hidden for virtual tables
-
manta-tracker-2296 - Enabling extraction of some objects without proper db2look configuration where possible (VIEW, PROCEDURE, FUNCTION, TRIGGER, VIRTUAL_TABLE)
Release 42.12.5
Date: 22 May 2025
Fixed in this release
Scanners
IBM Data Virtualization
- wdp-gov-tracker-225061 - Fixing virtual tables extraction from IBM DV
Release 42.12
Date: 17 April 2025
New in this Release
Scanners
Datastage
- manta-tracker-807 - Support for db2zos and db2cloud stages
DB2
-
manta-tracker-1445 - OpenManta export for Data Virtualization subdialect
-
manta-tracker-1924 - Support for the API Key authentication
-
manta-tracker-1988 - Data Virtualization - new script node and resource for Virtual Tables
ColumnFlow
Hive
- manta-tracker-1848 - Support for DataDirect JDBC driver
OpenLineage
- manta-tracker-1818 - Changed asset type for assets representing unknown data sources
Integrations
Alation
- manta-tracker-1534 - Export Dataflows involving File System. Important Additional Information: For more information, see Filesystem resource mapping configuration and Create Files System sources for IBM Automatic Data Lineage Filesystem objects.
Fixed in this release
Security issues fixed in this release
CVE-2025-22223, CVE-2025-24813, CVE-2025-24928, CVE-2025-24970, CVE-2025-25193
CVE-2024-4741, CVE-2024-5535, CVE-2024-6197, CVE-2024-8096, CVE-2024-8176, CVE-2024-9143, CVE-2024-27316, CVE-2024-28182, CVE-2024-35325, CVE-2024-45490, CVE-2024-45491, CVE-2024-56171, CVE-2024-57699
CVE-2023-27535, CVE-2023-27536, CVE-2023-27538, CVE-2023-28320, CVE-2023-44487, CVE-2023-45853, CVE-2023-52425
CVE-2022-40897, CVE-2022-49043
CVE-2021-3200, CVE-2021-22922, CVE-2021-22923
CVE-2019-3822, CVE-2019-3823, CVE-2019-5436
CVE-2018-0732, CVE-2018-0734, CVE-2018-0737, CVE-2018-16839, CVE-2018-16840, CVE-2018-16842, CVE-2018-16890
CVE-2017-0663, CVE-2017-3731, CVE-2017-3732, CVE-2017-3738, CVE-2017-7375, CVE-2017-9047, CVE-2017-9048, CVE-2017-9050, CVE-2017-18258, CVE-2016-0797, CVE-2016-0799, CVE-2016-0800, CVE-2016-1762, CVE-2016-1833, CVE-2016-1834, CVE-2016-1835, CVE-2016-1836, CVE-2016-1837, CVE-2016-1838, CVE-2016-1839, CVE-2016-1840, CVE-2016-2105, CVE-2016-2106, CVE-2016-2107, CVE-2016-2108, CVE-2016-2109, CVE-2016-2178, CVE-2016-2842, CVE-2016-4447, CVE-2016-4448, CVE-2016-4449, CVE-2016-4472, CVE-2016-4658, CVE-2016-5131, CVE-2016-5419, CVE-2016-5420, CVE-2016-6302, CVE-2016-6306, CVE-2016-7056, CVE-2016-7141, CVE-2016-8610, CVE-2016-8615, CVE-2016-8616, CVE-2016-8617, CVE-2016-8618, CVE-2016-8619, CVE-2016-8621, CVE-2016-8622, CVE-2016-8623, CVE-2016-8624, CVE-2016-8625, CVE-2016-9318
CVE-2015-0204, CVE-2015-0205, CVE-2015-0206, CVE-2015-0209, CVE-2015-0293, CVE-2015-3194, CVE-2015-3195, CVE-2015-3196, CVE-2015-3216, CVE-2015-4000, CVE-2015-7497, CVE-2015-7941, CVE-2015-7942, CVE-2015-8241
General
-
manta-tracker-2051 - Extraction fails with exception
Caused by: java.lang.IllegalArgumentException: Malformed \uxxxx encodingfor IBM Automatic Data Lineage installed using containers andAgentas the client for extraction -
manta-tracker-2074 - Fixed OutOfMemory error in Manta Launcher
Scanners
Datastage
-
manta-tracker-1923 - Project extraction fails after the extractor receives an unknown export status response
-
manta-tracker-1965 - Datastage job never finishes throwing no error message in the logs
DB2
- manta-tracker-2096 - Not possible to import old DB2 connection due to missing default value for
db2.extractor.authentication.mode
Microstrategy
- manta-tracker-1890 - Dossiers being "executed/triggered" on Microstrategy side during extraction phase
OpenLineage
-
manta-tracker-1826 - Unsupported resource type
abfssresults in no lineage -
manta-tracker-1911 - Case insensitivity of smart mapping
SAP HANA
-
manta-tracker-1951 - "FOR SHARE LOCK OF column" statement is now parsed without error. Important Additional Information: Small improvement to accept RLANG as language for create procedure.
-
manta-tracker-2000 - Extractor scenario fails with exceptions
SAS
- manta-tracker-1983 - SAS analysis creates columns that show both DICTIONARY and DEDUCTION in DB2 database
Release 42.11
Date: 28 March 2025
Fixed in this release
Security issues fixed in this release
CVE-2025-24928, CVE-2025-24970, CVE-2025-25193
CVE-2024-35325, CVE-2024-56171, CVE-2024-57699, CVE-2024-57970
Scanners
COBOL
-
manta-tracker-1959 - Broken multiline literal preprocessing
-
manta-tracker-1963 - Make ending DOT in
dataDescriptionItemEntrystatement optional -
manta-tracker-1987 - Support more formats for IKJEFT01
-
manta-tracker-1990 - Allow
SCREENas variable name
Databricks
-
manta-tracker-1877 - Enabling Foreign Tables extraction
-
manta-tracker-1945 - HTTPS incorrectly required in the hostname property
Datastage
-
manta-tracker-1499 - Support API pagination for DataStage extractor
-
manta-tracker-1526 - Runtime Column Propagation support in IBM DataStage for Cloud Pak for Data
DB2
- manta-tracker-1966 - NPE during procedure extraction. Important Additional Information: Extracting procedures with dropped custom type parameters no longer fail at the whole extraction.
Erwin
- manta-tracker-1895 - Export produces different output file. Important Additional Information: Erwin scanner now resolves the source technology for objects referenced from other technologies covered by integrated scanners, resulting in more accurate cross-technology lineage where Erwin scanner is used.
Informatica PowerCenter
- manta-tracker-1902 - Schema name and representation in Netezza connection
MSSQL
-
manta-tracker-1496 - Resolve custom types properly. Important Additional Information: MSSQL scanner now properly identifies and handles user defined types which not only reduces warnings and deduction messages in logs but allows more precise tracking of types.
-
manta-tracker-1874 - NTLM connection string gets extended with each edit/save action on the UI. Important Additional Information: MSSQL connection configuration now correctly recognizes domain name containing the dash symbol
(–)in URL. Dashed domain name no longer results in invalid URL created during edit/save.
Oracle
- manta-tracker-524 - Normalize Connection ID and Connection String prior to Connection Alias Comparison. Important Additional Information: When alias mapping connection string matches mapped connection string, whitespaces notwithstanding, alias will now still match, as opposed to getting rejected.
Tableau
-
manta-tracker-1709 - Incorrect parsing of multiline comments
-
manta-tracker-1711 - Parsing error - scientific notation
Release 42.10.10
Date: 24 March 2025
Fixed in this release
Scanners
MSSQL
- manta-tracker-1982 - MSSQL connection validation / extraction no longer fails when using one of MSAL authentication methods. Important Additional Information: Connection validation / extraction no longer supported for SQL Server versions 2012 and earlier.
Release 42.10.4
Date: 13 March 2025
Fixed in this release
Scanners
DB2
- manta-tracker-1971 - (DB2) DV - deduce remote tables and columns if not found
Release 42.10.3
Date: 13 March 2025
Fixed in this release
Scanners
DB2
- manta-tracker-1832 - Update db2 dictionary mappings during product upgrade from 42.8, 42.9 to 42.10. Important Additional Information: Manual DB2 alias mappings now gets updated automatically when migrating from Manta 42.8 or earlier using Manta installer, adding the Subdialect field. Manual steps are no longer needed to adjust manual alias mappings for DB2.
Release 42.10.2
Date: 25 February 2025
Fixed in this release
Scanners
SAP HANA
- manta-1882 - Process exceptions thrown by SAP HANA extractor. Important Additional Information: When encountering issues with permissions related to a single object, the extractor no longer crashes / fails at the whole extraction.
Release 42.10
Date: 21 February 2025
New in this Release
Scanners
DB2
- manta-tracker-195 - Scanner now supports IBM_DV subdialect, which enables stitching Virtual Tables from IBM Data Virtualization service with their source tables in relational databases
OpenLineage
- manta-tracker-1291 - Use "smart" mapping when column-level lineage information is not available in OpenLineage events
Integrations
General
- manta-tracker-1728 - Support for OpenLineage export to Alation
Fixed in this release
Security issues fixed in this release
CVE-2025-25724
General
- manta-tracker-1843 - Manta launcher is hitting OOM error during prolonged use
Scanners
COBOL
- manta-tracker-1789 - Analysis of COPY statement no longer fails when optional terminating
.is missing
Cognos
-
manta-tracker-506 - Support user groups in translations of search paths
-
manta-tracker-1733 - Database name specified in
dataSourceUsagein FM model not reflected when generating lineage resulting in use of UNKNOWN_DATABASE asset
Databricks
-
manta-tracker-335 - Fix Databricks notebook import cycle detection
-
manta-tracker-1527 - Support for TIMESTAMP_NTZ datatype
-
manta-tracker-1672 - Repository hierarchy is represented with connection string instead of hostname
-
manta-tracker-1768 - OpenLineage mapping not working
-
manta-tracker-1796 - Add included jobs to Databricks
Datastage
-
manta-tracker-1461 - Extend automatic extraction to extract jobRun metadata
-
manta-tracker-1555 - Implement resolving of the metadata used in the jobRun based RCP algorithm for DataStage NextGen. For more information, see DataStage Next Generation / on Cloud Pak Scanner Guide.
-
manta-tracker-1571 - Support for
postgresql-ibmcloudstage in DataStage NextGen -
manta-tracker-1593 - Reader loads OMD files as primary input
-
manta-tracker-1639 - Change default setting for job runs processing to false
MicroStrategy
- manta-tracker-1865 - Skip failing input to process remaining dossiers
SAP HANA
- manta-tracker-1710 -
inkeyword now supported insubstr_regexp
SAS
- manta-tracker-818 - Scanner now supports SQL Passthrough Facility for Hive, and LIBNAME definitions of Hadoop resources
Snowflake
- manta-tracker-1309 - Analyzing OVER clause no longer fails when CURRENT ROW is used
Teradata
- manta-tracker-1540 - Macro source scripts now shows under extracted Macro objects when successfully parsed
Release 42.9
Date: 31 January 2025
New in this release
Integrations
Alation
- manta-tracker-1535 - Manta Alation Export - Manual authentication mode implementation. Important Additional information: For more information, see Manta Flow Alation: IBM Automatic Data Lineage Configuration.
Fixed in this release
Security issues fixed in this release
CVE-2024-4741, CVE-2024-6602, CVE-2024-6763, CVE-2024-9287, CVE-2024-11168, CVE-2024-45337, CVE-2024-47535
CVE-2019-12900
General
-
manta-tracker-1025 - Optimized use of RAM during Dictionary Dataflow Scenario. Important Additional information: Dictionary Dataflow Scenario memory usage is now not dependent on number of scanned objects and should not require increasing available memory (via
SCENARIO_LOAD_MEMORY) over the default 3GB in most cases. -
manta-tracker-1520 - Launcher is hitting OOM error
-
manta-tracker-1700 - Automatically exported bash functions break CLI execution
-
manta-tracker-1774 -
OutOfMemoryErrorin commit revision scenario
Scanners
COBOL
-
manta-tracker-832 - location change of
cobol.call.targets.file. Important Additional Information:cobol.call.targets.filenow needs to be provided as part of Cobol input scripts intomantaflow/cli/input/cobol/<conbol.connection.id>/cobolCallProgramNames.csv(instead of prior location cli configuration). -
manta-tracker-923 - Support for IS ARE syntax
-
manta-tracker-1368 - Support empty step name in JCL
Cognos
-
manta-tracker-704 - Agent implementation for Cognos extraction. See Manta Flow Agent Configuration for Extraction for more details.
-
manta-tracker-1262 - Support semicolons as parameter delimiter in #prompt
Databricks
-
manta-tracker-768 - Fix duplicated columns issue
-
manta-tracker-1228 - Query Extraction is failing with NullPointerException
Datastage
- manta-tracker-1308 - Fix case insensitivity of parameter set names
DB2
-
manta-tracker-811 - Fix
CharConversionExceptionduring extraction -
manta-tracker-1799 - DB2 dictionary mappings now contain
Subdialectfield. Important Additional Information: Currently, this needs to be manually added to manual mappings through CSV, and re-run of dictionary mapping scenario is needed to refresh the extracted mappings, before they can be edited through UI. A hotfix of installer is being processed to migrate the format as part of upgrade process.
IFPC
- manta-tracker-1353 - Logs contain messages "Cannot find node type IFPC..."
Microstrategy
-
manta-tracker-1503 - Extraction of dossier without datasets fails with NPE
-
manta-tracker-1615 - Support multiple regular expressions in include and exclude lists. Important Additional Information: See properties
microstrategy.extractor.includeandmicrostrategy.extractor.excludein MicroStrategy Resource Configuration for more details.
MSSQL
- manta-tracker-585 - Support for IS [NOT] DISTINCT syntax
OBIEE
- manta-tracker-1443 - Analysis fails because of wrong InputService configuration
PostgreSQL
- manta-tracker-1552 - Support for
DISTSTYLEin create materialized view
SAS
-
manta-tracker-820 - Support for title statement in proc SQL
-
manta-tracker-1243 - Support export of SAS tables to Collibra
-
manta-tracker-1573 - Allow period separated hostname in connect statement's server argument
-
manta-tracker-1592 - Restore support for hierarchical dicrectories. Important Additional Information: See SAS Manual Inputs and SAS Resource Configuration for more details.
-
manta-tracker-1652 - Better support for optional argument delimiter
-
manta-tracker-1679 - Options within data or proc statements are not recognized and error out
Snowflake
- manta-tracker-1457 - Connection validation for
ACCOUNT_USAGEconnections times out for large databases
Tableau
- manta-tracker-787 - Incorrect handling of Tableau API responses results in "Insufficient Access Rights Error" even when using an Admin User
Release 42.8.33
Date: 18 December 2024
Fixed in this release
Scanners
Db2
- manta-811 - CharConversionException is not thrown during extraction from the Db2 scanner
Databricks
- manta-1671 - Databricks Analysis fails when Python is enabled
Release 42.8.30
Date: 5 December 2024
Fixed in this release
Scanners
MSSQL
- manta-tracker-1631 - Fixed unintended unification of columns in results of table function within the same schema
Release 42.8.28
Date: 21 November 2024
Fixed in this release
Scanners
MSSQL
- manta-tracker-1595 - Fix MSSQL Export scenario failing
Release 42.8.27
Date: 18 November 2024
Fixed in this release
General
- manta-tracker-1458 - Fix lineage when selecting vizualization/exporting from a Node that goes through routines
Dataflow Repository
- Fixed bug concerning server failing to start after upgrade from R42.7.x
Flow Server
-
manta-tracker-1560 - Flow Server does not log errors
-
manta-tracker-1562 - Dataflow analysis fails because of duplicate flow edges
Scanners
PostgreSQL
- manta-198072 - Postgresql URL not constructed correctly when query string contains '/'
Tableau
- manta-tracker-1591 - Cannot create a new Tableau connection or run an existing one
Release 42.8.7
Date: 12 November 2024
Fixed in this release
Scanners
Databricks
- DEV-41146 - Databricks Columns are being duplicated
Release 42.8
Date: 18 October 2024
New in this release
General
- 1411 - Remove
scriptMetadataDb.mv.dbH2 database
Scanners
DataStage
-
428 - Support for UnstructuredDataConnectorPX stage
-
294 - Support DataStage for Cloud Pak for Data (Next Gen) embedded stage connection
-
274 - DataStage for Cloud Pak for Data (Next Gen) support different version of Netezza Stage
OpenLineage
- 1287 - Include and Exclude filtering for OpenLineage connection Important Additional Information: Check OpenLineage Resource Configuration for more details about the new properties
Oracle
- 291 - Support outdated (UN)RECOVERABLE modifier
PostgreSQL
- 1321 - User-set server name Important Additional Information: See property
postgresql.hostNamein PostgreSQL Resource Configuration for more details.
PowerBI
- 1288 - Proxy support Important Additional Information: Check Power BI Resource Configuration for more details about the new properties.
SAS
- 1408 - Support export of SAS tables to Collibra
Snowflake
- 352 - Automatically extract search path from Snowflake. Important Additional Information: As of R42.8, search path is auto-extracted instead of relying on the user-set values only. This may result in a different but more accurate
lineage after upgrading from previous version. User-set value is still respected, and takes precedence over automatically extracted value. See property
snowflake.searchPathin Snowflake Resource Configuration for more details.
Hive
- 297 - Sanitize SQLException stacktrace rather than truncating it
Fixed in this release
Security issues fixed in this release
CVE-2024-2236, CVE-2024-2511, CVE-2024-4603, CVE-2024-4741, CVE-2024-5535, CVE-2024-6119, CVE-2024-6232, CVE-2024-6923, CVE-2024-8088, CVE-2024-26461, CVE-2024-26462, CVE-2024-34397, CVE-2024-35325, CVE-2024-37370, CVE-2024-37371, CVE-2024-38816, CVE-2024-45490, CVE-2024-45491, CVE-2024-45492
CVE-2023-3446, CVE-2023-3817, CVE-2023-4156, CVE-2023-4504, CVE-2023-5678, CVE-2023-6129, CVE-2023-6237, CVE-2023-7256, CVE-2023-30571, CVE-2023-36191, CVE-2023-36632, CVE-2023-37920, CVE-2023-39804, CVE-2023-45322, CVE-2023-45918, CVE-2023-48161, CVE-2023-50495
CVE-2022-3219, CVE-2022-3857, CVE-2022-4899, CVE-2022-27943, CVE-2022-29458, CVE-2022-41409
CVE-2021-25317, CVE-2021-36217
CVE-2020-12413
CVE-2005-2541
RHSA-2024:6464
General
Dataflow Viewer
- 817 - Export to csv fails if selected data is too big
Scanners
Datastage
-
1372 - Configuration property
datastage.editionis not reflected in extraction scenario -
1371 - Blank port property causing initialization failures Important Additional Information: Use port 443 as a workaround.
Open Manta Designer
- 758 - License error on OMD startup
Oracle
- 793 - Proper resolution of object and schema name in case they are the same
Snowflake
-
1329 - AccountUsage extraction shows unexpected column
SYS_MV_SOURCE_PARTITIONin materialized views -
1165 - Fix case ambiguity when analyzing extracted DDLs that create entities with unqualified names
Tableau
- 306 - Prevent failure of extraction on generic errors
Release 42.7.3
Date: 27 September 2024
Fixed in this release
Scanners
Datastage
-
manta-tracker-1371 - Port property causing initialization failures
-
manta-tracker-1372 -
datastage.editionis not reflected in extraction scenario
Known Issues
Datastage connection gives false validation error about wrong port unless port 433 is provided - can be ignored, extraction will still work
Release 42.7.2
Date: 4 September 2024
Fixed in this release
Security issues fixed in this release
CVE-2024-38807, CVE-2024-38810
Release 42.7
Date: 27 August 2024
This is primarily a fix release, but with selected new capabilities as listed below. The significant improvements include automated extractions of Jobs from Datastage NextGen, new Automapping UI, support for Triggers in PostgreSQL and Extraction and improved support for Streams in Snowflake.
New in this release
General
-
DEV-41184 Prevent manta from starting under incorrect user. Important Additional Information: Set 'manta.user' in manta.properties to enable. Checks if current user matches specified user, if 'manta.user' not set this check is disabled. Compatible with interactive use and service mode:
- Windows (BAT):
- Uses %USERNAME% environment variable
- Checks against %MNT_manta.user%
- Unix/Linux (SH):
- Uses $(id -un) command to get current user
- Checks against ${MNT_manta_user}"
- Windows (BAT):
-
DEV-39255 Remove license key validation from the product. Important Additional Information: License key is no longer required when installing/updating Manta, and all the license related features were removed
Administration User Interface
- DEV-41271 Make Automapping UI available by default. Important Additional Information: For details, see Cross-platform lineage explained.
Scanners
Databricks
-
DEV-40840 Support missing and changed configuration in IKC
-
DEV-38527 Remove orphan catalogs and schemas from the viewer
DataStage
-
DEV-41141 Support for Datastage Next Gen extraction Important Additional Information: For details about new attributes related to extraction, see DataStage Next Generation / on Cloud Pak Scanner Guide and DataStage Resource Configuration.
-
DEV-40581 Support missing and changed configuration in IKC
-
DEV-39641 Support for azuresql Stage
Db2
- DEV-41103 Support for for_n_rows_insert
Informatica PowerCenter
- DEV-40876 Add truststore properties for IFPC connection
Important Additional Information: In case of use of certificate that is not validated by default Java truststore, you can now add the path and password to the custom truststore directly in Informatica PowerCenter connection.
For details, see properties (
ifpc.extractor.infaTruststorePath;ifpc.extractor.infaTruststorePassword) in Informatica PowerCenter Resource Configuration.
MicroStrategy
-
DEV-40580 Support missing and changed configuration in IKC
-
DEV-40644 Fix host name setting in connection
MSSQL
- DEV-40900 Load persisted server attributes from dictionary
Open Lineage
- DEV-41290 Display column names for file columns instead of numbers when the OpenLineage description attribute is available
QlikSense
- DEV-35244 Improve message for failed validations
Snowflake
-
DEV-41111 Stream Support in Snowflake - CREATE/ALTER/DROP Stream
-
DEV-41110 Stream Support in Snowflake - Extraction
StreamSets
- DEV-40826 Improve the validation error message
Tableau
-
DEV-41158 Support of workbooks in personal workspaces Important Additional Information: For details about personal workspaces configuration, see Create and Edit Private Content in Personal Space. For details about additional new configuration, see Tableau Resource Configuration.
-
DEV-39875 Capture comments in expression in calculated attributes
Integrations
Collibra
- DEV-40710 Manta Link not generated for View and Schema to Collibra
Fixed in this release
Security issues fixed in this release
CVE-2024-3656, CVE-2024-34750
General
-
DEV-40899 Revision difference scenario does not work with Target scans functionality (minor revisions)
-
DEV-38135 Script DB crashed during a commit revision scenario
-
DEV-41001 Import by path in Open Manta Extensions fails
-
DEV-41104 Insecure configuration in Manta Launcher
Scanners
BigQuery
- DEV-40949 Extraction fails because of expired token / Need to reauthenticate after 1 hour
COBOL
- DEV-41149 Placeholder
jcl.sas.dictionary.idcannot be resolved after upgrading to R42.6
Databricks
- DEV-41012 Incorrect token is validated during connection creation
DataStage
-
DEV-40713 Parameter value passed without quotation treated causes interpretation as variable instead of a fixed value
-
DEV-40712 Format string in SQL interpreted and evaluated as a parameter resulting in an invalid SQL
-
DEV-40707 Peek not properly connected to lineage
Db2
-
DEV-40942 Support for UNIQUE as synonym of DISTINCT
-
DEV-40940 Missing support for DECLARE CURSOR WITH ROWSET
-
DEV-40939 Add support for compatibility clauses in create procedure statement
-
DEV-40934 QUERY should not be treated as reserved keyword
Informatica PowerCenter
- DEV-40799 IFPC Validation without port fails with NumberFormatException
Oracle
-
DEV-41163 Missing support for SET AUTOTRACE SQL*Plus statement
-
DEV-41162 Missing support for SET TIME SQL*Plus statement
-
DEV-41161 Fix SET SERVEROUTPUT SQL*Plus statement
-
DEV-41129 Improve parsing support for SQLPlus import statement
-
DEV-40885 Support for TABLE function call syntax without parentheses and TABLE keyword
Power BI
-
DEV-41273 Resolving undefined identifier ends by StackOverflowError
-
DEV-41208 PostgreSQL.Database Incorrectly Resolves Valid Table Selector
-
DEV-40678 Power BI scan stuck on invalid DAX expression
SAS
- DEV-40822 SAS download statement in a defined session resolves inlib and outlib differently
Snowflake
- DEV-34663 Snowflake resolves Sequences as Tables
SSRS
- DEV-40833 SSRS - Non-deterministic results of SSRS Dataflow. Important Additional Information: SSRS Data Points have different nodes for each value (e.g. a Series now has Data Point X and Data Point Y instead of a single Data Point with both X and Y expressions)
Integrations
OpenManta Integration Export
- DEV-41231 CREATE VIEW script is exported even if Export view definitions switch is turned off. Important Additional Information: The CreateView objects will be removed from objects.csv output for Snowflake, BigQuery, and SAP HANA (unless explicitly turned on)
Release 42.6.4
Date: 23 July 2024
COBOL
- DEV-41149 Placeholder
jcl.sas.dictionary.idcannot be resolved after upgrading to R42.6
Release 42.6.3
Date: 18 July 2024
Fixed in this release
Security issues fixed in this release
CVE-2024-34750
Release 42.6.2
Date: 28 June 2024
SSAS / PowerBI
- DEV-40678 - Power BI scan stuck
Release 42.6.1
Date: 27 June 2024
Manta Dataflow CLI
- Extra testing libraries were removed from the product.
Release 42.6
Date: 24 June 2024
This is primarily a fix release, but with selected new capabilities as listed below.
New in this release
General
- DEV-40920 Change copyright in AdminUI
- DEV-40736 Turn off Keycloak event logging by default. Important Additional Information: To prevent data corruption, logging of all Keycloak events has been disabled.
- DEV-40739 Automated export for configurations, workflow definitions and OMD. Important Additional Information: Every configuration change (configurations, connections, workflows) generates a backup file stored in the data subdirectory of respective component.
- DEV-40921 Change copyright in rest of the product
- DEV-40901 Set Artemis Memory Parameter at Manta/conf/manta.properties. Important additional Information: Users can setup Artemis memory via manta.artemis.memory property in conf/manta.properties
- DEV-40735 Automatically remove corrupted H2s - LV, Usage stats, Script Metadata
- DEV-40950 Wait for Neo4j start
Dataflow Viewer
- DEV-40914 Change copyright in FlowServer and KB links
- DEV-39975 Select multiple objects from Main List Area to Selected for Lineage
- DEV-39024 Put focus on the newly added filtering field
Open Manta Designer
- DEV-40280 Reporting state of the "Workflow execution" to OpenManta Designer front end
- DEV-40200 Provide last published information and confirmation dialog in OMD
- DEV-39622 Improve OMD RepositoryTree Search UX
Scanners
General
- DEV-40434 Ignore/Skip failed query service parsing so that it does not fail analysis of the whole cube analysis (for SSAS and Teradata)
Cognos
- DEV-40195 Better logging for unsupported database
Db2
- DEV-40180 Object-level filtering Important Additional Information: See Db2 Resource Configuration, property
db2.excludedEntitiesfor more details. - DEV-39998 DB2 z/OS implement foreign key extraction
Hive
- DEV-40527 Auto-flush dictionary writer in Extraction Output Parser
Informatica PowerCenter
- DEV-37861 Case insensitive matching for workflow name in ifpc.parameter.file.mapping.file
MicroStrategy
- DEV-31716 Dataflow for imported datasets attributes
- DEV-40737 Fix Include paths in extraction
- DEV-40623 MicroStrategy database connectivity
Oracle Data Integrator
- DEV-39993 Improvement of ODI context logging
PostgreSQL
- DEV-40808 Support for new built-in functions introduced in PostgreSQL 17
- DEV-40018 Properly Assign Column Names for "CSV Import" operation
- DEV-29635 Resolve in topological order of dependencies
SAS
- DEV-39811 Rename SAS_PROGRAM node name not to contain file suffix. Important Additional Information: According to the list of SAS file extensions (
File Extensions for SAS Files), SAS programs should have.sas file suffix. As of R42.5:
- Sas scanner will accept only files with .sas suffix
- .sas suffix will be removed from the SAS Program node displayed in Manta repository
- DEV-40756 Support for PROC SQL Command Options such as UNDO_POLICY=NONE
Snowflake
- DEV-40129 Support for trailing commas
Integrations
OpenManta Integration Export
- DEV-39965 Implement export of Tableau Datasource hierarchy
Fixed in this release
Security issues fixed in this release
CVE-2024-22262, CVE-2024-25710, CVE-2024-27309, CVE-2024-29025, CVE-2024-29131
CVE-2023-52428
General
- DEV-40924 Error on Validation to MSSQL with Native Authentication type
- DEV-40405 Automapping - loss of data during higher event numbers
- DEV-40610 Manta hostname is missing case normalization. Important Additional Information: manta.system.hostname and manta.keycloak.public.url are made case insensitive on Linux.
- DEV-41001 Import by path in Open Manta Extensions fails
- DEV-40704 Import from repository into OMD is not working
- DEV-40774 Disable indirect link to be considered in API Revision Diff. Important Additional Information: Revision difference output CSV might change regarding content. Lines related to indirect flows only won't be printed anymore. The CSV structure is unchanged. For more information, see IBM Manta Data Lineage
- DEV-40773 Diff API calls that are triggered in parallel produce inconsistent results
Dataflow Viewer
- DEV-40435 Tooltip for PK and FK icons are the same in list lineage
- DEV-40422 Clicking disabled button causes IllegalStateException
- DEV-40338 Flow Viewer gets stuck on choosing the resources
- DEV-40767 Undefined levels of COBOL assets shown incorrectly
Manta Agent
- DEV-40874 Agent extraction fails to terminate extraction
- DEV-40658 Agent workflow fails on status timeout
Scanners
General
- DEV-40309 Hive Incorrect table associate of columns used in LEFT JOIN statement (for Databricks and HiveQL)
Databricks
- DEV-40742 Databricks UC Scanner should not parse Notebooks
DataStage
- DEV-40714 Support for JDBCConnectorPX
- DEV-40534 org.json.JSONException: JSONObject["parameters"] not found.
- DEV-40407 PROJDEF not resolved in all places
- DEV-39590 Incorrect lineage for Modify stage
- DEV-39214 Job filtering does not work
Db2
- DEV-40941 Support for FETCH clause in SELECT
Hive
- DEV-40305 Add replace as built-in function
MicroStrategy
- DEV-40453 NPE in dataflow log
Oracle Data Integrator
- DEV-40705 Context treated as case sensitive in Manta instead of case-insensitive as in ODI
- DEV-40325 ODI Extract Scenario failure based on inability to extract for one ODI Job
PostgreSQL
- DEV-40689 Incorrect GET DIAGNOSTICS syntax
- DEV-40615 Support for COLLATE in variable declaration
Power BI
- DEV-40373 Support for Date.EndOfWeek function
QlikSense
- DEV-35281 Proper handling of non-ASCII application names
SAP BO
- DEV-40289 Non-deterministic results of SAP BO Dataflow
SAP HANA
- DEV-40291 Support for REPLACE function
SAS
- DEV-31368 Cobol Scanner not able to honor call for SAS program from the jcl. Important Additional Information: Due to introduction of a new property jcl.sas.dictionary.id, existing COBOL connections need to be edited and saved (without making any actual change) to have Manta add this property. Without doing so, the attempt to run data lineage analysis on existing Cobol connection will fail.
- DEV-40779 Unexpected underscore in input format
- DEV-40757 Support for LABEL Attribute without "="
- DEV-40753 Support for Length Declaration without "="
- DEV-40752 Support for "Not Equals" (not eq) Operator in SAS Code Parser
- DEV-40227 "Order" is not a recognized identifier
- DEV-40225 Support for Footnote statements
Snowflake
- DEV-40796 Missing support for FETCH FIRST 1 ROWS ONLY
- DEV-40246 Support for MONTHS_BETWEEN function
SSRS
- DEV-39652 Support for system constants System.Double.Epsilon, Today, FirstDayOfWeek
Teradata
- DEV-40996 TPT variables files not recognized on Linux platform
- DEV-40892 Broken TPT lineage analysis in Manta R42.5.3
- DEV-40659 TPT attribute names are case-insensitive
- DEV-40642 BTEQ Script misses parent TPT Script node
- DEV-40628 Support for mixed DEFINE and STEP commands
Release 42.5.10
Date: 04 June 2024
- DEV-40950 Wait for Neo4j start
- DEV-40704 Import from repository into OMD is not working
Release 42.5.9
Date: 03 June 2024
Scanners: Teradata PT
- DEV-40892 Followup to 42.5.3 - connect lineage for SQL logic in Teradata PT scripts
Release 42.5.3
Date: 10 May 2024
Scanners: Teradata PT
- DEV-40628 Support for mixed DEFINE and STEP commands
- DEV-40659 Support case-insensitive attribute names in more places
- DEV-40642 Place BTEQ Script nodes under TPT Script node
Release 42.5.2
Date: 9 May 2024
- DEV-40687 Fix frozen Viewer after triggering the Follow operation in the lineage
Release 42.5.1
Date: 4 May 2024
- DEV-40639 MicroStrategy - database connectivity fix
Release 42.5
Date: 03 May 2024
Important enhancements
- Improved support for Cognos Data Modules to accommodate changes in Cognos internals. This ensures support of Cognos Data Modules for Cognos Release 11.1 and beyond.
- The OpenManta Designer now supports direct publishing of new assets for users with proper credentials, and also contains new templates for Custom Databases and REST APIs.
Special notes
- The PDF export for Automatic Data Lineage documentation is no longer available at the Manta Portal. Automatic Data Lineage documentation is now fully accessible at https://ibm.com/docs/en/manta-data-lineage.
- Targeted Scanning is now enabled by default for new installations. For existing installations, once users choose to enable it, it cannot be reverted back. Targeted scanning is the preferred and future proof way of working with Automatic Data Lineage and managing the scanning process. For more information, see Targeted scanning.
New in this release
General
- DEV-39870 Ignore MacOS system files in manual inputs
- DEV-39756 Update Artemis to 2.33.0
- DEV-39755 Update Keycloak to 24.0.2. Important Additional Information: Keycloak has been upgraded to v 24. Breaking Change: Minimal username length is now 3 characters.
Administration User Interface
DEV-40098 Remove deprecated Spring configuration. Important Additional Information: Configuration property server.max-http-header-size has been replaced with server.max-http-request-header-size.
Dataflow Repository
- DEV-21786 Merge Layer nodes with the same name
- DEV-39377 manta_hyperlink in Lineage listing export is empty
- DEV-40102 Targeted scans - Close nodes for deleted connections
- DEV-39629 Hidden major scan with Targeted scans as default. Important Additional Information: After enabling targeted scanning you will be asked to create an empty major revision to start using targeted scanning. This is a must to allow repopulating repository with metadata information needed for targeted scanning. Major revisions will no longer be available and your existing workflows will be converted to use minor revisions only. For more information, see Targeted scanning.
Dataflow Viewer
- DEV-39699 Revision comparison update. Important Additional Information: Revision comparison has been moved from top-left corner of the screen to the bottom-right corner of the screen.
- DEV-39647 Show minor revisions similar to major revision in viewer. Important Additional Information: When targeted scanning is enabled on R42.5, major revisions cannot be used anymore and as such, the original major.minor revision number format does not make sense anymore. Only minor revision will be displayed if there are no historical major revisions in the repository.
- DEV-39519 Make viewer left panel wider by default
Open Manta Designer
- DEV-40304 Custom Database Template
- DEV-39337 Add info about the Current Release to tooltip of the Help button.
- DEV-38649 Define and create a Resource Template for REST APIs
- DEV-38645 Support the ability within a Resource Template to explicitly define the nodes to be created when using the "Create child-nodes hierarchy" feature.
- DEV-38636 Node name case-insensitivity Option
- DEV-36458 Publishing OMD Connection into Admin UI
- DEV-34124 UX improvements in the "after import" dialog
Scanners
Cognos
- DEV-39547 Support for Data Modules in 11.1 and beyond
DataStage
- DEV-39404 Fix logging about enabled RCP on NextGen
- DEV-40215 Support for changed structure of job exports in NextGen
HiveQL
- DEV-39940 Improve logging for Hive Agent extraction
MicroStrategy
- DEV-40176 Do not extract hidden objects
PowerBI
- DEV-37278 Support reports with the same name and the same type
- DEV-36928 Connect TABLE COLUMN UNKNOWNS to created Nodes
- DEV-40019 Implement Propagation for Table.PromoteHeaders
- DEV-39873 Keep source informations through Table.SelectRows
- DEV-39328 Add support for SharePoint.Files
SAS
- DEV-39787 Support for procsql outobs=
- DEV-19146 PUTLOG statement
Tableau
- DEV-18602 Make deduction work for BigQuery
Integrations
Alation
- DEV-40241 Hive Alation Export
-
DEV-40393 Change types in open export for Folders and Reports. Important Additional Information: In case the default setting for Open MANTA Integration Export Configuration was previously overridden by the user, in Admin UI, go to Tab Configuration and then section Integrations > Open MANTA Integration Export > Open MANTA Integration Export Configuration and look up the following lines
"MicroStrategy Artificial Folder": "DATA_SERIES", "MicroStrategy Report": "DATA_SERIES",and replace them with
"MicroStrategy Artificial Folder": "STATEMENT", "MicroStrategy Report": "TRANSFORMATION",
Fixed in this release
Security issues fixed in this release
CVE-2024-28849, CVE-2024-22257, CVE-2024-22201, CVE-2023-6378
Administration User Interface
- DEV-40406 NumberFormatException while processing Scenario statistics event
- DEV-40335 Process Manager input files use hardcoded path to OS Temp directory. Important Additional Information: Process Manager input files are stored in Automatic Data Lineage temp directory, instead of OS temp directory."
Dataflow Repository
- DEV-39513 Exports from Flow Server to .csv files take too long
- DEV-40171 "Flow Server not Starting with error message: "Node is not in any layer"
Dataflow Viewer
- DEV-40159 Application Level Lineage not displaying all Applications already Onboarded
- DEV-39968 Summary Active Tags are not appearing for Parent Nodes
- DEV-39753 Not all node names are displayed in technology dropdown
OpenManta Designer
- DEV-40333 Context menu of last node in RepoTree cannot be used because of AZ sorting button
- DEV-40042 Chinese characters GB18030 not displayed properly
Scanners
General
- DEV-38420 Very unuseful message for PowerBI and OBIEE when certificate missing
- DEV-39868 Order removal from graph nodes is too eager. Important Additional Information: Resultset nodes starting with numbers now keep their number prefix.
COBOL
- DEV-38014 File reader of cobol dataflow returns absolute path if input folder path points to a file
DataStage
- DEV-39338 Disconnected lineage because of unsupported input links for Funnel stage
Db2
- DEV-39900 Support for RUN OPTIONS clause
HiveQL
- DEV-39933 Fix parsing of CHECK constraint
Informatica PowerCenter
- DEV-39986 Agent Extraction for IFPC is getting errored out
PostgreSQL
- DEV-38578 Support references to window clauses
PowerBI
- DEV-40279 Handling trailing whitespaces in workspace and report names
SSAS
- DEV-40250 Empty expressions in Calculated Columns aren't supported
Integrations
Collibra
- DEV-40332 Collibra Edge Export is Exporting a Stored Procedure that does not match with Export Filter configuration
- DEV-40217 PowerBi Export to Collibra - some assets are ignored
Release 42.4.5
Date: 15 April 2024
-
DEV-40456 Invalid Agent version during minor upgrade after hotfix
-
DEV-40390 Add option to use exact URLs from Launcher configuration by specifying new property
manta.launcher.use-json-urls=trueintomanta.propertiesfile
Release 42.4.4
Date: 02 April 2024
- DEV-40234 Add configurable client support of TLSv1.3, which can be enabled by setting -Dmanta.tls.version=TLSv1.3
Release 42.4.3
Date: 29 March 2024
- DEV-40049 Upgraded spring-framework version to
6.1.5, spring-security to6.2.3and spring-boot to3.2.4
Release 42.4.1
Date: 29 March 2024
- DEV-39868 Properly connecting columns with name starting with number space or question mark space
Release 42.4
Date: 22 March 2024
Notable additions to Release 42.4 include enhancements to PowerBI scanner, performance enhancements to Repository Management, along with various usability enhancements for the OpenManta Designer. This release also introduces the automatic replacement of numeric offset-based column names for files. These numeric column names are still present in the Repository, but a Description Attribute or MANTA_ALIAS (if present) is now used instead, in both the Repository and the Lineage Viewer. Column descriptions are typically populated directly by the ETL Scanners and by the COBOL Scanner.
New in this release
General
-
DEV-39177 Include the calling system of a connection object in automapping events
-
DEV-39145 Allow configuring ZipFileDecompresser.maxNumberOfEntries with a configuration property for Flow Server
-
DEV-39346 Add Direction column in Lineage listing
-
DEV-37537 Improve performance of attribute filter keys by disregarding permissions and revisions. Important Additional Information: Attribute keys are considered as part of database schema, they don't contain sensitive values. Attribute filter keys in Viewer search may contain attribute keys from assets which are unavailable to the current user or in the selected revision.
-
DEV-38428 Simplify evaluation of the search query in search API. Important Additional Information: The full text index is rebuilt automatically on the first Flow Server start after the upgrade. The full text search is unavailable during the rebuilding and may throw an error documented at Neo4j: The Full-Text Search Index Is Populating
-
DEV-39344 Improve performance of first tree loading
-
DEV-34279 Use less memory when importing dump
-
DEV-33854 Prefer user local bash over global bash, if available. Important Additional Information: The shell scripts will use #!/usr/bin/env bash to determine the correct shell version to use.
-
DEV-39230 Ignore MacOS system files in manual inputs, see API Metadata Input for more details.
-
DEV-37326 Ingestion from Git. Important Additional Information: Manta can now download files directly from Git. See Manta Flow Agent Configuration for Extraction for more details.
Administration
-
DEV-36584 Option to Select Multiple Connections for Deletion
-
DEV-23827 Prevent use of xi:include in custom logging configuration. Important Additional Information: Use of XInclude namespace is prohibited for all user-provided XML configurations for security reasons.
Dataflow Viewer
-
DEV-39322 Rename Lineage listing export button from "Export Lineage" to "Export list to CSV"
-
DEV-39247 Visualization parameters in textual lineage page
-
DEV-36478 Display the number of steps and allow sorting
-
DEV-39156 Display column names for files rather than numbers when the description attribute is available. Important Additional Information: As of R42.4, Manta will display column description (if available) for file columns instead of the column number. Note that column numbers are still used for exports to ensure uniqueness. See Browse the Object Catalog for more details.
-
DEV-39491 Direction in Lineage listing for multiple start nodes
OpenManta Designer
-
DEV-39680 Preselect latest revision and Physical Layer in OMD Import dialog
-
DEV-39052 Copy & paste multiple columns into Create New Node dialog
-
DEV-38003 Allow sorting nodes in Repository Tree alphabetically
-
DEV-39479 Search in repository tree
COBOL
-
DEV-39281 Propagate DDs defined in JCL into EXECuted PROCedures. Important Additional Information: Dataflow nodes parent structure fixes:
-
Added missing "JCL Execution" parent node to all "JCL Procedure" nodes representing from which they were called (between it and its current parent "JCL Job" or another "JCL Procedure"). As those nodes are used as parents for all "Cobol Program" nodes when started by PROCedure, this produces different repository hierarchy structure compared to prior versions. Fixes mixed-up lineage when the same PROCedure is called multiple times from one JCL.
-
Fixed parent structure of "JCL Defined dataset" nodes according to their definition location (even when only part is redefined) instead of final place where they are used (typically from PROCedure to JOB). Fixes mixed-up lineage on "JCL Defined dataset" node when the same PROCedure is called multiple times with different defined DDs.
-
-
DEV-38866 Add support for call of IKJEFT01, IKJEFT1A, IKJEFT1B by definition of SYSTSIN
Databricks
- DEV-38571 Implement Databricks OpenLineage Dataset Mapping Scenario. Important Additional Information: A new extractor scenario for Databricks is available which automatically generating dataset mapping for OpenLineage scanner
DataStage
- DEV-37498 Support for PxOdbc stage
Db2
- DEV-37964 Add front-end validation of User-set server name field for DB2
MicroStrategy
- DEV-29849 Dataflow for secondary datasources
PostgreSQL
- DEV-39208 Implementation of return query statement
PowerBI
-
DEV-38903 Stop using Regular API. Important Additional Information: This issue decommissions an old inferior way of scanning the Power BI Azure server. If your Power BI Azure validations have been successful lately (or are successful now), then you're already using the newest Power BI Azure scan type and you safely ignore this change. If your Power BI Azure validations have been failing recently with the message about the regular API being set up correctly while the Scanner API is not, thenfollow the guide in Power BI Azure Setup to set up the Scanner API access rights. Once you do that, the validation should succeed and the resulting Power BI lineage will improve significantly.
-
DEV-39761 Improve dataflow extraction
-
DEV-38540 Support Linked Dataflows
-
DEV-38367 Support live connection Power BI reports connecting to SSAS
PowerQuery
-
DEV-36946 Connect TABLE COLUMNS UNKNOWN to created Nodes - cube
-
DEV-36944 Connect TABLE COLUMNS UNKNOWN to created Nodes - compute functions
SAS
- DEV-39690 Link connection name to Server asset
Snowflake
-
DEV-39783 Parsing support for GROUP BY ALL
-
DEV-39368 Perform LIST STAGE queries in a separate thread/connection
SSIS
- DEV-35890 Improve logging message for unknown component and remove stacktrace
Integrations
General
- DEV-38945 - Support for OpenLineage export to Open Manta Integration
OpenManta Integration Export
- DEV-39601 Export SAS tables
Fixed in this release
Security issues fixed in this release
CVE-2024-22259, CVE-2024-22233, CVE-2024-22201, CVE-2024-1597, CVE-2023-51074, CVE-2023-26159
General
-
DEV-35325 Not possible to create qliksenseKeystore.pkcs12
-
DEV-39803 Avoid creating backlinks if they already exist
-
DEV-39143 Improve Repository Postprocessing - Edge Propagation performance
-
DEV-39354 Improve log message for missing levels configuration
-
DEV-39352 Update log level for Edge Propagation
-
DEV-39006 Upgrade does not remove old record about Manta from installed programs
-
DEV-39326 Failed extraction causing node closing for the whole connection
-
DEV-39245 Direct Links are not removing lineage information on subsequent scans
-
DEV-39643 Caddy does not support multiple hostnames. Important Additional Information: By default, Caddy will listen on the system hostname provided during installation (manta.system.hostname property in manta.properties) and on hostname parsed from manta.keycloak.public.url (property in manta.properties). Additional domains can be specified using the manta.caddy.hostnames property in manta.properties.
-
DEV-39727 Caddy is not logging to file. Important Additional Information: Caddy is correctly storing logs in mantaflow/caddy/log/caddy.log file
Administration
-
DEV-39444 Confusing validation message for exclusion filters in connection settings.
-
DEV-39461 User can create wrong connection when clicking fast enough
-
DEV-39325 Missing Agent Manager truststore
-
DEV-39887 Manta.properties proxy file not mapping to manta.conf in keycloak. Important Additional Information: Keycloak will use conf/manta.properties configuration to setup its proxy settings. The proxy property will be removed from keycloak/conf/manta.conf during upgrade and will no longer be used.
-
DEV-31782 powerbiDataflowScenario has a missing attribute error message in the log
Dataflow Viewer
-
DEV-39708 Scroll and Order Issue with Repository tree in 42.3
-
DEV-39416 Repository tree refers to deduced objects as deducted
-
DEV-39308 Hitting search twice resets the search results
-
DEV-39306 Search keyword is removed when not changed
-
DEV-39284 Filters in the list not working as expected
-
DEV-39283 Lineage listing - blinking UI (preloader) during load of the query result
OpenManta Designer
-
DEV-39613 Import connection from zip only imports one value in attributes
-
DEV-39367 Wrong encoding in log
-
DEV-39130 Import connection from zip leads to import of node names without special characters
BigQuery
- DEV-39392 Structure fields do not respect order
COBOL
- DEV-38435 Cobol/JCL SORTIN-READ produces two edges to targets when there should be only one
DataStage
-
DEV-39580 Incorrect node type is created during DataStage NextGen (DSNG) Design analysis. Important Additional Information: Manta node type for DataStage flows that are not included in the input with any relevant instance of a job has been changed from Datastage Job to Datastage Flow Design, as was originally planned. No manual changes are required unless you use any 3rd party application which uses Manta exports and depends on the specified node type.
-
DEV-39646 Wrong encoding used when reading zip entries
-
DEV-39224 "Unexpected database type was met" for Oracle
-
DEV-39223 connectionString=null making connection Alias mapping impossible
-
DEV-39215 Incorrect context in the log message for the number of edges found
-
DEV-37825 Specification cannot be processed because of an unexpected format: [NOWARN]
Db2
-
DEV-38616 Unable to extract constraints in DB2 for z/OS
-
DEV-38585 Error fetching procedures from database in DB2 for z/OS
HiveQL
- DEV-39744 Do not use system temp during extraction and cleanup after extraction is completed
Informatica PowerCenter
- DEV-38874 No viable alternative to character 'E' on expression like '1/EXYZ' (division by field starting with 'E' without spaces around / character)
MicroStrategy
- DEV-39611 Improve error handling in MicroStrategy extractor
MSSQL
- DEV-39097 Domain name with dot not correctly handled in JDBC url by Admin UI
MySQL
- DEV-39509 Default values for mysql.jdbcDriverClassName and mysql.url are not compatible
OpenManta Extensions
- DEV-39835 Import of Perspectives via Conceptual overlays does not work as of R42.2
Oracle
-
DEV-39501 Incorrect handling as 'AT' alias
-
DEV-38516 Support for JSON_ARRAY, JSON_ARRAYAGG, JSON_DATAGUIDE, JSON_MERGEPATH, JSON_OBJECT, JSON_OBJECTAGG, JSON_SCALAR, JSON_SERIALIZE, JSON_TRANSFORM
PostgreSQL
- DEV-37052 Composite flow in Postgresql is not working properly
PowerBI
-
DEV-39321 Dataflow table has incorrect child type
-
DEV-39100 Mismatched input: 'VAR' and Mismatched token: 'Sort' in MDX parser
-
DEV-38259 Support for NBSP / xA0 and NEL / x85 as whitespace characters
-
DEV-38257 NULL_FILE_PATH caused by reference to Web.Contents
Snowflake
-
DEV-39785 Fix edge types for REGEXP functions
-
DEV-39658 Fix support for Snowflake join USING clause
SSAS
- DEV-38258 Support for '&' concatenation operator in MDX
SSIS
-
DEV-39520 Extraction does not write extracted object into files
-
DEV-39036 Support for SAP HANA connection via ADO NET connection
Tableau
-
DEV-39503 National characters causing extraction errors on linux
-
DEV-39318 Handling trailing whitespaces in workbook names
-
DEV-39316 Unexpected format of Content-Disposition header
Integrations
OpenManta Integration Export
- DEV-39653 False flow edges between database assets
Release 42.3.17
Date: 19 March 2024
General
- DEV-39703 Upgrade spring version to 6.0.17
General
- DEV-39702 Upgrade spring-security version to 6.1.7
Release 42.3.13
Date: 05 March 2024
Open Manta Integration Export
- DEV-39601 SAS tables export
Dataflow Merger
- DEV-39803 Duplicate backlinks fix
Release 42.3.12
Date: 01 March 2024
Security issues fixed in this release
CVE-2022-25647
Release 42.3.10
Date: 01 March 2024
General
- DEV-39733 Update Neo4j to 5.17.0
Release 42.3.8
Date: 29 February 2024
Scanners
- DEV-39603 Update org.postgresql to version 42.5.5
Release 42.3.5
Date: 26 February 2024
General
- DEV-39326 Targeted scanning: Failed extraction causing node closing for the whole connection
Scanners
SSIS
- DEV-39520 SSIS extraction failing on specific folder structures
Release 42.3.4
Date: 26 February 2024
General
- DEV-39371 Update Neo4j to 5.16.0
Release 42.3.3
Date: 21 February 2024
Scanners
Tableau
-
DEV-39316 Fix for unexpected format of Content-Disposition header
-
DEV-39318 Fix for trailing whitespaces in workbook names
-
DEV-39503 Fix for escaping national characters
Release 42.3.2
Date: 21 February 2024
The release provides a fix for Manta Insights accessibility.
New in this release
Dataflow Viewer
- DEV-39505 Fix for Manta Insights to be available from Viewer using a license without any special add-on
Release 42.3
Date: 6 February 2024
Release 42.3 provides a new approach for representing and managing lineage, called Lineage Listing. It is accessible at the Manta Repository page. This feature enables various use cases, including:
-
Providing a list of reports that will be impacted by a change in certain database tables.
-
Generating a list of tables in specified datamarts that contribute to loading a particular report.
-
Exporting any kind of object list to CSV.
For each of these lists, the user can apply filters based on any attributes regularly available for assets in the Manta Repository. See Lineage listing (from R42.3) for more details.
New in this release
General
-
DEV-36890 Improve performance of delete scenarios
-
DEV-4614 Rewrite init.d script for Apache Tomcat to systemd. Important Additional Information: Services may stop working on Linux with SEL enabled, as there are restrictions to running scripts from the home directory. There is a documentation that explains the process to remedy this Creating A System Service for systemd-based Linux Distros. Previously used init.d service (from older versions of Manta) will be uninstalled during upgrade and replaced with systemd service instead.
-
DEV-37336 Do not restore logs during the upgrade. Important Additional Information: Logs will not be restored during the upgrade, but they will still be available in the backup folder. During hotfix upgrade, the logs will be preserved.
-
DEV-37337 Do not ask for hostname during the upgrade. Important Additional Information: The system hostname parameter is no longer needed during upgrade from version R42 or newer.
-
DEV-37346 Remove the hostname related properties from Keycloak configuration file
-
DEV-38158 Set heap size proportionally for WKC deployment.
Administrative User Interface
-
DEV-38505 Disable Backup Data During Hotfixes. Important Additional Information: When installing hotfix using installer, the data from the backup are moved and not copied. This brings massive speed up for the installation.
-
DEV-37896 Add info about need to re-enter password after importing connections
Dataflow Viewer
-
DEV-32556 Make interactions in the central area table clearer
-
DEV-39287 Enable Lineage listing by default
-
DEV-38232 Extend the clickable area for column sorting
OpenManta Designer
-
DEV-38950 Rename OMD header for IBM solution
-
DEV-38459 OMD theming for IBM: nodes colouring and application name
-
DEV-38243 Rendering of edges attached from a Node to "itself" (esp. for Application Level Lineages)
Process Manager
- DEV-24320 Decorators for nodes with environment variable configured
Scanners
General
- DEV-34430 Unify naming for deduced databases and servers - implementation Hive, DataBricksSQL, Netezza, DB2
BigQuery
- DEV-30776 Support for Label Statement
Databricks
-
DEV-30321 Databricks SQL - COPY INTO
-
DEV-31387 Add support for extraction of DBC files
DataStage
-
DEV-38632 Support for Data Virtualization (dv) stage
-
DEV-38628 Support for Survive stage
-
DEV-38625 Support for bigqueryPX stage
-
DEV-37883 Log Warning about RCP being used in the job for new Datastage
-
DEV-37979 Use datepicker for "Analyze job runs since"
-
DEV-37496 Support for PxOracle stage
Db2
-
DEV-38592 Upgrade Db2 driver to work with DB2 for LUW and z/OS
-
DEV-36299 DB2 Extraction error - CharConversionException
HiveQL
- DEV-38467 Support for EXTRACT(field FROM source)
Informatica PowerCenter
- DEV-38573 Support for Netezza Bulk Writer
Microstrategy
- DEV-30985 Support attributes/metrics from project schema as a source for dossier visualization
OpenLineage
-
DEV-38566 Support for dataset mapping in dataflow generator. Important Additional Information: The connections.ini mapping is no longer available and is replaced by more generic mapping. More information is described here: OpenLineage Dataset Mapping
-
DEV-37940 Delete contents of temp directory before extraction. Important Additional Information: change of the structure that is passed between reader and dataflow task
-
DEV-37945 Design and implement a new structure of the temp folder. Important Additional Information: The structure of the temporary folder has been changed. Hence none of previously extracted inputs could be analyzed.
Oracle
- DEV-34469 Support for IF NOT EXISTS
PostgreSQL
- DEV-34382 Abort processing of large scripts - Postgresql. Important Additional Information: Internal safety check lowering the possibility of OutOfMemoryException by proactively terminating the processing of potentially too large inputs. By default turned on, can be turned off according to Common Resource Configuration More information can be found at Large input memory protection
Power BI
-
DEV-38048 Support for manually extracted SSRS reports within PowerBI
-
DEV-33300 Support references between workspaces
PowerQuery
-
DEV-36941 Connect TABLE COLUMNS UNKNOWN to created Nodes - column add
-
DEV-36929 Connect TABLE COLUMNS UNKNOWN to created Nodes - columns move
Snowflake
-
DEV-38514 Upgrade JDBC driver to work with Java 21
-
DEV-18831 Add support for array_construct
SSIS
- DEV-37486 Support for manual inputs. Important Additional Information: See SSIS Manual Inputs for more details on how to utilize this.
SSRS
- DEV-38047 Support for manual inputs. Important Additional Information: See SSRS Manual Inputs (since R42.3) for more details on how to utilize this.
Tableau
- DEV-38220 Update the Tableau Server URL tool tip to be the same verbiage as in the Manta Documentation
Integrations
OpenManta Integration Export
-
DEV-17316 Add Connection ID information to all Open Manta Integration Export files. Important Additional Information: All Open Manta Integration Export files will now contain new columns that will contain connection ID (or list of connection IDs), so that each exported object can be clearly mapped to an existing Manta connection. Consumer will have to adjust integration on their side if they expect fixed number of columns in output CSVs. See Manta Flow Open Manta Integration Export End-User Documentation for more details.
-
DEV-38263 Implement Databricks Job export
-
DEV-28816 Exports for MicroStrategy
Fixed in this release
Security issues fixed in this release
CVE-2023-6134, CVE-2023-46750, CVE-2023-26031
General
-
DEV-38859 abort.analysis.input.timeoutSeconds and abort.analysis.input.edgeLimit applied for Talend, IFPC and others as well that are not configurable yet
-
DEV-37853 Arbitrary file download from Manta instance through Agent
-
DEV-39204 After disabling Targeted Scanning, Manta can't read multi-edges from targeted scan
-
DEV-38786 Agent extraction process freezes if the extracted DDL has empty content
Administration User Interface
-
DEV-38445 Parts of multiline error messages get discarded during connection validation
-
DEV-38422 Perpetual Process stuck in UNAVAILABLE state
-
DEV-34445 IBM environment > Invoke getting MANTA Repository Usage Statistics returns error 401
-
DEV-34362 Very unhelpful validation message when connection validation fails
Dataflow Viewer
-
DEV-38716 Wrong revision ordering
-
DEV-38622 Revision comparison gives inconsistent results
-
DEV-38481 Double click in search result caused application error
-
DEV-38438 Button '>|' doesn't move user to the last page
-
DEV-38315 Query engine: user can add multiple filters of same type while query engine is loading for the first time
-
DEV-38032 Not all "Steps displayed" are visible in visualization configuration
-
DEV-37279 clicking in the repository tree automatically scrolls the repo tree to the top
-
DEV-36615 Can't un-highlight search suggestion box
-
DEV-35529 Usage action flow_catalog_show is not produced by the new visualization home page
-
DEV-35426 Strange wrapping and sizing of tooltip for Active tags
-
DEV-33035 Cannot change the search pattern if it is a substring of current search pattern
OpenManta Designer
-
DEV-30418 Improved logging for invalid inputs for Open Manta Extensions
-
DEV-38977 Fix Node and Resource icons in OMD and Manta Insights
-
DEV-38671 OMD help button to redirect into Manta Portal login
-
DEV-38670 Fix behaviour of new revision selector in OMD
-
DEV-38293 APPLICATION edge retyping for check for updates
Process Manager
-
DEV-38480 Use of ' special symbol in the workflow name leads to failing scenario. Important Additional Information: Workflow name cannot contain apostrophe/single quote character.
-
DEV-32696 Workflow designer shows it's adding nonsensical scenarios in Basic mode. Important Additional Information: Clean repository scenario has been removed from Basic mode in Process Manager Workflow Editor.
-
DEV-38174 No useful information about reason for failure; failure not reported in process manager
-
DEV-38156 Process manager fills logs with message about missing custom workflow
Scanners
Databricks
- DEV-38366 Task Node not showing up in the repository tree hierarchy
DataStage
-
DEV-38629 Wise mapping does not work as expected - connects too much. Important Additional Information: In DataStage Common configuration, the default value for "Connect all inputs to all outputs for unsupported stages" was changed from true to false. This can result in changed lineage which should be more accurate.
-
DEV-38634 Improve logging - unknown stage reported as a consequence of missing connection
-
DEV-38631 Filter condition attribute missing on Filter stage in certain cases
Db2
-
DEV-38491 Support for WITH REPLACE in DECLARE GLOBAL TEMPORARY TABLE
-
DEV-38476 Failure to to retrieve schemas for DB2 Z/OS
-
DEV-35919 Support of IF EXISTS clause in DROP TABLE
-
DEV-35891 TRUNCATE TABLE fails parsing
HiveQL
-
DEV-38691 variableSubstitution.properties is not applied
-
DEV-38082 Hive connection validation takes too long
Informatica PowerCenter
- DEV-38702 Dataflow analysis process stuck on expression with deep function nesting
MSSQL
-
DEV-36978 Add SYS schema to default exclude schemas list
-
DEV-14199 Parsing error on ALTER DATABASE ... ADD FILEGROUP
Netezza
- DEV-38376 Fixed bug in lineage when typecasting is involved
Oracle
- DEV-37397 Oracle parser fails on line starting with PROMPT thinking it is PROMPT sqlplus statement
PostgreSQL
- DEV-37510 Fix database name normalization issue preventing objects in the affected database from proper visualization and providing correct lineage
Power BI
-
DEV-35173 Extract reports over 1GB
-
DEV-38262 Processing of Table.ExpandTableColumn causes NullPointerException
-
DEV-38099 Do not interpret logical operators in identifiers names
-
DEV-38098 IndexOutOfBoundsException when if expression is used
SAP HANA
- DEV-37660 Support for parsing and dataflow generation for DEFAULT clause in parameter declaration
Snowflake
-
DEV-38974 Issue with parsing PRIOR as identifier
-
DEV-38972 Parsing TAG details fails
-
DEV-38673 Parsing fails on file format without quotes
-
DEV-38667 Issue parsing #UNKNOWN_TAG='#UNKNOWN_VALUE'
-
DEV-38664 Issue parsing #unknown_policy
-
DEV-38662 Parsing issue with LIMIT clause directly after FROM clause
SSAS
- DEV-38097 Parsing issue on SKIP, DENSE arguments of RANKX function
SSIS
- DEV-38478 null connectionString for ODBC connection making alias connection mapping impossible
Tableau
-
DEV-38944 Tableau Workbooks Not Getting Extracted Because of Task "RestExtractorTableau" Failed
-
DEV-32022 Fix IllegalArgumentException: Unknown format of column ID
Integrations
Alation
- DEV-38840 403 Forbidden error not properly logged and handled; upload continues
OpenManta Integration Export
- DEV-38795 Fix Hive export matching of dictionary mappings
Release 42.2.7
Date: 19 January 2024
Scanners
DataStage
-
DEV-38634 Improve logging - unknown stage reported as a consequence of missing connection
-
DEV-38632 Support for Data Virtualization (dv) stage
-
DEV-38631 Filter condition attribute missing on Filter stage in certain cases
-
DEV-38629 Wise mapping does not work as expected - connects too much
-
DEV-38628 Support for Survive stage
-
DEV-38625 Support for bigqueryPX stage
-
DEV-37496 Support for PxOracle stage
-
DEV-37883 Log Warning about RCP being used in the job for new Datastage
Release 42.2.4
Date: 17 January 2024
Informatica Powercenter
- DEV-39028 Fixed bug causing parsing of expressions with deep function nesting to get stuck
Release 42.2.3
Date: 11 January 2024
Dataflow Common
- DEV-38859 Fix applying parameters for analysis runtime limits to technologies which do not have them configurable (abort.analysis.input.timeoutSeconds and abort.analysis.input.edgeLimit parameters)
Release 42.2.2
Date: 4 January 2024
Open Integration Export
- DEV-38795 Fix Hive export matching of dictionary mappings
Release 42.2.1
Date: 4 January 2024
Netezza
- DEV-38376 Fixed bug in lineage when typecasting is involved
Release 42.2
Date: 20 December 2023
New in this release
Manta now provides support for Collibra Edge. Sites employing Collibra Integration with Manta can now configure Manta to publish lineage so that it is stitched to existing assets created by Collibra Edge. This complements the stewardship and metadata management capabilities of Collibra. See Collibra Edge: Quick Start Guide / Configuration Checklist for more details.
General
-
DEV-38577 Enable automapping for IBM instances by default
-
DEV-37422 Mount secrets into files instead of environment variables - Artemis
-
DEV-36233 Add workflow metadata file to the output directory. Important Additional Information: The Manta Workflow output zip file now contains workflow_information.json file containing information about the workflow and Manta instance that generated the output, such as the Manta version, revision of the lineage repository from which the output was generated, etc.
Administration User Interface
- DEV-33673 Make datetime picker usable in AdminUI configurations
Dataflow Viewer
- DEV-35192 Show latest minor revision in the revision drop down by default
Open Manta Designer
-
DEV-36561 Integration of OpenMantaDesigner to IBM IKC
-
DEV-37879 Edge type selection in a canvas BEFORE it is created
-
DEV-38129 New "Application" edge type to be supported for Application Level Lineage. Important Additional Information: See Application Level Lineage Configuration for more details on Application Level Lineage and its configuration.
Scanners
General
- DEV-37162 Make edge/time limits editable via UI for various scanners. Important Additional Information: This is specific to DataStage, PowerBI and SSIS Scanners.
Cognos
- DEV-36968 Support for Report Data Stores
Databricks
-
DEV-37322 Add support for notebook task in dataflow
-
DEV-37298 Enable UC lineage for jobs/notebooks not reading any table
-
DEV-37304 Add manual dictionary mapping configuration page to Admin UI
-
DEV-37778 Support added for DELETE FROM
DataStage
- DEV-36898 Log Warning about RCP being used in the job (which will result in a missing lineage).
Power BI
-
DEV-19717 Agent - PowerBI extraction
-
DEV-37487 Support for manually extracted reports. Important Additional Information: See more details in Power BI manual user inputs
-
DEV-38072 Improve logging on metadata schemaRetrievalError
-
DEV-37772 Change API call used for extracting dataflows
-
DEV-37230 Add abort.analysis.input.timeoutSeconds & abort.analysis.input.edgeLimit to configurable properties
QlikSense
- DEV-36641 Automatically extract referenced files included with the include or must_include clause. Important Additional Information: See: Mapping Included Files
Tableau
- DEV-32689 Support for comments in Tableau
Integrations
Collibra
-
DEV-37247 Add Change Status option to Collibra Integration Synchronization Mode. Important Additional Information: Collibra integration can be now configured to change the status (as opposed to deleting) of old assets that were exported by Manta in older exports but are not part of the export anymore. See also Manta Flow Collibra Client Configuration for more information. The name of the property is Synchronization Mode in UI and manta.collibra.useIntegrationApi in the API.
-
DEV-37556 Export source code of Transformations into Collibra. Important Additional Information: Source code of SQL procedures and other transformations can be now published into Collibra. See also Manta Flow Collibra Client Configuration for more information.
Fixed in this release
Security issues fixed in this release
CVE-2023-45857, CVE-2023-44483, CVE-2023-35116
General
-
DEV-38440 Artemis installation fails if JAVA_HOME is not set
-
DEV-36769 Admin UI login does not work when Keycloak public URL contains trailing slash
-
DEV-36993 License is not correctly detected and user is presented with expired license for admin ui/server/omd
Administration User Interface
-
DEV-36963 Mixed up configuration page in case of visit another page during saving configuration
-
DEV-38136 Admin and OpenManta Designer unable to resolve configuration with Keycloak after switch from SSL to Caddy. Important Additional Information: Keycloak configuration file is reset during upgrade.
-
DEV-38057 Maintenance links with IP instead of URL
-
DEV-30461 Improve error text/log when user tries to rename default agent with using an existing agent name
-
DEV-38156 Process manager fills logs with message about missing custom workflow
-
DEV-37941 Performance issue in Process Manager
Dataflow Viewer
-
DEV-38426 Improve the performance of the search bar
-
DEV-38020 IBM color schema > Import dump screen contains old copyright and there is no social network buttons
-
DEV-37430 Change isn't seen in the revision comparison
-
DEV-37339 Selected for lineage visualization position is incorrect
-
DEV-32830 Home page, switch layer -> switching from layer to same layer causes selected search to clear
OpenManta Designer
-
DEV-38353 List "Application Level" among available Layer Types
-
DEV-38255 Message "Unknown Node Type" shown in Property Editor although the Node is known
-
DEV-37913 Help button does not do anything
Scanners
General
- DEV-37794 Incorrect lineage for ROW_NUMBER OVER PARTION BY clause. Important Additional Information: This affects only the BigQuery and DB2 Scanners.
BigQuery
-
DEV-38053 Wrong extraction of a routine with ANY TYPE argument.
-
DEV-37803 Missing built-in encryption functions
COBOL
- DEV-36656 Cobol dataflow gets stuck in infinite loop if input folder path points to a file
DataStage
- DEV-38101 Parameters in connection definitions not resolved
Oracle
- DEV-38105 abort.analysis. edgeCount / timeoutSeconds doesn't abort as expected
PostgreSQL
- DEV-6940 Incorrect dataflow graph for cursor
SAP HANA
-
DEV-37662 Support for N ("national" modifier) for strings
-
DEV-37661 Support for datatype size specification
Snowflake
- DEV-33853 Incorrect resolving of LATERAL joined subselect
SSAS
- DEV-32857 Incorrect datalinage within SSAS between datamodel and Measures
Tableau
- DEV-32021 NPE Cannot invoke "String.split(String)" because "normalizedDirPath" is null
Integrations
Open Integration Export, IGC, EDC
- DEV-38088 SSRS lineage export contains incorrect location paths to reports. Important Additional Information: Export outputs may newly include SSRS Directory assets. Consequent processes may have to be adjusted to keep them working.
Open Integration Export
- DEV-38025 Lineage for synonyms is missing in OpenManta Integration Export
Release 42.1.5
Date: 13 December 2023
Dataflow Viewer
- DEV-38426 Improve the performance of the search bar
Admin UI
- DEV-38156 Process manager fills logs with message about missing custom workflow
Release 42.1.2
Date: 30 November 2023
Dataflow Viewer
- DEV-38326 Fixed feature flag for disabling attribute filters
Admin UI
-
DEV-38156 Process manager fills logs with message about missing custom workflow
-
DEV-37941 Performance issue in Process Manager
Release 42.1.0
Date: 22 November 2023
New in this release
Administration
-
DEV-22840 Provide more user friendly instructions when value doesn't match regex pattern.
-
DEV-34193 Skip default connections during export Important Additional Information. Default connections are not exported if there is at least one non-default connection present
Dataflow Repository
-
DEV-36961 Switch Neo4j transaction memory from OFF_HEAP to ON_HEAP Important Additional Information. The transaction state memory has been moved to on-heap, because off-heap has been deprecated by Neo4j. After the upgrade, if Flow Server starts running out of memory in equivalent scenarios where it was running fine before the upgrade, increase Flow Server max heap memory up to by the original transaction state memory size prior the upgrade. For example, if there was Flow Server max heap size 8 GB and the transaction state memory size 4 GB (default value) prior the upgrade, increase Flow Server max heap size up to by 4 GB, up to total 8+4=12 GB. The total effective memory usage (off-heap + on-heap) stays the same. See Transaction State Memory for more details.
-
DEV-36430 Drop and re-create failed Neo4j indexes
Dataflow Viewer
-
DEV-36559 Shared UI Library - Inline MDSInputLabelLeft.
-
DEV-32469 Display filters for listing lineage by technology, type and available attributes. Product upgrades between incremental releases (e.g. R42.0.0 -> R42.1.0) will run in a simplified mode, requiring less user input and limiting external processes executed, starting from R42.1.
-
DEV-37405 Rename Unfilter and Contract element operations in context menu in Viewer
-
DEV-35408 New active tag "D" for deduced objects
-
DEV-36757 Shared UI Library - Update MDS version
-
DEV-36502 Homepage - add double-click or navigation icon to drill down into an object
Installer
-
DEV-37611 Simplify upgrades between incremental versions
-
DEV-37672 Restore/do not delete mantaflow/cli/temp during upgrade Important Additional Information. During upgrade from R42 and higher, cli/temp folder is no longer deleted
Scanners
General
-
DEV-37113 Fix ingests in various reporting/etl scanners
-
DEV-33989Database analyzers to be compatible with metadata extracted by older Manta versions
Annotated Script
- DEV-36526 Migrate configurations to Configuration Service - annotatedscriptResourceTypesConfiguration.csv Important Additional Information. File annotatedscriptResourceTypesConfiguration.csv no longer exists; all modifications should be made via Admin UI or via Orchestration API by adjusting configuration for Annotated scanner Manta Orchestration API
Databricks
-
DEV-37030 Metastore extraction of column types.
-
DEV-36687 Use Notebook real name or path in log
Db2
-
DEV-36918 Support for interval
-
DEV-36660 make Server Name configurable New user-set property
db2.hostName, see Db2 Resource Configuration for more information
Informatica PowerCenter
- DEV-37817 Support for SnowflakeCloudDataWarehouse Reader connector.
MySQL, MariaDB, SingleStore
- Brand new MySQL dictionary scanner (scans only database structure (views, tables, columns), no lineage at the moment. See MySQL, MariaDB, SingleStore for more details.
MSSQL
-
DEV-36390 Object-level filtering Important Additional Information. New user-set property
mssql.excludedEntities, see MS SQL Resource Configuration for more details -
DEV-35042 More Graceful Stack Overflow Handling
Netezza
- DEV-35802 Netezza User Set Host Name Important Additional
Information. New user-set property
netezza.hostName, see Netezza Resource Configuration for more information
Oracle
- DEV-35041 More Graceful Stack Overflow Handling
Power BI
-
DEV-36799 Better reporting of reason and solution of PowerBI extraction failure
-
DEV-36958 java.lang.IllegalArgumentException: can't parse argument number
Snowflake
-
DEV-37229 Add abort.analysis.input.timeoutSeconds & abort.analysis.input.edgeLimit to configurable properties.
-
DEV-35046 More Graceful Stack Overflow Handling
SSIS
-
DEV-32480 Normalization of paths used within scanner inputs
-
DEV-36523 Migrate configurations to Configuration Service - ssisComponentOverrides.csv Important Additional Information. File ssisComponentOverrides.csv no longer exists; all modifications should be made via Admin UI or via Orchestration API by adjusting configuration for SSIS scanner Manta Orchestration API
-
DEV-36524 Migrate configurations to Configuration Service - ssisVariableOverrides.csv Important Additional Information. File ssisVariableOverrides.csv no longer exists; all modifications should be made via Admin UI or via Orchestration API by adjusting configuration for SSIS scanner Manta Orchestration API
Tableau
- DEV-19718 Agent - Tableau extraction
Talend
- DEV-36525 Migrate configurations to Configuration Service - talendColumnMapping.csv Important Additional Information. File talendColumnMapping.csv no longer exists; all modifications should be made via Admin UI or via Orchestration API by adjusting configuration for Talend scanner Manta Orchestration API
Integrations
Collibra
- DEV-37220 Default asset type for views Important Additional Information. Manta now uses 'View' (00000000-0000-0000-0001-000400000009) as the default asset type for database views. Before this change, Manta used the 'Table' (00000000-0000-0000-0000-000000031007) asset type. To accommodate for the change, make sure that the 'View' asset type is usable within the 'Manta' scope in Collibra.
Informatica EDC
- DEV-25947 Context lineage export - Make source and target data assets optional Important Additional Information. If Context Lineage export is turned on, lineage might be displayed differently than before.
OpenManta Extensions
- DEV-35553 Update header detection setting default for Open Manta files to autodetect
OpenManta Integration Export
- DEV-37276 Change type of resource for Databricks notebooks to "Databricks ETL Scripts" in exports Important Additional Information. Databricks export will be empty above data with "Databricks notebooks" resource type. A new Databricks scan is needed in this case.
Fixed in this release
Security issues fixed in this release
CVE-2023-5072, CVE-2023-45133, CVE-2023-44270, CVE-2023-43642, CVE-2023-41900, CVE-2023-41080, CVE-2023-40167, CVE-2023-39410, CVE-2023-36479, CVE-2022-26336, GHSA-58qw-p7qm-5rvh, GHSA-xpw8-rcwv-8f8p
General
-
DEV-37891 Workflows with 25+ connections fail during diagnoseRepositoryScenario
-
DEV-35922 In case of failure the installer still offer the user to launch the applications
-
DEV-37259 Installer does not respect machine name override setting
Administration
-
DEV-31855 Possibility to override environment variables leads to vulnerabilities. Important Additional Information. It is no longer possible to set the following environment variables in a workflow definition: PATH, HOME, LD_LIBRARY_PATH, BEGINLIBPATH, ENDLIBPATH, PATHEXT, JAVA_HOME, JRE_HOME, JAVA_OPTS. Any workflow utilizing any of these environment variables will stop working. Specifically any workflows including IFPC extraction defined in older Manta version (before R39) should be checked as they used the LD_LIBRARY_PATH variable; it is possible to configure LD_LIBRARY_PATH in IFPC connection itself.
-
DEV-37155 Keycloak URL on Maintenance page is incorrect
-
DEV-35116 Log Viewer logs export no longer includes Flow Server logs in Docker. Important Additional Information. Option to export filesystem logs when Admin UI is running in a container is removed.
-
DEV-35570 Non-unified recovery strategy for failed scenarios. Important Additional Information. The postprocessing repository scenario failure no longer fails the whole workflow, and its recovery strategy has been set to none.
Dataflow Viewer
-
DEV-33141 Revision Selector - options menu above and over input - update MUI version
-
DEV-37899 Repository Tree Node misalignment and "jumpy" navigation issues when clicking on a node
-
DEV-37404 Application level lineage should be renamed in process manager
-
DEV-37279 Clicking in the repository tree automatically scrolls the repo tree to the top
-
DEV-34436 Disappearing Nodes in Viewer
Scanners
General
- DEV-35117 DB scanners, flow agent > propagation of information about failed extraction took much more time
BigQuery
-
DEV-23131 BigQuery generates dataflow edges among composite item parents and cannot handle nested composites properly
-
DEV-37051 Proper setting of "audience" URL when generating JWT token for private instances
-
DEV-36353 Dictionary mapping > lessen the probability of BigQuery picking up on a connection when dictionary mapping allows everything with an include/exclude filter
Databricks
-
DEV-37112 File path mapping fields are doubling the backslashes
-
DEV-36378 Databricks extractor does not remove all # MAGIC commands
-
DEV-36305 Parsing error for LONG datatype in CREATE TABLE definition
Datastage
-
DEV-37610 Netezza stage not supported
-
DEV-37385 Parameters in path not resolved (II)
-
DEV-36059 Process "valueDerivation" in DataStage NextGen
HiveQL
-
DEV-37766 Connection validation takes too long
-
DEV-37390 Connection created in previous version of manta returns exception during extraction
Oracle
-
DEV-35012 Some SQL connection templates (Oracle) contain non-escaped regexp character in the exclude filter default value
-
DEV-35259 Oracle scanner not creating lineage for SQLs with count(*)
PowerBI
-
DEV-37400 Prevent duplicated extraction of App reports
-
DEV-36948 Reports with the same name and the same type crash analysis of the whole workspace
-
DEV-36724 PowerQuery fails to handle out-of-order definitions of operand values
SAS
- DEV-36726 Incorrect parent of the FILTER_DISTINCT node in the PROC SORT statement
Snowflake
- DEV-37865 Connection validation fails when include filter is specified
Integrations
Alation
- DEV-37846 Change of username not reflected when refreshing authentication token
Release 42.0.15
Date: 16 October 2023
Fixed in this release
Security issues fixed in this release
CVE-2023-39410
Scanners
DataStage
- DEV-37385 Parameters were not resolved in paths to SQL files in DataStage (Part two)
PowerBI
-
DEV-36958 Fixed Power BI message format
-
DEV-36171 Fixed Power BI duplicate names error
-
DEV-36948 Reports with the same name and the same type crash analysis of the whole workspace
Release 42.0.14
Date: 10 November 2023
Fixed in this release
General
Admin UI
- DEV-37892 Workflows with 25+ connections fail during diagnoseRepositoryScenario
Release 42.0.11
Date: 6 November 2023
Fixed in this release
General
Installer
- DEV-37816 Installer - fixing wrong port loading during upgrades and hotfixes from R42
Release 42.0.10
Date: 6 November 2023
Fixed in this release
Scanners
Hive
- DEV-37766 Hive connection validation takes too long, skip checking of every table’s DDL
Release 42.0.9
Date: 2 November 2023
Fixed in this release
General
Installer
- DEV-37755 Installer - enabling agent hotfix during the main installer hotfix upgrade
Release 42.0.8
Date: 31 October 2023
Fixed in this release
Scanners
DB2
- DEV-36660 DB2 - make
serverNameconfigurable
Release 42.0
Date: 16 October 2023
Data Lineage, Done Right.
Manta is the automated approach to visualize, optimize, and modernize how data moves through your organization. With Manta’s newest product release, customers have the flexibility to take advantage of best-in-class code-level lineage in a cloud environment. We have innovated to meet evolving customer needs — from on-prem and cloud options and intuitive automation to enhanced customization and greater value for technical and business users.
Release 42 includes:
-
A simpler user experience.
-
Enhanced automated processes and intelligence capabilities for better workflows and prescriptive capabilities.
-
More intuitive options to meet customers where they are.
What’s New in R42?
Auto mapping and Manta Intelligence
Manta is empowering you better than ever before with intuitive automation. With the introduction of automapping, Manta gives customers an end-to-end view of their environments faster. Automapping is a new kind of Manta intelligence that leverages metadata to stitch the lineage between interdependent systems on the fly. Combined with deduced lineage, you’ll be able to reveal interactions between systems for a more complete lineage picture without needing to scan every source.
Application View, Targeted Scanning, and New Scanners
Our new "targeted" scans offer a more flexible approach to repository management, allowing customers to selectively update their connections without the need for comprehensive scans. Other notable updates include a system-level aggregated lineage perspective ("Application Lineage"), a new scanner for Databricks UC to better support the Databricks environment and capabilities, and object-level filtering for Oracle connections. All of this works together to combat shadow data by illuminating orphan tables and bridges the gap between technical and business users, ensuring alignment on what systems are in a repository and how they interact.
Targeted Scanning:
Targeted scanning
Databricks:
Databricks Scanner Guide
OpenManta
OpenManta Designer provides a simple graphical user interface (GUI) for users to build lineage to augment Manta's out-of-the-box scanners. To reduce the barrier to entry for end-to-end lineage, OpenManta Designer allows users to integrate custom assets faster and more effectively. OpenManta Designer also creates manual data lineage using a drag-and-drop interface and/or a spreadsheet, allowing users to draw connections between related items.
OpenManta Designer: Open Manta Designer - User's manual
Special notes
-
Release 42 requires, at a minimum, Java release 17. Java release 21 is also supported by Manta Flow, with the exception of sites that are using the Snowflake Scanner, which only works with Java 17.
-
See DEV-35938 below in the “New in this Release”, Administration section. Be aware that there could be issues with some configuration entries.
Text identified with the words “Important additional information“ provides extra clarity and/or describes potential compatibility issues.
New in this Release
General
-
DEV-35286 Introduce consolidated product configuration. Important Additional Information: On premise is configured from single central location. It is no longer needed to adjust multiple configuration files located in different directories. All configuration specific for integration of the deployment into the environment is now in single configuration file. This option includes setting the port numbers, Java location, HTTPS settings, Keycloak URLs and more.
-
DEV-35475 Only keep most recent backup during installation
-
DEV-34969 Enable hotfix installation using the installer
-
DEV-34699 Upgrade to Java 17
-
DEV-29128 Upgrade to Spring 6
-
DEV-34305 Improve Commit Revision Scenario output if there is no revision to commit
-
DEV-33439 Remove Spring Bean annotations from Manta libs
-
DEV-31796 manta-lib-http - Improvements - replace usages of java http client - manta-edge-be
-
DEV-34602 Use Neo4j Enterprise instead of Community
-
DEV-35730 Approve kafka-clients library
Administration
-
DEV-36639 Remove collect statistics scenario from major update
-
DEV-35948 Changing Twitter logo to X logo in AdminUI
-
DEV-35224 Admin UI simplification. Hide unnecessary configurations. Important Additional Information: Multiple entries from Configurator were hidden from FE and cannot be editted via AdminUI anymore.
-
DEV-35062 Admin UI simplification - changes in Advanced Mode. Important Additional Information: On Connection pages in Admin UI, all configuration properties should be visible by default - no properties will be hidden in advance mode.
-
DEV-35938 Admin UI simplification. Follow up - Re-order connections and configurations. Important Additional Information: Several properties have been reordered in the Admin UI screens to improve usability and guide users. There have been also several properties, that should not be configurable anymore, removed. This change may break import of some connections and configurations (connection-level truststore configuration, properties that are no longer available) exported from previous versions of Manta. The recommendation is not to import connection information from older versions of Manta.
-
DEV-36594 Create environment variable for overriding CLI properties
-
DEV-35225 Admin UI simplification. Re-order connections and configurations properties. Important Additional Information: Some of the fields on connections are reordered and groups are renamed.
Dataflow Repository
-
DEV-30899 Allow configuring ZipFileDecompresser.maxDecompressedFileSize with a configuration property for Flow Server
-
DEV-16572 Remove SuperRootAdapter from service layer. Important Additional Information: Endpoint /public/v1/rev/{rev}/root was removed from Public API
-
DEV-26679 Upgrade to Neo4j 5
-
DEV-35578 Improve performance of Collect Statistics Scenario by traversing from top to bottom
-
DEV-35009 Decrease memory usage of delete scenarios
-
DEV-34976 Repository API to return even Resource ID for each Node
-
DEV-34394 Changing Repository API for not returning specific Resources (Oracle DDL etc.)
Dataflow Viewer
-
DEV-28075 Add multiple objects to Selected for lineage via mass button
-
DEV-32468 Textual lineage in Main list area
-
DEV-35861 Viewer - Add "Resources" detail level to the visualization's options panel
-
DEV-35427 Set "By Category" schema as a default one
-
DEV-34782 Create service for creating System Level layer
-
DEV-34778 Create scenario calling System Level lineage derivation
-
DEV-34553 Display collapsed resources in visualization for "System Level" layer
-
DEV-34518 Set a new "System Level lineage" visualization settings for "System Level" layer
-
DEV-34160 For "By Category" display resources and connections in viewer
-
DEV-34151 System level lineage for all resources in revision
-
DEV-35763 Record each change of visualization options in usage statistics
-
DEV-35749 Create server.json file in usage statistics zip
-
DEV-35466 Restoring Repository tree state
-
DEV-35465 Restoring viewer settings
-
DEV-35577 Change logging level for "Queue capacity exceeded." from ERROR to WARN
-
DEV-33288 Visualization Parameters - refactor code
Scanners
BigQuery
-
DEV-36431 Big Query url changing output in Repository, but not changing the url accessed for extraction. Important Additional Information: Will break existing connections where
BigQuery API service URLis configured to an invalid or inaccessible URL. The value of this property (bigquery.url) needs to contain a valid endpoint URL. -
DEV-34873 Failed extraction of Bigquery based on wrong oauth routing
COBOL
-
DEV-32607 Weaken Cobol FilterTask
-
DEV-31322 Capture COBOL Field "level number" in an individual node attribute for the field
DataStage
-
DEV-33140 Support AzureStorageConnectorPx stage
-
DEV-35260 Include Job Parameters and Parameter Sets as attribute for Job instance node for DataStage NextGen
-
DEV-34918 Improve error logging location context to ease identification of parsing errors for large jobs
-
DEV-34034 Include stageID as an attribute
-
DEV-33318 Represent Job Runs as a dedicated node type
Db2
-
DEV-37066 Allow DB2 mapping to have empty instanceName as it doesn't exist for z/OS
-
DEV-35920 Support for CREATE TEMP TABLE
-
DEV-30497 Support for ALTER FUNCTION/PROCEDURE/VIEW
Informatica PowerCenter
-
DEV-30910 Normalization of paths used within scanner inputs. Important Additional Information: Connection property "ifpc.parameter.files.dirs" now supports only a single path. Connection property "ifpc.indirect.files.dirs" now supports only a single path. Support for absolute paths was removed in both of these properties. Use only paths relative to the directory root. Common property "ifpc.input.dir-ingest" renamed to "ifpc.input.manual.dir-ingest"
-
DEV-35631 Support Source Type = Source Qualifier for Lookup Procedure
-
DEV-34056 Support for SnowflakeCloudDataWarehouse Writer connector
MSSQL
- DEV-32344 Move temporary tables to MSSQL top-level resource. Important Additional Information: Temporary tables which are defined inside a procedure, function, or trigger body are no longer listed under script resource, instead they are listed under the procedure, function, or trigger.
Oracle
-
DEV-35379 Object-level filtering Important Additional Information: See Oracle Resource Configuration, property
oracle.excludedEntitiesfor more details. -
DEV-34843 Object-level filtering Important Additional Information: See Oracle Resource Configuration, property
oracle.excludedEntitiesfor more details.
PostgreSQL
-
DEV-34283 More graceful stack overflow Handling
-
DEV-40672 Support for Data Change Triggers
-
DEV-41292 Extraction of materialized views
PowerBI
- DEV-35612 Support for Databricks as a source
PowerQuery
- DEV-35552 Implement AmazonRedshift.Database()
Snowflake
-
DEV-36114 Support for DATE literal
-
DEV-35699 Support for Character varying datatype
-
DEV-35690 Support for TIMESTAMP literal
-
DEV-35689 Support WITH TAG and WITH ROW ACCESS POLICY in grammar
SSAS
- DEV-35002 Processing .asdatabase SSAS file as input
SSIS
-
DEV-33014 Oracle and Teradata components support
-
DEV-34140 Add support for JavaKerberos authentication
-
DEV-10918 Support for PragmaticWorks PW.TaskFactory.UpsertDestination
Integrations
General
-
DEV-34975 Support View Column node in OBIEE exports. Important Additional Information: Export of metadata with "Data Column" assets will not work anymore. A new OBIEE scan is required in this case.
-
DEV-34987 Exports change - Represent Job Runs as a dedicated node type
-
DEV-33736 Log warning message if no data are exported
-
DEV-33540 Support for Calculation Groups - export impl
Open Integration Export
- DEV-33672 Use Project name as found in the input file for both NextGen and Legacy DS. Important Additional Information: Objects in exports can have different names after this change.
Fixed in this Release
Security issues fixed in this release
CVE-2023-34478, CVE-2023-34455, CVE-2023-2976, CVE-2023-28708, CVE-2023-26048, CVE-2023-25194, CVE-2022-42252
General
-
DEV-35590 Callback from MANTA to WKC is missing a parameter
-
DEV-35995 Keycloak hostname URL is not updated when enabling Caddy. Important Additional Information: The Keycloak public URL has to be explicitly requested to be overridden. The installer dialog window has been resized to fit the new options.
-
DEV-36056 Incorrect Service Name in unattended_installer.sh file
-
DEV-32942 Manta Launcher Issues: Health Endpoints Show Status UP, Manta Launcher Webpage Not Showing UP or PIDS. Important Additional Information: Launcher now supports both
netstatandssutilities on Linux installations.
Administration
-
DEV-31855 Possibility to override environment variables leads to vulnerabilities. Important Additional Information: It is no longer possible to set the following environment variables in a workflow definition: PATH, HOME, LD_LIBRARY_PATH, BEGINLIBPATH, ENDLIBPATH, PATHEXT, JAVA_HOME, JRE_HOME, JAVA_OPTS.
Any workflow utilizing any of these environment variables will stop working. Specifically any workflows including IFPC extraction defined in older Manta version (before R39) should be checked as they used the LD_LIBRARY_PATH variable. -
DEV-35516 Pattern Validation is accepted in Javascript but fails in Java
-
DEV-34315 Unwanted scrollbar in Launcher
-
DEV-34251 Update links to Data Lineage Done Right + rebranding letter case in MANTA
-
DEV-36214 Search bar not providing results - Log Viewer
-
DEV-36661 SAP BO validation does not allow dot characters
Authentication
-
DEV-34041 Keycloak is not accessible via public URL. Important Additional Information: Keycloak now requires correct URL on which it can be accessed. This can be provided in the installation process.
-
DEV-35665 Installation doesn't finish because of DefaultCacheManager
Containerization
- DEV-35555 Docker & EKS Operator guides for R40 and R41 missing
Dataflow Repository
-
DEV-35929 Repository corrupted when second /dump/import executed before first is finished
-
DEV-35807 Upload source code if not exists
-
DEV-35246 R40.1 Export Repository Scenario Fails Due to Unexpected Chunk Size
Dataflow Viewer
-
DEV-34596 Horizontal filters are not automatically refreshed in Flow Server when modified via AdminUI
-
DEV-35989 Home (Repository) Page Filter on Definition Source is not working correctly
-
DEV-35949 Corrected links in Viewer about popup
-
DEV-34620 Previously visualized object reappears in "Selected for lineage" after returning to homepage
-
DEV-34455 Redirect in Flow Server controllers is breaking IBM integration
-
DEV-33633 Steps dropdown is hardcoded
-
DEV-33452 Viewer - extracted csv file is empty
-
DEV-33168 When adding filter groups and refreshing the API, filters are getting multiplied
-
DEV-33004 Active Tags don't appear after searching repository
-
DEV-32224 New "hierarchy tree" page misses between-layer mappings
Scanners
DataStage
-
DEV-35685 Parameters are not resolved in paths to SQL files
-
DEV-34916 Unescaped parameter values causing parsing errors
-
DEV-33719 Gracefully handle misconfigured jobs
Db2
- DEV-34989 HIDDEN columns in Db2 are not handled in extractor
Informatica PowerCenter
- DEV-34687 Fix processing of parameter file with workflow name
Netezza
- DEV-31914 Unify processing of cast expressions across dialects
Oracle Data Integrator
- DEV-34984 Data Load -> Data off-load scenario not supported
Oracle
- DEV-35328 Infinite recursion on extraction of synonyms to object behind dblink
PostgreSQL
-
DEV-35111 Postgresql bulk extractor failed with MVStoreException
-
DEV-34255 Improve handling of AmbigousNameException errors
PowerBI
-
DEV-36171 IllegalStateException: Duplicate key - RDL and PowerBI report of the same name cause extraction of workspace to fail
-
DEV-35952 Fix Pbix file filtering - R41
-
DEV-35384 Analysis errors - java.lang.StackOverflowError: null
PowerQuery
- DEV-34260 NullPointerException from resolving later defined AstRecordField
SAS
-
DEV-36194 Empty body in the %do macro statement
-
DEV-35840 SAS operators can be used as SQL identifiers (eg. column name)
Snowflake
-
DEV-36020 Extraction gets stuck if the connection pool is full
-
DEV-35705 The Snowflake PUT creates a single leaf node causing column lineage to be distorted
-
DEV-35020 Support for WITH MASKING POLICY
SSIS
- DEV-35887 No connection string information for DB2 connection manager
Integrations
General
- DEV-35034 Prevent the NullPointerException on Export
Collibra
-
DEV-36104 Export failing with error -> Failed to authenticate request post upgrade to R41
-
DEV-35841 Upload to Collibra failed with 500 error and NullPointerException
IGC
- DEV-35171 IGC Export common configuration does not work