IGC Lineage Troubleshooting

This article describes the steps for troubleshooting issues with IBM Manta Data Lineage lineage loaded into IBM InfoSphere Information Governance Catalog (IGC).

Initial Situation

Manta Data Lineage is used to analyze lineage that is loaded into IGC. The user locates a particular asset to see the lineage for it and runs a data lineage report. There is an unexpected result. The situations that may occur are listed below with additional information on how to investigate the root cause.

Potential Issues

No IGC Lineage Available for an Asset

Potential cause

Steps to take

Manta Data Lineage lineage has not been run at all

Verify the last time Manta Data Lineage was run via the log files <MANTA_CLI_HOME>/log/*upload*.log.

If the last run is older than expected or the file cannot be found at all, rerun Manta Data Lineage.

Otherwise, continue to the next step.

Manta Data Lineage does not have access privileges to analyze lineage for the assets in question

Consult the *ExtractorScenario*.properties.log log files and look for error messages related to insufficient privileges for the account that is being used to gather information from the database. Several examples follow.

MS SQL

Cannot list databases:

2017-03-21 13:44:34.947 [pool-2-thread-1] ERROR eu.profinit.manta.platform.Scenario$TaskLauncher - Exception during execution of task: ScenarioExecutionTask and input: SqlServer.properties.

org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'columnMapper' defined in class path resource [manta-connector-mssql-dictionary-extractor/MssqlExtractorBase.xml]: Cannot resolve reference to bean 'sqlSessionFactory' while setting bean property 'sqlSessionFactory'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'sqlSessionFactory' defined in class path resource [manta-connector-mssql-dictionary-extractor/MssqlExtractorBase.xml]: Cannot resolve reference to bean 'dataSource' while setting bean property 'dataSource'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'dataSource' defined in URL [file:C:/programs/Manta/R16.2-IGC/manta-platform-cli-1.16-standard/platform/bin/../../scenarios/manta-dataflow-igc-cli/etc/mssqlExtractorScenario.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Could not instantiate bean class [eu.profinit.manta.connector.mssql.extractor.MssqlExtractorDatabaseRoutingDataSource]: Constructor threw exception; nested exception is java.lang.RuntimeException: Cannot fetch database list

at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:326) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:107) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1417) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1158) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:296) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:293) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:610) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:932) ~[spring-context-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:479) ~[spring-context-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at eu.profinit.manta.platform.ScenarioExecutionTask.doExecute(ScenarioExecutionTask.java:53) ~[?:?]

at eu.profinit.manta.platform.ScenarioExecutionTask.doExecute(ScenarioExecutionTask.java:22) ~[?:?]

at eu.profinit.manta.platform.automation.AbstractTask.execute(AbstractTask.java:50) ~[manta-platform-automation-1.16.jar:?]

at eu.profinit.manta.platform.Scenario$TaskLauncher.run(Scenario.java:137) [manta-platform-1.16.jar:?]

at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [?:1.8.0_121]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [?:1.8.0_121]

at java.lang.Thread.run(Unknown Source) [?:1.8.0_121]

Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'sqlSessionFactory' defined in class path resource [manta-connector-mssql-dictionary-extractor/MssqlExtractorBase.xml]: Cannot resolve reference to bean 'dataSource' while setting bean property 'dataSource'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'dataSource' defined in URL [file:C:/programs/Manta/R16.2-IGC/manta-platform-cli-1.16-standard/platform/bin/../../scenarios/manta-dataflow-igc-cli/etc/mssqlExtractorScenario.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Could not instantiate bean class [eu.profinit.manta.connector.mssql.extractor.MssqlExtractorDatabaseRoutingDataSource]: Constructor threw exception; nested exception is java.lang.RuntimeException: Cannot fetch database list

at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:326) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:107) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1417) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1158) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:296) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:293) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:320) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

... 19 more

Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'dataSource' defined in URL [file:C:/programs/Manta/R16.2-IGC/manta-platform-cli-1.16-standard/platform/bin/../../scenarios/manta-dataflow-igc-cli/etc/mssqlExtractorScenario.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Could not instantiate bean class [eu.profinit.manta.connector.mssql.extractor.MssqlExtractorDatabaseRoutingDataSource]: Constructor threw exception; nested exception is java.lang.RuntimeException: Cannot fetch database list

at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:285) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1075) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:979) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:487) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:296) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:293) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:320) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:107) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1417) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1158) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:296) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:293) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:320) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

... 19 more

Caused by: org.springframework.beans.BeanInstantiationException: Could not instantiate bean class [eu.profinit.manta.connector.mssql.extractor.MssqlExtractorDatabaseRoutingDataSource]: Constructor threw exception; nested exception is java.lang.RuntimeException: Cannot fetch database list

at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:163) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:121) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:277) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1075) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:979) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:487) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:296) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:293) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:320) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:107) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1417) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1158) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:296) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:293) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:320) ~[spring-beans-3.2.8.RELEASE.jar:3.2.8.RELEASE]

... 19 more

Caused by: java.lang.RuntimeException: Cannot fetch database list

Unable to find a system object such as:

See typical error message ...

2017-04-18 08:49:07.019 [pool-2-thread-1] ERROR eu.profinit.manta.connector.mssql.extractor.MssqlDbDdlProvider - Error extracting DDL type SEQUENCE org.springframework.jdbc.BadSqlGrammarException: ### Error querying database. Cause: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'sys.sequences'.

Only an empty package/procedure body has been extracted:

See typical error message ...

2017-04-18 08:49:19.843 [pool-2-thread-1] ERROR eu.profinit.manta.mssql.parser.MssqlSQLMain_TSQLMain - Failed to parse input at position 9,1 - the statement will be ignored. Parser error: no viable alternative at input '<EOF>' Script context: ... -- WARNING: This file has been automatically generated by -- Manta extractor. -- It contains only the definitions needed for its -- function and it cannot be used as a complete -- definition of the routine. ; ... 2017-04-18 08:49:19.880 [pool-2-thread-1] ERROR eu.profinit.manta.connector.mssql.extractor.MssqlExtractor - Could not mark entity as database-sourced: PROCEDURE CCMS_Reporting.bnqhhy5.cds_refr_statistics - entity not found in dictionary

The required set of privileges for MS SQL Server is available at MS SQL Server Integration Requirements.

Teradata

Connection issues (typically a firewall restricting communication or an incorrect connection string to Teradata):

See typical error message ...

2017-04-21 14:39:01.984 0 ERROR eu.profinit.manta.platform.Scenario$TaskLauncher Exception during execution of task: ScenarioExecutionTask and input: teradata.properties.
eu.profinit.manta.platform.automation.ScenarioFailedException: Error during extraction metadata for dictionary.
at eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.metadata.TeradataMetadataExtractorProvider.extractDictionary(TeradataMetadataExtractorProvider.java:105) ~[?:?]
at eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.metadata.TeradataMetadataExtractorReader.read(TeradataMetadataExtractorReader.java:33) ~[?:?]
at eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.metadata.TeradataMetadataExtractorReader.read(TeradataMetadataExtractorReader.java:19) ~[?:?]
at eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.ExtractorScenario.doExecute(ExtractorScenario.java:32) ~[?:?]
at eu.profinit.manta.platform.automation.AbstractScenario.execute(AbstractScenario.java:88) ~[manta-platform-automation-1.16.jar:?]
at eu.profinit.manta.platform.ScenarioExecutionTask.doExecute(ScenarioExecutionTask.java:60) ~[?:?]
at eu.profinit.manta.platform.ScenarioExecutionTask.doExecute(ScenarioExecutionTask.java:22) ~[?:?]
at eu.profinit.manta.platform.automation.AbstractTask.execute(AbstractTask.java:50) ~[manta-platform-automation-1.16.jar:?]
at eu.profinit.manta.platform.Scenario$TaskLauncher.run(Scenario.java:137) [manta-platform-1.16.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [?:1.8.0_121]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [?:1.8.0_121]
at java.lang.Thread.run(Unknown Source) [?:1.8.0_121]
Caused by: org.mybatis.spring.MyBatisSystemException: nested exception is org.apache.ibatis.exceptions.PersistenceException:
### Error querying database. Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is com.teradata.jdbc.jdbc_4.util.JDBCException: [Teradata JDBC Driver] [TeraJDBC 14.00.00.13] [Error 1000] [SQLState 08S01] Login failure for Connection to 192.168.0.17 Fri Apr 21 14:39:01 CEST 2017 socket orig=192.168.0.17 cid=4e23ea49 sess=0 java.net.ConnectException: Connection refused: connect at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method) at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) at java.net.AbstractPlainSocketImpl.connect(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.SocksSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at com.teradata.jdbc.jdbc_4.io.TDNetworkIOIF$ConnectThread.run(TDNetworkIOIF.java:968)
### The error may exist in class path resource [eu/profinit/manta/connector/teradata13/metadata/extractor/mybatis/metadata/data/DatabaseListMapper.xml]
### The error may involve eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.metadata.data.DatabaseListMapper.selectDatabases
### The error occurred while executing a query
### Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is com.teradata.jdbc.jdbc_4.util.JDBCException: [Teradata JDBC Driver] [TeraJDBC 14.00.00.13] [Error 1000] [SQLState 08S01] Login failure for Connection to 192.168.0.17 Fri Apr 21 14:39:01 CEST 2017 socket orig=192.168.0.17 cid=4e23ea49 sess=0 java.net.ConnectException: Connection refused: connect at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method) at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) at java.net.AbstractPlainSocketImpl.connect(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.SocksSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at com.teradata.jdbc.jdbc_4.io.TDNetworkIOIF$ConnectThread.run(TDNetworkIOIF.java:968)
at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:76) ~[?:?]
at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:399) ~[?:?]
at com.sun.proxy.$Proxy21.selectList(Unknown Source) ~[?:?]
at org.mybatis.spring.SqlSessionTemplate.selectList(SqlSessionTemplate.java:205) ~[?:?]
at org.apache.ibatis.binding.MapperMethod.executeForMany(MapperMethod.java:122) ~[?:?]
at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:64) ~[?:?]
at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:53) ~[?:?]
at com.sun.proxy.$Proxy22.selectDatabases(Unknown Source) ~[?:?]
at eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.metadata.TeradataMetadataExtractorProvider.extractDatabaseList(TeradataMetadataExtractorProvider.java:148) ~[?:?]
at eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.metadata.TeradataMetadataExtractorProvider.extractDictionary(TeradataMetadataExtractorProvider.java:78) ~[?:?]
... 11 more
Caused by: org.apache.ibatis.exceptions.PersistenceException:
### Error querying database. Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is com.teradata.jdbc.jdbc_4.util.JDBCException: [Teradata JDBC Driver] [TeraJDBC 14.00.00.13] [Error 1000] [SQLState 08S01] Login failure for Connection to 192.168.0.17 Fri Apr 21 14:39:01 CEST 2017 socket orig=192.168.0.17 cid=4e23ea49 sess=0 java.net.ConnectException: Connection refused: connect at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method) at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) at java.net.AbstractPlainSocketImpl.connect(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.SocksSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at com.teradata.jdbc.jdbc_4.io.TDNetworkIOIF$ConnectThread.run(TDNetworkIOIF.java:968)
### The error may exist in class path resource [eu/profinit/manta/connector/teradata13/metadata/extractor/mybatis/metadata/data/DatabaseListMapper.xml]
### The error may involve eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.metadata.data.DatabaseListMapper.selectDatabases
### The error occurred while executing a query
### Cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is com.teradata.jdbc.jdbc_4.util.JDBCException: [Teradata JDBC Driver] [TeraJDBC 14.00.00.13] [Error 1000] [SQLState 08S01] Login failure for Connection to 192.168.0.17 Fri Apr 21 14:39:01 CEST 2017 socket orig=192.168.0.17 cid=4e23ea49 sess=0 java.net.ConnectException: Connection refused: connect at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method) at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) at java.net.AbstractPlainSocketImpl.connect(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.SocksSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at com.teradata.jdbc.jdbc_4.io.TDNetworkIOIF$ConnectThread.run(TDNetworkIOIF.java:968)
at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:30) ~[?:?]
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:122) ~[?:?]
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:113) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_121]
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[?:1.8.0_121]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[?:1.8.0_121]
at java.lang.reflect.Method.invoke(Unknown Source) ~[?:1.8.0_121]
at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:386) ~[?:?]
at com.sun.proxy.$Proxy21.selectList(Unknown Source) ~[?:?]
at org.mybatis.spring.SqlSessionTemplate.selectList(SqlSessionTemplate.java:205) ~[?:?]
at org.apache.ibatis.binding.MapperMethod.executeForMany(MapperMethod.java:122) ~[?:?]
at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:64) ~[?:?]
at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:53) ~[?:?]
at com.sun.proxy.$Proxy22.selectDatabases(Unknown Source) ~[?:?]
at eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.metadata.TeradataMetadataExtractorProvider.extractDatabaseList(TeradataMetadataExtractorProvider.java:148) ~[?:?]
at eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.metadata.TeradataMetadataExtractorProvider.extractDictionary(TeradataMetadataExtractorProvider.java:78) ~[?:?]
... 11 more
Caused by: org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is com.teradata.jdbc.jdbc_4.util.JDBCException: [Teradata JDBC Driver] [TeraJDBC 14.00.00.13] [Error 1000] [SQLState 08S01] Login failure for Connection to 192.168.0.17 Fri Apr 21 14:39:01 CEST 2017 socket orig=192.168.0.17 cid=4e23ea49 sess=0 java.net.ConnectException: Connection refused: connect at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method) at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) at java.net.AbstractPlainSocketImpl.connect(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.SocksSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at com.teradata.jdbc.jdbc_4.io.TDNetworkIOIF$ConnectThread.run(TDNetworkIOIF.java:968)
at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:80) ~[?:?]
at org.mybatis.spring.transaction.SpringManagedTransaction.openConnection(SpringManagedTransaction.java:82) ~[?:?]
at org.mybatis.spring.transaction.SpringManagedTransaction.getConnection(SpringManagedTransaction.java:68) ~[?:?]
at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:315) ~[?:?]
at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:75) ~[?:?]
at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:61) ~[?:?]
at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:303) ~[?:?]
at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:154) ~[?:?]
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:102) ~[?:?]
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:82) ~[?:?]
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:120) ~[?:?]
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:113) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_121]
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[?:1.8.0_121]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[?:1.8.0_121]
at java.lang.reflect.Method.invoke(Unknown Source) ~[?:1.8.0_121]
at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:386) ~[?:?]
at com.sun.proxy.$Proxy21.selectList(Unknown Source) ~[?:?]
at org.mybatis.spring.SqlSessionTemplate.selectList(SqlSessionTemplate.java:205) ~[?:?]
at org.apache.ibatis.binding.MapperMethod.executeForMany(MapperMethod.java:122) ~[?:?]
at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:64) ~[?:?]
at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:53) ~[?:?]
at com.sun.proxy.$Proxy22.selectDatabases(Unknown Source) ~[?:?]
at eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.metadata.TeradataMetadataExtractorProvider.extractDatabaseList(TeradataMetadataExtractorProvider.java:148) ~[?:?]
at eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.metadata.TeradataMetadataExtractorProvider.extractDictionary(TeradataMetadataExtractorProvider.java:78) ~[?:?]
... 11 more
Caused by: com.teradata.jdbc.jdbc_4.util.JDBCException: [Teradata JDBC Driver] [TeraJDBC 14.00.00.13] [Error 1000] [SQLState 08S01] Login failure for Connection to 192.168.0.17 Fri Apr 21 14:39:01 CEST 2017 socket orig=192.168.0.17 cid=4e23ea49 sess=0 java.net.ConnectException: Connection refused: connect at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method) at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) at java.net.AbstractPlainSocketImpl.connect(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.SocksSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at com.teradata.jdbc.jdbc_4.io.TDNetworkIOIF$ConnectThread.run(TDNetworkIOIF.java:968)
at com.teradata.jdbc.jdbc_4.util.ErrorFactory.makeDriverJDBCException(ErrorFactory.java:93) ~[?:?]
at com.teradata.jdbc.jdbc_4.util.ErrorFactory.makeDriverJDBCException(ErrorFactory.java:68) ~[?:?]
at com.teradata.jdbc.jdbc_4.util.ErrorFactory.makeIoJDBCException(ErrorFactory.java:206) ~[?:?]
at com.teradata.jdbc.jdbc_4.util.ErrorAnalyzer.analyzeIoError(ErrorAnalyzer.java:61) ~[?:?]
at com.teradata.jdbc.jdbc_4.io.TDNetworkIOIF.createSocketConnection(TDNetworkIOIF.java:137) ~[?:?]
at com.teradata.jdbc.jdbc_4.io.TDNetworkIOIF.<init>(TDNetworkIOIF.java:116) ~[?:?]
at com.teradata.jdbc.jdbc_4.TDSession.getIO(TDSession.java:586) ~[?:?]
at com.teradata.jdbc.jdbc.GenericLogonController.run(GenericLogonController.java:95) ~[?:?]
at com.teradata.jdbc.jdbc_4.TDSession.<init>(TDSession.java:215) ~[?:?]
at com.teradata.jdbc.jdk6.JDK6_SQL_Connection.<init>(JDK6_SQL_Connection.java:30) ~[?:?]
at com.teradata.jdbc.jdk6.JDK6ConnectionFactory.constructConnection(JDK6ConnectionFactory.java:22) ~[?:?]
at com.teradata.jdbc.jdbc.ConnectionFactory.createConnection(ConnectionFactory.java:130) ~[?:?]
at com.teradata.jdbc.jdbc.ConnectionFactory.createConnection(ConnectionFactory.java:120) ~[?:?]
at com.teradata.jdbc.TeraDriver.doConnect(TeraDriver.java:228) ~[?:?]
at com.teradata.jdbc.TeraDriver.connect(TeraDriver.java:154) ~[?:?]
at java.sql.DriverManager.getConnection(Unknown Source) ~[?:1.8.0_121]
at java.sql.DriverManager.getConnection(Unknown Source) ~[?:1.8.0_121]
at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriverManager(DriverManagerDataSource.java:173) ~[?:?]
at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:164) ~[?:?]
at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnectionFromDriver(AbstractDriverBasedDataSource.java:153) ~[?:?]
at org.springframework.jdbc.datasource.SingleConnectionDataSource.initConnection(SingleConnectionDataSource.java:244) ~[?:?]
at org.springframework.jdbc.datasource.SingleConnectionDataSource.getConnection(SingleConnectionDataSource.java:186) ~[?:?]
at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:111) ~[?:?]
at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:77) ~[?:?]
at org.mybatis.spring.transaction.SpringManagedTransaction.openConnection(SpringManagedTransaction.java:82) ~[?:?]
at org.mybatis.spring.transaction.SpringManagedTransaction.getConnection(SpringManagedTransaction.java:68) ~[?:?]
at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:315) ~[?:?]
at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:75) ~[?:?]
at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:61) ~[?:?]
at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:303) ~[?:?]
at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:154) ~[?:?]
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:102) ~[?:?]
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:82) ~[?:?]
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:120) ~[?:?]
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:113) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_121]
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[?:1.8.0_121]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[?:1.8.0_121]
at java.lang.reflect.Method.invoke(Unknown Source) ~[?:1.8.0_121]
at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:386) ~[?:?]
at com.sun.proxy.$Proxy21.selectList(Unknown Source) ~[?:?]
at org.mybatis.spring.SqlSessionTemplate.selectList(SqlSessionTemplate.java:205) ~[?:?]
at org.apache.ibatis.binding.MapperMethod.executeForMany(MapperMethod.java:122) ~[?:?]
at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:64) ~[?:?]
at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:53) ~[?:?]
at com.sun.proxy.$Proxy22.selectDatabases(Unknown Source) ~[?:?]
at eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.metadata.TeradataMetadataExtractorProvider.extractDatabaseList(TeradataMetadataExtractorProvider.java:148) ~[?:?]
at eu.profinit.manta.connector.teradata13.metadata.extractor.mybatis.metadata.TeradataMetadataExtractorProvider.extractDictionary(TeradataMetadataExtractorProvider.java:78) ~[?:?]
... 11 more
Caused by: java.net.ConnectException: Connection refused: connect
at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method) ~[?:1.8.0_121]
at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source) ~[?:1.8.0_121]
at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[?:1.8.0_121]
at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[?:1.8.0_121]
at java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[?:1.8.0_121]
at java.net.PlainSocketImpl.connect(Unknown Source) ~[?:1.8.0_121]
at java.net.SocksSocketImpl.connect(Unknown Source) ~[?:1.8.0_121]
at java.net.Socket.connect(Unknown Source) ~[?:1.8.0_121]
at com.teradata.jdbc.jdbc_4.io.TDNetworkIOIF$ConnectThread.run(TDNetworkIOIF.java:968) ~[?:?]

A user with insufficient privileges to download the database catalog has been provided to Manta Data Lineage:

See typical error message ...

TBD

The set of privileges required for Teradata is available at Teradata Requirements.

Oracle

Issues related to an invalid JDBC connection string to the database, network, or firewall:

See typical error message ...

2017-02-07 15:05:31.277 [pool-2-thread-1] ERROR eu.profinit.manta.platform.automation.AbstractIOScenario - Task "OracleDictionaryMapperTask" failed while processing "": Could not get JDBC Connection; nested exception is org.apache.commons.dbcp.SQLNestedException: Cannot create PoolableConnectionFactory (IO Error: The Network Adapter could not establish the connection)
org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is org.apache.commons.dbcp.SQLNestedException: Cannot create PoolableConnectionFactory (IO Error: The Network Adapter could not establish the connection)
at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:80) ~[?:?]
at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:382) ~[?:?]
at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:456) ~[?:?]
at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:464) ~[?:?]
at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:472) ~[?:?]
at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:477) ~[?:?]
at eu.profinit.manta.connector.oracle.extractor.OracleDictionaryMapperTask.doExecute(OracleDictionaryMapperTask.java:57) ~[?:?]
at eu.profinit.manta.connector.oracle.extractor.OracleDictionaryMapperTask.doExecute(OracleDictionaryMapperTask.java:28) ~[?:?]
at eu.profinit.manta.platform.automation.AbstractTask.execute(AbstractTask.java:50) ~[manta-platform-automation-1.16.jar:?]
at eu.profinit.manta.platform.automation.AbstractScenario.executeTask(AbstractScenario.java:129) [manta-platform-automation-1.16.jar:?]
at eu.profinit.manta.platform.automation.AbstractScenario.executeTasks(AbstractScenario.java:116) [manta-platform-automation-1.16.jar:?]
at eu.profinit.manta.platform.automation.NullScenario.doExecute(NullScenario.java:17) [manta-platform-automation-1.16.jar:?]
at eu.profinit.manta.platform.automation.AbstractScenario.execute(AbstractScenario.java:88) [manta-platform-automation-1.16.jar:?]
at eu.profinit.manta.platform.ScenarioExecutionTask.doExecute(ScenarioExecutionTask.java:60) [manta-platform-1.16.jar:?]
at eu.profinit.manta.platform.ScenarioExecutionTask.doExecute(ScenarioExecutionTask.java:22) [manta-platform-1.16.jar:?]
at eu.profinit.manta.platform.automation.AbstractTask.execute(AbstractTask.java:50) [manta-platform-automation-1.16.jar:?]
at eu.profinit.manta.platform.Scenario$TaskLauncher.run(Scenario.java:137) [manta-platform-1.16.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [?:1.8.0_121]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [?:1.8.0_121]
at java.lang.Thread.run(Unknown Source) [?:1.8.0_121]
Caused by: org.apache.commons.dbcp.SQLNestedException: Cannot create PoolableConnectionFactory (IO Error: The Network Adapter could not establish the connection)
at org.apache.commons.dbcp.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:1549) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.createDataSource(BasicDataSource.java:1388) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.getConnection(BasicDataSource.java:1044) ~[?:?]
at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:111) ~[?:?]
at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:77) ~[?:?]
... 19 more
Caused by: java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish the connection
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:458) ~[?:?]
at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:546) ~[?:?]
at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:236) ~[?:?]
at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:32) ~[?:?]
at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:521) ~[?:?]
at org.apache.commons.dbcp.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:38) ~[?:?]
at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.validateConnectionFactory(BasicDataSource.java:1556) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:1545) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.createDataSource(BasicDataSource.java:1388) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.getConnection(BasicDataSource.java:1044) ~[?:?]
at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:111) ~[?:?]
at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:77) ~[?:?]
... 19 more
Caused by: oracle.net.ns.NetException: The Network Adapter could not establish the connection
at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:392) ~[?:?]
at oracle.net.resolver.AddrResolution.resolveAndExecute(AddrResolution.java:434) ~[?:?]
at oracle.net.ns.NSProtocol.establishConnection(NSProtocol.java:687) ~[?:?]
at oracle.net.ns.NSProtocol.connect(NSProtocol.java:247) ~[?:?]
at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1102) ~[?:?]
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:320) ~[?:?]
at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:546) ~[?:?]
at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:236) ~[?:?]
at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:32) ~[?:?]
at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:521) ~[?:?]
at org.apache.commons.dbcp.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:38) ~[?:?]
at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.validateConnectionFactory(BasicDataSource.java:1556) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:1545) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.createDataSource(BasicDataSource.java:1388) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.getConnection(BasicDataSource.java:1044) ~[?:?]
at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:111) ~[?:?]
at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:77) ~[?:?]
... 19 more
Caused by: java.net.ConnectException: Connection timed out: connect
at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method) ~[?:1.8.0_121]
at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source) ~[?:1.8.0_121]
at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[?:1.8.0_121]
at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[?:1.8.0_121]
at java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[?:1.8.0_121]
at java.net.PlainSocketImpl.connect(Unknown Source) ~[?:1.8.0_121]
at java.net.SocksSocketImpl.connect(Unknown Source) ~[?:1.8.0_121]
at java.net.Socket.connect(Unknown Source) ~[?:1.8.0121]
at oracle.net.nt.TcpNTAdapter.connect(TcpNTAdapter.java:150) ~[?:?]
at oracle.net.nt.ConnOption.connect(ConnOption.java:133) ~[?:?]
at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:370) ~[?:?]
at oracle.net.resolver.AddrResolution.resolveAndExecute(AddrResolution.java:434) ~[?:?]
at oracle.net.ns.NSProtocol.establishConnection(NSProtocol.java:687) ~[?:?]
at oracle.net.ns.NSProtocol.connect(NSProtocol.java:247) ~[?:?]
at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1102) ~[?:?]
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:320) ~[?:?]
at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:546) ~[?:?]
at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:236) ~[?:?]
at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:32) ~[?:?]
at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:521) ~[?:?]
at org.apache.commons.dbcp.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:38) ~[?:?]
at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.validateConnectionFactory(BasicDataSource.java:1556) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:1545) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.createDataSource(BasicDataSource.java:1388) ~[?:?]
at org.apache.commons.dbcp.BasicDataSource.getConnection(BasicDataSource.java:1044) ~[?:?]
at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:111) ~[?:?]
at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:77) ~[?:?]
... 19 more

A user with insufficient privileges to download the database catalog has been provided to Manta Data Lineage:

See typical error message ...

TBD

The set of privileges required for Oracle is available at Oracle Integration Requirements.

Manta Data Lineage lineage has run but failed to load data into IGC

Consult the log files `*IgcUploadMetadataScenarioproperties.log</code> for any errors. Some typical issues are:</p> <ul> <li><p>Invalid/expired login credentials</p></li> <li><p>Invalid URL for IGC server</p> <p>See typical error message ...</p> <p><code>org.apache.http.conn.HttpHostConnectException: Connect to 192.168.62.100:9445 [/192.168.62.100] failed: Connection timed out: connect</code><br /> <code> at org.apache.http.impl.conn.HttpClientConnectionOperator.connect(HttpClientConnectionOperator.java:140) ~[httpclient-4.3.5.jar:4.3.5]</code><br /> <code> at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:318) ~[httpclient-4.3.5.jar:4.3.5]</code><br /> <code> at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:363) ~[httpclient-4.3.5.jar:4.3.5]</code><br /> <code> at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:219) ~[httpclient-4.3.5.jar:4.3.5]</code><br /> <code> at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:195) ~[httpclient-4.3.5.jar:4.3.5]</code><br /> <code> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:86) ~[httpclient-4.3.5.jar:4.3.5]</code><br /> <code> at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:108) ~[httpclient-4.3.5.jar:4.3.5]</code><br /> <code> at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184) ~[httpclient-4.3.5.jar:4.3.5]</code><br /> <code> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) ~[httpclient-4.3.5.jar:4.3.5]</code><br /> <code> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106) ~[httpclient-4.3.5.jar:4.3.5]</code><br /> <code> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57) ~[httpclient-4.3.5.jar:4.3.5]</code><br /> <code> at eu.profinit.manta.connector.http.caller.AbstractCaller.executeRequestInner(AbstractCaller.java:88) [manta-connector-http-1.16.jar:?]</code><br /> <code> at eu.profinit.manta.connector.http.caller.AbstractCaller.executeRequest(AbstractCaller.java:60) [manta-connector-http-1.16.jar:?]</code><br /> <code> at eu.profinit.manta.connector.http.caller.RequestFactoryCaller.sendData(RequestFactoryCaller.java:24) [manta-connector-http-1.16.jar:?]</code><br /> <code> at eu.profinit.manta.dataflow.igc.common.UploadModelTask.getModels(UploadModelTask.java:69) [manta-dataflow-igc-common-cli-1.16.jar:?]</code><br /> <code> at eu.profinit.manta.dataflow.igc.common.UploadModelTask.doExecute(UploadModelTask.java:56) [manta-dataflow-igc-common-cli-1.16.jar:?]</code><br /> <code> at eu.profinit.manta.dataflow.igc.common.UploadModelTask.doExecute(UploadModelTask.java:29) [manta-dataflow-igc-common-cli-1.16.jar:?]</code><br /> <code> at eu.profinit.manta.platform.automation.AbstractTask.execute(AbstractTask.java:50) [manta-platform-automation-1.16.jar:?]</code><br /> <code> at eu.profinit.manta.platform.automation.AbstractScenario.executeTask(AbstractScenario.java:129) [manta-platform-automation-1.16.jar:?]</code><br /> <code> at eu.profinit.manta.platform.automation.AbstractScenario.executeTasks(AbstractScenario.java:116) [manta-platform-automation-1.16.jar:?]</code><br /> <code> at eu.profinit.manta.platform.automation.NullScenario.doExecute(NullScenario.java:17) [manta-platform-automation-1.16.jar:?]</code><br /> <code> at eu.profinit.manta.platform.automation.AbstractScenario.execute(AbstractScenario.java:88) [manta-platform-automation-1.16.jar:?]</code><br /> <code> at eu.profinit.manta.platform.cli.Main.main(Main.java:237) [manta-platform-cli-1.16.jar:1.16]</code><br /> <code>Caused by: </code>[java.net](http://java.net)<code>.ConnectException: Connection timed out: connect</code><br /> <code> at </code>[java.net](http://java.net)<code>.DualStackPlainSocketImpl.connect0(Native Method) ~[?:1.8.0_121]</code><br /> <code> at </code>[java.net](http://java.net)<code>.DualStackPlainSocketImpl.socketConnect(Unknown Source) ~[?:1.8.0_121]</code><br /> <code> at </code>[java.net](http://java.net)<code>.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[?:1.8.0_121]</code><br /> <code> at </code>[java.net](http://java.net)<code>.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[?:1.8.0_121]</code><br /> <code> at </code>[java.net](http://java.net)<code>.AbstractPlainSocketImpl.connect(Unknown Source) ~[?:1.8.0_121]</code><br /> <code> at </code>[java.net](http://java.net)<code>.PlainSocketImpl.connect(Unknown Source) ~[?:1.8.0_121]</code><br /> <code> at </code>[java.net](http://java.net)<code>.SocksSocketImpl.connect(Unknown Source) ~[?:1.8.0_121]</code><br /> <code> at </code>[java.net](http://java.net)<code>.Socket.connect(Unknown Source) ~[?:1.8.0_121]</code><br /> <code> at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:239) ~[?:?]</code><br /> <code> at org.apache.http.impl.conn.HttpClientConnectionOperator.connect(HttpClientConnectionOperator.java:123) ~[?:?]</code><br /> <code> ... 22 more </code></p> </div> </div> <p><br /> </p></li> <li><p>Insufficient privileges</p></li> <li><p>Untrusted SSL certificate</p> <p>See typical error message ...</p> <pre><code>javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target at sun.security.ssl.Alerts.getSSLException(Alerts.java:192) ~[?:1.8.0_121] at sun.security.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1949) ~[?:1.8.0_121] at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:302) ~[?:1.8.0_121] at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:296) ~[?:1.8.0_121] at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1514) ~[?:1.8.0_121] at sun.security.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:216) ~[?:1.8.0_121] at sun.security.ssl.Handshaker.processLoop(Handshaker.java:1026) ~[?:1.8.0_121] at sun.security.ssl.Handshaker.process_record(Handshaker.java:961) ~[?:1.8.0_121] at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1062) ~[?:1.8.0_121] at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375) ~[?:1.8.0_121] at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403) ~[?:1.8.0_121] at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387) ~[?:1.8.0_121] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:275) ~[httpclient-4.3.5.jar:4.3.5] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:254) ~[httpclient-4.3.5.jar:4.3.5] at org.apache.http.impl.conn.HttpClientConnectionOperator.connect(HttpClientConnectionOperator.java:123) ~[httpclient-4.3.5.jar:4.3.5] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:318) ~[httpclient-4.3.5.jar:4.3.5] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:363) ~[httpclient-4.3.5.jar:4.3.5] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:219) ~[httpclient-4.3.5.jar:4.3.5] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:195) ~[httpclient-4.3.5.jar:4.3.5] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:86) ~[httpclient-4.3.5.jar:4.3.5] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:108) ~[httpclient-4.3.5.jar:4.3.5] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184) ~[httpclient-4.3.5.jar:4.3.5] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) ~[httpclient-4.3.5.jar:4.3.5] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106) ~[httpclient-4.3.5.jar:4.3.5] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57) ~[httpclient-4.3.5.jar:4.3.5] at eu.profinit.manta.connector.http.caller.AbstractCaller.executeRequestInner(AbstractCaller.java:88) [manta-connector-http-1.16.jar:?] at eu.profinit.manta.connector.http.caller.AbstractCaller.executeRequest(AbstractCaller.java:60) [manta-connector-http-1.16.jar:?] at eu.profinit.manta.connector.http.caller.RequestFactoryCaller.sendData(RequestFactoryCaller.java:24) [manta-connector-http-1.16.jar:?] at eu.profinit.manta.dataflow.igc.common.UploadModelTask.getModels(UploadModelTask.java:69) [manta-dataflow-igc-common-cli-1.16.jar:?] at eu.profinit.manta.dataflow.igc.common.UploadModelTask.doExecute(UploadModelTask.java:56) [manta-dataflow-igc-common-cli-1.16.jar:?] at eu.profinit.manta.dataflow.igc.common.UploadModelTask.doExecute(UploadModelTask.java:29) [manta-dataflow-igc-common-cli-1.16.jar:?] at eu.profinit.manta.platform.automation.AbstractTask.execute(AbstractTask.java:50) [manta-platform-automation-1.16.jar:?] at eu.profinit.manta.platform.automation.AbstractScenario.executeTask(AbstractScenario.java:129) [manta-platform-automation-1.16.jar:?] at eu.profinit.manta.platform.automation.AbstractScenario.executeTasks(AbstractScenario.java:116) [manta-platform-automation-1.16.jar:?] at eu.profinit.manta.platform.automation.NullScenario.doExecute(NullScenario.java:17) [manta-platform-automation-1.16.jar:?] at eu.profinit.manta.platform.automation.AbstractScenario.execute(AbstractScenario.java:88) [manta-platform-automation-1.16.jar:?] at eu.profinit.manta.platform.cli.Main.main(Main.java:237) [manta-platform-cli-1.16.jar:1.16] Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:387) ~[?:1.8.0_121] at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:292) ~[?:1.8.0_121] at sun.security.validator.Validator.validate(Validator.java:260) ~[?:1.8.0_121] at sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:324) ~[?:1.8.0_121] at sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:229) ~[?:1.8.0_121] at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:105) ~[?:1.8.0_121] at org.apache.http.conn.ssl.SSLContextBuilder$TrustManagerDelegate.checkServerTrusted(SSLContextBuilder.java:190) ~[?:?] at sun.security.ssl.AbstractTrustManagerWrapper.checkServerTrusted(SSLContextImpl.java:984) ~[?:1.8.0_121] at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1496) ~[?:1.8.0_121] ... 32 more Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target at sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141) ~[?:1.8.0_121] at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126) ~[?:1.8.0_121] at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:280) ~[?:1.8.0_121] at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:382) ~[?:1.8.0_121] at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:292) ~[?:1.8.0_121] at sun.security.validator.Validator.validate(Validator.java:260) ~[?:1.8.0_121] at sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:324) ~[?:1.8.0_121] at sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:229) ~[?:1.8.0_121] at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:105) ~[?:1.8.0_121] at org.apache.http.conn.ssl.SSLContextBuilder$TrustManagerDelegate.checkServerTrusted(SSLContextBuilder.java:190) ~[?:?] at sun.security.ssl.AbstractTrustManagerWrapper.checkServerTrusted(SSLContextImpl.java:984) ~[?:1.8.0_121] at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1496) ~[?:1.8.0_121] ... 32 more </code></pre> </div> </div> <p>See <a href="manta-flow-ibm-igc-client-configuration.html" data-linked-resource-id="743342282" data-linked-resource-version="32" data-linked-resource-type="page">Common Resource Configuration for IGC</a> for a guide to resolving this issue.</p></li> <li><p>Failed upload due to IGC server error, for example, due to WebSphere API limits being reached; see [Manta Flow IGC Configuration](manta-flow-ibm-igc-client-configuration.html) and the related troubleshooting article <a href="asset-flow-upload-to-igc-fails-with-500-internal-error.html" data-linked-resource-id="69470316" data-linked-resource-version="19" data-linked-resource-type="page">Asset/Flow Upload to IGC Fails with 500: Internal Error</a> for details on investigation and resolution</p></li> <li><p>Failure during upload due to session expiration; see [Manta Flow IGC Configuration](manta-flow-ibm-igc-integration.html) and the related troubleshooting article <a href="asset-flow-upload-to-igc-fails-with-403-the-session-...-has-expired-or-was-not-found.html" data-linked-resource-id="69571336" data-linked-resource-version="15" data-linked-resource-type="page">Asset/Flow Upload to IGC Fails with 403: The Session [...] Has Expired or Was Not Found</a> for details on investigation and resolution</p></li> <li><p>An issue with the generated lineage file for IGC</p> <p>See typical error message ...</p> <p>2017-02-07 16:40:59.355 [pool-2-thread-1] INFO eu.profinit.manta.dataflow.igc.common.UploadModelTask - Inserting assets.</p> <p>2017-02-07 16:41:00.175 [pool-2-thread-1] ERROR eu.profinit.manta.connector.http.caller.callback.BasicErrorCallback - Response 400: {"errors":[{"code":"CDIGC1042E","message":"Class with code \"$MantaModel-Column\" does not have a reference with code \"$Input\". Asset ID=\"a1616\".","explanation":"Class- and reference codes must conform to the REST codes, for the given REST version.","userResponse":"Make corrections to the XML or the code that produces it, and then try again."}]}.</p> <p>2017-02-07 16:41:00.179 [pool-2-thread-1] INFO eu.profinit.manta.dataflow.igc.common.UploadModelTask - Inserting flows.</p> <p>2017-02-07 16:41:01.326 [pool-2-thread-1] ERROR eu.profinit.manta.connector.http.caller.callback.BasicErrorCallback - Response 400: {"errors":[{"code":"CDIGC1042E","message":"Class with code \"$MantaModel-Column\" does not have a reference with code \"$Input\". Asset ID=\"a1616\".","explanation":"Class- and reference codes must conform to the REST codes, for the given REST version.","userResponse":"Make corrections to the XML or the code that produces it, and then try again."}]}.</p> </div> </div> <p>In such cases, go to [IBM Support](https://www.ibm.com/mysupport) and provide the log files for further investigation.</p></li> </ul></td> </tr> <tr class="even"> <td class="confluenceTd"><p>The asset in question is not configured to be analyzed by Manta Data Lineage</p></td> <td class="confluenceTd"><p>Manta only links lineage for the assets it analyzes. There are two ways to get lineage connected to such an asset.</p> <ol> <li><p>Include the asset (database/schema) in the Manta Data Lineage lineage analysis (configure the connection to the asset and add it to the Manta-IGC mapping file); see [Manta Flow IGC Client Installation](manta-flow-ibm-igc-client-configuration.html) and the subsection related to the asset in question.</p></li> <li><p>Include such assets in <code>DictionaryMantaMappingManual.csv</code> to provide the correct mapping for schemas that are not processed by Manta Data Lineage but need to be correctly mapped; see [Manta Flow IGC Client Installation](manta-flow-ibm-igc-client-configuration.html) and the subsection related to the asset in question.</p></li> </ol> <p>In order to investigate this situation in IGC, verify that lineage has been loaded into IGC by exploring the assets loaded.</p> <ol> <li><p>Navigate to <em>Information Assets | MantaModel Root</em>.</p></li> <li><p>Navigate to the asset you expect to see in the lineage and run lineage on this asset.</p></li> <li><p>The resulting lineage will point to a virtual (grayed-out) asset with the same name but a different hierarchy than expected.</p></li> <li><p>Include such an asset in <code>DictionaryMantaMappingManual.csv</code> to provide the correct mapping for schemas that are not processed by Manta Data Lineage but need to be correctly mapped.<br /> Alternatively, configure it to be analyzed by Manta Data Lineage.</p></li> </ol></td> </tr> <tr class="odd"> <td class="confluenceTd"><p>IGC-Manta Resource mapping is not configured correctly</p></td> <td class="confluenceTd"><p>This issue is similar to the previous one, with the exception that there was no expectation that the asset in question would actually be analyzed.</p> <p>Lineage run on an asset shows that asset but not anything else that is expected from Manta Data Lineage.</p> <ol> <li><p>In order to evaluate if any lineage has been loaded at all, navigate to <em>Information Assets | MantaModel Root</em>.</p></li> <li><p>Navigate to the asset you expect to see in the lineage and run lineage on this asset.</p></li> <li><p>The resulting lineage will point to virtual (grayed-out) assets with the same name but a different hierarchy than expected.</p></li> <li><p>Update the <code>IgcMantaMapping.csv` file to match the IGC Host and Database to the Manta Data Lineage asset; see Manta Flow IGC Data Resource Mapping for more details.
IGC Host—name of the first level of the hierarchy for the IGC asset in question (Information Assets | Implemented Data Resources)
IGC Database—name of the second level of the hierarchy for the IGC asset in question (Information Assets | Implemented Data Resources)
Host—Manta identification of the equivalent asset

  • Rerun the lineage and verify the results.

  • Lineage Available but Points to Virtual (Grayed-Out) Assets

    Potential cause

    Steps to take

    Resource is not loaded into IGC as a native resource

    Manta Data Lineage provides lineage information for views, stored procedures, macros, BTEQ scripts, etc. by connecting native IGC resources (tables and views). If the native asset is not loaded into IGC as a native resource, it appears in the lineage as a virtual (grayed-out) asset.

    Verify that the resource in question has been loaded into IGC as a native resource by navigating to Information Assets | Implemented Data Resources and locating the asset in question.

    If the asset cannot be found, load it into IGC using InfoSphere Metadata Asset Manager. After loading and sharing the loaded assets in the IGC repository, the lineage should be fixed. Alternatively, continue with the next step.

    If the asset is present, continue with the next step.

    Resource in question is not configured to be analyzed by Manta Data Lineage

    Refer to the step "Resource in question is not configured to be analyzed by Manta Data Lineage" to verify that the resource has been analyzed by Manta Data Lineage and resolve it accordingly.

    IGC-Manta Resource mapping is not configured correctly

    Refer to the step "IGC-Manta Resource mapping is not configured correctly" to verify that the Manta-IGC mapping is configured properly.

    Lineage Is Available but Is Incomplete

    Potential cause

    Steps to take

    IGC-Manta Resource mapping is not configured correctly

    In this situation, the lineage is shown but parts of the lineage which you expect to see are missing. This issue may have occurred for a couple of reasons.

    1. Verify that the resource in question has been analyzed by Manta Data Lineage.

    2. Verify that the lineage has been run and loaded into IGC.

    3. Verify that the the mapping between Manta Data Lineage and the IGC resources is configured properly.

    Use the above steps to perform this verification.

    There are parsing issues in Manta Data Lineage that result in parts of the lineage being omitted

    Everything seems to be configured properly, the lineage has been loaded into IGC, but it is incomplete. There may have been some parsing issues that caused parts of the lineage to be omitted. Refer to the Manta CLI log files *ExtractorScenario_*.properties.log and *DataflowScenario_*.properties.log to identify the issues. Search for the particular asset missing and look for lines saying "ERROR".

    Go to IBM Support and provide the log files for further investigation.