Uploading JDBC drivers for lineage import (Watson Knowledge Catalog)

For some data sources, you must upload specific JDBC drivers before you can import lineage.

The following connection types require JDBC drivers:

You must restart the respective manta-xxxx pod after you upload the driver.

Amazon Redshift

Starting with Cloud Pak for Data 4.6.4, you can import lineage from Amazon Redshift data sources.

Upload the AWS Advanced JDBC Driver.

Download location: https://github.com/awslabs/aws-advanced-jdbc-wrapper/releases/download/1.0.1/aws-advanced-jdbc-wrapper-1.0.1.jar
Target location in the manta-admin-gui-xxxxx-xxxx pod: /opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext

Command :

oc cp <jar> <manta-admin-gui-pod-id>:/opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext

Example :

oc cp aws-advanced-jdbc-wrapper-1.0.1.jar manta-admin-gui-7b7558dcdc-dd94s:/opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext

Apache Hive

Instructions are different depending on the version of Cloud Pak for Data that you install or to which you upgrade:

New or upgrade installation of Cloud Pak for Data 4.6.0

Upload a standalone Apache Hive JDBC driver.

Download location: https://repo1.maven.org/maven2/org/apache/hive/hive-jdbc/3.1.2/hive-jdbc-3.1.2-standalone.jar
Target location in the manta-dataflow-xxxxx-xxxx pod: /opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext/

Command :

oc cp <jar> <manta-dataflow-pod-id>:/opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext

Example :

oc cp hive-jdbc-3.1.2-standalone.jar manta-dataflow-7d45bb44cc-7s9vv:/opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext/

New or upgrade installation of Cloud Pak for Data 4.6.1

Upload a set of JDBC drivers.

Prerequisite for upgrade installations:: Delete the hive-jdbc-3.1.2-standalone.jar JDBC driver from the manta-admin-gui pod before uploading the new set of drivers. Run the following command replacing the pod ID as applicable:

oc exec manta-admin-gui-xxxxx-xxxx -- sh -c 'rm /opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext/hive-jdbc-3.1.2-standalone.jar'

Download location

JAR file	Repository
hive-jdbc-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-jdbc/3.1.2
hive-common-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-common/3.1.2
hive-metastore-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-metastore/3.1.2
hive-serde-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-serde/3.1.2
hive-service-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-service/3.1.2
hive-service-rpc-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-service-rpc/3.1.2
hive-shims-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-shims/3.1.2
libthrift-0.9.3.jar	https://mvnrepository.com/artifact/org.apache.thrift/libthrift/0.9.3
zookeeper-3.4.6.jar	https://mvnrepository.com/artifact/org.apache.zookeeper/zookeeper/3.4.6
curator-client-2.12.0.jar	https://mvnrepository.com/artifact/org.apache.curator/curator-client/2.12.0
curator-framework-2.12.0.jar	https://mvnrepository.com/artifact/org.apache.curator/curator-framework/2.12.0
hadoop-shaded-protobuf_3_7-1.1.1.jar	https://mvnrepository.com/artifact/org.apache.hadoop.thirdparty/hadoop-shaded-protobuf_3_7/1.1.1

Target location in the manta-admin-gui-xxxxx-xxxx pod: /opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext/

Command :

oc cp <jar> <manta-admin-gui-pod-id>:/opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext

Example :

oc cp hive-jdbc-3.1.2.jar manta-admin-gui-7d45bb44cc-7s9vv:/opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext/

New or upgrade installation of Cloud Pak for Data 4.6.3 or later

Upload a set of JDBC drivers. If you upgrade from version 4.6.1 or 4.6.2, you will need to upload only the commons-lang-2.6.jar file; the other JDBC drivers are already available.

Prerequisite for upgrade installations:: If you upgrade from a version before 4.6.1, delete the hive-jdbc-3.1.2-standalone.jar JDBC driver from the manta-admin-gui pod before uploading the new set of drivers. Run the following command replacing the pod ID as applicable:

oc exec manta-admin-gui-xxxxx-xxxx -- sh -c 'rm /opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext/hive-jdbc-3.1.2-standalone.jar'

Download location

JAR file	Repository
hive-jdbc-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-jdbc/3.1.2
hive-common-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-common/3.1.2
hive-metastore-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-metastore/3.1.2
hive-serde-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-serde/3.1.2
hive-service-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-service/3.1.2
hive-service-rpc-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-service-rpc/3.1.2
hive-shims-3.1.2.jar	https://mvnrepository.com/artifact/org.apache.hive/hive-shims/3.1.2
libthrift-0.9.3.jar	https://mvnrepository.com/artifact/org.apache.thrift/libthrift/0.9.3
zookeeper-3.4.6.jar	https://mvnrepository.com/artifact/org.apache.zookeeper/zookeeper/3.4.6
curator-client-2.12.0.jar	https://mvnrepository.com/artifact/org.apache.curator/curator-client/2.12.0
curator-framework-2.12.0.jar	https://mvnrepository.com/artifact/org.apache.curator/curator-framework/2.12.0
hadoop-shaded-protobuf_3_7-1.1.1.jar	https://mvnrepository.com/artifact/org.apache.hadoop.thirdparty/hadoop-shaded-protobuf_3_7/1.1.1
commons-lang-2.6.jar	https://mvnrepository.com/artifact/commons-lang/commons-lang/2.6

Target location in the manta-admin-gui-xxxxx-xxxx pod: /opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext/

Command :

oc cp <jar> <manta-admin-gui-pod-id>:/opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext

Example :

oc cp hive-jdbc-3.1.2.jar manta-admin-gui-7d45bb44cc-7s9vv:/opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext/

Teradata

Instructions are different depending on the version of Cloud Pak for Data that you install or to which you upgrade:

New or upgrade installation of Cloud Pak for Data 4.6.0
New or upgrade installation of Cloud Pak for Data 4.6.1 or later

New or upgrade installation of Cloud Pak for Data 4.6.0

Download location https://downloads.teradata.com/download/connectivity/jdbc-driver

Target location in the manta-dataflow-xxxxx-xxxx pod: /opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext

Command :

oc cp <jar> <manta-dataflow-pod-id>:/opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext

Example :

oc cp terajdbc4.jar manta-dataflow-7b7558dcdc-dd94s:/opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext

New or upgrade installation of Cloud Pak for Data 4.6.1 or later

Download location: https://downloads.teradata.com/download/connectivity/jdbc-driver
Target location in the manta-admin-gui-xxxxx-xxxx pod: /opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext

Command :

oc cp <jar> <manta-admin-gui-pod-id>:/opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext

Example :

oc cp terajdbc4.jar manta-admin-gui-7b7558dcdc-dd94s:/opt/mantaflow/cli/scenarios/manta-dataflow-cli/lib-ext

Learn more

Parent topic: Administering