Running data movement from Db2 Warehouse

Learn how to run data movement between Db2® Warehouse and Hadoop.

Procedure

  1. Install the required files in the Db2 Warehouse container, as described in Configuring Fast Data Movement on Db2 Warehouse.
  2. Copy and edit the fq-export-remote-conf.xml or fq-import-remote-conf.xml file using any text editor. The XML configuration details are described in Preparing configuration XML files.
  3. In the XML configuration file, set the value for the nz.fq.hadoop.client.configs parameter. The value specifies the path to the downloaded client configuration files:
     <property>
                <name>nz.fq.hadoop.client.configs</name>
                <value>/path/to/client/config/files/</value>
            </property>
    
  4. In the XML configuration file, set the value for the nz.fq.hadoop.remote.user parameter. The value specifies the remote Hadoop user name that will run data movement. This user must have access to HDFS.
     <property>
                <name>nz.fq.hadoop.remote.user</name>
                <value>biadmin</value>
            </property>
  5. Execute fdm_iias command which runs fdmIIAS.sh script. As parameters, provide the downloaded libraries and the XML configuration file that you edited. For example:
    [bluadmin@nc143206 - Db2wh FDM]$ fdm_iias -hadoop_jars /mnt/blumeta0/home/bluadmin/hadoop_libs/horton/fqdm -conf ~/fq-export-remote-conf.xml