Validating data movement configuration

It is recommended that you validate your connection configuration before running data movement.

About this task

You use a validation process to verify that the configuration details are correct. The script performs the following checks:
  • Access to HDFS
  • Connection to warehouse
  • Connection to database engine (Hive or BigSQL)
  • Map-reduce jobs
It also checks the completeness of the configuration XML file, its read access rights, and whether the values provided are allowed.

Procedure

On Hadoop, run the following command before you run data movement: 
/fastDataMovement/fdm.sh -conf <configuration_file>.xml -validate

Results

Status is displayed on screen. A complete validation log can be found in the following log directories:
  • on Hadoop in /fastDataMovement/var/log