Configuring the agent by using the silent response file

You can use the silent response file to configure the Hadoop agent on Linux, AIX®, and Windows systems.

About this task

The silent response file contains the agent configuration parameters. For some parameters, the default values are provided in comments. You can specify different values for these parameters, and remove the comment tags that are placed at the beginning of the parameters.

Procedure

  1. Open the silent response file that is available at this path: install_dir\samples\hadoop_silent_config.txt

  2. In the response file, complete the following steps:

    a. When you want to monitor the Hadoop Cluster that is enabled for Kerberos SPNEGO-based authentication, type yes and enter values for the following parameters:

      HADOOP_REALM_NAME HADOOP_KDC_HOSTNAME HADOOP_PRINCIPAL_NAME HADOOP_SPNEGO_KEYTAB
    

    b. To monitor SSL enabled Hadoop daemons-HDFS, YARN, and MapReduce/MapReduce2, specify Yes for HADOOP_SSL parameter and enter the values for the following parameters:

      HADOOP_TRUSTSTORE_PATHHADOOP_TRUSTSTORE_PASSWORD
    

    c. Enter values for the following parameters of Cluster, NameNode (NN), ResourceManager (RM), and Job History Server (JHS):

      HADOOP_CLUSTER_NAME (optional)HADOOP_NN_HOSTNAME HADOOP_NN_PORT HADOOP_RM_HOSTNAME HADOOP_RM_PORT HADOOP_JHS_HOSTNAME (optional) HADOOP_JHS_PORT (optional)
    

    d. Optional: For the HADOOP_ADDITIONAL_NN_HOSTNAME parameter, specify the host name of the Standby or Secondary NameNode.

    e. Optional: For the HADOOP_ADDITIONAL_NN_PORT parameter, specify the port number of the Standby or Secondary NameNode.

    Remember: If the additional NameNode is a Standby NameNode, the default port number that is associated with the Standby NameNode daemon process is 50070. If the additional NameNode is a Secondary NameNode, the default port number that is associated with the Secondary NameNode daemon process is 50090.

    f. Optional: For the Hadoop_SRM parameter, type Yes to add Standby ResourceManagers for a high-availability cluster, and go to step g.

    g. Optional: To monitor Kerberos authentication enabled REST endpoints of Ambari server, specify Yes for the HADOOP_KERBEROS_AMBARI parameter and enter the values of following parameters and keep a blank value for step h parameters:

      HADOOP_KERBEROS_AMBARI=YES
      HADOOP_AMBARI_REALM_NAME
      HADOOP_AMBARI_KDC_HOSTNAME
      HADOOP_AMBARI_PRINCIPAL_NAME
      HADOOP_AMBARI_KEYTAB
      AMBARI_HOSTNAME
      AMBARI_PORT
    

    h. Optional: To monitor SSL enabled Ambari services, specify Yes for the AMBARI_SSL parameter and enter the values of following parameters:

      HADOOP_AMBARI=YES
      AMBARI_SERVER_HOSTNAME 
      AMBARI_SERVER_PORT 
      USERNAME_OF_AMBARI_USER 
      PASSWORD_OF_AMBARI_USER
      AMBARI_TRUSTSTORE_PATH (optional)
      AMBARI_TRUSTSTORE_PASSWORD (optional)
    

    Note: If the values for the fields TrustStore file path and TrustStore Password are provided in sub-step b and are same, then the values for fields TrustStore file path and TrustStore Password can be kept as blank.

    i. Optional: To monitor SSL enabled Cloudera Manager services, specify Yes for CDH_SSL parameter and enter the values of following parameters:

        HADOOP_CMSERVICE=Yes
        HADOOP_CM_HOSTNAME
        HADOOP_CM_PORT
        USERNAME_OF_CM
        PASSWORD_OF_CM_USER
        CDH_TRUSTSTORE_PATH (optional)
        CDH_TRUSTSTORE_PASSWORD (optional)
    

    Note: If the values for the fields TrustStore file path and TrustStore Password are provided in sub-step b and are same, then the values for fields TrustStore file path and TrustStore Password can be kept as blank.

    j. For the JAVA_TRACE_LEVEL parameter, specify the appropriate trace level.

    k. Optional: For the JAVA_JVM_ARGS parameter, specify arguments for the Java™™ virtual machine.

    l. Optional: Add the host name and the port number of a Standby ResourceManager in the following format:

    HADOOP_SRM_PORT.hadoop_srm_config_sec_1=8088

    Where, hadoop_srm_config_sec_1 is the host name of the node where the daemon process for Standby ResourceManager runs, and 8088 is the default port number. To add more Standby ResourceManagers, add the host name and port number of other Standby ResourceManagers on new lines in the same format.

  3. Save the response file, and run the following command:

    alt:

    install_dir/bin/hadoop-agent.sh config install_dir/samples/hadoop_silent_config.txt

    alt install_dir/bin/hadoop-agent.bat config install_dir/samples/hadoop_silent_config.txt

  4. Start the agent:

    alt Run the following command:

    install_dir\bin\hadoop-agent.sh start

    alt Right-click Monitoring Agent for Hadoop and then click Start.

What to do next

  1. Enable the subnode events to view eventing thresholds of the Hadoop agent. For information about enabling subnode events, see Configuring the dashboard for viewing Hadoop events.

  2. Log in to the IBM Cloud Pak console to view the data that is collected by the agent in the dashboards. For more information about using the console, see Starting the Cloud App Management UI.