Configuring the agent by using the silent response file
You can use the silent response file to configure the Hadoop agent on Linux, AIX®, and Windows systems.
About this task
The silent response file contains the agent configuration parameters. For some parameters, the default values are provided in comments. You can specify different values for these parameters, and remove the comment tags that are placed at the beginning of the parameters.
Procedure
-
Open the silent response file that is available at this path:
install_dir\samples\hadoop_silent_config.txt
-
In the response file, complete the following steps:
a. When you want to monitor the Hadoop Cluster that is enabled for Kerberos SPNEGO-based authentication, type
yes
and enter values for the following parameters:HADOOP_REALM_NAME HADOOP_KDC_HOSTNAME HADOOP_PRINCIPAL_NAME HADOOP_SPNEGO_KEYTAB
b. To monitor SSL enabled Hadoop daemons-HDFS, YARN, and MapReduce/MapReduce2, specify
Yes
for HADOOP_SSL parameter and enter the values for the following parameters:HADOOP_TRUSTSTORE_PATHHADOOP_TRUSTSTORE_PASSWORD
c. Enter values for the following parameters of Cluster, NameNode (NN), ResourceManager (RM), and Job History Server (JHS):
HADOOP_CLUSTER_NAME (optional)HADOOP_NN_HOSTNAME HADOOP_NN_PORT HADOOP_RM_HOSTNAME HADOOP_RM_PORT HADOOP_JHS_HOSTNAME (optional) HADOOP_JHS_PORT (optional)
d. Optional: For the HADOOP_ADDITIONAL_NN_HOSTNAME parameter, specify the host name of the Standby or Secondary NameNode.
e. Optional: For the HADOOP_ADDITIONAL_NN_PORT parameter, specify the port number of the Standby or Secondary NameNode.
Remember: If the additional NameNode is a Standby NameNode, the default port number that is associated with the Standby NameNode daemon process is
50070
. If the additional NameNode is a Secondary NameNode, the default port number that is associated with the Secondary NameNode daemon process is50090
.f. Optional: For the Hadoop_SRM parameter, type
Yes
to add Standby ResourceManagers for a high-availability cluster, and go to step g.g. Optional: To monitor Kerberos authentication enabled REST endpoints of Ambari server, specify Yes for the HADOOP_KERBEROS_AMBARI parameter and enter the values of following parameters and keep a blank value for step h parameters:
HADOOP_KERBEROS_AMBARI=YES HADOOP_AMBARI_REALM_NAME HADOOP_AMBARI_KDC_HOSTNAME HADOOP_AMBARI_PRINCIPAL_NAME HADOOP_AMBARI_KEYTAB AMBARI_HOSTNAME AMBARI_PORT
h. Optional: To monitor SSL enabled Ambari services, specify Yes for the AMBARI_SSL parameter and enter the values of following parameters:
HADOOP_AMBARI=YES AMBARI_SERVER_HOSTNAME AMBARI_SERVER_PORT USERNAME_OF_AMBARI_USER PASSWORD_OF_AMBARI_USER AMBARI_TRUSTSTORE_PATH (optional) AMBARI_TRUSTSTORE_PASSWORD (optional)
Note: If the values for the fields TrustStore file path and TrustStore Password are provided in sub-step b and are same, then the values for fields TrustStore file path and TrustStore Password can be kept as blank.
i. Optional: To monitor SSL enabled Cloudera Manager services, specify Yes for CDH_SSL parameter and enter the values of following parameters:
HADOOP_CMSERVICE=Yes HADOOP_CM_HOSTNAME HADOOP_CM_PORT USERNAME_OF_CM PASSWORD_OF_CM_USER CDH_TRUSTSTORE_PATH (optional) CDH_TRUSTSTORE_PASSWORD (optional)
Note: If the values for the fields TrustStore file path and TrustStore Password are provided in sub-step b and are same, then the values for fields TrustStore file path and TrustStore Password can be kept as blank.
j. For the JAVA_TRACE_LEVEL parameter, specify the appropriate trace level.
k. Optional: For the JAVA_JVM_ARGS parameter, specify arguments for the Java™™ virtual machine.
l. Optional: Add the host name and the port number of a Standby ResourceManager in the following format:
HADOOP_SRM_PORT.hadoop_srm_config_sec_1=8088
Where, hadoop_srm_config_sec_1 is the host name of the node where the daemon process for Standby ResourceManager runs, and
8088
is the default port number. To add more Standby ResourceManagers, add the host name and port number of other Standby ResourceManagers on new lines in the same format. -
Save the response file, and run the following command:
:
install_dir/bin/hadoop-agent.sh config install_dir/samples/hadoop_silent_config.txt
install_dir/bin/hadoop-agent.bat config install_dir/samples/hadoop_silent_config.txt
-
Start the agent:
Run the following command:
install_dir\bin\hadoop-agent.sh start
Right-click Monitoring Agent for Hadoop and then click Start.
What to do next
-
Enable the subnode events to view eventing thresholds of the Hadoop agent. For information about enabling subnode events, see Configuring the dashboard for viewing Hadoop events.
-
Log in to the IBM Cloud Pak console to view the data that is collected by the agent in the dashboards. For more information about using the console, see Starting the Cloud App Management UI.