Configuring basic HA for YARN resource manager failover

If you set up basic HA in IBM® Spectrum Symphony for your YARN resource manager, when an active resource manager fails, IBM Spectrum Symphony selects a standby resource manager to become active.

Procedure

  1. Modify the YARN configuration file ($HADOOP_CONF_DIR/yarn-site.xml) on all resource manager hosts and node manager hosts to add properties for YARN workload recovery. For example:
    <property>
        <name>yarn.resourcemanager.recovery.enabled</name>
        <value>true</value>
    </property>
    <property>
        <name>yarn.resourcemanager.fs.state-store.uri</name>
        <value>hdfs://namenode:8020/rmstore</value>
    </property>
    <property>
        <name>yarn.resourcemanager.store.class</name>
        <value>org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore</value>
    </property>
    Note: This example uses the default port for namenode (8020). Configure the URI based on your HDFS cluster configuration.
  2. Restart the EGOYARN service:
    egosh service stop EGOYARN
    egosh service start EGOYARN