Post setup

This section lists the steps to be performed post setup.

  1. Log in to Ambari GUI.
  2. On a separate console, check the /usr/lpp/mmfs/bin/mmlsfs -r replication value and update the HDFS config panel dfs.replication field in Ambari if the value does not match the mmlsfs command output. For more information, see the mmlsfs command topic in the IBM Storage Scale: Command and Programming Reference Guide.
    Note: For IBM®® ESS file system, if the file system replication is set to 1, the HDFS dfs.replication field should be set as 1 in the HDFS config panel in Ambari to ensure that the services do not get misleading error message for not having enough space. For example: spark2 thrift server down due to do not have enough space error.
  3. IBM Spectrum® Scale service is up with Restart Required icon.
    Restart IBM Spectrum Scale service.
    Note: From Mpack 2.7.0.3, the Restart Required icon will not appear after the IBM Spectrum Scale service is deployed.

    Run service check for IBM Spectrum Scale service.

  4. HDFS Transparency is now integrated into HDFS service.
  5. Start all other services from Ambari. Click Ambari GUI > Services > Start All. If some services did not start properly, start them by going to the host dashboard, and restarting each service individually.
    Note: HDFS will get alerts on the NameNodes.
    1. HDFS Transparency does not perform the checkpointing because IBM Spectrum Scale is stateless. Disable the alert as NameNode checkpoint is not relevant. From HDFS panel > Alert > NameNode Last Checkpoint > State:Enabled > Confirmation panel > Confirm Disable.
    2. Disable the NameNode Blocks Health as this value is not relevant when IBM Spectrum Scale is integrated. From HDFS panel > Alert > NameNode Blocks Health > State:Enabled > Confirmation panel > Confirm Disable.
    3. Disable the NameNode HDFS Pending Deletion Blocks as this value is not relevant when IBM Spectrum Scale is integrated. From HDFS panel > Alert > NameNode > HDFS Pending Deletion Blocks > State:Enabled > Confirmation panel > Confirm Disable.
Important:
  • Restart all affected components with Stale Configs when the dashboard displays the request.
  • If any configuration in the gpfs-site is changed in the IBM Spectrum Scale dashboard in Ambari, a restart required alert is displayed for the IBM Spectrum Scale service and the HDFS service. Check your environment to ensure that the changes made are in effect.
  • IBM Spectrum Scale service must be restarted and only then can the HDFS service be restarted.