Installing IBM Spectrum LSF Suite for HPC on a single host

Install IBM Spectrum LSF Suite for HPC on a single host as proof of concept.

About this task

Install the IBM Spectrum LSF Suite for HPC LSF management host, GUI server host, database host, LSF Web Services hosts (available starting in Fix Pack 15), and LSF suite installation repository on a single host. Use this simple configuration as a proof of concept for your cluster.

In this task, you learn how to customize the cluster name, set up the roles on the host and how to verify your installation.

1. Log in as root to the host you want to install on, and change to the /opt/ibm/lsf_installer/playbook directory to customize the installation.
   1. Edit the lsf-inventory file to set up host roles for your cluster:

      LSF_Masters, GUI_Hosts, LSF_WebService, and DB_Host

      The name of the single host for the installation.

      LSF_Servers and LSF_Clients

      These options are a subset of the LSF_Masters role, so you can leave these options empty.

   2. Edit the lsf-config.yml file to set the cluster name and other properties.
      For example,

      LSF
        # Set my_cluster_name to the name of the cluster.
        my_cluster_name: cluster1
      ...
      

      Remember: Make sure to maintain the indentation in the lsf-config.yml

      Note: In version 10.2.0.9 and later, to install Kibana for use with Elasticsearch, set the parameter Install_Kibana: True. Kibana will be installed on the first GUI_Host defined in lsf-inventory.

      For a single-machine installation, you do not need to specify a shared directory (HA_shared_dir). Leave system monitoring enabled (Enable_Monitoring: True). The single host is also used as the database host, so do not set the JDBC_string option.

2. After you set up the lsf-inventory and lsf-config.yml files, run two pre-installation tests.
   1. Check the configuration file, and correct any errors.

      ansible-playbook -i lsf-inventory lsf-config-test.yml

   2. Run the pre-deployment test.

      ansible-playbook -i lsf-inventory lsf-predeploy-test.yml

      This test runs on each host to check network connectivity and host name resolution, minimum disk space, and available memory. The test takes a few minutes to run.

   Correct any errors from the tests and run them again before you run the installation.
3. Run the installation with the lsf-deploy.yml playbook to deploy your cluster.

   ansible-playbook -i lsf-inventory lsf-deploy.yml

   Note: By using the '--limit' option, new LSF_Servers can be installed and existing LSF_Servers can be reinstalled.

   ansible-playbook -i lsf-inventory --limit {Some Host or hosts} lsf-deploy.yml

   When the installation is finished, it gives you a URL for the IBM Spectrum LSF Suite for HPC portal and a URL for the LSF Web Services API endpoint.

   For example,

   http://hosta.company.com:8080
   https://hosta.company.com:8448

   where hosta is the host with your installation.
4. Run some commands to verify the installation.
   1. Log out of the deployer host, and log in to a host in the cluster.
   2. Run the lsid to see your cluster name and management host name.

      lsid
      IBM Spectrum LSF 10.1.0.3, Sep 13 2017
      Suite Edition:  IBM Spectrum LSF Suite for HPC 10.2.0
      Copyright International Business Machines Corp, 1992-2017.
      US Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
      
      My cluster name is cluster1
      My master name is hosta

   3. Run the lshosts command to see that the single host belongs to your cluster.

      lshosts hostA
      HOST_NAME      type    model   cpuf ncpus   maxmem  maxswp  server RESOURCES 
      hosta        X86_64  Intel_EM  60.2    16   255.8G    3.9G    Yes  (mg)

   4. Run the bhosts command to check that the status of the host is ok, and the cluster is ready to accept work.

      bhosts
      HOST_NAME          STATUS       JL/U    MAX  NJOBS    RUN  SSUSP  USUSP    RSV
      hosta              ok              -     16     0       0      0      0      0

5. Log in to the GUI as the lsfadmin user.

   If the lsfadmin user was created by the installation and did not exist in your system, you might need to create a password for lsfadmin with the passwd command.

   1. Open your browser and enter the GUI portal URL from the installation.
   2. Log in with the lsfadmin user or any other user that you know exists.
   On the Resources > Dashboard page, you can see the single host that you deployed to.