Setting up Network Performance Insight cluster

Use the Ambari installation wizard in your browser to complete your installation, configuration, and deployment of Network Performance Insight® components and Hadoop components.

Before you begin

  • Ensure that you have the SSH Private key for root user on Ambari server host.
  • Ensure that you have configured the SSH Passwordless login entry to all target hosts.

Procedure

  1. Open a browser and access the Ambari server dashboard.

    Use the following default URL:
    http://<myserver.ibm.com>:8080

    The default user name is admin, and the default password is admin.

  2. Click Launch Install Wizard on the Ambari Welcome page.

    The CLUSTER INSTALL WIZARD opens.

  3. Enter a name for the cluster you want to create on the Get Started page and click Next.
    Note: The name cannot contain blank spaces or special characters.
    For example, npi.
  4. On the Select Stack page, select HDP-2.6.NPI stack and select the Use Public Repository option option.
  5. Click Next.
  6. Complete the following steps on the Install Options page:
    1. List all the nodes that are used in the HDP® cluster on Target Hosts pane.
      Specify one node per line, as in the following example:
      
      node1.abc.com
      node2.abc.com
      node3.abc.com
      
      Note: The host name must be the fully qualified domain name (FQDN).
    2. Select Provide your SSH Private Key to automatically register hosts on Host Registration Information pane.

      If the root user installed the Ambari server, the private key file is /<root>/.ssh/id_rsa. Where <root> is the root user home directory.

      You have two options to get the private key file:
      1. Browse to the location of the .ssh/id_rsa

        Or

      2. Copy the contents of the .ssh/id_rsa file and paste the contents in the SSH key field.
      Make sure to copy all the content from:
      -----BEGIN RSA PRIVATE KEY-----
      
      To
      -----END RSA PRIVATE KEY-----
    3. Click Register and Confirm.
  7. Ensure that the correct hosts are registered successfully on the Confirm Hosts page.
    If you want to change the hosts that are selected, remove the hosts one-by-one by following these steps:
    1. Click the check box next to the server to be removed.
    2. Click Remove in the Action column.
      Note:
      • If warnings are found during the check process, click Click here to see the warnings to see the warnings. The Host Checks page identifies any issues with the hosts. For example, a host might have Firewall issues.
      • Ignore the process issues that are not related to Network Performance Insight.
    3. After you resolve the issues, click Rerun Checks on the Host Checks page. After you have confirmed the hosts, click Next.
  8. Select the following services on the Choose Services page:
    Service Version Description
    HDFS 2.7.3 Apache Hadoop Distributed File System (HDFS)
    YARN + MapReduce2 2.7.3 Apache Hadoop NextGen MapReduce (YARN)
    ZooKeeper 3.4.6 Centralized service that provides reliable distributed coordination.
    Ambari Metrics 0.1.0 A system for metric collection that provides storage and retrieval capability for metrics that are collected from the cluster.
    Kafka 0.10.1 A high-throughput messaging system.
    NPI 1.3.0.0 Network Performance Insight cluster service
    NPI Spark Client Scala 2.11 2.0.1 Apache Spark is an engine for large-scale data processing. The Apache Spark client library is compiled on Scala 2.11 and is specific to Network Performance Insight 1.3.
  9. Click Next.
  10. Assign the master services to hosts in your cluster on the Assign Masters page and click Next.

    You can accept the current default assignments. To assign a new host to run services, click the list next to the master node in the left column and select a new host.

  11. Click Next.
  12. Assign the slave and client components to hosts in your cluster on the Assign Slaves and Clients page.
    Click all to assign all the services on your hosts. Or, you can select one or more components next to a selected host.
    Note: If you do not need a microservice based on your installation scenario, do not select the check box against the service on a host.
  13. Click Next.
  14. Update the configuration settings for the following services and components on Customize Services pane.
    You can see a set of tabs from where you can manage configuration settings for Hadoop and Network Performance Insight components.
    Note: Default values are completed automatically when available and they are the recommended values.
  15. Click Next after you have reviewed your settings, and completed the configuration of the services.
  16. Verify that your settings are correct and click Deploy on the Review page.
  17. See the progress of the installation on Install, Start, and Test page.

    The progress bar at the top of the page gives the overall status and the main section of the page gives the status for each host. When you click the task, log for a specific task can be displayed.

  18. Click Next after the services are installed successfully.
  19. Review the completed tasks on the Summary page and click Complete.

Results

It might take a while for Ambari to start all the services. To see the status of all the services in a host, click the Hosts tab in the Ambari server host, and then select a host. You can see the services that are started from the Summary page.