Setup

This section gives the setup information for Hortonworks Data Platform (HDP) and IBM Spectrum Scale Hadoop integration support.

Local Repository server

Set up a local repository server to be used for Ambari, IBM Spectrum Scale, and for the OS repository.

1. Set up the Mirror repository server.
2. Set up the Local OS repository if needed.

Base packages

The following packages must be installed on all IBM Spectrum Scale nodes:

$ yum -y install kernel-devel cpp gcc gcc-c++ binutils

For more information, see IBM Spectrum® Scale Software requirements topic in the IBM Storage Scale: Concepts, Planning, and Installation Guide.

HDP packages:

• Install libtirpc-devel package (From RH optional packages) on all nodes.
• MySQL community edition

  For new database install option through HDP for Hive Metastore, the MySQL community would require internet access or have a local repository setup to deploy on the Hive Metastore host. For more information, see MySQL Community Edition repository.

The following recommended packages can be downloaded to all nodes:

acl, libacl – to enable Hadoop ACL support

libattr – to enable Hadoop extended attributes

java-<version>-openjdk-devel – Development tool-kit required for short circuit

Some of these packages are installed by default while installing the operating system.