Preparing for a multi-node deployment

Make a file system

For each disk that you added on node0 and node1, you must make a file system.

You can use any suitable file system for your disks. Ext4 and XFS are two popular Linux file systems. The choice between Ext4 and XFS depends on your preferences and the specific needs of your system. Ext4 is a good choice for most systems, but if you need a more reliable file system, XFS might be a better option.

• Here are examples of using the ext4 file system.

  • On node0 (instana-0), you can use the following command to make a single file system:

    for disk in vdb ; do
        echo "make filesystem for $disk"
        mkfs.ext4 -m 0 -E lazy_itable_init=0,lazy_journal_init=0,discard /dev/$disk
    done
    

  • On node1 (instana-1), you can use the following command to make three file systems:

    for disk in vdb vdc vdd ; do
        echo "make filesystem for $disk"
        mkfs.ext4 -m 0 -E lazy_itable_init=0,lazy_journal_init=0,discard /dev/$disk
    done
    

• Here are examples of using the xfs file system.

  • On node0 (instana-0), you can use the following command to make a single file system:

    for disk in vdb; do
        echo "make filesystem for $disk"
        mkfs.xfs -f -i size=1024 -L $disk /dev/$disk
    done
    

  • On node1 (instana-1), you can use the following command to make three file systems:

    for disk in vdb vdc vdd; do
        echo "make filesystem for $disk"
        mkfs.xfs -f -i size=1024 -L $disk /dev/$disk
    done
    

Create the directories

On your host, make sure that you create the four directories. See Hardware requirements.

The following example commands use the default directory paths. You can create the directories in any location of your choice. However, make sure that you use the correct path when you mount the directories.

• On node0 (instana-0), create the objects directory:

  mkdir -p /mnt/instana/stanctl/objects
  

• On node1 (instana-1), create the following three directories:

  mkdir -p /mnt/instana/stanctl/data
  mkdir -p /mnt/instana/stanctl/metrics
  mkdir -p /mnt/instana/stanctl/analytics
  

Add mount paths

You must add mount paths to the directories that you created.

First, replace the device names with their UUIDs (Universally Unique Identifiers) in the file system table (fstab) files on node0 (instana-0) and node1 (instana-1). For more information, see Update fstab file with UUIDs.

Then, as a precaution, take a backup of your fstab files before you create the mount paths. Run the following command on node0 (instana-0) and node1 (instana-1).

cp /etc/fstab /etc/fstab.backup

The following example commands use the default mount paths and the disks that we used as examples in the previous sections. The commands might vary based on your environment. Also, if you created the directories in custom paths, make sure to use those paths.

If you created custom mount paths, make sure to add the --volume-<directory-name> flag to the stanctl up --multi-node-enable command when you install your Self-Hosted Standard Edition. For example, if you added /data/analytics as the mount path, then use stanctl up --multi-node-enable --volume-analytics /data/analytics.

• Ext4 example commands.

  • Commands for node0 (instana-0).

    echo "UUID=<device_vdb_uuid>  /mnt/instana/stanctl/objects    ext4    discard,defaults,nofail        0 0" >> /etc/fstab
    

  • Commands for node1 (instana-1).

    echo "UUID=<device_vdb_uuid>  /mnt/instana/stanctl/analytics  ext4    discard,defaults,nofail        0 0" >> /etc/fstab
    echo "UUID=<device_vdc_uuid>  /mnt/instana/stanctl/metrics    ext4    discard,defaults,nofail        0 0" >> /etc/fstab
    echo "UUID=<device_vdd_uuid>  /mnt/instana/stanctl/data       ext4    discard,defaults,nofail        0 0" >> /etc/fstab
    

• XFS example commands.

  • Commands for node0 (instana-0).

    echo "UUID=<device_vdb_uuid>  /mnt/instana/stanctl/objects    xfs   discard,defaults,nofail    0 0" >> /etc/fstab
    

  • Commands for node1 (instana-1).

    echo "UUID=<device_vdb_uuid>  /mnt/instana/stanctl/analytics  xfs   discard,defaults,nofail    0 0" >> /etc/fstab
    echo "UUID=<device_vdc_uuid>  /mnt/instana/stanctl/metrics    xfs   discard,defaults,nofail    0 0" >> /etc/fstab
    echo "UUID=<device_vdd_uuid>  /mnt/instana/stanctl/data       xfs   discard,defaults,nofail    0 0" >> /etc/fstab
    

Verify the mount paths

Verify that the directory is mounted on the correct disk. See Prepare the additional disks to get the device name.

lsblk <device name>

Mount the file systems

Mount all the file systems. Run the following command on node0 (instana-0) and node1 (instana-1).

mount -a

DNS settings

For the required DNS settings, see DNS settings of single-node deployment.

In multi-node clusters, the base domain points to the public IP address of node0 (instana-0). For more information about the public IP address requirement, see IP addresses.

Firewall rules

Certain Linux distributions might have potential conflicts or restrictions that the firewall imposes. These conflicts might impact network communication and service discovery that are necessary for the installation. Therefore, if your firewall is open, add the required ports and rules to it.

If you have an external firewall, see the firewall documentation for information on how to open ports.

For Standard Edition deployment on Amazon Web Services (AWS), you must open all the ports in the security group even if the firewall is disabled.

Complete the following steps to open the required ports:

• On Ubuntu hosts, run the following commands on all nodes. Use the IP addresses of the nodes in the commands.

  ufw allow 22/tcp
  ufw allow 80/tcp
  ufw allow 443/tcp
  ufw allow 8443/tcp
  ufw allow from <node0 (instana-0) IP> to any port 22 proto tcp
  ufw allow from <node0 (instana-0) IP> to any port 6443,10250,2379,2380,5001,9443,53 proto tcp
  ufw allow from <node0 (instana-0) IP> to any port 8472,53 proto udp
  ufw allow from <node1 (instana-1) IP> to any port 6443,10250,2379,2380,5001,9443,53 proto tcp
  ufw allow from <node1 (instana-1) IP> to any port 8472,53 proto udp
  ufw allow from <node2 (instana-2) IP> to any port 6443,10250,2379,2380,5001,9443,53 proto tcp
  ufw allow from <node2 (instana-2) IP> to any port 8472,53 proto udp
  ufw allow from 10.42.0.0/16 to any
  ufw allow from 10.43.0.0/16 to any
  ufw allow in on lo
  ufw allow out on lo
  ufw reload
  

• On Debian, Red Hat Enterprise Linux, CentOS Stream, Amazon Linux, Oracle Linux, and SUSE Linux Enterprise Server (SLES) hosts, run the following commands on all nodes. Use the IP addresses of the nodes in the commands.

  firewall-cmd --permanent --add-port=22/tcp
  firewall-cmd --permanent --add-port=80/tcp
  firewall-cmd --permanent --add-port=443/tcp
  firewall-cmd --permanent --add-port=8443/tcp
  firewall-cmd --new-zone=internal-access --permanent
  firewall-cmd --permanent --zone=internal-access --add-source=<node0 (instana-0) IP>
  firewall-cmd --permanent --zone=internal-access --add-source=<node1 (instana-1) IP>
  firewall-cmd --permanent --zone=internal-access --add-source=<node2 (instana-2) IP>
  firewall-cmd --permanent --zone=internal-access --add-port=22/tcp
  firewall-cmd --permanent --zone=internal-access --add-port=6443/tcp
  firewall-cmd --permanent --zone=internal-access --add-port=10250/tcp
  firewall-cmd --permanent --zone=internal-access --add-port=2379/tcp
  firewall-cmd --permanent --zone=internal-access --add-port=2380/tcp
  firewall-cmd --permanent --zone=internal-access --add-port=5001/tcp
  firewall-cmd --permanent --zone=internal-access --add-port=8472/udp
  firewall-cmd --permanent --zone=internal-access --add-port=9443/tcp
  firewall-cmd --permanent --zone=internal-access --add-port=53/udp
  firewall-cmd --permanent --zone=internal-access --add-port=53/tcp
  firewall-cmd --permanent --zone=trusted --add-source=10.42.0.0/16
  firewall-cmd --permanent --zone=trusted --add-source=10.43.0.0/16
  firewall-cmd --permanent --zone=trusted --add-interface=lo
  firewall-cmd --reload
  

Configuring an HTTP proxy

Define the HTTP_PROXY, HTTPS_PROXY, and NO_PROXY environment variables.

When you run the stanctl up --multi-node-enable command to install the Standard Edition, the installation automatically uses the environment variable values from the current shell.

For more information about setting these variables, see Configuring an HTTP proxy in a single-node deployment.

nm-cloud-setup utility on RHEL and CentOS Stream hosts

On Red Hat Enterprise Linux and CentOS Stream hosts, if nm-cloud-setup is enabled, you must disable it on each node and reboot the nodes.

For the commands that you need to run on each node, see nm-cloud-setup utility for single-node clusters.