IBM Streams 4.3.0

Upgrading when Apache Hadoop YARN is used

If you are using resources that are managed by YARN, use these procedures to install IBM® Streams Version 4.3.0.

Any resources that are managed by the default IBM Streams resource manager are also upgraded.

Restriction: The rolling upgrade option is not supported for Apache Hadoop YARN.

Before you begin

Ensure that you satisfy the following requirements:

To upgrade the product, you must be the installation owner or have root authority. If you are installing the product as a root user, you must select the same installation owner as the previous version when prompted.
You must complete this procedure on all resources that have the main installation package installed. This package includes all of the product files. Additional resources with the resource installation package or domain host installation package installed are automatically updated. IBM Streams provisions all updates to these additional resources in the domain.
Important: For the upgrade and automatic resource updates to work correctly, you must install the new version in the same root directory as the previous version.

About this task

When you install the product in the same root directory as the previous version, IBM Streams creates a new version directory for the installation. The version directory for the previous installation is not removed.

If an X Window System is installed, the default mode for upgrading IBM Streams is interactive GUI. Otherwise, the default mode is interactive console.

Procedure

Download the Version 4.3.0 installation package from the IBM Passport Advantage® website. For information about downloading IBM Streams Version 4.3.0, see the Download Document.
Install IBM Streams on all resources that have the main installation package installed by using one of the following procedures:
After installing IBM Streams, complete the following steps:
1. Configure the IBM Streams environment variables for the new version by entering the following command:
```
source product-installation-root-directory/product-version/bin/streamsprofile.sh
```
  Note: If you added the source command for the previous version to the .bashrc or /etc/profile.d file, update the version directory in those files.
2. Optional: Set the instance.startAsVersion and domain.determineInstanceStartAsVersion version management properties. For more information about these properties, see Version management and rolling upgrade options.
Stop the applications, instances, and domains that are using the installation.
1. Stop all applications. Applications include the Domain Manager, Streams Console, Streams Studio, and any other applications that are using the current installation.
2. Stop all instances by using the streamtool stopinstance command.
3. Stop all domains by using the streamtool stopdomain command.
For better streamtool performance, clear the streamtool Java cache. For more information, see Java cache for IBM Streams streamtool command operations.
Install the resource installation package on the externally managed resources.
1. Stop the YARN application master by entering the following command:
```
$STREAMS_INSTALL/bin/streams-on-yarn stop --zkconnect host:port -d domain-id
```
2. Start the YARN application master by entering the following command:
```
$STREAMS_INSTALL/bin/streams-on-yarn start --zkconnect host:port -d domain-id --deploy
```
  Notes:
  - The --zkconnect option specifies the name of one or more host and port pairs for the configured external ZooKeeper ensemble. If you specify multiple host and port pairs, separate each pair with a comma. This value is the external ZooKeeper connection string. If the STREAMS_ZKCONNECT environment variable is set to this value, you do not need to specify the --zkconnect option on the command. To obtain this value, you can use the streamtool getzk command.
  - The -d option specifies the domain identifier. If the STREAMS_DOMAIN_ID environment variable is set to this value, you do not need to specify the -d option on the command.
  - The --deploy option enables you to take advantage of the IBM Streams provisioning features. When you specify this option, YARN copies and extracts the installer for each container. To avoid timeout issues, ensure that the value of the IBM Streams domain.serviceStartTimeout property is at least 300 seconds before you start the domain.
    To view domain properties, use the streamtool getdomainproperties command. To update properties, use the streamtool setdomainproperties command. For more information about domain properties, use the streamtool man domainproperties command.
Upgrade the domain by starting it with the new version. To start the domain with the new version, you can use the Domain Manager or enter the following command:
```
streamtool startdomain -d domain-id
```
IBM Streams completes the following operations when upgrading the domain:
1. Provisions all updates to additional resources in the domain that have the resource installation package or domain host installation package installed.
2. Restarts the domain controller service.
3. Restarts the domain services with the new version.
Instances in the domain continue to run using the installation of the previous version.
Upgrade the instances in the domain by starting the instances with the new version. To start an instance with the new version, you can use the Streams Console, Streams Studio, or the following command:
```
streamtool startinstance -d domain-id -i instance-id
```
Verify that the upgrade is successful by entering the following commands:
```
streamtool getdomainstate --long
```
If the installation is successful, the new version is the active version. In the version column of the command output, an asterisk (*) indicates which version is active.
```
streamtool lsinstance --long
```
If the upgrade is successful, the new version is listed in the Version column.