Version 1.0.19.2 release notes (November 2019)
Version 1.0.19.2 replaces versions 1.0.19.0 and 1.0.19.1, providing a fix for GPFS upgrade issues. Apart from this hotfix, the 1.0.19.2 release contains the same set of features, improvements, and fixes that were included in 1.0.19.0.
- If you already are on version 1.0.19.0 or 1.0.19.1, there is no need to upgrade to any version other than 1.0.19.7 or newer.
- Integrated Analytics System model M4002-001 uses a different software bundle than the regular rack-provided IAS models. If you are using this model, see Version 1.0.19.0 release notes for M4002-001 model (March 2020)
What's new
- Rack expansion
- The following options are available:
- From M4002-003 to M4002-006
- From M4002-006 to M4002-010
- From M4002-010 to M4002-010S
- From M4002-010S to M4002-020S
- Security
-
- The
rootuser lock-down for IAS appliance can be disabled by raising a PMR request.Attention: On disablingrootlock-down, therootuser has all the privileges to update the operations on the appliance. Improper handling of the appliance by therootuser might lead to system instability, downtime, or other incidents. IBM Corporation is not liable for any such incidents.
- The
- Migration tools
-
- db_migrate
- Added support for migration to Db2 tables with hidden columns: hidden columns are automatically skipped and ignored.
- Restored support for MIXED format.
- db_migrate_iias
- Improved performance by:
- Parallel unload of tables to multiple nodes in source machine with
-strategy partitionsparameter. The-strategy partitionsparameter uses all MLNs to unload data, so the number of inserts is high. You can also use-strategy dataslices, which allows you to control the number of inserts with the--max-insertsparameter. - Parallel loading to multiple nodes on target IAS. You can now specify multiple hosts (within the
same IAS) with the
thostsparameter. If a node is not responding, it is skipped and the workload is shared on the remaining nodes. If all nodes are unavailable, migration fails. With this change, the-targetoption no longer accepts thehostparameter. You must always specify the-thosts|-thostoption.
- Parallel unload of tables to multiple nodes in source machine with
- Added support for migration from and to Db2 tables with hidden columns: hidden columns are automatically skipped and ignored
- Added support for binary data transfer with
-binary. - Added support for LZ4 compression of migrated data with
-compress LZ4parameter.
- Improved performance by:
- dbsql
-
- Added support for case sensitive, camel case schema names.
- Platform Management
- A new tool apsnmpagent is available for enabling and disabling SNMP interface. You can use it to configure IAS to send hardware information via SNMP traps. For more information see Enabling the SNMP interface to retrieve hardware information.
- Backup and restore
-
- For restoring from a multi-path database backup, added a check to make sure that all the required paths are specified.
- Any database admin user should now be able to run backups and restores using db_backup and db_restore scripts respectively.
- db_backup now gives out the following return codes (rc):
- 0 upon success.
- 1 upon failure.
- Added checks for schema/table restore with db_restore to make sure that the backup directories have the right permissions/ownership to read the backup files.
- db_backup now allows multiple schema backups using -schema
or -schemafile options:
If using -schema option, the schema names must be separated by a space, for example:
If using -schemafile option, specify the absolute path to the file that contains schema names separated by new line. Example:-schema S1 S2 S3
Example of the schema_names.txt:-schemafile /scratch/schema_names.txtS1 S2 S3 S4 S5You can specify any number of schema names using either of these options, but maximum three schemas can run in parallel, while the remaining ones wait in the queue. Each of these schema backups is associated with its own timestamp.
- db_backup now allows schema backups to multiple paths using
-path option. Make sure that the paths do not share the same underlying storage or
the filesystem. For example,
/scratch/backup1and/scratch/backup2cannot be used because they share the same underlying filesystem/scratch.You can also use db_restore to restore a schema or tables from multiple paths using -path option:- If using the same paths for restore and for backup, you must provide the paths in the same order as at the end of the backup. Run db_backup -history to find out path order.
- If using different paths for restore, make sure that the backup directory structure, data/metadata files in the backup and their ownership/permissions are not altered or tampered.
- The backup and restore logs now record the following details:
- the db_backup and db_restore commands with its arguments
- the user ID (UID)
- the effective user ID (EUID)
- the backup/restore process ID (PID)
- For schema level backups, db_backup now supports a new option -format binary to back up the table data in the binary format. If -format option is not specified, by default the table data files are generated in text format.
Components
Integrated Analytics System version 1.0.19.0 includes the following components:- Db2 Warehouse v. 3.10
- Maintenance release with no new features. See What's New in IBM Db2 Warehouse.
- Db2 Engine v. 11.1 (latest update)
-
- Support for SQL Server 2017 data sources has been added to Db2 Warehouse's federation capability.
- The STATSPROFTYPE column has been added to the ADMIN_GET_TAB_INFO table.
- Passing UNI_SIMPLE as the locale name now results in simple case-folding, as described in https://www.ibm.com/support/knowledgecenter/en/SSEPEK_11.0.0/sqlref/src/tpc/db2z_bif_upper.html.
- IBM Data Replication for Availability v. 1.2
-
- External SAN or NFS storage can now be used for Db2 transient logging to support replication in IBM Integrated Analytics System for workload volumes that might exceed the capacity of the disk space from /scratch.
- Replication is now enabled for tables with no primary key, unique constraint, or unique index at the target. In these cases, replication creates its own key that includes all valid columns in the table; however, this type of key can impede performance and it is recommended that you provide some kind of uniqueness for replicated tables, which can include the use of a hidden identity column.
- Support for Active Directory.
- DSX - Watson Studio Local
- DSX is no longer pre-installed starting with IAS version 1.0.19.0. Any existing installations
will continue to be supported until you transition to Watson Studio Local. IAS 1.0.19.0 entitles you
to five user licenses for Watson Studio Local, to be installed on your own hardware. For more
information on the product, see Watson Studio Local Knowledge Center.If you have DSX pre-installed, and you are using it:
- IBM recommends that you leverage Watson Studio Local on a separate hardware for reasons of scalability.
- IBM Support can help transition you to Watson Studio Local.
- IBM recommends that you open a support tickets to uninstall it.
- You are still entitled to five user licenses for Watson Studio Local, to be installed on your own hardware.
Note: If you want to disable DSX, you have to uninstall it. To uninstall DSX, run ./InstallPackages/utils/uninstall.sh from the directory where install was run. Usually, the install directory is located in /opt/ibm/appliance/storage/platform. If you can't find the directory, contact IBM Support.
Resolved issues
- Fixed the issue with GPFS that was not upgraded during IAS upgrade.
- Defects addressed in Db2 Warehouse:
- LDAP should have TLS 1.2 as minimum allowed version
- After ap upgrade to 1.0.16.0, DB2 services are not coming up, causing HA management and Db2 to go down.
- Fixed the issue with hidden columns in IBM Data Replication for Availability: when creating a target table a hidden identity column on source was not created as hidden on target.
- Web console component includes fixes for the following issues:
- Backup and restore could not be launched from console
- Console configuration files might be corrupted sometimes
- User provided certificate is lost after console is upgraded
- Large sort memory and tablespace consumption in console utility event monitor query
- Granular backup and restore object ownership fixes.
- Fixed the issue with incremental database backup: updated db_backup to estimate the increase in database size since the last full online backup and then compare if the given backup path has enough space to accommodate the backup, instead of comparing it with the entire database size.
- Fixed a bug in db_restore, to allow database restore from multiple paths
specified with a space ( ), or a comma (,), or both, a comma and a space (, ) as separators. Examples:
-path p1,p2-path p1 p2-path p1, p2
- Fixed a bug in db_backup, to avoid creating multiple database backups under
the same directory. Now, every database backup has its own unique directory
backup_<type>_<number>. - Updated db_backup script to create backup directories as db2inst1 or database
admin user, to allow users to delete schema backups without root access.
During schema backup, if the db2inst1 or the database admin user doesn't have the right permissions to create backup directories in the given path, then the directories are created with a root user and a warning is displayed. Note that root access is required to remove them.
- Fixed
db_backup -historycommand not to throw a Traceback error when run during an offline backup or any restore operation. However, this command cannot return history results when the database is down during any offline operation. - The list of Red Hat CVEs patched in 1.0.19.0 release:
CVE-2018-10911 CVE-2019-11477 CVE-2019-11478 CVE-2019-11479 CVE-2019-10161 CVE-2019-10166 CVE-2019-10167 CVE-2019-10168 CVE-2019-10160 CVE-2019-12735
Known issues
- After schema level restore permissions of objects are changed
- A PUBLIC create privilege is added in schema ownership after schema level restore.
Workaround:
REVOKE CREATEIN ON SCHEMA SchemaName FROM PUBLIC BY ALL - Misleading Backup failed message on the web console
- When running backup from the web console, a Backup failed message is displayed even when the backup finished successfully. You can check the backup history in the console, or run db_backup -history to verify if the backup actually failed.
- Guardium configuration fails at apinit
- When configuring IBM Guardium, apstop might fail but the process continues with apinit, resulting in error.
- Problems with static routing
-
- While adding a static route with apsetup, most nodes lose their fbond/mbond network interfaces. You must bring up bonded interfaces manually.
- Deleting a static route with apsetup only deletes it on the current node.
- The About window in the web console displays HTTP Error 400 message instead of system information.
- Log in to the web console and select the user icon from the top bar, then select About. The error message is displayed.
- The
db_backup -historycommand cannot return history results when the database is down during any offline operation. - IBM Spectrum Protect backups fail with Kernel issues
-
When using the IBM Spectrum Protect client for backup and restore, the Kernel issues might occur, which cause the backups to fail.
Workaround:- Edit all dsm.sys files in
/opt/ibm/appliance/storage/head/tsm/api/node010X-fab, where X is a node number.
Add the following lines to all these dsm.sys
files:
tcpbuffsize 512 tcpwindowsize 1024 tcpnodelay no - Start the backup again.
- Edit all dsm.sys files in
/opt/ibm/appliance/storage/head/tsm/api/node010X-fab, where X is a node number.
Add the following lines to all these dsm.sys
files:
- EMC NetWorker backup/restore fails
- EMC NetWorker backup/restore fails with SQL2062N. An error occurred while accessing the
/usr/lib/libnsrdb2.somedia. Reason code is 0. This is occurring due to two parameters that are added in the nmda_db2.cfg file on each node.WORKAROUND:- As the
rootuser, edit the /nsr/apps/config/nmda_db2.cfg file and comment out theNSR_LIBNSRDB2_DEBUG_LEVEL=9andNSR_DEBUG_LEVEL=9parameters. This must be done on every node in the container. - Rerun backup/restore.
- As the
- Backup and restore
- The -compress lz4 option is not supported for backup and restore.
- Fibre channel switch replacements
-
If a Fibre Channel (FCSW) switch was replaced on an IAS system that now runs software version 1.0.19.0 or lower, the upgrade to 1.0.19.2 might fail. The failure is caused by an incompatibility with newer fibre channel switch firmware (8.2.1c) and switch configurationm and an older IAS software.
WORKAROUND:
When you're upgrading from versions 1.0.19.0 and lower to 1.0.19.2 on systems where the FCSW was replaced, use the--skip-firmware --skip-pfs-postinstalloption with the upgrade command. Example:apupgrade --upgrade --use-version 1.0.19.2_release --upgrade-directory /localrepo --skip-firmware --skip-pfs-postinstall