Readme and Release notes for release 4.2.3.6 IBM Spectrum Scale 4.2.3.6 Spectrum_Scale_Protocols_Advanced-4.2.3.6-ppc64LE-Linux Readme

Unless specifically noted otherwise, this history of problems fixed for IBM Spectrum Scale 4.2.x applies for all supported platforms.

Problems fixed in IBM Spectrum Scale 4.2.3.6 [November 30, 2017]

• Fix an issue in the AFM environment where AFM prefetch causes daemon assert if the directories are deleted after the prefetch queueing IJ00977.
• Fix potential issue with cesiplist file updates in ccr that can result in messages like "cesiplistLocalSerial is not numeric: ()" IJ02158.
• This fix excludes hidden CCR files from the scheduled callhome data collection IJ00977.
• Fix code to avoid long running CCR synods on different quorum nodes causing long running GPFS 'mmgetstate -a' command IJ00977.
• This fix respects the mmdelsnapshot -N option when resuming DeleteRequired snapshot IJ02220.
• Fix a rare assert that can occur during metanode takeover due to a stalled indirect block left in the cache IJ00977.
• Fix a deadlock caused by the allocation region requests handler. Users would see long waiters on allocation manager cursors when deadlock happens IJ01063.
• Address a problem where failbackToPrimary --start command tries to delete any later snapshots than the latest snapshot present at the old primary end. But when that snapshot is not present at the acting primary - we need to handle the error rather than ignoring and continuing the failback command IJ00977.
• Fix an inode count leak problem which may happen when gpfs_iwrite/gpfs_iwritex API fails with ESTALE, tsrestorefileset utility uses this GPFS API IJ00977.
• Fix hangs and timeouts that occur during snapshot commands in rare failure cases IJ01335.
• Fix a problem where the close issued on a remote NFS mount can get stuck and causes an unlink of an AFM fileset to get stuck IJ00977.
• Fix the assert issue on generation number when flushing or writing indirect blocks. This issue only happens when the clone files were used and deleted IJ00977.
• Fix a disk address assert that can occur when a thread reads a compressed region of a file at the same time when a different node uncompresses the same region IJ00977.
• Fix a vectored DIO (writev/readv) dead lock which may happen if the filesystem is being quiesced IJ00977.
• Fix a potential infinite loop when reading a compressed file with alternating compressed and uncompressed regions IJ00977.
• Add specific handling of SKLM error messages in case a required configuration parameter in the SKLMConfig.properties file is missing. Add a more detailed error message from mmkeyserv command in case a configuration parameter is wrong or missing IJ00977.
• Fix a potential snapshot file data corruption that can be caused by a crash occurring when a compressed file is being deleted from the active file system or a snapshot IJ00977.
• Fix a NULL buffer pointer dereference problem by adding synchronization for accessing the buffer pointer IJ00977.
• Fix a problem in disk verification that wrongly calculated on disk stripe group descriptor checksum IJ01325.
• Fix a potential E_HOSTDOWN (80) error when a compressed file is being appended while the node is the process of becoming a metanode at the same time IJ00977.
• Fix an issue in the AFM environment where recovery fails with error 112 while checking for the deleted directories IJ00977.
• Fix the no space issue when running mmchdisk start command. A similar issue can happen on normal writes IJ01065.
• Add more provision to catch a case where a Queue item is becoming NULL when IO is happening to the fileset and the queue is being flushed IJ00977.
• Fix an assert that can occur when xattrs is heavily used and there is an unusual block size setting IJ00977.
• An inaccurate and unnecessary assert in buffer bitmap processing is removed IJ00977.
• Fix wrong fs struct error format IJ00977.
• Fix a deadlock situation involving lock conflict while stealing a buffer for file system metadata repair IJ00977.
• Fix a logic bug which may cause a log recovery to fail with E_RECOV_INCOMPLETE (code 234), this problem can happen on PARALLEL_LOGRECOVERY enabled builds (since GPFS 4.2.1) if log file size is bigger than 16MB IJ00977.
• Add a debugging utility to calculate checksum values of disk data IJ00977.
• Fix a problem in which mmgetstate -s may not display the correct number of quorum nodes defined in the cluster IJ01064.
• Fix a signal 7 that can occur when a compressed file is expanded in hyper allocation mode IJ00977.
• Address a problem where re-applyupdates should not invoke failbacktoprimary --start when failbacktoprimary --stop is failed due to changes that are detected at acting primary IJ00977.
• Fix assert "'false' failed" in paxosserver.C:3129 in the GPFS daemon (CCR) that happened during GPFS startup IJ00977.
• Fix an issue in the AFM environment where deleting directories from .ptrash directory fails with directory not empty error. This issue happens when the directory is deleted from home before readdir is performed at cache IJ01066.
• In a dump file, the dump directory size was incorrectly reported as PB when the unit is TB. The problem is now fixed IJ00977.
• Fix a problem in which AIX/NFS servers deadlock trying to recover a client's fcntl lock following the loss of another node in the same cluster IJ01068.
• Fix a problem in which the prefetch command did not work on a special character (--) named file IJ01067.
• When the read or write of a log vdisk fails during rebuild operation, use the IO error code to trigger resignation, as opposed to using E_OK IJ00977.
• Fix a potential assert that can occur when a compressed file is being closed after having been deleted and any compressed compression group within the file was partially copied (COW) before the file deletion IJ00977.
• This fix supports callbacks with long list of parameters IJ01069.
• With this fix the output of mmsmb export list -Y and mmsmb config list -Y is changed. It now has an additional colon at the end of the output lines IJ00977.
• Fix an issue in the AFM environment where the cached bit is not set after reading the entire file. This causes the eviction failures and also performance degradation during the write operations IJ00977.
• Address a problem where changing the backend from NFS to GPFS (or viceversa) - can cause bad filehandle errors IJ00977.
• Update directory code to avoid excessive recursion that could lead to stack overflow. Stack overflow could cause GPFS daemon to either crash with Signal 11 or get stuck in a signal handler IJ01070.
• Fix a DBGASSERT exp(bytesLeftInStride > 0) which may happen if multiple threads access the same file and (at least) one of them access the file with stride access pattern IJ01114.
• Fix service_running appearing in the mmhealth eventlog without a reason IJ00977.
• This fix is recommended if you see file system hangs requiring reboots to recover IJ00977.
• Fix a GPFS daemon assert that can occur when the inode0 file grows to more than 4B blocks IJ01087.
• Fix a deadlock scenario involving starting a disk at the time of recovery IJ01328.
• Fix an issue in the AFM environment where a prefetch can cause a filesystem quiesce not to happen when home is not responding. This will cause a deadlock at cache cluster until home starts responding IJ00977.
• This fix prevents a segmentation fault in tslspdisk. This fix applies to GSS/ESS customers IJ01327.
• Fix an issue in the AFM environment where ACLs are not updated properly in the cache with directory inheritance. This happens when users do not have permission to update the ACLs IJ00977.
• Fix an assert - exp(ioDataUpdateInProgress == 0 OR DaemonShuttingDown) which may happen if the application does IO with fuzzySequential access pattern IJ00977.
• Fix for gpfs.snap to collect CES address marker files (node-affinity information) IJ01072.
• Fix code to speed-up GPFS CCR read requests and mm-commands when reading from the CCR IJ01086.
• This fix allows customers to run the mmchenclosure command to confirm that a storage enclosure fan is reporting a failure and can be replaced. This fix applies to GSS/ESS customers IJ01330.
• In a mixed cluster where the HSM session manager runs on a 4.2.x node, the access to HSM migrated files from a 4.1.x node now works fine IJ01115.
• Fix a problem in the gpfs mmap code that can result in negative mmap counters. When a file gets memory mapped by a child process GPFS skipped incramenting mmap counters when it failed to verifying its credentials because of the number of groupids exceeded the limit. But decramented mmap counters during close time. This caused a node to crash because of the negative mmap counter IJ01913.
• Fix a performance problem in mmsmb and a minor problem with its machine readable output IJ01073.
• Fix a problem that can result in a flood of handle_network_problem_info mmhealth events. This can cause the GUI to crash IJ02010.
• Fix the high CPU usage issue on Windows due to a busy loop in a receiver thread when there are some network errors IJ01863.
• This update addresses the following APARs: IJ00977 IJ01063 IJ01064 IJ01065 IJ01066 IJ01067 IJ01068 IJ01069 IJ01070 IJ01072 IJ01073 IJ01086 IJ01087 IJ01114 IJ01115 IJ01325 IJ01327 IJ01328 IJ01330 IJ01335 IJ01863 IJ01913 IJ02010 IJ02158 IJ02220.

Problems fixed in IBM Spectrum Scale 4.2.3.5 [October 12, 2017]

• Fix a log assert "Unable to find cached PG map entry for pg X in vIndex Y". This fix will produce a GNR event log when unable to fix a media error IV99611.
• Fix a problem where the nsd was deleted and created again, then the node tried to reread disk configuration so it can update the nsd information, but network issue caused that to fail, then the node got stale nsd info that led to mount failure IV99675.
• Fix a mutex locking order problem, which can lead to a deadlock when the file system is being closed IV99611.
• Fix the use count leak on a stripe group to resolve a stripe group cleanup pending issue IV99611.
• Fix an assert 'iter->second' in the GPFS daemon (CCR) that can occur during mmshutdown IV99611.
• Fix a problem in which the CTIME is not updated correctly on files, Ganesha, IV99677.
• Fix the 93 seconds delay always seen during GPFS daemon startup on the current cluster manager node IV99611.
• Fix GPFS (CCR) logic to close used socket file descriptors just one time avoiding failed GPFS remote procedure calls IV99611.
• Fix generating unnecessary recalls when truncating migrated files IV99676.
• Fix a problem in which a file system unmount will fail if FileHeat is enabled and snapshots are present IV99611.
• Fix a problem in which the mmnfs export list command fails in an unpredictable manner IV99611.
• Fix log assert when a Windows node is added into a cluster that has an encrypted fs IV99611.
• Fix a ofP->inodeLk.get_lock_state() & (0x2000000000000000LL | 0x4000000000000000LL) assert that can occur when FileHeat is enabled and snapshots are present IV99611.
• Fix a problem in which offline fsck does not repair all ind block replicas in reserved files which can lead to more corruptions during fs use IJ00397.
• The fix affects customers using mmhealth THRESHOLD SERVICE. Fix a problem in which the mmhealth THRESHOLD state for some nodes never changes from CHECKING. This is for all platforms IV99611.
• Fix a problem in which the default grace period on a Ganesha system is not displayed correctly IV99611.
• Fix for blocked cesFailoverLock (cesFailoverLock: failed with rc 99) IV99611.
• Fix a problem in which accessing a TCT migrated file can result in a hang when thumbnail support is used IV99611.
• Fix a (delay forever" == "completed") daemon assert IV99678.
• Fix an issue in the AFM environment where incorrect filtering under certain workloads causes the writes to be dropped. This causes the replication not to happen fully and causes the data mismatch between cache/primary and home/secondary IV99796.
• The fix affects customers that have renamed the cluster and is using mmhealth THRESHOLD SERVICE. Fix a problem in which the SYSTEM HEALTH eventlog contains unhealthy alerts for pool_data, pool_metadata, and inode components even though they don't have capacity utilization problems. This can occur on any platform IV99611.
• Fix a segmentation fault that happens when the file system rebalancing fails to open the file system IV99611.
• Fix an issue in the AFM environment where incorrect entries in the prefetch list file (ex. . and ..) causes directory block corruption because AFM permits the filename as '.' to be created without validation of the input IV99679.
• Fix a performance degradation problem when running tar from an NFS client IV99709.
• Correct the %filesetName that is passed to the callback command for the usageUnderSoftQuota callback event. This can only occur on FILESET quota types IV99680.
• Fix quota usage accounting, in a file system with strict allocation "whenpossible", when not all data replicas can be allocated due to lack of space or failure groups IJ00031.
• Fix a deadlock seen while using NFS with TCT IJ00094.
• Fix possible file system corruption caused by a network reconnect IJ00398.
• This update addresses the following APARs: IJ00031 IJ00094 IJ00397 IJ00398 IV99611 IV99675 IV99676 IV99677 IV99678 IV99679 IV99680 IV99709 IV99796.

Problems fixed in IBM Spectrum Scale 4.2.3.4 [August 24, 2017]

• Avoid erroneous FSSTRUCT error in rare cases after a SG panic.
• Fix a problem in which ESS server node deadlocks with many threads showing 'wait for log buffers'.
• Fix a memory corruption issue that can occurs during/after a reconnect.
• Fix a logAssert "!IsMemoryMappingFree" which is caused by a race between mmshutdown and 'tsctl nqStatus'.
• Fix a a possible GPFS daemon assert that can occur while running the mmdelsnapshot command. The assert can happen when prefetch is reading from a snapshot that is being deleted.
• Fix an issue in AFM ADR environment where secondary mount failure causes kernel crash.
• Ensure a copy of the keystone and auth config is created when the Object protocol is disabled and uninstalled from the protocol environment.
• Fix an issue in AFM environment where unresponsive remote mount causes synchronous operations like Reads to fail intermittently.
• Address a problem in resync/failover/changeSecondary where while recreating a deleted file at home/secondary it might cause an invalid memory access and cause the daemon to crash.
• Fix a condition where cNFS on SLES12 or later fail to restart statd.
• Fix deadlock that can occur during inode cleanup in Linux kernel 3.13 and later.
• Address a problem where applyupdates should not be started until failback --start is completed successfully.
• Fix an incorrect assertion which can go off when the file system manager is brought down while running one of the following commands mmrestripefs/mmdeldisk/mmrpldisk.
• Fix an issue in the AFM environment where a fileset unlink or a unresponsive remote mount can cause a deadlock.
• Improve snapshot command error reporting when batching is used.
• Fix a problem with the GPFS file system metadata scanning function in IBM Spectrum Scale 4.2.3.0 - 4.2.3.3 which may result in file system data or metadata corruption on certain failures, like run out of GPFS pagepool memory while running mmrestripefs, mmdeldisk, mmrpldisk, or mmadddisk -r.
• Return ESTALE when file referenced by FileHandle is deleted instead of ENOENT.
• Fix a kernel assert caused by missing buffer lock checking.
• Address a problem where applyUpdates generates operations on files/dirs that were removed from primary - but never played to secondary and later applyUpdates fail to pull such files/dirs back.
• Fix a problem in which GPFS was returning EBADF when Ganesha provided an fd which is not a GPFS fd.
• Fix a mmfsd daemon crashes after upgrading GNR code level and issuing mmchconfig release=LATEST.
• Fix an issue in the AFM environment where mmgetstate or mmdiag commands causes daemon crash if handlers are being disabled.
• Fix mmsetquota to work with non-standard username.
• Fix a deadlock issue in AFM environment when new gateway node joins the cluster and it takes over the fileset from existing gateway node where the workload is running.
• Change in lockd behavior on SLES12 SP2 may cause it to reboot while recovering another cNFS node.
• Fix mmlsquota -u: to work with a non-standard username.
• Fix for missing arping command path declaration for CentOS.
• Fix mmlscluster: to correctly output the "Remote shell command" line.
• This fix reduces the snap processing time for clusters which have the Object protocol deployed with the Unified File and Object feature enabled.
• Fix a problem in which mmsmb exportacl list shows SID instead of user name for all users but the first.
• Fix a memory leak in GNR that may cause mmfsd heap memory usage to increase over time, particularly when the workload does many small writes. The problem occurs in an ESS or GSS environment.
• Fix a daemon crash in the AFM environment where a replication error or a fileset unlink causes a memory handler to be accessed incorrectly.
• Fix a bug where failure to execute the mmdevdiscover script resulted in all pdisks to temporarily lose their I/O paths. This caused the workload to pause while paths were recovered. Sometimes it caused the recovery group to fail over to the backup node. In a few instances, it resulted in the unmount of the file system, requiring manual intervention to restore service.
• This update addresses the following APARs: IV98545 IV98609 IV98640 IV98641 IV98643 IV98683 IV98684 IV98685 IV98686 IV98687 IV98701 IV99044 IV99059 IV99060 IV99062 IV99063.

Problems fixed in IBM Spectrum Scale 4.2.3.3 [July 27, 2017]

• Fix an issue in AFM environment where lookup and metatdata operations on same file from different nodes causes the daemon assert.
• Allow a user to specify the afmrpo interval in weeks[W],days[D] or hours[H].
• Fix a fcntl revoke handler exception that can occur after an EIO error.
• Fix a pdisk firmware version attribute issue. After the pdisk firmware level is changed, mmlspdisk still shows the old version which may mislead the administrator.
• Change EIO to ESTALET for open operation of a file that was deleted.
• Fix a race condition that causes command to fail with "invalid version on put".
• Don't allow kernel modules to cleanup when removing gpfs.gpl if gpfs.gplbin is currently installed.
• Fix an Assert: exp(dm != inv) L-813 in ../fs/fsop.C which can occur when trying to resend a read event.
• Fix a mmfsd crashes, due to a Signal 6 (abort). This can happen removing socket connections in a CCR environment.
• Fix a very rare fault that can occur during heavy directory update workloads.
• Fix a problem in which mmchfirmware --type storage-enclosure fails if running in adminMode=central where only one node has ssh privileges. This fix applies to GSS/ESS customers.
• The mmlsmount command has been changed on all platforms. The change only affects the output format of the -Y argument only when IPv6 address is used.
• This change does not allow mmchcluster -p LATEST on a CCR enabled cluster.
• This fix a problem in which unnecessary allocation manager cursors are being consumed.
• Fix an assert "ioStatsP == __null" that can occur when creating a file system with "-v yes" option, after the "fastest" readReplicaPolicy is enabled.
• Fix a err 112 rename failure that can occur during recovery for IW fileset.
• Fix an AIX kernel crash due to assert "freeing vnode not on gnode list".
• Fix an issue in the AFM environment where an unresponsive target causes a queue to be dropped during the attribute setting.
• Fix a problem where a verbsRdmaSend enable node sent excessive nsdMsgRdmaPrepare to an AIX node.
• Fix a replicas mismatch problem caused by mmrestripefs -b wrongly resetting the missupdate flag.
• Fix CCR and/or mmsdrcli-RPC request errors that can occur during authentication of the incoming socket connections.
• Address a problem where renames across directories do not reset the dirty bit which in future leads to a big list of dirty directories and hence recovery on AFM filesets might take longer to scan.
• Fix an issue in the AFM environment where UIDs in ACLS are not remapped during replication over NSD protocol when UID remapping is enabled.
• When an AFM fileset is to be converted to a regular independent fileset, first check for incomplete dirs, uncached files and orphans. If found inform the user to run prefetch, prior to the conversion.
• Fix a condition where mmautoload may hung.
• Fix a mmlogsort failure that can occur when mmlogsort attempts to query the time zone information on a node that is down.
• Fix a gpfs.snap command failure in a sudo wrapper environment if the legacy log timestamp format is used.
• Fix a divide by zero problem, when running mmrestripefs, which is specific to a file system using directly attached disks only with no NSD servers defined.
• Fix a dynassert 'mmapFlushSXLock.isLockedShared' which may fail as a secondary failure while daemon is shutting down.
• Fix a problem in which a CES ip could not be removed from a node. This can occur when problems are occurring during a CES ip move or failover (e.g. network issues, CCR issues, quorum loss). Subsequent runs of mmcesnetworkmonitor did not fix this and the ip remain active on a node where it should not.
• This fix adds more group memberships (up to 2048) on AIX.
• Fix a "freeSpace != __null" assert. This issue could only happen when doing file system rebalance after suspending some disks.
• Fix a problem in which you get a Unable to create file in fileset error even if the inode limit is not reached which is most likely to occur if the user fills up the fileset from a single node.
• Fix mmcommon test scpwrap.
• This update addresses the following APARs: IV97601 IV97676 IV97677 IV97678 IV97680 IV97681 IV97682 IV97683 IV97685 IV97693 IV97808 IV97836 IV98052 IV98053 IV98054 IV98058.

Problems fixed in IBM Spectrum Scale 4.2.3.2 [June 21, 2017]

• Address a problem where AFM recovery stalls on a read of an IW fileset when it waits to fetch the file from home after the recovery completes.
• Improve a conditional ccr update for CES IPs list file.
• Fix a problem that causes RenameHandler long waiter. This can occur if PIT is in progress.
• Fix a Ganesha crash that can occur when the user enters a string which contains a colon in any mmnfs command that requires a client option or client list string.
• Fix an assert that can occur when changing gateway nodes to non gateway nodes while operations are being performed on an iw fileset and then the non gateway nodes are turned back into gateway nodes.
• Fix a rare deadlock that can occur between a thread handling mmap and a thread handling a memory map pagefault.
• Fix an E_STALE failure that can occur when during a DMAPI dm_read_invis.
• Fix long waiters that can occur on a very busy system doing background snapshot deletion.
• Fix a case where GPFS skipped shrinking lastdata block which causes excess space to be consumed.
• Improve the mmsetquota error message that occurs when a block limit is specified in 'T' unit and larger than 909T is specified.
• Fix an assert that can occur when mmcheckquota and mmrepquota are passed fileset ids from deleted filesets.
• Fix an issue in the AFM environment where afmHardMemThreshold configuration value is not honored and more memory is used than specified.
• Increase the wait time for commands to execute, before failing.
• Correct formatting of large call counts reported by "mmfsadm vfsstats".
• Fix long waiters that can occur after a file system panic and a very busy system.
• Fix a problem in which inodes become Busy after unmount with NFS and immutable files.
• mmkeyserv: Make it possible to set certain attributes to the default with the use of "delete" or "default" keyword.
• Fix a problem in which mkdir, creates, and resync can fail during revalidation from cache/primary to home/secondary in newer kernels 3.18 or later.
• Fix a problem in which GPFS can not handle errors that occur when a DM application was unable to retrieve data due to offline tape.
• Suppress repeated message "Expanded ... inode space N from X to Y inodes" in mmfs.log.
• Fix a rare quota management deadlock caused by error conditions such as out of disk space.
• Fix an issue in AFM+HSM environment where resync/failover/changeSecondary commands fails to replicate migrated files.
• Fix an issue in the AFM environment where a fileset force unlink could cause the daemon to crash.
• Address a problem where a gateway node can assert/crash when having more than 1024 active fileset operations occurring across different filesets on a single gateway node.
• Fix a problem in which gpfs.snap may not gather mmfs logs on AIX nodes correctly.
• Fix a clone parent file deletion performance issue.
• Fix a problem in which fsetxattr failed with ENOENT using a fd of an unlinked file.
• Fix the Assert exp(fileLockHeld != LkObj::nl) in fetchBufferM() that can occur when compression is being used.
• Fix a problem where DMAPI invis read/write fails with an err 22 when calling from non session node.
• Fix a problem in which the mmnetverify command does not correctly verify remote addresses when running many tests in parallel.
• Fix a deadlock that is very rare and can occur after running snapshot commands.
• Fix a policy problem which causes the LOWDISKSPACE callback to not trigger after a fs manager takeover when the old fs manager fails because of an abort or a lost connection.
• This update addresses the following APARs: IV96355 IV96416 IV96417 IV96418 IV96419 IV96420 IV96425 IV96426 IV96429 IV96472 IV96473 IV96474 IV96476 IV96482 IV96483 IV96487 IV96488 IV96585 IV96761 IV96762 IV96763 IV96764 IV96783 IV96786 IV96791.

Problems fixed in GPFS 4.2.3.1 [May 16, 2017]

• Fix a Ganesha crash caused by an applyUpdate.
• Fix a ccrio initialization failure (err 811) when changing the daemon-interface.
• Fix a rare segmentation fault in the mmgetstatus command.
• Fix a SIGBUS error that can occur during a mmap read on a snapshot file.
• Fix a problem in which we see a flood of "failed to scrub vdisk" log message when GNR node experiences quorum loss. This is for ESS/GSS.
• Fix a rare race between unlink, lookup and token revoke which causes kernel crash in d_revalidate.
• This fix will make sure Ganesha request reference a valid GPFS filesystem.
• Fix a system hang that can occur when a file system is suspended while doing a mmap.
• This fix rejects unreasonable large requests to preallocate inodes immediately with ENOSPC.
• Fix a directory rename issue with IW filesets that can occur if the rename target is an existing directory.
• Fix a fault that can occur when restripe runs while the SG is not mounted on all NSD nodes.
• This fix restricts the afmMaxParallelRecoveries config value from 0 to 128.
• This fix removes the unnecessary error message "cannot open /proc/net/tcp6" when shutting down GPFS.
• Fix a problem with not properly handling quotas in an AFM environment. This can occur when you have very large hard and soft limit values.
• Fix a "exp(!sgP->isSGMgr())" assert that can occur when you delete a file system and then create a new file system with the same name at the same time.
• Fix an err 112 that can show up in the mmfs logs when mmchnode --gateway is executed.
• Fix a kernel crash that can occur while attempting to mount a loop device to a correspond file in a GPFS file system or while using a GPFS file system file as a LIO backend.
• Address a problem where applyUpdates continues to run even if the fileset at the old primary is unlinked or the mmfs daemon has been shutdown.
• Fix an outband resync failure that can occur if a recovery is triggered by deleting some files in a directory and the directory itself. This is an AFM/DR environment.
• Fix rename conflicts that can occur in SW/DR filesets.
• Update log code to prevent log recovery error when log file became illReplicated. This could happen on file system with -K set to NO and there is not enough disk space for full replication.
• This fix will use new interface that will reduce multiple retries every time a lock is freed and there are multiple waiters for the lock.
• Fix an assert that can occur with a DR fileset and the file system is suspended.
• Fix bug that requires a large free space in /var/mmfs to run change commands.
• Fix recovery failure err 17 when psnap0 deletion fails.
• Fix a daemon assert that can occur in an AFM environment where the mmfsd daemon fails to start repeatedly with a DMAPI enabled filesystem at a gateway node.
• Address a problem where trying to queue a writeSplit message to the helper gateway's queue can fail with an error 28 (E_NOSPAC).
• Fix an issue which returns EACCESS(errno = 13) while running mmapplypolicy when there is a mounted NFS file system which has the same name with a GPFS file system.
• A fastpath optimization defect can result in an internal error to be returned to the user when it is safe to continue without entering the fast path.
• Install if you suffer from mmapplypolicy/tspolicy hanging after otherwise finishing all work.
• cNFS: fix a problem with /usr/sbin/rpcinfo not found in SLES12 or later.
• Fix a failure in Object Authentication configuration with Active Directory or LDAP. This fix is only required if Object is being configured with Active Directory or LDAP and DN of Swift service user(specified in --ks-swift-user) is more than 79 characters.
• Fix a problem with ESS disk replacement in which the mmchcarrier command may wipe out the pdisk location code. The problem will prevent the subsequent mmchcarrier command to proceed without a valid location code.
• Fix a problem in which a GPFS command may wrongly terminate another process.
• Fix a rare deadlock problem caused by stream write(enableRepWriteStream=yes).
• Update log recovery code to avoid GPFS daemon assert after detecting invalid directory block during log recovery. Code has been changed to log a FSSTRUCT error and fail the log recovery so offline mmfsck can be run on the file system.
• Fix a mmfsd crashes (incompleteOk assertion), when the number of files in the committed directory doesn't match the number of files in CCR's file list in case of a new CCR file update request.
• This update addresses the following APARs: IV94991 IV94992 IV94994 IV94995 IV94996 IV94997 IV94998 IV95015 IV95021 IV95230 IV95557 IV95643 IV95925 IV96037 IV96163.

Unless specifically noted otherwise, this history of problems fixed for IBM Spectrum Scale 4.2.3 applies for all supported platforms.

Problems fixed in Spectrum Scale Protocols Packages 4.2.3-6 [Nov 30, 2017]

• callhome: removed ccr hidden files from daily.conf collection
• callhome: fixed data capture crashing with RC=10 on ppc64le architecture
• callhome: fixed wrong package dependencies (now 4.2.3.6 callhome requires 4.2.3.6 gpfs.ext and not just any 4.2.2+ version, also removed unneeded dependencies)
• ganesha: Support only NFSV4.0 minor version by default
• ganesha: Lower message log level for a non-existent user
• ganesha: Fix upcall to update group, mode when flag UP_OWN is seen
• ganesha: Fix reap_expired_open_owners() using the wrong list field
• ganesha: Use separate entry for cache_open_owners list
• ganesha: Make the uses of so_state_list clear
• ganesha: Validate client_record before using it.
• gui: GUI plays ping-pong with nodeclass and callback updates in certain circumstances
• gui: Fix Rest Api errors from 4.2.3-x
• gui: The DMP to update the firmware of all drives or all enclosures with outdated firmware does not work
• gui: Increase Inode DMP fails with IndexOutOfBounds
• gui: The PM_MONITOR refresh task does not raise HEALTHY events for nodes that do not have the perfmon designation anymore which leads to stale "gui_pmsensors_connection_failed" events
• gui: System Setup Wizard fails with "UnsupportedOperationException" error
• gui: Event is not updated if just the arguments have changed
• gui: ESS ems1 GUI node slow due to postgres processes
• gui: "mmces address list -Y" uses the host name instead of the nodeid
• gui: Missing Pool information in rest api
• gui: GUI dumps end up in wrong directory and are not cleaned up (/tmp instead of /var/crash)
• gui: Rc code from mmsmb changed - GUI code needs to be adjusted
• gui: REST API: Submitting more than 256 jobs leads to Internal Server Error
• gui: History of HealthEvents is incomplete under certain circumstances
• gui: File System Creation wizard: Sometimes list of declustered arrays is empty if there is not free space left
• gui: removing all CES nodes leaves CES service info stale and the GUI panels for protocols don't disappear
• gui: HEALTH_STATES task fails with NullPointerException because event_time is null
• gui: REST API V2 /nfs/exports/exportPath PUT nfsremove can lead to inconsistencies
• gui: GUI shows wrong cluster down event if a remote filesystem is mounted or unmounted
• gui: GUI OOM errors filling root file system and causing upgrade to fail
• gui: Runtask filesets fails
• gui: GUI does not handle all-SAN deployment of storage
• install-toolkit: Bug fixes
• obj: Updated spectrum-scale-object and pmswift rpms/debs to release 4.2.3-6
• obj: Updated spectrum-scale-object-selinux rpm to release 4.2.3-6
• obj: Updated python-dnspython to release 1.12.0-5
• obj: Keystone and swift rpms fix to avoid duplicated logrotate files
• obj: Swiftonfile updated to process containers parallelly, ibmobjectizer fixed syntax error when connection_timeout is configured and ibmobjectizer is now able to deal with UTF8 characters in filenames
• smb: missing ":" at the end of line at cli command: mmsmb export li
• smb: mmcessmblsexport errors flood in mmfs.logs
• smb: mmsmb exportacl list truncates output after a space character
• smb: Colon missing between export name and export path in "mmsmb exp

Problems fixed in Spectrum Scale Protocols Packages 4.2.3-5 [Oct 12, 2017]

• ganesha: Use op_ctx->export_perms in cache_inode_rdwr.
• ganesha: Use 'v6disabled' flag to know if IPv6 is disabled.
• ganesha: Set Grace_Period default to 60 seconds.
• ganesha: Bumped max value for Dispatch_Max_Reqs to 300K.
• ganesha: DISPATCHER : Mark important messages as event.
• ganesha: Bump default value of Dispatch_Max_Reqs_Xprt to 5000.
• ganesha: Allow '.' and '..' as target path in symlink creation for NFSv4.
• ganesha: export: add a parameter to indicating lock type for foreach_gsh_export.
• ganesha: skip export entries that init_export_root fail.
• gui: New feature: Multiple XCAT support in the GUI.
• gui: Fixed rest Api errors.
• gui: Missing metadata blocksize values on mkfs option -m fixed.
• gui: Fixed GUI reports sudo error event while there isn't.
• gui: Fix of user can not set domain user/ domain group while creating a Samba share via Spectrum Scale GUI.
• gui: Fix GUI reports wrong gui_cluster_down state.
• gui: Fix REST API can't change MaxInodes without AllocInodes.
• gui: Fix GPFS API [GET]/filesets returns wrong permissionChangeMode for chmodAndUpdateAcl fileset.
• gui: Fix error after update to ESS Rel. 5.1 GUI snapshot rule stop working.
• gui: Fix error File System Creation Wizard page "Pools" is blank when user clicks fast.
• install-toolkit: Bug fixes
• obj: Updates spectrum-scale-object and spectrum-scale-object-selinux to release 4.2.3-5
• swiftonfile: Updated swift rpms and debs to fix http_connect method for secure middleware.
• swiftonfile: Updated swiftonfile rpm and deb to 2.7.2_0-4 to fix objectizer not recognizing new link filesets when CLI ran from non singleton node.

Problems fixed in Spectrum Scale Protocols Packages 4.2.3-4 [Aug 24, 2017]

• ganesha: Fix re-use of wrong rpc_dplx_rec leading to a crash.
• ganesha: Reduce severity of trace "Export entry is not cached"
• ganesha: Reduce severity level of trace "PROTO_CLIENT: .."
• ganesha: Fix a race in get_nlm_state()
• ganesha: Fix HASHTABLE_ERROR_KEY_ALREADY_EXISTS error
• ganesha: Determine size of ACLs to be encoded when getting ACLs
• gui: Fixed GUI Disk Replacement DMP release wrong disks
• gui: Fixed error of "Mark As Read" failing with DuplicateKeyException.
• gui: Fixed error of Registered Gpfs callbacks were not updated while upgrading to 4.2.1
• gui: Error: Cannot click next after changing password in wizard (solved)
• gui: Fixed error of AFM panel not visible when user is Data Access or Monitor
• gui: Pool States now properly presented
• gui: Fixed error of password policies not checked until HW setup
• gui: Fixed error merging LE ESS to BE editing rack components causing failure
• gui: Error: Statistics -> Capacity -> NSDs grouping by file system is wrong (solved)
• install-toolkit: Bug fixes
• obj: spectrum-scale-object rpm and deb updated to 4.2.3-4
• obj: spectrum-scale-object-selinux rpm updated to 4.2.3-4
• swiftonfile: openstack-swift debian packages bumped from 2.7.2-3 to 2.7.2-5 due to dependencies updates
• zimon: fixed a bug that limted the length of full metric keys to 124 characters

Problems fixed in Spectrum Scale Protocols Packages 4.2.3-3 [Jul 27, 2017]

• ganesha: enable large ACLs
• ganesha: Determine size of ACLs to be encoded when getting ACLs
• gui: Fixed error with not properly updated mount states
• gui: Fixed error that shows false status as critical under filesystem panel for pool.
• gui: Error: cannot start GPFS GUI (solved)
• gui: Fixed error with email notifications continued being sent after the option was disabled
• gui: Fixed error with the enclosure image not seen in Hardware GUI
• gui: Fix of HealthEventRaiser using the wrong entityId
• gui: Fixed errir with Rest API - Invalid size values in GB instead of byte, wrong bools and dump config sections
• gui: Fix of Performance data not loaded in AFM>Gateway>Node details charts
• install-toolkit: Bug fixes
• obj: spectrum-scale-object rpm and deb updated to 4.2.3-3
• obj: spectrum-scale-object-selinux rpm updated to 4.2.3-3
• smb: Rebase to Samba 4.5.10
• smb: Update source4 removal patch
• swiftonfile: openstack-swift debian packages bumped from 2.7.2-2 to 2.7.2-3

Problems fixed in Spectrum Scale Protocols Packages 4.2.3-2 [Jun 16, 2017]

• ganesha: Delay SVC shutdown call while stopping ganesha service
• ganesha: libntirpc pullup: Release lock after netconfig buffer is duplicated
• ganesha: libntirpc pullup: XDR and netbuf: fix decoder overruns from guidovranken
• ganesha: Fix nlm state refcount going up from zero
• ganesha: Use option grace_period to determine grace timeout
• ganesha: remove short_file_handle option in GPFS FSAL
• ganesha: Disable NLM SHARE requests
• ganesha: Fix name of python-ganesha dependency package
• ganesha: Fix infinite loop in cache_inode_unexport for STALE entry
• gui: ESS510; Default inode blocksize should not be 512K
• gui: If no hard limit is specified for a fileset quota a NPE appears on the "Capacity" page
• gui: lsinventory doesn't return expected data
• gui: Login not possible when LDAP enabled
• gui: ESS510; LE: pools = 0 under filesystem tab
• gui: NPE when clicking "Create Filesystem"
• gui: GUI Missing Disk state for "emptied"
• gui: ESS GUI Hardware page does not display enclosures in case mmdiscovercomp failed to discover storage servers
• install-toolkit: Bug fixes
• smb: wbinfo -t and wbinfo -a lockups; Fix regression for tight loop waiting for revoke to complete
• smb: smbd INTERNAL ERROR Signal 11 PANIC; Do an early exit on negprot failure.
• swiftonfile: Fixed setup.py to ignore owner/group/mode for object-server-sof.conf and bumped from 2.7.2_0-1 to 2.7.2_0-2
• This update addresses the following APARs: IV97172

Problems fixed in Spectrum Scale Protocols Packages 4.2.3-1 [May 17, 2017]

• ganesha: Fix a deadlock between reaper thread and setclientid
• gui: Support for a new 24 slot enclosure
• gui: memory leak - mmchcom* commands are extremely slow
• gui: Enclosures discovery is affected by mmlscomp coming back with unexpected rc=2
• gui: Node panel is empty, not showing any of 783 nodes
• gui: ESS510LE: Discovered scale cluster hangs
• gui: GUI does not know enclosure FW or part info (and unknown server/enclosure state)
• gui: GUI does not remove port 443 port forwarding rules after stop/uninstall
• gui: GUI reflecting a red error state for event name: gui_config_sudoers_error on Ubuntu
• gui: The System Setup wizard takes long time to complete because it discovers the HBA firmware without need
• gui: Charts may display "Error loading chart" eventhough there is no issue with ZIMon
• gui: Performance chart preset not found error - Fix the 3x3 dashboard
• gui: The image of the OneStor enclosure displayed in the GUI rack view is too dark
• gui: REST API: XMLHttpRequest failure
• gui: VendorResourceHandler can crash with certain browser locales
• gui: Server preview not displayed in Hardware page
• gui: EMS server not seen in the "Hardware" view of GUI
• gui: TCT Nodes and File systems grids are broken
• gui: Filesets inodes values display negative values
• gui: Filesets page hangs on F5 refresh
• install-toolkit: added auth prerequisite precheck
• install-toolkit: restrict config populate on 4.2.3+
• install-toolkit: improved warning messages in deploy precheck
• smb: Fix ADS down winbind not available.
• smb: Rebase to Samba 4.5.8
• smb: Update SELinux policy module for polkit.
• smb: Samba crashes found in log. Protect against bogus records in dbwrap.
• smb: busy looping trying to revoke readonly delegations. Avoid a tight loop waiting for revoke to complete.
• smb: CTDB hot record tracking does not detect bouncing between. Reimplement hot record detection using migrations per second
• smb: Samba bugzilla 12733: ctdb docs: ctdb -n option does only take numeric values
• zimon: Fixed a bug that causes a remote peer to hang if a query request includes a filter expression.

Problems fixed in Spectrum Scale Protocols Packages 4.2.3-0 [Apr 07, 2017]

• Please see the "What's New" page in the IBM Knowledge Center