Readme and Release notes for release 5.0.1.2 IBM Spectrum Scale 5.0.1.2 Spectrum_Scale_Protocols_Data_Management-5.0.1.2-ppc64LE-Linux Readme

Unless specifically noted otherwise, this history of problems fixed for IBM Spectrum Scale 5.0.x applies for all supported platforms.

Problems fixed in IBM Spectrum Scale 5.0.1.2 [August 14, 2018]

• Fix Assert exp(!"Assert on Structure Error") in line 365 of file /project/sprelttn423/build/rttn423s005a/src/avs/fs/mmfs/ts/logger/Logger.C which can occur during a restore of many file systems. IJ07355
• Fix an issue in the AFM environment where gateway node crashes if remote is not responding. IJ07355
• Fix a deadlock FileBlockWriteFetchHandlerThread: on ThCond 0x1800598FEB8 (IndBlockAccessCondvar), reason 'Waiting for access to indirect block'. This can occur when replication is set to 2 for both data and metadata and both servers for one building block is down. IJ07355
• Fix a problem in which mmrestoreconfig wrongly failed because mmcheckquota failed and returned E_NODEV. IJ07355
• Fix Assert exp(thisSnap.isSnapOkay() || thisSnap.isSnapEmptying() || thisSnap.getSnapId() == sgP->getEaUpgradeSnapId()) in line 3677 of file /project/spreltac/build/rtac1807e/src/avs/fs/mmfs/ts/fs/metadata.C which can occur when closing a file in a snapshot that is being deleted. IJ07410
• Fix GNR Assert exp(vtBufValid.getBit(index) == 1) vtrackBuf.C:2625 which can occur during I/O in dio mode. IJ07355
• Fix a problem in which no failover takes place when Ethernet cable is unplugged. IJ07355
• With this change mmhealth node show will include unique identifiers in the reason column of NATIVE_RAID events again. Before, information like the enclosure was missing. IJ07355
• Fix a problem in which mmshutdown might cause a Kernel assert in gpfsCleanup(). IJ07355
• Fix a problem in which the file system can not mount. This can occur if asserts occur on multiple nodes that have the file system mounted. IJ07355
• Fix Assert exp(Remote ASSERT from node : SGNotQuiesced snap 9/0 ino 2851912 reason 1 code 0) in line 3447 of file /project/spreltac501/build/rtac5011814e/src/avs/fs/mmfs/ts/cfgmgr/sgmrpc.C which can occur on an AFM file set with huge amounts of small writes during a snapshot. IJ07355
• Fix a problem in which the output of mmces address move commands are inconsistent. IJ07355
• Fix a hang in mmcesnetworkmonitor. IJ07355
• Fix LOGASSERT(getPhase() == snapCmdDone) which can happen if more than one request to delete the same snapshot is run concurrently and the fs SGPanic during the delsnapshot process. IJ07355
• Fix firmware monitoring to disregard missing disks, it caused erroneous events like this: drive_firmware_notavail(DRV-5-12, DRV-1-3). IJ07355
• Fix a problem in which sysmonitor breaks after an upgrade of gpfs. IJ07355
• Fix a problem in which the mmhealth show command on mixed clusters that have Windows nodes will show the windows nodes as failed. IJ07355
• Fix the AIX kernel crash which can happen when there is I/O against inconsistent compressed files. IJ07409
• Fix a deadlock which may happen when threads of one process uses mmap while doing multiple reads on the same file. IJ07782
• Fix local disk monitoring on AIX, issue causes erroneous "local_fs_unknown" event. IJ07443
• Fix a problem in which recovery was triggered on a stopped AFM fileset. IJ07355
• Fix viInUse assert in gpfsOpen for NFS file access. IJ07411
• Fix AFM: recovery stuck and dropped fileset with error 2. This can occur when the directory name has special characters. IJ07412
• Fix a bug that could cause the file size to be incorrectly updated to a smaller than expected value. This could happen if a node failure occurs when a hole is being punched at the end of the file. IJ07413
• Fix an issue in the AFM environment where leading spaces in file names causes recovery to fail. IJ07444
• Change mmcrnodeclass to use CLUSTER_PERF_SENSOR_CANDIDATES to manually configure the list of node candidates for the single node sensors. IJ07355
• Fix EBADHANDLE (521) errno which can occur doing NFS file operations on RHEL 7.5. IJ07355
• This fix is for customer that use a mixed cluster with a minimum release level lower than 4.2.2-0. It will fix the machine-readable output of the mmhealth node show command and the false or inconsistent information in the GUI. IJ07355
• Fix logAssertFailed: "useCount >= 0" in file alloc.h which can occur running mmrestripefile -c repeatedly. IJ07414
• Fix mmapplypolicy -L 3 showing garbage characters. IJ07784
• Fix a rare AIX kernel crash LOGASSERT(size != 0) in cxiAttachSharedMemory. This can happen if you run a gpfs utility during startup before the kernel is fully loaded. IJ07783
• Fix an issue in AFM environment where control file setup used for transferring EAs/ACLs might hang if remote is not responding. This causes node to run out of RPC handler threads handling the incoming messages. IJ07751
• Fix an assert in openlog.C. This can occur as a result of a mmdeldisk failure. IJ08031IJ08031
• Fix mmfsd terminating because of network failure or hardware failure. Assert exp(nConns== nReplyConns) in line 1727 of file verbsClient.C. IJ08018
• Fix Waiters: VdiskFlusherThread. IJ07355
• Fix assert bufP->pageP != NULL gpl-linux/mmap.c, 194. IJ08204
• RDMA reconnect can fail when RDMA port is used by multiple verbsPorts definition using different fabnum. IJ08144
• This update addresses the following APARs: IJ07355 IJ07409 IJ07410 IJ07411 IJ07412 IJ07413 IJ07414 IJ07443 IJ07444 IJ07751 IJ07782 IJ07783 IJ07484 IJ08018 IJ08031 IJ08144 IJ08204.

Problems fixed in IBM Spectrum Scale 5.0.1.1 [June 15, 2018]

• Fix a mmfsck failure due to file system panic. IJ06116
• Fix a mmfsd assert exp(de.getNameP()[0] != 0) direct.C:654 that can occur when running fsck with patch-file option twice. IJ06116
• Fix an Assert: !"search long and hard in getSnapP" which can occur when running mmfsck fs1 -c -vn --patch-file. IJ06116
• Fix an Assert exp(readRepIndex == -1 OR (readRepIndex >= 0 which can occur when running mmfsck -yv:. IJ06116
• Fix a FSCK:sig8 on FsckDirCache::readBlockDA which can occur when running mmfsck with --skip-inode-check -n -v. IJ06116
• Fix an Assert exp(!"Assert on Structure Error") in Logger.C which can occur when running fsck. IJ06116
• Fix Long waiter : PCacheMsgHandlerThread: on ThCond that can occur when running 'mmafmctl gpfs1 getstate', parallelly to a link cmd. IJ06116
• Fix Corruption: InodeMetadata/Critical which can occur during a heavy workload of create, list, delete of snapshots and filesets. IJ06116
• Fix assert: cachedcomm.C:182: assertion 'iter->second' in the GPFS daemon (CCR) during mmshutdown on Windows based quorum nodes. IJ06116
• Fix Assert exp(!"Assert on Structure Error, called from the kernel") in Logger.C which can occur during a heavy workload. IJ06116
• Fix a case in which mmlsdisk returned incorrect data. This can occur when /var/mmfs/etc/ignoreAnyMount or /var/mmfs/etc/ignoreAnyMount. exist. IJ06479
• Fix a fsck: SGPanic at line 11801 in /ts/pfsck/cache.C. IJ06116
• Existing afmctl file at home fileset should not be changed after running ConvertoSecondary command. IJ06116
• Fix lease overdue with unsuccessful replies to lease requests. Probing cluster. IJ06116
• Update logging code to prevent possible long waiters where thread can get stuck waiting on 'force wait on active buffer to become stable'. This can happen if file system panic occurs while a thread is actively appending records to log file. IJ06116
• Fix a problem in which fsck: does not reclaim unused metadata when fixing fs. IJ06116
• Fix an endless loop which can happen if the mmlsquota command has a syntax error. IJ06219
• Fix a zLinux: Assert exp(!synchedStale) in line 2770 of file bufdesc. This can happen if compression is involved. IJ06116
• Fix Assert exp(secSendCoalBuf != __null && secSendCoalBufLen > 0. IJ06116
• Add unavailable disk warning message at end of fsck output. IJ06116
• Fix Assert exp(cleanupOnFailure == 0 || nNodes > 0) which can occur running fsck with not enough memory. IJ06116
• Fix a problem in which Pcache: hit Oops while running workload stress. IJ06116
• Fix Assert exp(dm != inv) which can occur after a failback to secondary and then trying to get back to primary. IJ06116
• Fix Assert:fileAllocPool[kind].fapFree == 0 qualloc.C 591 which can occur after suspending a disk. IJ06116
• Fix a deadlock that can occur during a file close when the file system is quiesce. IJ06116
• Fix a problem in which the file system can not be unmounted that can occur during a large amount of file deletes and node asserting. IJ06116
• Fix a Oops: Kernel access of bad area, sig: 11 that can occur on P9 running an exported GPFS filesystem through NFS. IJ06116
• Fix a deadlock that can occur on afmHashVersion 4 enabled clusters during fileset deletions and creations. IJ06116
• Address a problem where a race between Create and remove on the same fileset (with a sandwiched write message), can filter the create and play just the remove .. Meanwhile the Write in between tries to write the file and finds that the file has not been created at home and causes the queue to be dropped. IJ06116
• Fix a vmcore: oops bad area, crashed at func ganesha_grant_deferred. IJ06116
• gpfs.snap: improve performance on large cluster. IJ06213
• Fix "ganesha.nfsd-29872[work-239] lookup :FSAL :CRIT :DOTDOT error, inode: xxxxx". IJ06216
• Fix "Assert exp(!synchedStale)" problem that can occur during access of compressed files. IJ06116
• Fix Assert !addrDirty OR synchedStale OR allDirty bufdesc.C 7416. IJ06116
• Fix a problem in which trace starts itself. This can occur when CCR is disabled, adminMode=allToAll, and mmsdrservPort=0. IJ06214
• Fix logAssertFailed: !isMsgOptionFlagsCallback(optionFlagsArg). IJ06116
• Fix a problem in which a hanging NFS process (Ganesha) was not clearly detected. IJ06116
• Fix a problem in which you can not set the value 'desired' for smb option "smb encrypt" through Spectrum Scale CLI. IJ06116
• Fix a problem which could cause I/O worloads to hang longer than expected if the cluster manager and fs manager fails at the same time. IJ06116
• Address a problem where STOP command on the fileset (mmafmctl stop) can cause deadlock when there's a parallel Write in the queue taking the SplitWrite path. IJ06116
• Following fix will change the mmhealth node show -Y output so that the GUI is able to process specific health events again, that weren't in the right format in a mixed cluster environment. This affects only cluster with a cluster minRelease level lower than 4.2.0 and nodes higher than or equal to 4.2.0. Affected events are: all pool_ and pool- events of the FILESYSTEM component. IJ06217
• Fix "Signal 11 at location ... PaxosServer::handleCheck ... at paxosserver.C". IJ06116
• Fix Error in `/usr/lpp/mmfs/bin/mmfsd': double free or corruption (!prev): signal 6. This can happen running fsck in too small of a page pool. IJ06116
• Fix a problem that when QOSio is enabled for a filesystem, occasionally GPFS daemon deadlocks during unmount. IJ06116
• Fixed issue with un-escaped dollar signs in config values in the Object protocol. When configuring Object protocol with values containing dollar signs, the command would fail with messages such as "[E] Keystone role add command failed". Checking the log file /var/log/keystone/keystone.log may have messages indicating that authentication was incorrect. IJ06116
• Fix an issue in AFM environment where failover/resync runs slower for write operations due to connecting the file dentry to the parent. IJ06116
• Fix deadlock:SGExceptionAdjustServeTMThread on(MsgRecordCondvar). IJ06116
• Fix a hang condition on Linux when mmfsd is executed from a shell. IJ06116
• This fix makes sure mmcommon deadlockBreakup is canceled if the long waiters disappear. IJ06116
• Fix a deadlock, mmwaiters show SharedHashTabFetchHandlerThread: on ThCond 0x1800BDC7EF0 (LkObjCondvar), reason 'change_lock_shark waiting to set acquirePending flag'. This can occur with heavy IO with errors. IJ06116
• Fix a problem in which callhome stopped sending data on Ubuntu after and upgrade. IJ06116
• Fix GPFS assert "logAssertFailed: !isRead" which can happen doing a data prefetch. IJ06450
• Fix an AFM:data mismatch in read if replication factor is more then 1. IJ06220
• Fix an error in the mmsysmonitor log and "ks_url_warn" event when upgrading to 5.0.1. Issue will disappear after a mmsysmoncontrol restart. While error is 'active' the keystone server (object authentication) is not monitored correctly. IJ06116
• Fix mmbackup handling of -g option. It should use config var sharedTmpDir to determine the relative or absolute paths. IJ06116
• Fix an mmfsd shutdown. The log shows ReadMap: Cannot open map file /usr/lpp/mmfs/bin/mmfsd, not enough memory. This can occur during lots of fsync syscalls at the same time as stat calls. IJ06242
• Fix a rare case logAssert "Assert:(indIndex & 0xFF00000000000000ULL)==0 IndDesc.h" which can happen when write beyond EOF of a file which has lots EA entries. IJ06116
• Fix a problem in which mmcrfs --profile returns an error when both defaultMetadataReplicas and maxMetadataReplicas are specified in the profile. IJ06222
• Fix a problem in which a gpfs_set_share call is incorrectly failing. IJ06449
• Fix a mmimgbackup assert problem when there is a symbolic link and the full pathname length is 1023 bytes. IJ06223
• When you update the NSD type via mmchconfig updateNsdtype command, this fix will also update the NSD type of any tiebreakerdisks in CCR cluster. IJ06116
• Fix a signal 11 which can occur when a node is being added to a cluster. IJ06843
• Fix a problem in which statfs/df is reporting free disk space that includes fragmented disk space. It should only be reporting full disk blocks. IJ06116
• Fix a problem where GPFS can potentially get stuck on dumping a kernel thread stack during file system panic. IJ06255
• Fix a "Assert on Structure Error": Direct::invalidDirBlock which is caused by a race condition between log wrap and directory expansion. IJ06863
• Fix a problem in which /usr/lpp/mmfs/bin/mmchattr --compact=73315124 fails with Compact directory failed: Invalid argument. IJ06116
• Fix a deadlock that can occur when a new node is taking over the cluster manager role. IJ06116
• Fix a problem in which a NSD server shutdown could cause a disk failure and file system unmounted on a NSD client. IJ06761
• Fix a problem in which POSIX ACLs set on a GPFS file or directory from Unix may not be correctly translated to access permissions on a GPFS Windows node. IJ06451
• Fix a problem in which mmafmctl prefetch failure does not list the failed files. IJ06478
• Address an issue in Prefetch (migration) where filenames containing '\\' and '\\n' characters need to be handled better. IJ06116
• This fix corrects an error in the mmchfirmware command. This fix applies to Lenovo GSS/DSS customers. IJ06116
• Fix a problem in which mmadddisk failed on aix with return value of 5. IJ06116
• Improve the cluster monitoring in case of a GPFS cluster manager move. IJ06116
• This fix corrects an error in the mmlsenclosure command. This fix applies to GSS/ESS customers that have DCS3700 storage enclosures. IJ06116
• Fix a bug in "mmkeyserv server update" that may cause encryption policy fail. IJ06116
• Fix a recovery failure and a resign from recovery. IJ06974
• This fix increases the maximum supported number of extra IP addresses to 64. IJ06762
• Fix a problem in which mmchpolicy -I test incorrectly declares policy installed. IJ06116
• Fix a problem where mmchdisk incorrectly requires disks in 'system.log' pool to have disk usage type 'dataOnly'. IJ06116
• This fix disables writing protocol tracing debug messages to mmfs.log, since they were irrelevant to the user and inconsistently formatted. IJ06116
• Fix Assert: getQueue()->getRenameDepTable() == __null that can occur after renaming active AFM filesets and directories. IJ06116
• Fix the issue that the extra IP addresses cannot be propagated to other nodes. IJ06116
• This change improves the performance of 'mmcloudgateway files ..." commands like migrate or recall. It does so by removing a rpm db check for installed TCT software. IJ06116
• The manpage for mmchconfig command ('subnets' section) has been updated to describe limitation in the number of subnets a given node may be part of. IJ06116
• Workaround a GNR VCD (vdisk configuration data) inconsistency issue that two vtrack tracks may map to the same physical location in very rare cases when recovering free ptracks which causes RG recovery to fail with error like "[E] Vdisk xxx recoverFreePTracks failure: Error 214 code 2063". With this fix, the RG can be recovered with minimal data lost vs. losing the whole RG. IJ06856
• Fixed an issue in AFM environment where if root user have supplementary GID greater than value 42949676, replication might fail and messages are requeued. IJ06972
• This update addresses the following APARs: IJ06116 IJ06213 IJ06214 IJ06216 IJ06217 IJ06219 IJ06220 IJ06222 IJ06223 IJ06242 IJ06255 IJ06449 IJ06450 IJ06451 IJ06478 IJ06479 IJ06761 IJ06762 IJ06843 IJ06856 IJ06863 IJ06972 IJ06974.