IJ39454: GPFS DAEMON RESTART DUE TO LOGASSERTFAILED: !"TRASH_DOMAIN"

APAR status

• Closed as program error.

Error description

• Error Description:
  
  When file system is unmounted, GPFS daemon may hit
  logAssertFailed as below and restarts.
  
  2022-03-31_14:17:45.504+0800: mmcommon preunmount
  invoked.  File system: gpfs-idc2  Reason: SGPanic
  2022-03-31_14:17:49.354+0800: [X] logAssertFailed:
  !"Trash_Domain"
  2022-03-31_14:17:49.354+0800: [X] return code 2, reason
  code -1780360504, log record tag 0
  2022-03-31_14:17:51.282+0800: [X] *** Assert
  exp(!"Trash_Domain") in line 2059 of file
  /project/sprelmax510/build/rmax510s001a/src/avs/fs/mmfs/t
  s/tm/tokenclass.C
  2022-03-31_14:17:51.282+0800: [E] *** Traceback:
  2022-03-31_14:17:51.282+0800: [E]
  2:0x5613AD08F213 logAssertFailed + 0x3E3 at ??:0
  2022-03-31_14:17:51.282+0800: [E]
  3:0x5613ADD17356 TokenClass::Trash_Domain(int) + 0x6A6 at
  ??:0
  2022-03-31_14:17:51.282+0800: [E]
  4:0x5613ADD176B4 TokenClass::DeleteDomain() + 0xD4 at
  ??:0
  2022-03-31_14:17:51.282+0800: [E]
  5:0x5613AD002C6B StripeGroup::endUseInternal() + 0xF0B at
  ??:0
  2022-03-31_14:17:51.282+0800: [E]
  6:0x5613AD1403AA
  StripeGroupCfg::exceptionHandlerBody(void*) + 0x25A at
  ??:0
  2022-03-31_14:17:51.282+0800: [E]
  7:0x5613ACB4FAD8 Thread::callBody(Thread*) + 0x118 at
  ??:0
  2022-03-31_14:17:51.282+0800: [E]
  8:0x5613ACB3D800 Thread::callBodyWrapper(Thread*) + 0xC0
  at ??:0
  2022-03-31_14:17:51.282+0800: [E]
  9:0x7FD8C13A0DD5 start_thread + 0xC5 at ??:0
  2022-03-31_14:17:51.282+0800: [E]
  10:0x7FD8C028702D __clone + 0x6D at ??:0
  
  Reported in:
  Spectrum Scale 5.1.0.1 on RHEL7
  
  Known Impact:
  daemon crash
  
  Verification steps:
  
  Recovery action:
  

Local fix

Problem summary

• GPFS daemon crashes with logAssertFailed: !"Trash_Domain"
  in file tokenclass.C.
  

Problem conclusion

• This problem is fixed in 5.1.2 PTF 5
  To see all Spectrum Scale APARs and
  their respective fix solutions refer to page
  https://public.dhe.ibm.com/storage/spectrumscale/spectrum_scale_
  apars.html
  
  Benefits of the solution:
  Prevent this GPFS daemon assert.
  
  Work Around:
  Disable this assert via mmchconfig disableAssert
  Problem trigger:
  Unmount the file system for any reason
  Symptom:  Abend/Crash
  Platforms affected: ALL Operating System environments
  Functional Area affected:  All Scale Users
  Customer Impact: High Importance
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  SPEC SCALE DME

• Fixed component ID

  5737F34AP

Applicable component levels