IJ40279: FILESET DF NOT WORKING ON SPECTRUMSCALE 5.1.3-0

APAR status

• Closed as program error.

Error description

• Customer upgraded his cluster to 5.1.3-0 and the
  filesetdf
   option is no longer functioning.
  
  > mmlsfs mforge|grep filesetdf
   --filesetdf        Yes                      Fileset df
  enabled?
  
  Below is the fileset in the mforge file system:
  > mmlsfileset mforge | grep bsi_rcarchive
  bsi_rcarchive            Linked
  /mforge/research/bsi/archive/rc_archive
  
  It has the following quota:
  > mmrepquota -j --block-size 1t mforge | grep
  bsi_rcarchive
  bsi_rcarchive root       FILESET        2179       2560
      2560          0     none | 22682508       0        0
        0     none
  
  A df for the fileset directory should show a size of
  2560T
   with 2179T used, but it does not. It shows the entire
  file system size.
  -> df -h /mforge/research/bsi/archive/rc_archive
  Filesystem      Size  Used Avail Use% Mounted on
  mforge           20P   15P  5.4P  74% /mforge
  
  Here is a df of the file system showing the same output.
  > df -h /mforge
  Filesystem      Size  Used Avail Use% Mounted on
  mforge           20P   15P  5.4P  74% /mforge
  
  The OS is:
  
  > cat /etc/redhat-release
  Red Hat Enterprise Linux Server release 7.9 (Maipo)
  
  
  It works correctly on a 5.1.2-2 system:
  
  # df -h /mforge/research/bsi/archive/rc_archive
  Filesystem   Size Used Avail Use% Mounted on
  mforge     2.5P 2.2P 382T 86% /mforge
  
  
  
  And that fileset is:
  
  # mmrepquota -j mforge | grep rcarchive
  bsi_rcarchive root    FILESET 2338959888256 2748317696000
  2748317696000     0   none | 22682508    0    0    0
  none
  
  
  > mmrepquota -j --block-size 1t mforge | grep
  bsi_rcarchive
  bsi_rcarchive root       FILESET        2179       2560
      2560          0     none | 22682508       0        0
        0     none
  
  A df for the fileset directory should show a size of
  2560T with 2179T used, but it does not. It shows the
  entire file system size.
  -> df -h /mforge/research/bsi/archive/rc_archive
  Filesystem      Size  Used Avail Use% Mounted on
  mforge           20P   15P  5.4P  74% /mforge
  
  Here is a df of the file system showing the same output.
  > df -h /mforge
  Filesystem      Size  Used Avail Use% Mounted on
  mforge           20P   15P  5.4P  74% /mforge
  
  The OS is:
  
  > cat /etc/redhat-release
  
  Red Hat Enterprise Linux Server release 7.9 (Maipo)
  
  
  It works correctly on a 5.1.2-2 system:
  
  # df -h /mforge/research/bsi/archive/rc_archive
  
  Filesystem   Size Used Avail Use% Mounted on
  
  mforge     2.5P 2.2P 382T 86% /mforge
  
  
  
  And that fileset is:
  
  # mmrepquota -j mforge | grep rcarchive
  
  bsi_rcarchive root    FILESET 2338959888256 2748317696000
  2748317696000     0   none | 22682508    0    0    0
  none
  

Local fix

• The developer has provided below ways to by pass the
  issue:
  
    - upgrade the release level to the latest (at least
  5.1.1):
      mmchconfig release=LATEST
  
      or
  
    - set quota file limits for the filesets.
  

Problem summary

• Fileset df doesn't report correct limit and usage for a fileset
  

Problem conclusion

• This problem is fixed in 5.1.4 PTF 1
  To see all Spectrum Scale APARs and
  their respective fix solutions refer to page
  https://public.dhe.ibm.com/storage/spectrumscale/spectrum_scale_
  apars.html
  
  Benefits of the solution:
  Fixed the code so the fileset df can work correctly
  on a 5.1.3 node even without upgrading
  cluster version to 5.1.1.0.
  
  Work Around: Upgrade the cluster version to 5.1.1.0.
  Problem trigger:
  Enable fileset df and set quota limit on
  a block but not on an inode.
  Symptom: Unexpected results
  Platforms affected:  Linux Only
  Functional Area affected:
  df command when filesetdf is enabled.
  Customer Impact: High Importance
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  SPEC SCALE DME

• Fixed component ID

  5737F34AP

Applicable component levels