IBM Support

HIPER: Potential undetected data corruption with specific Flash drives

News


Abstract

Some 800GB, 960GB, 1.6TB, 1.92 TB, 3.2TB, and 3.84TB Flash drives may have exposure to a possible undetected data corruption. This can affect client data if a drive fails while a drive has this issue.

Only systems that contain the SAS drives listed below are affected. Systems that only contain NVMe drives are not affected.

Upgrade drive firmware to prevent this issue.

Content

The drives in the table below, running affected firmware, may not handle the SCSI Unmap command correctly. This command is issued by Spectrum Virtualize systems to regions of the drive that should be zeroed. The firmware issue may cause these regions of the drive to contain non-zero data. A background parity scrub process will detect this condition, and report parity inconsistency (1691) errors in the eventlog.
Typically, drives affected by this issue will cause hundreds or thousands of 1691 errors to be reported.
This does not immediately affect host data integrity. However, if a drive rebuild then occurs, then incorrect data would be rebuilt onto the replacement drive, meaning that application data can be corrupted.
To prevent this issue, upgrade the drive firmware.
Affected drive types
Note:
  • These drives are only affected when installed in a Spectrum Virtualize (SVC, Storwize or FlashSystem) product. Other IBM storage products are not affected.
  • Drives with capacity greater than 3.84 TB are not affected, even if running the firmware versions listed below.
Feature
Product ID
Affected firmware levels Firmware level with Fix
200 GB 2.5" SAS MZILT200HAHQ MS63/MS64/MS68/MS69 MS6C
400 GB 2.5" SAS MZILT400HAHQ MS63/MS64/MS66/MS68/MS69 MS6C
800 GB 2.5" SAS MZILT800HAHQ MS63/MS64/MS68/MS69 MS6C
800 GB 2.5" SAS MZILT800HAJQ MS33/MS34/MS35/MS36/MS38/MS39/MS3B MS3E
1.6 TB 2.5 SAS MZILT1T6HALS MS33/MS34/MS35/MS36/MS38/MS39/MS3B MS3E
1.92 TB 2.5" SAS MZILT1T9HAJQ MS33/MS34/MS35/MS36/MS39/MS3B MS3E
3.2 TB 2.5" SAS MZILT3T2HMLA MS33/MS34/MS35/MS36/MS38/MS39/MS3B MS3E
3.84 TB 2.5" SAS MZILT3T8HALS MS33/MS34/MS35/MS36/MS39/MS3B MS3E
Fix
Obtain the latest drive firmware package from Fix Central, and upgrade affected drives. The fixed drive firmware is included in all drive firmware packages dated 22nd October 2021 and later.
If affected drives have not yet been added to arrays, upgrade their firmware before creating the array.
Determining the drive firmware using the GUI

1. Click Pools > Internal Storage to display the list of installed drives
2. Right-click on one of the table headers such as Drive ID and select the Firmware Level option
The firmware level is now added to the table.

Determining the drive firmware using the CLI

The firmware level for an individual drive can be displayed through the lsdrive Drive_ID command, where Drive_ID specifies an individual drive. The following short script will display the firmware levels for all drives in the system:

lsdrive -nohdr | while read drive etc; do echo "Drive $drive:"; lsdrive $drive | grep firmware ; echo "__________"; done
 

[{"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"ST3FR7","label":"IBM Storwize V7000"},"Component":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Versions","Edition":"","Line of Business":{"code":"LOB26","label":"Storage"}},{"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"STPVGU","label":"SAN Volume Controller"},"Component":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Versions","Edition":"","Line of Business":{"code":"LOB26","label":"Storage"}},{"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"STHGUJ","label":"IBM Storwize V5000"},"Component":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Versions","Edition":"","Line of Business":{"code":"LOB26","label":"Storage"}},{"Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"STKMQV","label":"IBM FlashSystem V9000"},"Component":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Versions","Edition":"","Line of Business":{"code":"LOB26","label":"Storage"}},{"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"STSLR9","label":"IBM FlashSystem 9x00"},"Component":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Versions","Edition":"","Line of Business":{"code":"LOB26","label":"Storage"}},{"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"STSLR9","label":"IBM FlashSystem 9x00"},"ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Version(s)","Line of Business":{"code":"LOB26","label":"Storage"}},{"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"SSA76Z4","label":"IBM FlashSystem 7x00"},"ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Version(s)","Line of Business":{"code":"LOB26","label":"Storage"}},{"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"STHGUL","label":"IBM Storwize V5000E"},"ARM Category":[{"code":"a8m0z000000bqPRAAY","label":"Configuration"}],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Version(s)","Line of Business":{"code":"LOB26","label":"Storage"}},{"Line of Business":{"code":"LOB26","label":"Storage"},"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"ST3FR9","label":"IBM FlashSystem 5000"},"ARM Category":[{"code":"a8m0z000000bqUHAAY","label":"Hardware->Drive\/Internal Drive"}],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Version(s)"},{"Line of Business":{"code":"LOB26","label":"Storage"},"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"ST2HTZ","label":"IBM FlashSystem Software"},"ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Version(s)"}]

Document Information

Modified date:
28 March 2023

UID

ibm16508601