IBM Support

RETAIN Tip H212293 Special considerations for resolving 0X806F010C 0X806F030C 0X806F050C memory events - System x

Troubleshooting


Problem

There are a number of advanced features implemented in the memory subsystem of IBM's System x Server Architecture which actively monitor Dual In-Line Modules (DIMMs). If memory errors are detected, the Integrated Management Module (IMM) or IMMv2 of theserver will log messages similar to:

Resolving The Problem

Source

RETAIN tip: H212293

Symptom

There are a number of advanced features implemented in the memory subsystem of IBM's System x Server Architecture which actively monitor Dual In-Line Modules (DIMMs). If memory errors are detected, the Integrated Management Module (IMM) or IMMv2 of the server will log messages similar to:

  0x806F010C - Uncorrectable ECC memory error.
0x806F030C - Memory scrub failed (Power On Self Test (POST) MRC/Training error).
0x806F050C - Correctable ECC memory error logging limit reached.
(where: ECC = Error Correction Code)

Respectively System UEFI or POST diagnostic error codes will be generated when the server starts up or while the server is running and the memory error is detected:

  W.58001] The PFA Threshold limit (correctable error logging limit) has been exceeded on DIMM number percent at address percent. MC5 Status contains percent and MC5 Misc contains percent.
[S.51003] An uncorrectable memory error was detected in DIMM slot percent on rank percent.
[S.51003] An uncorrectable memory error was detected on processor percent channel percent. The failing DIMM within the channel could not be determined.
[S.51003] An uncorrectable memory error has been detected during POST.
[S.58008] A DIMM has failed the POST memory test.

In addition, to maintaining the highest levels of system availability, if a memory error is detected during POST or memory configuration, the server can disable the memory bank containing the failed memory DIMM automatically and continue operating with reduced memory capacity.

Affected configurations

The system may be any of the following IBM servers:

  • System x3100 M4, type 2582, any model
  • System x3250 M4, type 2583, any model
  • System x3300 M4, type 7382, any model
  • System x3400 M3, type 7378, any model
  • System x3400 M3, type 7379, any model
  • System x3500 M3, type 7380, any model
  • System x3500 M4, type 7383, any model
  • System x3500 M4, type 7383 E5-xxxxV2, any model
  • System x3550 M3, type 4254, any model
  • System x3550 M3, type 7944, any model
  • System x3550 M4, type 5459, any model
  • System x3550 M4, type 7914, any model
  • System x3550 M4, type 7914 E5-xxxxV2, any model
  • System x3620 M3, type 7376, any model
  • System x3630 M3, type 7377, any model
  • System x3630 M4, type 7158, any model
  • System x3630 M4, type 7158 E5-xxxxV2, any model
  • System x3650 M3, type 4255, any model
  • System x3650 M3, type 5454, any model
  • System x3650 M3, type 7945, any model
  • System x3650 M4 BD, type 5466, any model
  • System x3650 M4 HD, type 5460, any model
  • System x3650 M4, type 7915, any model
  • System x3650 M4, type 7915 E5-xxxxV2, any model
  • System x3690 X5, type 7147, any model
  • System x3690 X5, type 7148, any model
  • System x3690 X5, type 7149, any model
  • System x3690 X5, type 7192, any model
  • System x3750 M4, type 8722, any model
  • System x3750 M4, type 8733, any model
  • System x3750 M4, type 8752, any model
  • System x3850 X5, type 7143, any model
  • System x3850 X5, type 7145, any model
  • System x3850 X5, type 7146, any model
  • System x3850 X5, type 7191, any model
  • System x3950 X5, type 7143, any model
  • System x3950 X5, type 7145, any model
  • iDataPlex dx360 M3 Server, type 6391, any model
  • iDataPlex dx360 M4 2U chassis, type 7913, any model
  • iDataPlex dx360 M4 server, type 7912, any model
  • iDataPlex dx360 M4 server, type 7912 E5-xxxxV2, any model

This tip is not software specific.

This tip is not option specific.

The following system BIOS or UEFI level(s) are affected: Refer to fix section for affected list of FW

Solution

Following are the minimum system firmware build levels that should be running on an IBM System x servers prior to replacement of memory DIMMs for memory scrub and correctable/uncorrectable ECC memory error events:

System x3750 M4 imm2_1aoo40z-2.50 uefi_koe136s-1.40
System x3650 M4 imm2_1aoo40z-2.50 uefi_vve134m-1.50
System x3630 M4 imm2_1aoo40z-2.50 uefi_bee128e-1.42
System x3550 M4 imm2_1aoo40z-2.50 uefi_d7e134e-1.50
System x3300 M4 imm2_1aoo40z-2.50 uefi_yae128e-1.23
System x3250 M4 imm2_1aoo40z-2.50 uefi_jqe152f-1.03
System x3100 M4 imm2_1aoo40z-2.50 uefi_jqe152f-1.03
iDataPlex dx360 M4 imm2_1aoo48l-3.30 uefi_tde134e-1.31
System x3500 M4 imm2_1aoo40z-2.50 uefi_y5e134f-1.50
iDataPlex dx360 M4 imm2_1aoo48l-3.30 uefi_tde134e-1.31
System x3690 X5 imm_yuoof7a-1.40 uefi_mle179a-1.79
System x3850 X5 imm_yuoog2c-1.42 uefi_g0e181b-1.81
System x3950 X5 imm_yuoog2c-1.42 uefi_g0e181b-1.81
System x3650 M3 imm_yuoof7a-1.40 uefi_d6e159a-1.17
System x3630 M3 imm_yuoof7a-1.40 uefi_hse123a-1.12
System x3620 M3 imm_yuoof7a-1.40 uefi_hse123a-1.12
System x3550 M3 imm_yuoof7a-1.40 uefi_d6e159a-1.17
System x3500 M3 imm_yuoof7a-1.40 uefi_y4e159a-1.14
System x3400 M3 imm_yuoof7a-1.40 uefi_y4e159a-1.14
iDataPlex dx360 M3 imm_yuoof7a-1.40 uefi_tme159a-1.20
(where: IMM = Integrated Management Module)
(where: UEFI = Unified Extensible Firmware Interface)

The file is available by selecting the appropriate Product Group, type of System, Product name, Product machine type, and Operating system on IBM Support's Fix Central web page, at the following URL:

After the latest system firmware build is applied to the server the user should re-enable the memory bank manually using the F1 Setup menu in the UEFI if DIMMs where disabled due to memory errors.

Refer to IBM System x Information Center or Problem Determination and Service Guide (PDSG) for steps related to the specific server that should be followed when taking actions for device specific events:

IMPORTANT: It should be noted that updating system firmware to the code levels listed in this document may not resolve all the memory subsystem issues but should address all memory issues known by IBM.

Additional information

System Unified Extensible Firmware versions listed in this document contain memory reference code updates as well as memory refresh and threshold optimization for predictive failure alerts (PFA) which will result in significant reduction in the rate of superfluous PFA alerts.

Document Location

Worldwide

Operating System

System x:Operating system independent / None

Lenovo x86 servers:Operating system independent / None

[{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW341","label":"System x->System x3250 M4"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWX70","label":"System x->System x3400 M3"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWX80","label":"System x->System x3500 M3"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWX90","label":"System x->System x3550 M3"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWX91","label":"System x->System x3550 M4"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXA0","label":"System x->System x3650 M3"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXA3","label":"System x->System x3650 M4"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"HWXA4","label":"System x->System x3650 M4 HD"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXA5","label":"System x->System x3650 M4 BD"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXB0","label":"System x->System x3690 X5"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXB8","label":"Lenovo x86 servers->Lenovo System x3300 M4"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXC0","label":"System x->System x3850 X5"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXC1","label":"Lenovo x86 servers->Lenovo System x3550 M4"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXC3","label":"Lenovo x86 servers->Lenovo System x3650 M4 BD"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXC4","label":"Lenovo x86 servers->Lenovo System x3650 M4 HD"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXD0","label":"System x->System x3950 X5"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXF0","label":"System x->System x iDataPlex dx360 M3 server"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXF6","label":"System x->System x iDataPlex dx360 M4 server"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXF8","label":"System x->System x iDataPlex dx360 M4 2U chassis"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXG0","label":"System x->System x3620 M3"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXG4","label":"System x->System x3300 M4"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXG6","label":"System x->System x3750 M4"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXH0","label":"System x->System x3630 M3"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXH1","label":"System x->System x3630 M4"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXK0","label":"System x->System x3100 M4"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXX2","label":"Lenovo x86 servers->Lenovo System x3650 M4"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}}]

Document Information

Modified date:
30 January 2019

UID

ibm1MIGR-5094904