PCIe fatal bus errors are reported for the wrong slot of the IBM Flex System PCIe Expansion Node - IBM Flex System Enterprise Chassis (8721)

Troubleshooting

Problem

Peripheral Component Interconnect Express (PCIe) fatal bus errors are reported for the wrong slot of the IBM Flex System PCI Expansion Node (PEN) in the Chassis Management Module (CMM) event log. Example error message: Node node9 message: Expansion card 4 (PEN Mezz4) fatal bus error more... [S.2018001] An uncorrected PCIe error has occurred on Bus 009B Device 10 Function 00 The vendor ID for this device is 14E4 and the Device ID is 1656

Resolving The Problem

Source

RETAIN tip: H206321

Symptom

Peripheral Component Interconnect Express (PCIe) fatal bus errors are reported for the wrong slot of the IBM Flex System PCI Expansion Node (PEN) in the Chassis Management Module (CMM) event log.

Example error message:

	Node node9 message: Expansion card 4 (PEN Mezz4) fatal bus error more... [S.2018001] An uncorrected PCIe error has occurred on Bus 009B Device 10 Function 00 The vendor ID for this device is 14E4 and the Device ID is 1656

Affected Configurations

The system can be any of the following IBM servers:

Flex System Enterprise Chassis, type 8721, any model
Flex System x220 Compute Node, type 2585, any model
Flex System x220 Compute Node, type 7864, any model
Flex System x220 Compute Node, type 7906, any model
Flex System x240 Compute Node, type 8737, any model
Flex System x240 Compute Node, type 8738, any model

The system is configured with one or more of the following IBM options:

Flex System Chassis Management Module, option part number 68Y7029, any replacement part number (CRU)

This tip is not software specific.

The following system BIOS or UEFI levels are affected:

UEFI firmware before version v1.20

The system has the symptom described above.

Solution

This issue was corrected with the following release of UEFI firmware:

IBM UEFI flash update v1.20 - IBM Flex System x240 Compute Node (or later)
IBM UEFI Flash Update v1.20 - IBM Flex System x220 Compute Node (or later)

The file is available by selecting the appropriate Product Group, type of System, Product name, Product machine type, and Operating system on IBM Support's Fix Central web page, at the following URL:

http://www.ibm.com/support/fixcentral/

Workaround

For additional information, click the 'more...' hyperlink tab in the error in the CMM event log.

Use this chart to determine the correct device:

PCI Device Number	PCI Slot Descriptor
14h	PEN PCIe Slot 1 (Full Height Bottom slot)
8	PEN PCIe Slot 2 (Full Height Top slot)
0Ch	PEN PCIe Slot 3 (Low Profile Bottom slot)
0Dh	PEN PCIe Slot 4 (Low Profile Top slot)
10h	MEZ3 connector
11h	MEZ3 connector
4	MEZ4 connector
5	MEZ4 connector

Document Location

Worldwide

Operating System

PureFlex System and Flex System:Operating system independent / None

[{"Type":"HW","Business Unit":{"code":"BU050","label":"BU NOT IDENTIFIED"},"Product":{"code":"QU01GRD","label":"PureFlex System and Flex System->Enterprise Chassis->8721"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"QU01GRH","label":"PureFlex System and Flex System->x240 Compute Node->8737"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU050","label":"BU NOT IDENTIFIED"},"Product":{"code":"QU01GRJ","label":"PureFlex System and Flex System->x220 Compute Node->7906"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU050","label":"BU NOT IDENTIFIED"},"Product":{"code":"QU91OLT","label":"PureFlex System and Flex System->x220 Compute Node->2585"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"QUOEDBG","label":"PureFlex System and Flex System->x240 Compute Node->8738"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}}]

Tips