Broadcom onboard Network Interface Controller port is disabled by Cisco Catalyst Switch Module 3012 - IBM BladeCenter

Resolving The Problem

Source

RETAIN tip: H196074

Symptom

Systems configured with on-board NetXtreme I adapters connected to Cisco 3012 Ethernet Switch Modules (ESMs) may have their switch port error disabled by the ESM during Windows shutdown. This condition may also occur when disabling the Network Interface Controller (NIC) from within Windows.

The following link-flap error message may be observed in the ESM log by entering "show logging" Cisco Command Line Interface (CLI) command:

Affected configurations

The system may be any of the following IBM servers:

• BladeCenter LS20, type 8850, any model
• BladeCenter HS12, type 8014, any model
• BladeCenter HS12, type 8028, any model
• BladeCenter HS20, type 8678, any model
• BladeCenter HS20, type 8832, any model

The system is configured with at least one of the following:

• Microsoft Windows 2000 Server, any service pack
• Microsoft Windows 2003 Server, any service pack

The system is configured with one or more of the following IBM Options:

• Cisco Catalyst Switch Module 3012 for IBM BladeCenter, Option part number 43W4395
  

Note: This does not imply that the network operating system will work under all combinations of hardware and software.

Solution

This problem is resolved by Broadcom NetXtreme device driver version 12.2.1.2 or software CD version 12.2.4.2 9or later).

The referenced file is available from the "Broadcom NetXtreme Gigabit Ethernet Drivers and Software CD v12.2.4.2 - IBM System x and BladeCenter" web page, at the following URL:

• http://www.ibm.com/support/docview.wss?uid=psg1MIGR-50506
  

Workaround

As an interim solution, "err-disabled" port can be reset by selecting "disable" then "enable" from Cisco ESM's GUI, or by running the "shutdown", then "no shutdown" commands in the Cisco Intelligent Gigabit Ethernet Switch Module Command Line Interface.

Additional information

Before driver version 12.2.1.2, the driver performed a hard reset on the on-board NIC during Windows shutdown. Sometimes this would lead to frequent link state changes that the ESM would interpret as link flapping. The ESM would deactivate the corresponding port as a result.

With driver version 12.2.1.2, the driver performs a soft reset of Rx CPU on the NIC instead of hard resetting, to eliminate unnecessary link state changes.