IBM Support

All EN4093 ports going into error-disable - IBM Flex System

Troubleshooting


Problem

[This abstract has been truncated due to length constraints] When two (2) Virtual Link Aggregation Group (vLAG) switches are reloaded, if one (1) of them cannot be on line, then all vLAG ports of the other switch always will be 'errdisabled,' becausethe ISL channel cannot be formed. This causes all traffic to be lost even there is one (1) vLAG switch is active. The root cause of the issue is that the Inter-Switch Link (ISL) channel cannot be formed if one (1) vLAG switch cannot be on line, the start up delay timer will not be started, and all vLAG ports always stay in 'errdisabled.' Users can recognize the issue when one (1) the vLAG switches shows all internal (INT) and external (EXT) ports go into 'ERRDISABLE' as in the following example: Alias Port Speed Duplex Flow Ctrl Link Name ----- ---- ----- ------ -TX--RX-- ---- ---- INTA1 1 10000 full yes yes up INTA1 INTA2 2 1

Resolving The Problem

Source

RETAIN tip: H213360

Symptom

When two (2) Virtual Link Aggregation Group (vLAG) switches are reloaded, if one (1) of them cannot be on line, then all vLAG ports of the other switch always will be 'errdisabled,' because the ISL channel cannot be formed. This causes all traffic to be lost even there is one (1) vLAG switch is active.

The root cause of the issue is that the Inter-Switch Link (ISL) channel cannot be formed if one (1) vLAG switch cannot be on line, the start up delay timer will not be started, and all vLAG ports always stay in 'errdisabled.'

Users can recognize the issue when one (1) the vLAG switches shows all internal (INT) and external (EXT) ports go into 'ERRDISABLE' as in the following example:


Alias Port Speed Duplex Flow Ctrl Link Name
---- ---- ----- ------ -TX--RX-- ---- ----
INTA1 1 10000 full yes yes up INTA1
INTA2 2 10000 full yes yes errdisabled INTA2
INTA3 3 10000 full yes yes errdisabled INTA3
INTA4 4 10000 full yes yes errdisabled INTA4
INTA5 5 10000 full yes yes errdisabled INTA5
INTA6 6 10000 full yes yes errdisabled INTA6
INTA7 7 10000 full yes yes errdisabled INTA7
INTA8 8 10000 full yes yes errdisabled INTA8
INTA9 9 10000 full yes yes errdisabled INTA9
INTA10 10 10000 full yes yes errdisabled INTA10
INTA11 11 10000 full yes yes errdisabled INTA11
INTA12 12 10000 full yes yes errdisabled INTA12
INTA13 13 10000 full yes yes errdisabled INTA13
INTA14 14 10000 full yes yes errdisabled INTA14
INTB1 15 1G/10G full yes yes down INTB1
INTB2 16 10000 full yes yes errdisabled INTB2
INTB3 17 10000 full yes yes errdisabled INTB3
INTB4 18 10000 full yes yes errdisabled INTB4
INTB5 19 10000 full yes yes errdisabled INTB5
INTB6 20 10000 full yes yes errdisabled INTB6
INTB7 21 10000 full yes yes errdisabled INTB7
INTB8 22 10000 full yes yes errdisabled INTB8
INTB9 23 10000 full yes yes errdisabled INTB9
INTB10 24 10000 full yes yes errdisabled INTB10
INTB11 25 10000 full yes yes errdisabled INTB11
INTB12 26 10000 full yes yes errdisabled INTB12
INTB13 27 10000 full yes yes errdisabled INTB13
INTB14 28 10000 full yes yes errdisabled INTB14
INTC1 29 1G/10G full yes yes disabled INTC1
INTC2 30 1G/10G full yes yes disabled INTC2
INTC3 31 1G/10G full yes yes disabled INTC3
INTC4 32 1G/10G full yes yes disabled INTC4
INTC5 33 1G/10G full yes yes disabled INTC5
INTC6 34 1G/10G full yes yes disabled INTC6
INTC7 35 1G/10G full yes yes disabled INTC7
INTC8 36 1G/10G full yes yes disabled INTC8
INTC9 37 1G/10G full yes yes disabled INTC9
INTC10 38 1G/10G full yes yes disabled INTC10
INTC11 39 1G/10G full yes yes disabled INTC11
INTC12 40 1G/10G full yes yes disabled INTC12
INTC13 41 1G/10G full yes yes disabled INTC13
INTC14 42 1G/10G full yes yes disabled INTC14
EXT1 43 1G/10G full no no disabled EXT1
EXT2 44 1G/10G full no no disabled EXT2
EXT3 45 1G/10G full no no disabled EXT3
EXT4 46 1G/10G full no no disabled EXT4
EXT5 47 1G/10G full no no disabled EXT5
EXT6 48 1G/10G full no no disabled EXT6
EXT7 49 10000 full no no down EXT7
EXT8 50 10000 full no no down EXT8
EXT9 51 10000 full no no down EXT9
EXT10 52 10000 full no no down EXT10
EXT11 53 10000 full no no down EXT11
EXT12 54 10000 full no no down EXT12
EXT13 55 10000 full no no down EXT13
EXT14 56 10000 full no no down EXT14
EXT15 57 10000 full no no errdisabled EXT15
EXT16 58 10000 full no no errdisabled EXT16
EXT17 59 10000 full no no errdisabled EXT17
EXT18 60 10000 full no no errdisabled EXT18
EXT19 61 10000 full no no errdisabled EXT19
EXT20 62 10000 full no no errdisabled EXT20
EXT21 63 10000 full no no errdisabled EXT21
EXT22 64 10000 full no no errdisabled EXT22
EXTM 65 any any yes yes disabled EXTM
MGT1 66 1000 full yes yes up MGT1

Affected configurations

The system is configured with one or more of the following IBM Options:

  • Flex System EN4093 10 Gb Fabric Scalable Switch, Option part number 49Y4270, any replacement part number (CRU)

This tip is not system specific.

This tip is not software specific.

Solution

Firmware release 7.7.x and later, has a new vLAG feature enhancement that fixes the error-disable issue.

The feature is called 'vLAG autorecovery.' The feature would start an auto-recovery timer when the vLAG 'globlal enable' command is applied, and when this timer is expired, it will bring up all vLAG ports.

The target date for this release is scheduled for third quarter 2012.

The file is or will be available by selecting the appropriate Product Group, type of System, Product name, Product machine type, and Operating system on IBM Support's Fix Central web page, at the following URL:

  http://www.ibm.com/support/fixcentral/

Additional information

Using firmware release 7.7.x or later will correct the issue.

Document Location

Worldwide

Operating System

PureFlex System and Flex System:Operating system independent / None

[{"Type":"HW","Business Unit":{"code":"BU050","label":"BU NOT IDENTIFIED"},"Product":{"code":"HW94B","label":"PureFlex System and Flex System->x220 Compute Node"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU050","label":"BU NOT IDENTIFIED"},"Product":{"code":"HW94C","label":"PureFlex System and Flex System->x222 Compute Node"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"HW94D","label":"Flex System x240 Compute Node"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU050","label":"BU NOT IDENTIFIED"},"Product":{"code":"HW94E","label":"PureFlex System and Flex System->x440 Compute Node"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"HW94J","label":"PureFlex System and Flex System->x880 X6 Compute Node"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"HW94K","label":"PureFlex System and Flex System->x280 X6 Compute Node"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU050","label":"BU NOT IDENTIFIED"},"Product":{"code":"HW94L","label":"PureFlex System and Flex System->x480 X6 Compute Node"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Line of Business":{"code":"","label":""}}]

Document Information

Modified date:
30 January 2019

UID

ibm1MIGR-5096370

Page Feedback