IBM Support

A minimum of Emulex firmware rev 2.101.411.14 is required for FDT 4.1 - PureData System for Analytics

Troubleshooting


Problem

Host firmware updater 4.1 fails due to hosts being below minimum Emulex firmware rev 2.101.411.14.

Symptom


*** F I R M W A R E U P D A T E R -- H o s t ***

FDT 4.1 - /opt/nz/fdt/log/firmware_updater_date-time.log

-------------------------------------SETUP-------------------------------------
User will be prompted after prerequisites are checked.
Now checking that cluster manager is stopped [DONE]
Now checking that NPS is stopped [DONE]
Now preparing and testing file transfer [DONE]
Now querying nodes for info [DONE]
Now checking validity of host detail [DONE]
Now gathering firmware details [DONE]
Now preparing for host update [FAIL]

These hosts are below minimum Emulex firmware rev 2.101.411.14:
- RACK # : HOST #
Please use the Emulex ISO to manually update, then run this script again.
To update all other firmware, run again with the "--no-update-ethernet" option.

Now cleaning up [DONE]
Now removing the lock file[DONE]
------------------------------------SUMMARY------------------------------------
Final Status [FAIL]
Total Failures 1
Main log file - /opt/nz/fdt/log/firmware_updater_date-time.log
------------------------------------------------------------------------

Cause

Hosts are below minimum Emulex firmware rev 2.101.411.14 which can be verified in sys_rev_check log. 

Diagnosing The Problem

Run /opt/nz/fdt/sys_rev_check Host to verify emulex version is indeed below minimum Emulex firmware rev 2.101.411.14.

Excerpt from sys_rev_check log:
HOST CHECK----------------------------------
       ---FDT
2.3.1 Contains Version---
HOST_X3650-M3_NUM_MEMORY_1GB       = 0
HOST_X3650-M3_NUM_MEMORY_2GB       = 0
HOST_X3650-M3_10GB_NIC             = 1
HOST_X3650-M3_PROCESSOR_CORE       = 16
HOST_X3650-M3_10GB_ID              = 19a2:0700,19a2:0710
HOST_X3650-M3_10GB_LOC             = 1a:00.0

HOST_X3650-M3_10GB_FW_T            = 2.103.269.3002,3.103.397.31
HOST_X3650-M3_NUM_MEMORY_4GB       = 6
HOST_X3650-M3_UEFI                 = D6E154AUS-1.13
HOST_X3650-M3_PROCESSOR2_TYPE      = E5620
HOST_X3650-M3_PROCESSOR1_TYPE      = E5620

ha1
HOST_X3650-M3_NUM_MEMORY_1GB    = 0              [PASS]
HOST_X3650-M3_NUM_MEMORY_2GB    = 0              [PASS]
HOST_X3650-M3_10GB_NIC          =
2              [ABOVE]
HOST_X3650-M3_PROCESSOR_CORE    = 16             [PASS]
HOST_X3650-M3_10GB_ID           = 19a2:0700      [PASS]
HOST_X3650-M3_10GB_LOC          = 15:00.0        [FAIL]
HOST_X3650-M3_10GB_FW_T         =
2.101.411.14   [BELOW]
HOST_X3650-M3_NUM_MEMORY_4GB    = 6              [PASS]
HOST_X3650-M3_UEFI              = D6E156BUS-1.14 [ABOVE]
HOST_X3650-M3_PROCESSOR2_TYPE   = E5620          [PASS]
HOST_X3650-M3_PROCESSOR1_TYPE   = E5620          [PASS]

ha2
HOST_X3650-M3_NUM_MEMORY_1GB    = 0              [PASS]
HOST_X3650-M3_NUM_MEMORY_2GB    = 0              [PASS]
HOST_X3650-M3_10GB_NIC          =
2              [ABOVE]
HOST_X3650-M3_PROCESSOR_CORE    = 16             [PASS]
HOST_X3650-M3_10GB_ID           = 19a2:0700      [PASS]
HOST_X3650-M3_10GB_LOC          = 15:00.0        [FAIL]
HOST_X3650-M3_10GB_FW_T         =
2.101.411.14   [BELOW]
HOST_X3650-M3_NUM_MEMORY_4GB    = 6              [PASS]
HOST_X3650-M3_UEFI              = D6E156BUS-1.14 [ABOVE]
HOST_X3650-M3_PROCESSOR2_TYPE   = E5620          [PASS]
HOST_X3650-M3_PROCESSOR1_TYPE   = E5620          [PASS]

Resolving The Problem

Workaround:
1 - Reattempt host firmware updater with option --no-update-ethernet to update all other firmware: /opt/nz/fdt/firmware_updater Host --no-update-ethernet
2 - Update emulex drivers at a later time.
* Emulex Host entries will still show [BELOW] in subsequent sys_rev_check logs gathered.

Solution:
1 - Install 2.6.1 service_tools included in nz-fdt-v2.6.1.tar.gz
2 - Run ./emulex -vv from /opt/nz/service_tools/emulex_driver to upgrade emulex to acceptable version
3 - Reattempt host firmware updater /opt/nz/fdt/firmware_updater Host

[{"Product":{"code":"SSULQD","label":"IBM PureData System"},"Business Unit":{"code":"BU053","label":"Cloud & Data Platform"},"Component":"System Upgrade","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"1.0.0","Edition":"All Editions","Line of Business":{"code":"LOB10","label":"Data and AI"}}]

Document Information

Modified date:
17 October 2019

UID

swg21676026