IBM Support

How to Recover From 564 Node Errors After Installing the SAS Host Interface Card

Troubleshooting


Problem

Installing the optional SAS Host Interface Card (HIC) in a SAN Volume Controller node running V7.1.0.0 or V7.1.0.1 or V7.1.0.2 may result in the node reporting a 564 error and ceasing system operations. This problem can be avoided by upgrading the node to 7.1.0.3 or later before the SAS HIC is installed.

Resolving The Problem

Recovery if there are no offline volumes in the IO group:
It is important to check for offline volumes before removing a node, as doing so may result in loss of hardened cache data.

  1. Confirm there are no offline volumes in the IO group
  2. Remove the node from the cluster using the management GUI, or by running the following CLI command:

    rmnode <nodeid>
  3. Use the service assistant GUI on the node to force the node to leave cluster
  4. Use the service assistant GUI to reboot the node
  5. Re-add the node to the cluster using the management GUI or by running the following CLI command:

    svctask addnode -panelname <nodepanelname> <iogrp>
  6. Confirm via the management GUI that the new SAS HIC has been accepted


Recovery if there are offline volumes in the IO group
  1. Confirm that offline volumes exist in the IO group
  2. Power off the node by running the following CLI command:

    satask stopnode -poweroff <nodepanelname>
  3. Remove the newly added SAS HIC
  4. Allow the node to restart and join the cluster
  5. Confirm that there are no longer any offline volumes
  6. Remove the node from the cluster using the management GUI, or by running the following CLI command:

    rmnode <nodeid>
  7. Use the service assistant GUI on the node to force the node to leave cluster
  8. Use the service assistant GUI to power off the node
  9. Remove the node from the rack and install the SAS HIC
  10. Restore the node to the rack and use the front panel power button to power on the node
  11. Re-add the node to the cluster using the management GUI or by running the following CLI command:

    svctask addnode -panelname <nodepanelname> <iogrp>
  12. Confirm via the management GUI that the new SAS HIC has been accepted
[{"Product":{"code":"STPVGU","label":"SAN Volume Controller"},"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Component":"7.1","Platform":[{"code":"","label":"SAN Volume Controller"}],"Version":"7.1","Edition":"","Line of Business":{"code":"LOB26","label":"Storage"}}]

Document Information

More support for:
SAN Volume Controller

Software version:
7.1

Operating system(s):
SAN Volume Controller

Document number:
689225

Modified date:
17 June 2018

UID

ssg1S1004385

Manage My Notification Subscriptions

Page Feedback