Removing and replacing a faulty node

You can use this procedure to remove a faulty node and replace it with a new node. You can remove the parts from the faulty node and reinstall them into the new node. You can also use this procedure to allow for replacement of parts inside the node.

About this task

Notes:
  • Ensure the FRU part number (P/N) of the replacement part matches that of the failed node, or is an approved substitute. The FRU P/N is identified on the label of the and on the FRU packaging.
  • Do not operate the control enclosure with one node that is removed for longer than 16 minutes. Operating for longer than this period might cause the enclosure to shut down due to overheating.
  • A Phillips screw driver is required to remove the node cover. Do not remove or loosen any other screws.
  • Use care when you remove a node from the control enclosure. The node is long and its center of gravity is far forward. It can be helpful to have a lift or other sturdy, flat surface ready to receive the node during removal.

Procedure

  1. Review the Event Log to identify the faulty node.
  2. Review Procedure: Understanding system volume dependencies to identify any volume dependencies on the node .
  3. Follow Procedure: Powering off a node canister to verify that the hosts do not lose access to data in volumes.
  4. From the rear of the control enclosure, label each cable and remove it from the node.

Removing the faulty node

  1. Remove the node, as described in Removing and reseating a node, and place it on a flat, level surface.
  2. Remove the new node from its packaging.
    Ensure that the FRU P/N of the replacement node matches that of the failed node or that the new P/N is an approved substitute. See Replaceable units for more information.
  3. Remove the covers from the faulty and replacement nodes and set them aside, as described in Removing and replacing the cover of a node.
  4. Remove the air baffles from the faulty and replacement nodes and set them aside, as described in Removing and replacing the air baffle of a node.
  5. Complete the following procedures to remove parts from the faulty node and install them in the replacement node.

Replacing the new node

  1. Replace the air baffle in the new node canister, as described in Removing and replacing the air baffle of a node.
  2. Replace the cover on the new node, as described in, as described in Removing and replacing the cover of a node.
  3. Install the new node into the control enclosure, as described in Removing and reseating a node.
  4. Reconnect the cables that were removed in step 4 to the appropriate ports in the replacement node.
  5. If the node was communicating with other nodes using RDMA over Ethernet, then use the Service Assistant Tool or the sainfo lsnodeip command to check if the node IP configuration has been lost. Use the Service Assistant Tool or the satask chnodeip command to set the node IP if needed.
    Note: Step 14 is only needed for a new node.
  6. Use the management GUI or service assistant GUI to check that the node is online (or is Active) in the system.
  7. Enter the service assistant command satask chbootdrive -replacecanister to update the drives to match the serial number of the new node.
    Note: Node error code 545 is expected. For more information, see 545.

    To help identify the node, the inside of the release levers are labeled with the serial number.

  8. Review the management GUI to determine that all errors are resolved.