Installing or replacing a PCI adapter with the system power on in Virtual I/O Server

You can install or replace a PCI adapter in the Virtual I/O Server logical partition or in the Integrated Virtualization Manager management partition.

The Virtual I/O Server includes a PCI Hot Plug Manager that is similar to the PCI Hot Plug Manager in the AIX® operating system. The PCI Hot Plug Manager allows you to hot plug PCI adapters into the server and then activate them for the logical partition without having to reboot the system. Use the PCI Hot Plug Manager for adding, identifying, or replacing PCI adapters in the system that are currently assigned to the Virtual I/O Server.

Getting started

Prerequisites:

If you are installing a new adapter, an empty system slot must be assigned to the Virtual I/O Server logical partition. This task can be done through dynamic logical partitioning (DLPAR) operations.
- If you are using a Hardware Management Console (HMC), you must also update the logical partition profile of the Virtual I/O Server so that the new adapter is configured to the Virtual I/O Server after you restart the system.
- If you are using the Integrated Virtualization Manager, an empty slot is probably already assigned to the Virtual I/O Server logical partition because all slots are assigned to the Virtual I/O Server by default. You only need to assign an empty slot to the Virtual I/O Server logical partition if you previously assigned all empty slots to other logical partitions.
If you are installing a new adapter, ensure that you have the software required to support the new adapter and determine whether there are any existing PTF prerequisites to install. To do this, use the IBM® Prerequisite Web site at http://www-912.ibm.com/e_dir/eServerPrereq.nsf
If you need help determining the PCI slot in which to place a PCI adapter, see the PCI adapter placement for machine types 82xx and 91xx or the PCI adapter placement for machine type 94xx.

Follow these steps to access the Virtual I/O Server, PCI Hot Plug Manager:

If you are using the Integrated Virtualization Manager, connect to the command-line interface.
Use the diagmenu command to open the Virtual I/O Server diagnostic menu. The menus are similar to the AIX diagnostic menus.
Select Task Selection, then press Enter.
At the Task Selection list, select PCI Hot Plug Manager.

Installing a PCI adapter

To install a PCI adapter with the system power on in Virtual I/O Server, do the following steps:

From the PCI Hot Plug Manager, select Add a PCI Hot Plug Adapter, then press Enter. The Add a Hot-Plug Adapter window is displayed.
Select the appropriate empty PCI slot from those listed, and press Enter. A fast-blinking amber LED located at the back of the server near the adapter indicates that the slot has been identified.
Follow the instructions on the screen to install the adapter until the LED for the specified PCI slot is set to the Action state. The adapter installation is performed the same as in a stand-alone AIX logical partition and includes the following sequence of events:
1. Set the adapter LED to the action state so that the indicator light for the adapter slot flashes
2. Physically install the adapter
3. Finish the adapter installation task in diagmenu.
Run the cfgdev command to configure the device for the Virtual I/O Server.

If you are installing a PCI, Fibre Channel adapter, it is now ready to be attached to a SAN and have LUNs assigned to the Virtual I/O Server for virtualization.

Replacing a PCI Adapter

Prerequisite: Before you can remove or replace a storage adapter, you must unconfigure that adapter. See Unconfiguring storage adapters for instructions.

To replace a PCI adapter with the system power on in Virtual I/O Server, do the following steps:

From the PCI Hot Plug Manager, select Unconfigure a Device, then press Enter.
Press F4 (or Esc +4) to display the Device Names menu.
Select the adapter you are removing in the Device Names menu.
In the Keep Definition field, use the Tab key to answer Yes. In the Unconfigure Child Devices field, use the Tab key again to answer YES, then press Enter.
Press Enter to verify the information on the ARE YOU SURE screen. Successful unconfiguration is indicated by the OK message displayed next to the Command field at the top of the screen.
Press F4 (or Esc +4) twice to return to the Hot Plug Manager.
Select replace/remove PCI Hot Plug adapter.
Select the slot that has the device to be removed from the system.
Select replace. A fast-blinking amber LED located at the back of the machine near the adapter indicates that the slot has been identified.
Press Enter which places the adapter in the action state, meaning it is ready to be removed from the system.

Unconfiguring storage adapters

Before you can remove or replace a storage adapter, you must unconfigure that adapter. Storage adapters are generally parent devices to media devices, such as disk drives or tape drives. Removing the parent requires that all attached child devices either be removed or placed in the define state.

Unconfiguring a storage adapter involves the following tasks:

Closing all applications that are using the adapter you are removing, replacing, or moving
Unmounting file systems
Ensuring that all devices connected to the adapter are identified and stopped
Listing all slots that are currently in use or a slot that is occupied by a specific adapter
Identifying the adapter's slot location
Making parent and child devices unavailable
Making the adapter unavailable

If the adapter supports physical volumes that are in use by a client logical partition, then You can perform steps on the client logical partition before unconfiguring the storage adapter. For instructions, see Preparing the client logical partitions. For example, the adapter might be in use because the physical volume was used to create a virtual target device, or it might be part of a volume group used to create a virtual target device.

Follow these steps to unconfigure SCSI, SSA, and Fibre Channel storage adapters:

Connect to the Virtual I/O Server command-line interface.
Use the oem_setup_env command to close all applications that are using the adapter you are unconfiguring.
Type lsslot-c pci to list all the hot plug slots in the system unit and display their characteristics.
Type lsdev -C to list the current state of all the devices in the system unit.
Type unmount to unmount previously mounted file systems, directories, or files using this adapter.
Type rmdev -l adapter -R to make the adapter unavailable.
Attention: Do not use the -d flag with the rmdev command for hot plug operations because this action removes your configuration.

Preparing the client logical partitions

If the virtual target devices of the client logical partitions are not available, the client logical partitions can fail or they might be unable to perform I/O operations for a particular application. If you use the HMC to manage the system, you might have redundant Virtual I/O Server logical partitions, which allow for Virtual I/O Server maintenance and avoid downtime for client logical partitions. If you are replacing an adapter on the Virtual I/O Server and your client logical partition is dependent on one or more of the physical volumes accessed by that adapter, then You can take action on the client before you unconfigure the adapter.

The virtual target devices must be in the define state before the Virtual I/O Server adapter can be replaced. Do not remove the virtual devices permanently.

To prepare the client logical partitions so that you can unconfigure an adapter, complete the following steps depending on your situation.

Table 1. Situations and steps for preparing the client logical partitions
Situation	Steps
You have redundant hardware on the Virtual I/O Server for the adapter.	No action is required on the client logical partition.
HMC-managed systems only: You have redundant Virtual I/O Server logical partitions that, in conjunction with virtual client adapters, provide multiple paths to the physical volume on the client logical partition.	No action is required on the client logical partition. However, path errors might be logged on the client logical partition.
HMC-managed systems only: You have redundant Virtual I/O Server logical partitions that, in conjunction with virtual client adapters, provide multiple physical volumes that are used to mirror a volume group.	See the procedures for your client operating system. For example, for AIX, see Replacing a disk on the Virtual I/O Server in the IBM System p® Advanced POWER® Virtualization Best Practices Redpaper. The procedure for Linux is similar to this procedure for AIX.
You do not have redundant Virtual I/O Server logical partitions.	Shut down the client logical partition. For instructions, see the following topics about shutting down logical partitions: For systems that are managed by the HMC, see "Shutting down AIX logical partitions using the HMC", "Shutting down IBM i logical partitions using the HMC", and "Shutting down Linux logical partitions using the HMC" in the Logical partitioning.¹ For systems that are managed by the Integrated Virtualization Manager, see Shutting down logical partitions.
¹The Logical partitioning can be found on the Hardware Information Web site at http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/iphdx/power_systems.htm.