Adapter placement rules and slot priorities for the EMX0 PCIe Gen3 I/O expansion drawer
Find information about the placement rules and
slot priorities for the adapters that are supported for the EMX0 PCIe Gen3 I/O expansion drawer (EMX0 PCIe3 expansion drawer).
Slot descriptions for the EMX0 PCIe3 expansion drawer
The number of PCIe slots that are provided in
the EMX0 PCIe3 expansion drawer depends on the I/O module configuration of
the EMX0 PCIe3 expansion drawer. Your configuration might have one or two
PCIe3 6-slot fanout modules installed in the rear of the EMX0 PCIe3 expansion drawer. Each PCIe3 6-slot fanout module provides six full-length, full-height, PCIe3 slots.
The PCIe3 slots are compatible with PCIe1 and PCIe2 adapters. The PCIe slots use generation 3,
single-wide, blind-swap cassettes.
The I/O module in the EMX0 PCIe3 expansion drawer is connected to the
system with an expansion drawer cable pair. Each cable pair must
be the same length and are attached to the T1 and T2 ports in the I/O module and to the
corresponding ports in the PCIe3 cable adapter in the
system.
Figure 1 shows the rear view of the EMX0 PCIe3 expansion drawer with the location codes for the adapter slots in the
PCIe3 6-slot fanout module.
Table 1 lists the adapter slot locations and
details for the EMX0 PCIe3 expansion drawer. Figure 1. Rear view of a EMX0 PCIe3 expansion drawer with PCIe slot location codes
Note:
The left I/O module bay is configured with the first PCIe3 6-slot fanout module slot location codes P1-C1 through P1-C6.
The right I/O module bay is configured with the second PCIe3 6-slot fanout module slot location codes P2-C1 through P2-C6.
Table 1. Slot locations and descriptions for the EMX0 PCIe3 expansion drawer
Location code
Description
Slot capabilities
SR-IOV
Dynamic direct memory access (DMA) window
I/O adapter enlarged capacity enablement order
P1-C1
PCIe3 x16
Yes
Yes
Yes1
P1-C2
PCIe3 x8
Yes
Yes
No
P1-C3
PCIe3 x8
Yes
Yes
No
P1-C4
PCIe3 x16
Yes
Yes
No
P1-C5
PCIe3 x8
Yes
Yes
No
P1-C6
PCIe3 x8
Yes
Yes
No
P2-C1
PCIe3 x16
Yes
Yes
Yes1
P2-C2
PCIe3 x8
Yes
Yes
No
P2-C3
PCIe3 x8
Yes
Yes
No
P2-C4
PCIe3 x16
Yes
Yes
No
P2-C5
PCIe3 x8
Yes
Yes
No
P2-C6
PCIe3 x8
Yes
Yes
No
1Slots P1-C1 and P2-C1 inherit the I/O Adapter Enlarged Capacity attribute from the
slot in the system that connects to the EMX0 PCIe3 expansion drawer.
Notes:
All slots are PCIe3 slots.
All slots support full-length, full-height adapters or short form-factor with a full-height
tailstock in single-wide, generation 3, blind-swap cassettes.
Slots C1 and C4 in each PCIe3 6-slot fanout module are PCIe3 x16
buses and slots C2, C3, C5, and C6 are PCIe x8 buses.
All slots support enhanced error handling (EEH).
All PCIe slots are hot swappable and can be serviced with the power on.
All six adapters in a PCIe3 6-slot fanout module
can be in SR-IOV shared mode.
If you have a CCIN 50CB PCIe3 6-slot fanout module, the FC EC2S
and FC EC2U adapters are only supported in slots C2 and C5. If you have a CCIN 50CD PCIe3 6-slot fanout module, the FC EC2S and FC EC2U adapters are supported in
slots C1 through C6, but only four FC EC2S and FC EC2U adapters can be in SR-IOV mode at a
time.
Firmware slot capabilities
System PCIe slots are allocated direct memory access (DMA) space using the following algorithm:
All slots are allocated a 2 GB default DMA window.
Slots P1-C1 and P2-C1 inherit the I/O Adapter Enlarged Capacity attribute from the slot in the
system that connects to the EMX0 PCIe3 expansion drawer.
All other I/O adapter slots are allocated Dynamic DMA Window (DDW) capability based on installed
platform memory. DDW capability is calculated assuming 4K I/O mappings:
For systems with less than 64 GB of memory, slots are allocated no DDW capability.
For systems with at least 64 GB of memory, but less than 128 GB of memory, slots are allocated
16 GB of DDW capability.
For systems with at least 128 GB of memory, but less than 256GB of memory, slots are allocated
32 GB of DDW capability.
For systems with 256 GB or more of memory, slots are allocated 64 GB of DDW capability.
Adapters placement rules
Use this information while selecting slots for installing adapters in the EMX0 PCIe3 expansion drawer attached to the system. Use Table 2 to identify slot placement priorities and the
maximum number of adapters that can be installed in the EMX0 PCIe3 expansion drawer based on the operating system.
Note: You can click the link
that appears in the feature code column for more technical information specific to the
adapter.
If the EMX0 PCIe3 expansion drawer is configured with two PCIe3 6-slot
fanout modules, distribute the adapters across both I/O modules whenever possible.
If FC EC46 is driving the internal DVD, it must be installed in the I/O expansion drawer that is
closest to the system. The system and IO expansion drawer must be in the same rack.
Note: If slot
P1-C2 of the first node contains a controller adapter (CC), it must be the first option to consider
for wiring the module with the USB adapter driving the internal DVD. If it is a PCIe3 6-slot fanout module, install FC EC46 in slot Px-C3 of the PCIe3 6-slot fanout module.
Do not attempt to install x16 adapters in x8 slots. Doing so can damage the x16 connectors in
the EMX0 PCIe3 expansion drawer.
Table 2. Adapter slot priorities and maximum adapters supported in the
EMX0 PCIe3 expansion drawer
PCIe3 2-port 10 GbE NIC & RoCE SR adapter (FC EC2M,
EC2N, and EL54; CCIN 57BE); Adapter part number: full-height tailstock: 00RX875, low-profile
tailstock: 00RX872
PCIe3 2-port 10 GbE NIC & RoCE SR adapter (FC EC2M,
EC2N, and EL54; CCIN 57BE); Adapter part number: full-height tailstock: 00RX875, low-profile
tailstock: 00RX872
1The slot priority sequence is based on a EMX0 PCIe3 expansion drawer configured with two PCIe3 6-slot fanout modules.
2The maximum number of adapters supported per PCIe3 6-slot fanout module.
3If you have a CCIN 50CB PCIe3 6-slot fanout module, the
FC EC2S and FC EC2U adapters are only supported in slots C2 and C5. If you have a CCIN 50CD PCIe3 6-slot fanout module, the FC EC2S and FC EC2U adapters are supported in
slots C1 through C6, but only four FC EC2S and FC EC2U adapters can be in SR-IOV mode at a time.
