Verifying that RDMA is working
Ensure that RDMA is working between the two nodes by running a single command on each node.
Before you begin
Procedure
- System A: Run the following command and look for
output similar to the example below:
ib_write_bw RDMA_Write BW Test Number of qp's running 1 Connection type : RC Each Qp will post up to 100 messages each time Inline data is used up to 0 bytes message local address: LID 0x03, QPN 0x36004a, PSN 0x9357fd RKey 0xe2002015 VAddr 0x000fffab760000 remote address: LID 0x09, QPN 0x40004a, PSN 0x371132, RKey 0xd4002102 VAddr 0x000fffaa720000 Mtu : 2048 #bytes #iterations BW peak[MB/sec] BW average[MB/sec] Warning: measured timestamp frequency 511.975 differs from nominal 4005 MHz 65536 5000 1547.24 1547.21 - System B: Run the following command, including
the IP address of the server, and look for output similar to the example
below:
ib_write_bw 9.47.67.198 RDMA_Write BW Test Number of qp's running 1 Connection type : RC Each Qp will post up to 100 messages each time Inline data is used up to 0 bytes message local address: LID 0x09, QPN 0x40004a, PSN 0x371132 RKey 0xd4002102 VAddr 0x000fffaa720000 remote address: LID 0x03, QPN 0x36004a, PSN 0x9357fd, RKey 0xe2002015 VAddr 0x000fffab760000 Mtu : 2048 #bytes #iterations BW peak[MB/sec] BW average[MB/sec] Warning: measured timestamp frequency 511.975 differs from nominal 4005 MHz 65536 5000 1547.24 1547.21
Parent topic: InfiniBand how-to topics