Verifying that RDMA is working

Ensure that RDMA is working between the two nodes by running a single command on each node.

Before you begin

The perftest package is required to complete this task.

Procedure

  1. System A: Run the following command and look for output similar to the example below:
    ib_write_bw
    
    RDMA_Write BW Test 
    Number of qp's running 1 
    Connection type : RC 
    Each Qp will post up to 100 messages each time 
    Inline data is used up to 0 bytes message 
    local address: LID 0x03, QPN 0x36004a, PSN 0x9357fd RKey 0xe2002015 VAddr 0x000fffab760000 
    remote address: LID 0x09, QPN 0x40004a, PSN 0x371132, RKey 0xd4002102 VAddr 0x000fffaa720000 
    Mtu : 2048 
    
    #bytes #iterations BW peak[MB/sec] BW average[MB/sec] 
    Warning: measured timestamp frequency 511.975 differs from nominal 4005 MHz 
    65536 5000 1547.24 1547.21 
  2. System B: Run the following command, including the IP address of the server, and look for output similar to the example below:
    ib_write_bw 9.47.67.198
    
    RDMA_Write BW Test 
    Number of qp's running 1 
    Connection type : RC 
    Each Qp will post up to 100 messages each time 
    Inline data is used up to 0 bytes message 
    local address: LID 0x09, QPN 0x40004a, PSN 0x371132 RKey 0xd4002102 VAddr 0x000fffaa720000 
    remote address: LID 0x03, QPN 0x36004a, PSN 0x9357fd, RKey 0xe2002015 VAddr 0x000fffab760000 
    Mtu : 2048 
    
    #bytes #iterations BW peak[MB/sec] BW average[MB/sec] 
    Warning: measured timestamp frequency 511.975 differs from nominal 4005 MHz 
    65536 5000 1547.24 1547.21