smcr - Display information about SMC-R link groups, links and devices

Red Hat Enterprise Linux 8.6 LPAR mode z/VM guest KVM guest

SMC-R connections are based on RoCE devices, see RDMA over Converged Ethernet.
Read syntax diagramSkip visual syntax diagram smcr -d-ddlinkgroupshowlink-showhelpall<LG-ID>deviceshowhelpallibdev <dev>netdev <dev>-d-astatsshowhelpresetjsoninfo
Where:
-d or --details
displays detailed information about SMC-R link groups, devices, or statistics.
-dd or --ddetails
displays more details about SMC-R link groups and devices.
linkgroup
displays information about SMC-R link groups and links.
device
displays information about a specified SMC-R device, or all.
stats
displays statistics for SMC-R.
link-show
displays information about a specified link, or all.
show
displays information about the link group or device.
all
displays information about all link groups or devices.
<LG-ID>
Link group ID
ibdev <dev>
limits the command output to the device port with the specified RoCE device name.
netdev <dev>
limits the command output to the device with the specified network device name.
reset
displays the current statistics and resets all SMC-R statistics counters to zero.
-a or --absolute
ignores any counter resets and displays statistics beginning with smc module load.
json
displays the current statistics in JSON format.
info
displays a summary of the SMC levels supported in the Linux kernel, and the capabilities of the hardware:
Kernel Capabilities
Shows the Linux kernel’s SMC capabilities independently of any hardware prerequisites.
Hardware Capabilities
Shows the hardware’s capabilities independently of support for it in Linux.
-h or --help
displays help information for the specified sub-command. Depending on the sub-command of interest, specify smcr device help, smcr linkgroup help, or smcr stats help. To view the man page, enter man smcr.
-v or --version
displays version information.

Output columns for linkgroup and device

In the output tables for smcr linkgroup and smcr device, the columns headers have the following meanings:

Net-Dev
Network device name.
IB-Dev
RoCE (InfiniBand) device name.
IB-P
InfiniBand port of the RoCE device. The port count starts with 1. Consequently, devices where each port is represented as a separate device indicate the port as the first port for all ports.
IB-State
State of the RoCE device port. The state can be INACTIVE or ACTIVE.
Type
Type of the underlying PCI device. For SMC-R, the type can be:
  • RoCE_Express
  • RoCE_Express 2
Crit
Show whether the device is critical, that is, without a failover possibility. The value can be:
Yes
At least one link group runs on the device with state "SINGLE" or locally "ASYMMETRIC", which means that one or more link groups lack a failover device.
No
No link group running on the device with state "SINGLE" or locally "ASYMMETRIC", which means that the link group or groups all have a fallback device.
FID
Function ID of the PCI device.
PCI-ID
ID of the PCI device.
PCHID
Physical channel ID of the PCI device.
#Links
Number of links on the device.
PNET-ID
PNET ID of the device. A leading asterisk (*) means that the PNET ID is set by the user. For example, *NET1.

Output of stats

For the output of the stats sub-command, see Obtaining statistics for SMC connections.

Examples

  • To display all SMC-R link groups, issue:
    # smcr linkgroup show all
    LG-ID    LG-Role LG-Type  VLAN #Conns  PNET-ID
    00000100 CLNT    SYM         0      1  NET1
  • To display all SMC-R links, issue:
    # smcr linkgroup link-show all
    LG-ID    LG-Role LG-Type Net-Dev    Link-State   #Conns
    00000100 CLNT    SYM     ens281     LINK_ACTIVE       1
    00000100 CLNT    SYM     enP1s282   LINK_ACTIVE       0
  • To display SMC-R devices, issue:
    # smcr device show all
    Net-Dev  IB-Dev  IB-P   IB-State  Type          Crit #Links  PNET-ID
    ens281   mlx4_0     1   ACTIVE    RoCE_Express   No       1  NET1
    ens281d1 mlx4_0     2   INACTIVE  RoCE_Express   No       1  NET2
  • To limit the output to device ens281, issue:
    # smcr device show netdev ens281
    Net-Dev IB-Dev   IB-P   IB-State  Type         Crit  #Links  PNET-ID
    ens281  mlx4_0      1   ACTIVE    RoCE_Express   No       1  NET1
  • To show SMC-R statistics:
    # smcr stats
  • To show detailed SMC-R statistics and reset SMC-R statistics counters:
    # smcr -d stats reset
  • To ignore any counter resets and show detailed SMC-R statistics since module load in JSON format:
    # smcr -da stats json