Networking scalability on high-performance servers

How to avoid problems with Linux networking scalability on high-performance systems

Figure 1. netserver on SUT in out of the box configuration
netserver on SUT in out-of-the-box configuration

Figure 2. netperf on SUT in out of the box configuration
netperf on SUT in out-of-the-box configuration

Figure 3. netperf and netserver (bidirectional) on SUT "out of the box"
netperf and netserver (bidirectional) on SUT out of the box

Figure 4. netserver, out of the box with numactl
netserver, out of the box with numactl

Figure 5. netperf, out of the box with numactl
netperf, out of the box with numactl

Figure 6. netperf and netserver (bidirectional), out of the box with numactl
netperf and netserver (bidirectional), out of the box with numactl

Figure 7. netserver, Ethernet SMP IRQ affinity, no irqbalance
netserver, Ethernet SMP IRQ affinity, no irqbalance

Figure 8. netperf, Ethernet SMP IRQ affinity, no irqbalance
netperf, Ethernet SMP IRQ affinity, no irqbalance

Figure 9. netperf and netserver (bidirectional), Ethernet SMP IRQ affinity, no irqbalance
netperf and netserver (bidirectional), Ethernet SMP IRQ affinity, no irqbalance

Figure 10. netserver, Ethernet SMP IRQ affinity and numactl, no irqbalance
netserver, Ethernet SMP IRQ affinity and numactl, no irqbalance

Figure 11. netperf, Ethernet SMP IRQ affinity and numactl, no irqbalance
netperf, Ethernet SMP IRQ affinity and numactl, no irqbalance

Figure 12. Bidirectional, Ethernet SMP IRQ affinity and numactl, no irqbalance
Bidirectional, Ethernet SMP IRQ affinity and numactl, no irqbalance

Figure 14. netserver, Ethernet SMP IRQ affinity, no irqbalance, with and without bonding
netserver, Ethernet SMP IRQ affinity, no irqbalance, with and without bonding