Topic
1 reply Latest Post - ‏2013-01-14T22:02:54Z by W-SS
Tux11
Tux11
20 Posts
ACCEPTED ANSWER

Pinned topic massive performance problems after changing hardware & software

‏2013-01-14T08:13:22Z |
Hi,
our old system:

IBM P520 with AIX 5.3 and TSM 5.5.x as Partiton (AIX 5300-06-07-0818)

new System: IBM P720, 4 CPU´s, 28 GB RAM

LPAR: des. 24 GB RAM, max. 28 GB uncapped (Weight: 128), CPU: des. 2.0., max. 4.0 with AIX 6.1 TL8 (6100-08-01-1245)
VIO: des. 2 GB RAM, max. 8 GB uncapped (Weight: 255), CPU: des. 2.0, max. 4.0 (VIO 2.2.1.4)

no Active memory expansion active.

We backup sap system with 3 Sessions (3 Tapes) simultaneously.
The Problem our Backup takes mutch longer than with the old Hardware.
The old throughput was ~500GB/h, with new Hardware: ~300GB/h.

The max. per Tapes are 150 GB/h so the Tapes are not the Problem.

before we changed CPU and Networkparameters on VIO & LPAR

$ lsmap -all -net
SVEA Physloc

--------------------------------------------
ent4 U8231.E1C.06B79FR-V2-C7-T1

SEA ent8
Backing device ent1
Status Available
Physloc U78AB.001.WZSHMFW-P1-C7-T2

SVEA Physloc

--------------------------------------------
ent5 U8231.E1C.06B79FR-V2-C10-T1

SEA ent7
Backing device ent0
Status Available
Physloc U78AB.001.WZSHMFW-P1-C7-T1

SVEA Physloc

--------------------------------------------
ent6 U8231.E1C.06B79FR-V2-C66-T1

SEA ent9
Backing device ent2
Status Available
Physloc U78AB.001.WZSHMFW-P1-C7-T3
for i in 7 8 9
do
chdev -l ent$i -a min_buf_huge=64 -P
chdev -l ent$i -a max_buf_large=128 -P
chdev -l ent$i -a min_buf_large=64 -P
chdev -l ent$i -a max_buf_medium=512 -P
chdev -l ent$i -a min_buf_medium=256 -P
chdev -l ent$i -a max_buf_small=4096 -P
chdev -l ent$i -a min_buf_small=2048 -P
chdev -l ent$i -a max_buf_tiny=4096 -P
chdev -l ent$i -a min_buf_tiny=2048 -P
done

the backuptime was near 4 times longer than with the old Hardware

If we have Backups with one or two sessions
the Backuptime is the same than with the old system.

LPAR:

root@tsmsrv:/home/root>lsattr -El ent1
alt_addr 0x000000000000 Alternate Ethernet Address True
chksum_offload yes Checksum Offload Enable True
copy_buffs 32 Transmit Copy Buffers True
copy_bytes 65536 Transmit Copy Buffer Size True
desired_mapmem 0 I/O memory entitlement reserved for device False
max_buf_huge 64 Maximum Huge Buffers True
max_buf_large 128 Maximum Large Buffers True
max_buf_medium 512 Maximum Medium Buffers True
max_buf_small 4096 Maximum Small Buffers True
max_buf_tiny 4096 Maximum Tiny Buffers True
min_buf_huge 64 Minimum Huge Buffers True
min_buf_large 64 Minimum Large Buffers True
min_buf_medium 256 Minimum Medium Buffers True
min_buf_small 2048 Minimum Small Buffers True
min_buf_tiny 2048 Minimum Tiny Buffers True
trace_debug no Trace Debug Enable True
use_alt_addr no Enable Alternate Ethernet Address True
VIO:

  1. lsattr -El ent4
alt_addr 0x000000000000 Alternate Ethernet Address True
chksum_offload yes Checksum Offload Enable True
copy_buffs 32 Transmit Copy Buffers True
copy_bytes 65536 Transmit Copy Buffer Size True
desired_mapmem 0 I/O memory entitlement reserved for device False
max_buf_huge 128 Maximum Huge Buffers True
max_buf_large 128 Maximum Large Buffers True
max_buf_medium 512 Maximum Medium Buffers True
max_buf_small 4096 Maximum Small Buffers True
max_buf_tiny 4096 Maximum Tiny Buffers True
min_buf_huge 64 Minimum Huge Buffers True
min_buf_large 64 Minimum Large Buffers True
min_buf_medium 256 Minimum Medium Buffers True
min_buf_small 2048 Minimum Small Buffers True
min_buf_tiny 2048 Minimum Tiny Buffers True
trace_debug no Trace Debug Enable True
use_alt_addr no Enable Alternate Ethernet Address True
OLD System: TSM Partiton

955 root@tsm_old:/home/root>lsattr -El ent1
alt_addr 0x000000000000 Alternate Ethernet address True
flow_ctrl no Request Transmit and Receive Flow Control True
jumbo_frames no Request Transmit and Receive Jumbo Frames True
large_send yes Enable hardware Transmit TCP segmentation True
media_speed Auto_Negotiation Requested media speed True
multicore yes Enable Multi-Core Scaling True
rx_cksum yes Enable hardware Receive checksum True
rx_cksum_errd yes Discard RX packets with checksum errors True
rx_clsc 1G Enable Receive interrupt coalescing True
rx_clsc_usec 95 Receive interrupt coalescing window True
rx_q1_num 8192 Number of Receive queue 1 WQEs True
rx_q2_num 4096 Number of Receive queue 2 WQEs True
rx_q3_num 2048 Number of Receive queue 3 WQEs True
tx_cksum yes Enable hardware Transmit checksum True
tx_isb yes Use Transmit Interface Specific Buffers True
tx_q_num 512 Number of Transmit WQEs True
use_alt_addr no Enable alternate Ethernet address True

959 root@tsm_old:/home/root>lsattr -El ent0
alt_addr 0x000000000000 Alternate Ethernet address True
flow_ctrl no Request Transmit and Receive Flow Control True
jumbo_frames no Request Transmit and Receive Jumbo Frames True
large_send yes Enable hardware Transmit TCP segmentation True
media_speed Auto_Negotiation Requested media speed True
multicore yes Enable Multi-Core Scaling True
rx_cksum yes Enable hardware Receive checksum True
rx_cksum_errd yes Discard RX packets with checksum errors True
rx_clsc 1G Enable Receive interrupt coalescing True
rx_clsc_usec 95 Receive interrupt coalescing window True
rx_q1_num 8192 Number of Receive queue 1 WQEs True
rx_q2_num 4096 Number of Receive queue 2 WQEs True
rx_q3_num 2048 Number of Receive queue 3 WQEs True
tx_cksum yes Enable hardware Transmit checksum True
tx_isb yes Use Transmit Interface Specific Buffers True
tx_q_num 512 Number of Transmit WQEs True
use_alt_addr no Enable alternate Ethernet address True
Updated on 2013-01-14T22:02:54Z at 2013-01-14T22:02:54Z by W-SS
  • W-SS
    W-SS
    4 Posts
    ACCEPTED ANSWER

    Re: massive performance problems after changing hardware & software

    ‏2013-01-14T22:02:54Z  in response to Tux11
    Did you check this

    http://ibmsystemsmag.blogs.com/aixchange/2010/03/an-ethernet-configuration-tip.html

    ?