Topic
  • 17 replies
  • Latest Post - ‏2013-02-21T21:35:27Z by agilson
agilson
agilson
16 Posts

Pinned topic Network connection: x3650 M3 to x3650 M3

‏2013-01-07T21:14:32Z |
Interesting scenario that I'm trying to debug. I have 4 x3650 M3's stacked in a rack. Let's call them Server1 through Server4.

Server1 has a file, 476MB on it.
Server2 is able to copy the file from Server1 fine, at around 100 MB/s.
Server3 is able to copy the file from Server1 fine, at around 40 MB/s (heavier used server)
Server4 is able to copy the file from Server1 fine, but at only 700KB/s to 1.1MB/s

I have tried Server1 and Server4 with all combinations of NIC's in Auto sense or hard-locked at 1GB Full-duplex. Currently they are hard locked at that speed.

Now the trick to this. If I PUSH the file from Server1 to Server4 it goes fine at 124 MB/s average. So, what would cause a file pull from Server4 to Server1 to transfer at 700KB/s, but a push from Server1 to Server4 to average out to 124 MB/s?

Thoughts?
Updated on 2013-02-21T21:35:27Z at 2013-02-21T21:35:27Z by agilson
  • agilson
    agilson
    16 Posts

    Re: Network connection: x3650 M3 to x3650 M3

    ‏2013-01-07T21:15:29Z  
    More details: all firmware has the most current updates, and all machines are running Windows Server 2008 R2.
  • agilson
    agilson
    16 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-07T21:19:24Z  
    Shoot, I messed up the model numbers. There x3550 M3's, not x3650 M3's. We have some x3650's that I had in mind from another task today, but they're in a different location.
  • Novikov_Alexander
    Novikov_Alexander
    6877 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-09T03:53:23Z  
    • agilson
    • ‏2013-01-07T21:19:24Z
    Shoot, I messed up the model numbers. There x3550 M3's, not x3650 M3's. We have some x3650's that I had in mind from another task today, but they're in a different location.
    Dear Alan,

    could you provide DSA logs of all 4 servers.

    Regards,
    Alexander Novikov
    Russia, Moscow
  • agilson
    agilson
    16 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-09T14:51:20Z  
    Dear Alan,

    could you provide DSA logs of all 4 servers.

    Regards,
    Alexander Novikov
    Russia, Moscow
    Server 1.
  • agilson
    agilson
    16 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-09T14:53:19Z  
    Dear Alan,

    could you provide DSA logs of all 4 servers.

    Regards,
    Alexander Novikov
    Russia, Moscow
    Server 2.
  • agilson
    agilson
    16 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-09T14:54:06Z  
    Dear Alan,

    could you provide DSA logs of all 4 servers.

    Regards,
    Alexander Novikov
    Russia, Moscow
    Server 4. I can't collect a report for server 3 right now.
  • Novikov_Alexander
    Novikov_Alexander
    6877 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-10T05:38:29Z  
    • agilson
    • ‏2013-01-09T14:54:06Z
    Server 4. I can't collect a report for server 3 right now.
    Hi Alan,

    what about DSA logs?

    Regards,
    Alexander Novikov
    Russia, Moscow
  • agilson
    agilson
    16 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-10T06:37:49Z  
    Hi Alan,

    what about DSA logs?

    Regards,
    Alexander Novikov
    Russia, Moscow
    Server 4.
  • agilson
    agilson
    16 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-10T06:39:48Z  
    • agilson
    • ‏2013-01-10T06:37:49Z
    Server 4.
    Server 2
  • agilson
    agilson
    16 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-10T06:58:22Z  
    • agilson
    • ‏2013-01-10T06:39:48Z
    Server 2
    Server 1.
  • Novikov_Alexander
    Novikov_Alexander
    6877 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-14T19:44:53Z  
    • agilson
    • ‏2013-01-10T06:58:22Z
    Server 1.
    Hi Alan,

    as we can see in logs you have 3 differently configured servers with different RAID controllers and software. And as result they worked differently.
    In any cases first of all update all servers software:

    IBM ServeRAID M Series SAS Controller Driver for Windows v5.2.127.64
    Online Broadcom NetXtreme II Firmware Update Utility for Windows v6.2.0
    Matrox Video Driver v6.12.01.1030

    Regards,
    Alexander Novikov
    Russia, Moscow
  • agilson
    agilson
    16 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-15T15:28:10Z  
    Hi Alan,

    as we can see in logs you have 3 differently configured servers with different RAID controllers and software. And as result they worked differently.
    In any cases first of all update all servers software:

    IBM ServeRAID M Series SAS Controller Driver for Windows v5.2.127.64
    Online Broadcom NetXtreme II Firmware Update Utility for Windows v6.2.0
    Matrox Video Driver v6.12.01.1030

    Regards,
    Alexander Novikov
    Russia, Moscow
    Thanks for your response. I went through and updated all servers. Transfer speed is still the same, nothing changed.

    • Al
  • Novikov_Alexander
    Novikov_Alexander
    6877 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-15T19:35:21Z  
    • agilson
    • ‏2013-01-15T15:28:10Z
    Thanks for your response. I went through and updated all servers. Transfer speed is still the same, nothing changed.

    • Al
    Hi Alan,

    now lets check updated DSA logs of your servers.

    Regards,
    Alexander Novikov
    Russia, Moscow
  • agilson
    agilson
    16 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-15T21:31:32Z  
    Hi Alan,

    now lets check updated DSA logs of your servers.

    Regards,
    Alexander Novikov
    Russia, Moscow
    Server 1
  • agilson
    agilson
    16 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-15T21:31:55Z  
    Hi Alan,

    now lets check updated DSA logs of your servers.

    Regards,
    Alexander Novikov
    Russia, Moscow
    Server 2
  • agilson
    agilson
    16 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-01-15T21:32:21Z  
    • agilson
    • ‏2013-01-15T21:31:55Z
    Server 2
    Server 4.
  • agilson
    agilson
    16 Posts

    Re: Network connection: x3550 M3 to x3550 M3

    ‏2013-02-21T21:35:27Z  
    • agilson
    • ‏2013-01-15T21:32:21Z
    Server 4.
    As an update, I was able to fix this by turning off TCP Offloading on the NIC's.

    • Al