Topic
  • 10 replies
  • Latest Post - ‏2013-03-29T13:59:18Z by Mach_v
SystemAdmin
SystemAdmin
3234 Posts

Pinned topic BCH + HS23 + BNT VFS + v7k FCoE

‏2013-03-27T16:29:05Z |
Hello all,

I am going bonkers trying to support an installation of FCoE centric BCH + HS23 deployment.
Here are the components:
1. BCH Chassis equipped with:
- 2 x BNT L2/L3 Gigabit switches
- 2 x IBM Virtual Fabric 10Gbit Switches
2. 2 x HS23 servers with the 10Gbit interposer installed, Emulex VFA on board and the FCoE/iSCSI license installed
3. Storwize v7000 (2076-324)with 4 x 10Gbit iSCSI/FCoE ports
4. vSphere Essentials Plus 3 host license

Here is the problem:
We cannot get the FCoE vNIC to go up, in has no link to the switch. So there can be no connectivity to the v7000.
As an alternative we have tried iSCSI on the vNIC and it's working fine.

Anybody had issues with this kind of deployment in the past? Any ideas? We're going crazy here, are willing to try anything.
Updated on 2013-03-29T13:59:18Z at 2013-03-29T13:59:18Z by Mach_v
  • SystemAdmin
    SystemAdmin
    3234 Posts

    Re: BCH + HS23 + BNT VFS + v7k FCoE

    ‏2013-03-27T16:55:26Z  
    Hello, are you sure, that V7000 can be connected like that ? Which type of ports do you have there on V7000 side ? I think that there are iSCSI Ethernet 1Gbit and possibly 10Gbit and FC ports 8Gbit ...
  • SystemAdmin
    SystemAdmin
    3234 Posts

    Re: BCH + HS23 + BNT VFS + v7k FCoE

    ‏2013-03-27T17:07:47Z  
    Hello, are you sure, that V7000 can be connected like that ? Which type of ports do you have there on V7000 side ? I think that there are iSCSI Ethernet 1Gbit and possibly 10Gbit and FC ports 8Gbit ...
    Yes, you can.
    The link below states it pretty clearly.
    As I don't need multiple enclosure clustering it should do just fine.
    https://www.ibm.com/developerworks/mydeveloperworks/blogs/storagevirtualization/entry/svc_v7000_6_4_software_release_ndvm_fcoe_rtc_and_much_more1?lang=en
  • SystemAdmin
    SystemAdmin
    3234 Posts

    Re: BCH + HS23 + BNT VFS + v7k FCoE

    ‏2013-03-27T17:57:37Z  
    Yes, you can.
    The link below states it pretty clearly.
    As I don't need multiple enclosure clustering it should do just fine.
    https://www.ibm.com/developerworks/mydeveloperworks/blogs/storagevirtualization/entry/svc_v7000_6_4_software_release_ndvm_fcoe_rtc_and_much_more1?lang=en
    Ok, thank you for the info, is seams more like FCoE configuration issue. Sorry, I did a mistake.
  • SlowinskiS
    SlowinskiS
    28 Posts

    Re: BCH + HS23 + BNT VFS + v7k FCoE

    ‏2013-03-27T18:10:05Z  
    Ok, thank you for the info, is seams more like FCoE configuration issue. Sorry, I did a mistake.
    It won't work with FCoE ,
    For FCoE you need to have some boxes which support FCF gateway functionality( like IBM G8264CS or Cisco Nexus5k) , even you have whole FCoE setup.

    So I advice to run iSCSI

    Regards,Slawek
  • SystemAdmin
    SystemAdmin
    3234 Posts

    Re: BCH + HS23 + BNT VFS + v7k FCoE

    ‏2013-03-28T07:41:24Z  
    It won't work with FCoE ,
    For FCoE you need to have some boxes which support FCF gateway functionality( like IBM G8264CS or Cisco Nexus5k) , even you have whole FCoE setup.

    So I advice to run iSCSI

    Regards,Slawek
    Thanks Slawek, but I'm not convinced.
    You need an FCF so you can connect the FCoE network to a FC network (be it a SAN Switch or native FC storage).
    If my target supports FCoE than I should be able to make it work.
    The Virtual Fabric Switch supports all the prerequisites needed for FCoE connectivity (802.1QAZ, FIP, 802.1Qbb, 802.1AB) so it should work.

    Any more ideas?
  • Mach_v
    Mach_v
    2 Posts

    Re: BCH + HS23 + BNT VFS + v7k FCoE

    ‏2013-03-28T08:39:04Z  
    Thanks Slawek, but I'm not convinced.
    You need an FCF so you can connect the FCoE network to a FC network (be it a SAN Switch or native FC storage).
    If my target supports FCoE than I should be able to make it work.
    The Virtual Fabric Switch supports all the prerequisites needed for FCoE connectivity (802.1QAZ, FIP, 802.1Qbb, 802.1AB) so it should work.

    Any more ideas?
    DanXtrate,
    as Slowinsky say you MUST have FCF to have FCoE work, in a case of you setup this may been install pair of Qlogic Virtual Fabric Extension Module at BCH.

    FCF allow registration host and client at fabric, so it needed at this setup.

    Or change Virtual Fabric to Brocade Converged switch.

    Current version FC-BB-5 not support direct connected host/client without traffic going through FCF, this will be supported at FC-BB-6.
    see -
    http://pic.dhe.ibm.com/infocenter/storwize/ic/index.jsp?topic=%2Fcom.ibm.storwize.v7000.doc%2Fsvc_rulesswitch_223fp0.html for supported configuration.
    more info about FC-BB-5 and FCoE fabric - see http://forums.juniper.net/t5/The-New-Network/FCoE-FCF-FC-Switch-Not-Included/ba-p/159248
  • SlowinskiS
    SlowinskiS
    28 Posts

    Re: BCH + HS23 + BNT VFS + v7k FCoE

    ‏2013-03-28T09:55:43Z  
    • Mach_v
    • ‏2013-03-28T08:39:04Z
    DanXtrate,
    as Slowinsky say you MUST have FCF to have FCoE work, in a case of you setup this may been install pair of Qlogic Virtual Fabric Extension Module at BCH.

    FCF allow registration host and client at fabric, so it needed at this setup.

    Or change Virtual Fabric to Brocade Converged switch.

    Current version FC-BB-5 not support direct connected host/client without traffic going through FCF, this will be supported at FC-BB-6.
    see -
    http://pic.dhe.ibm.com/infocenter/storwize/ic/index.jsp?topic=%2Fcom.ibm.storwize.v7000.doc%2Fsvc_rulesswitch_223fp0.html for supported configuration.
    more info about FC-BB-5 and FCoE fabric - see http://forums.juniper.net/t5/The-New-Network/FCoE-FCF-FC-Switch-Not-Included/ba-p/159248
    Exactly,
    That's why I advice to use iSCSi.
    On virtual fabric it is done by hardware on adapter so no additional utilization for CPU.

    Please also remember that when using virtual fabric vnic mode you need to have dedicated uplinks.

    Regards,Slawek
  • SystemAdmin
    SystemAdmin
    3234 Posts

    Re: BCH + HS23 + BNT VFS + v7k FCoE

    ‏2013-03-28T11:45:37Z  
    Exactly,
    That's why I advice to use iSCSi.
    On virtual fabric it is done by hardware on adapter so no additional utilization for CPU.

    Please also remember that when using virtual fabric vnic mode you need to have dedicated uplinks.

    Regards,Slawek
    Got that.
    Thank you all for your support.
  • Escapo-IT
    Escapo-IT
    2 Posts

    Re: BCH + HS23 + BNT VFS + v7k FCoE

    ‏2013-03-29T07:57:39Z  
    Got that.
    Thank you all for your support.
    We were contemplating a very similar setup, but were advised against it by an IBM insider because of "lingering issues", ... we went with 8Gb FC and haven't looked back.
  • Mach_v
    Mach_v
    2 Posts

    Re: BCH + HS23 + BNT VFS + v7k FCoE

    ‏2013-03-29T13:59:18Z  
    • Escapo-IT
    • ‏2013-03-29T07:57:39Z
    We were contemplating a very similar setup, but were advised against it by an IBM insider because of "lingering issues", ... we went with 8Gb FC and haven't looked back.
    yup, i'm too have advise from IBM insider about BCH FCoE (use converged switch instead VF 10G+Qlogic VF FC), but we already use chassis, and after read about midplane "feature" with support of 8Gb FC (see http://www.ibm.com/developerworks/forums/thread.jspa?threadID=453815&tstart=0 thread), i'm prefer use VF10G+QlogicVF FC +vNic without oversubscription, than have chance of midplane change (i'm recive BCH at end of '12 with "BC H chassis v8 and later - midplane FRU 68Y6734 (or 44X2302)").