Topic
  • 21 replies
  • Latest Post - ‏2012-11-28T12:04:55Z by SystemAdmin
SystemAdmin
SystemAdmin
4779 Posts

Pinned topic Unable to attach DS3524 LUN to more than 2 ESXi hosts

‏2011-11-03T08:37:31Z |
BladeCenter HS22, ESXi, 5.0.0, 469512 and DS3524.
I have a bladcenter H that has four blades on there. Currently, I'm using a DS3524, which has two controllers that are directly attached to the SAS I/O modules #3 & #4. I'm able to attach the LUN0 to the first and second blades. However, I'm unable to attach it to the third and fourth ESXi hosts.
I used IBM DS Storage manager to create the logical volume, and then map to a host group, which has all four ESXi blades with their port identifiers.
Any suggestions?
Updated on 2012-11-28T12:04:55Z at 2012-11-28T12:04:55Z by SystemAdmin
  • SystemAdmin
    SystemAdmin
    4779 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-03T17:33:26Z  
    I meant DS5324.
  • Novikov_Alexander
    Novikov_Alexander
    1404 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-03T19:58:01Z  
    Dear will sani,

    DS3000 and DS5000 are not supported for ESXi5, yet (DS4000 not supported, too).

    System Storage Interoperation Center (SSIC)
    http://www-03.ibm.com/systems/support/storage/ssic/interoperability.wss

    Regards,
    Alexander Novikov
    Russia, Moscow
  • pavel.alexei
    pavel.alexei
    335 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-04T07:22:58Z  
    Dear will sani,

    DS3000 and DS5000 are not supported for ESXi5, yet (DS4000 not supported, too).

    System Storage Interoperation Center (SSIC)
    http://www-03.ibm.com/systems/support/storage/ssic/interoperability.wss

    Regards,
    Alexander Novikov
    Russia, Moscow
    it is not quite so
    http://www-03.ibm.com/systems/support/storage/ssic/midrange-entry/EMD_SSIC_Addendum_07.60.xls
    http://www-03.ibm.com/systems/support/storage/ssic/midrange-entry/EMD_SSIC_Addendum_07.70.38.xls
    http://www-03.ibm.com/systems/support/storage/ssic/midrange-entry/EMD_SSIC_Addendum_07.75.xls
    http://www-03.ibm.com/systems/support/storage/ssic/midrange-entry/EMD_SSIC_Addendum_07.77.xls

    to:"will sani gregorian"
    I didn't understand what does it means: "I'm unable to attach it to the third and fourth ESXi hosts".
  • Novikov_Alexander
    Novikov_Alexander
    1404 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-04T11:55:08Z  
    it is not quite so
    http://www-03.ibm.com/systems/support/storage/ssic/midrange-entry/EMD_SSIC_Addendum_07.60.xls
    http://www-03.ibm.com/systems/support/storage/ssic/midrange-entry/EMD_SSIC_Addendum_07.70.38.xls
    http://www-03.ibm.com/systems/support/storage/ssic/midrange-entry/EMD_SSIC_Addendum_07.75.xls
    http://www-03.ibm.com/systems/support/storage/ssic/midrange-entry/EMD_SSIC_Addendum_07.77.xls

    to:"will sani gregorian"
    I didn't understand what does it means: "I'm unable to attach it to the third and fourth ESXi hosts".
    Hi Pavel,

    thanks for information. But in your files there is a note:

    "SSIC is the master source for storage system interoperability. In the event of conflicting data between SSIC and this file, SSIC takes precedence."

    As you can see in SSIC ESXi5 is not supported.

    Regards,
    Alexander Novikov
    Russia, Moscow
  • SystemAdmin
    SystemAdmin
    4779 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-05T19:41:55Z  
    it is not quite so
    http://www-03.ibm.com/systems/support/storage/ssic/midrange-entry/EMD_SSIC_Addendum_07.60.xls
    http://www-03.ibm.com/systems/support/storage/ssic/midrange-entry/EMD_SSIC_Addendum_07.70.38.xls
    http://www-03.ibm.com/systems/support/storage/ssic/midrange-entry/EMD_SSIC_Addendum_07.75.xls
    http://www-03.ibm.com/systems/support/storage/ssic/midrange-entry/EMD_SSIC_Addendum_07.77.xls

    to:"will sani gregorian"
    I didn't understand what does it means: "I'm unable to attach it to the third and fourth ESXi hosts".
    @pavel.alexei

    I have four blades. I'm able to attach the SAS direct storage to blades one and two but, not three and four.

    @Novikov_Alexander

    That's discouraging but what isn't supported? I'm able to attach the direct storage to at least two of the blades but not the other three. I'm also trying to avoid the ISCSI2 2TB limitations with ESXi 4.1. Simply put, I want to attach the 5.7TB LUN as a whole without having to play around with the extents or having to use LVM (in guest) to create large partitions.
  • SystemAdmin
    SystemAdmin
    4779 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-05T23:28:45Z  
    @pavel.alexei

    I have four blades. I'm able to attach the SAS direct storage to blades one and two but, not three and four.

    @Novikov_Alexander

    That's discouraging but what isn't supported? I'm able to attach the direct storage to at least two of the blades but not the other three. I'm also trying to avoid the ISCSI2 2TB limitations with ESXi 4.1. Simply put, I want to attach the 5.7TB LUN as a whole without having to play around with the extents or having to use LVM (in guest) to create large partitions.
    I really have to slow down and read my own reply. I meant to say SCSI2 limitation, and I'm able to attach the storage to blades #1 and #2, not #3 and #4.
  • Novikov_Alexander
    Novikov_Alexander
    1404 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-06T12:56:33Z  
    I really have to slow down and read my own reply. I meant to say SCSI2 limitation, and I'm able to attach the storage to blades #1 and #2, not #3 and #4.
    Hi will sani,

    DS3000 and DS5000 are not supported for ESXi5, yet.

    System Storage Interoperation Center (SSIC)
    http://www-03.ibm.com/systems/support/storage/ssic/interoperability.wss

    Use only supported OS versions, for example ESX 4.1 or ESXi 4.1.

    Regards,
    Alexander Novikov
    Russia, Moscow
  • tbastia
    tbastia
    20 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-06T13:26:09Z  
    Hi will sani,

    DS3000 and DS5000 are not supported for ESXi5, yet.

    System Storage Interoperation Center (SSIC)
    http://www-03.ibm.com/systems/support/storage/ssic/interoperability.wss

    Use only supported OS versions, for example ESX 4.1 or ESXi 4.1.

    Regards,
    Alexander Novikov
    Russia, Moscow
    Can you confirm the blade center is zoned that all 4 blades have access to the external ports. If you shutdown a blade that has access does that allow another blade to have access.
  • SystemAdmin
    SystemAdmin
    4779 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-06T18:23:12Z  
    Hi will sani,

    DS3000 and DS5000 are not supported for ESXi5, yet.

    System Storage Interoperation Center (SSIC)
    http://www-03.ibm.com/systems/support/storage/ssic/interoperability.wss

    Use only supported OS versions, for example ESX 4.1 or ESXi 4.1.

    Regards,
    Alexander Novikov
    Russia, Moscow
    Alexander,

    Thanks for responding twice. I've already made my case on why I need to use VMFS-5. You've made your case on why I shouldn't use ESXi 5. I don't see how its productive to post the same response about the hardware/software interop (lack of) twice.

    VMware ESXi 5 supports DS3500: http://www.vmware.com/resources/compatibility/search.php?deviceCategory=san so, your pedantic rebuttal is pointless. Obviously, VMware recognizes the hardware. If you like to prove me wrong, you can contribute to my question by helping me identify the source of the problem. Perhaps, I'll find out why IBM doesn't support ESXi 5 that way.

    Thank you.
  • SystemAdmin
    SystemAdmin
    4779 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-06T18:30:56Z  
    • tbastia
    • ‏2011-11-06T13:26:09Z
    Can you confirm the blade center is zoned that all 4 blades have access to the external ports. If you shutdown a blade that has access does that allow another blade to have access.
    tbastia,

    SAS zone seems to be okay. All zones are configured properly:

    I/O Bay 3 - Predefined Config 01
    I/O Bay 4 - Predefined Config 01

    I/O Bay 3 - Chassis: BCE, BCH, BCT and BCHT. SAS modules: 1 or 2. Zoned Blade Bays: 1-14. Each SAS module port belongs to its own zone. All Blades can access all external ports. Cannot be modified.
    I/O Bay 4 - Chassis: BCE, BCH, BCT and BCHT. SAS modules: 1 or 2. Zoned Blade Bays: 1-14. Each SAS module port belongs to its own zone. All Blades can access all external ports. Cannot be modified.

    External ports enabled. The only difference that I can see is that VMware tested with DS3500 firmware version 07.75.28.60 where as I have 07.77.19.00 installed. If I turn off a blade, and then try to rescall the storage on the 3rd or 4th blades, it still does not present the DS3524.
  • Novikov_Alexander
    Novikov_Alexander
    1404 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-07T07:04:36Z  
    Alexander,

    Thanks for responding twice. I've already made my case on why I need to use VMFS-5. You've made your case on why I shouldn't use ESXi 5. I don't see how its productive to post the same response about the hardware/software interop (lack of) twice.

    VMware ESXi 5 supports DS3500: http://www.vmware.com/resources/compatibility/search.php?deviceCategory=san so, your pedantic rebuttal is pointless. Obviously, VMware recognizes the hardware. If you like to prove me wrong, you can contribute to my question by helping me identify the source of the problem. Perhaps, I'll find out why IBM doesn't support ESXi 5 that way.

    Thank you.
    Hi will sani,

    unfortunately VMware also not supported DS3500 for ESXi5. You can see it on your own link, there is VMware disclaimer for Firmware Version for SAS Switched - Refer to vendors Interoperability Matrix and as you already know IBM is not supports ESXi5 yet.

    > ...helping me identify the source of the problem.

    the source of the problem is your non-supported configuration. Just use any supported configuration.

    Regards,
    Alexander Novikov
    Russia, Moscow
  • SystemAdmin
    SystemAdmin
    4779 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-07T07:44:00Z  
    Hi will sani,

    unfortunately VMware also not supported DS3500 for ESXi5. You can see it on your own link, there is VMware disclaimer for Firmware Version for SAS Switched - Refer to vendors Interoperability Matrix and as you already know IBM is not supports ESXi5 yet.

    > ...helping me identify the source of the problem.

    the source of the problem is your non-supported configuration. Just use any supported configuration.

    Regards,
    Alexander Novikov
    Russia, Moscow
    Thank you,

    Nearly three months later, and IBM doesn't support ESXi 5. That is disappointing to say the least. I suppose wanting to live in beyond the 2TB limit is too bleeding edge...
  • pavel.alexei
    pavel.alexei
    335 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-07T08:29:09Z  
    Thank you,

    Nearly three months later, and IBM doesn't support ESXi 5. That is disappointing to say the least. I suppose wanting to live in beyond the 2TB limit is too bleeding edge...
    In reality IBM supports ESXi 5.0 on DS3500. SSIC became very hard to harvest. If you will select Product Family: IBM Entry Storage Disk-> Product Model: DS3500-> Product version: 07.77, then you'll see under Operating System: Vmware vSphere/ESX 5.0. Under Server models you'll see "ALL x86&x86_64 Compatible Servers".
    I didn't have experience with SAS module, i can only try to guess problems source.
    1. Sorry, but I really didn't understood your sentence "I'm unable to attach it (LUN0) to the third and fourth ESXi hosts". Does it means, that you mapped volume to group bl01p-esxi-grp, but only 1 and 2 blade "see" that volume? Or something else?
    2. Did you try to swap blade 1 with blade 3 (or 2 with 4)? issue is related to blade or chassis slot/SAS connectivity port?
    3. Can you post here storage profile configuration? May be SAS connectivity module has something like a configuration file?
    4. Did you upgraded to the latest version SAS connectivity modules and SAS CIOv modules?
    5. ESXi 4 don't have 2TB limitation for datastore. You may create several 2TB volumes on storage, expose them to ESX. On the fist create datastore, and then expand it using the rest of volumes.
    Until Update1 for ESXi 5 i wouldn't put it into production. But if you don't plan to launch this configuration just now into production, may be ESXi 5U1 will be released by that :-) VMFS 3 can be upgraded to VMFS 5 instant, but as far i remember you'll lose some features.
  • Novikov_Alexander
    Novikov_Alexander
    1404 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-07T17:24:24Z  
    In reality IBM supports ESXi 5.0 on DS3500. SSIC became very hard to harvest. If you will select Product Family: IBM Entry Storage Disk-> Product Model: DS3500-> Product version: 07.77, then you'll see under Operating System: Vmware vSphere/ESX 5.0. Under Server models you'll see "ALL x86&x86_64 Compatible Servers".
    I didn't have experience with SAS module, i can only try to guess problems source.
    1. Sorry, but I really didn't understood your sentence "I'm unable to attach it (LUN0) to the third and fourth ESXi hosts". Does it means, that you mapped volume to group bl01p-esxi-grp, but only 1 and 2 blade "see" that volume? Or something else?
    2. Did you try to swap blade 1 with blade 3 (or 2 with 4)? issue is related to blade or chassis slot/SAS connectivity port?
    3. Can you post here storage profile configuration? May be SAS connectivity module has something like a configuration file?
    4. Did you upgraded to the latest version SAS connectivity modules and SAS CIOv modules?
    5. ESXi 4 don't have 2TB limitation for datastore. You may create several 2TB volumes on storage, expose them to ESX. On the fist create datastore, and then expand it using the rest of volumes.
    Until Update1 for ESXi 5 i wouldn't put it into production. But if you don't plan to launch this configuration just now into production, may be ESXi 5U1 will be released by that :-) VMFS 3 can be upgraded to VMFS 5 instant, but as far i remember you'll lose some features.
    Hi Pavel,

    In reality IBM is not supports ESXi 5.0 on DS3500 for blade servers.
    SSIC became very hard to harvest. If you will select Product Family: IBM Entry Storage Disk-> Product Model: DS3500-> Product version: 07.77 -> IBM BladeCenter, then you'll see under Operating System: Vmware vSphere/ESX 4.1 U1 maximum.

    Regards,
    Alexander Novikov
    Russia, Moscow
  • SystemAdmin
    SystemAdmin
    4779 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-08T00:23:43Z  
    In reality IBM supports ESXi 5.0 on DS3500. SSIC became very hard to harvest. If you will select Product Family: IBM Entry Storage Disk-> Product Model: DS3500-> Product version: 07.77, then you'll see under Operating System: Vmware vSphere/ESX 5.0. Under Server models you'll see "ALL x86&x86_64 Compatible Servers".
    I didn't have experience with SAS module, i can only try to guess problems source.
    1. Sorry, but I really didn't understood your sentence "I'm unable to attach it (LUN0) to the third and fourth ESXi hosts". Does it means, that you mapped volume to group bl01p-esxi-grp, but only 1 and 2 blade "see" that volume? Or something else?
    2. Did you try to swap blade 1 with blade 3 (or 2 with 4)? issue is related to blade or chassis slot/SAS connectivity port?
    3. Can you post here storage profile configuration? May be SAS connectivity module has something like a configuration file?
    4. Did you upgraded to the latest version SAS connectivity modules and SAS CIOv modules?
    5. ESXi 4 don't have 2TB limitation for datastore. You may create several 2TB volumes on storage, expose them to ESX. On the fist create datastore, and then expand it using the rest of volumes.
    Until Update1 for ESXi 5 i wouldn't put it into production. But if you don't plan to launch this configuration just now into production, may be ESXi 5U1 will be released by that :-) VMFS 3 can be upgraded to VMFS 5 instant, but as far i remember you'll lose some features.
    I'm going to skip to number five. This is only if you create the VMFS with 8MB blocks, correct? Last time I attempted to attach a 2TB LUN it failed. Then again, the VMFS was created with 1MB blocks. If this is the case, then I may not need esxi 5, which makes this discussion a moot point.
  • Novikov_Alexander
    Novikov_Alexander
    1404 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-08T04:18:49Z  
    I'm going to skip to number five. This is only if you create the VMFS with 8MB blocks, correct? Last time I attempted to attach a 2TB LUN it failed. Then again, the VMFS was created with 1MB blocks. If this is the case, then I may not need esxi 5, which makes this discussion a moot point.
    Hi will sani,

    > This is only if you create the VMFS with 8MB blocks, correct?

    no, you can use any block size.

    > Last time I attempted to attach a 2TB LUN it failed.

    could you provide screenshote. Pay attention that LUN must be 2TB-512B, otherwise you will have the problem.

    Regards,
    Alexander Novikov
    Russia, Moscow
  • kopper
    kopper
    178 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2011-11-08T21:18:50Z  
    Hi will sani,

    > This is only if you create the VMFS with 8MB blocks, correct?

    no, you can use any block size.

    > Last time I attempted to attach a 2TB LUN it failed.

    could you provide screenshote. Pay attention that LUN must be 2TB-512B, otherwise you will have the problem.

    Regards,
    Alexander Novikov
    Russia, Moscow
    why people say DS35xx is not supported

    what about this?

    http://www.vmware.com/resources/compatibility/search.php?deviceCategory=san&productid=18507&deviceCategory=san&partner=43&releases=76&keyword=ds3500&isSVA=1&page=1&display_interval=10&sortColumn=Partner&sortOrder=Asc
  • SystemAdmin
    SystemAdmin
    4779 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2012-02-12T00:43:29Z  
    • kopper
    • ‏2011-11-08T21:18:50Z
    why people say DS35xx is not supported

    what about this?

    http://www.vmware.com/resources/compatibility/search.php?deviceCategory=san&productid=18507&deviceCategory=san&partner=43&releases=76&keyword=ds3500&isSVA=1&page=1&display_interval=10&sortColumn=Partner&sortOrder=Asc
    It looks like ESXi 5.0 now supports DS3524?

    http://www.vmware.com/resources/compatibility/detail.php?deviceCategory=san&productid=18508&releaseid=76&deviceCategory=san&partner=43&releases=76&arrayTypes=4&isSVA=1&page=1&display_interval=10&sortColumn=Partner&sortOrder=Asc

    Could someone confirm?
  • Novikov_Alexander
    Novikov_Alexander
    1404 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2012-02-12T07:17:52Z  
    It looks like ESXi 5.0 now supports DS3524?

    http://www.vmware.com/resources/compatibility/detail.php?deviceCategory=san&productid=18508&releaseid=76&deviceCategory=san&partner=43&releases=76&arrayTypes=4&isSVA=1&page=1&display_interval=10&sortColumn=Partner&sortOrder=Asc

    Could someone confirm?
    Dear will sani,

    yes, as you can see in IBM SSIC, now ESXi5 supported for x3500. Pay attention that for Blade servers it still not supported.

    Regards,
    Alexander Novikov
    Russia, Moscow
  • SystemAdmin
    SystemAdmin
    4779 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2012-11-28T12:03:52Z  
    I'm going to skip to number five. This is only if you create the VMFS with 8MB blocks, correct? Last time I attempted to attach a 2TB LUN it failed. Then again, the VMFS was created with 1MB blocks. If this is the case, then I may not need esxi 5, which makes this discussion a moot point.
    Sorry for bumping thread. I have the same issue. I see now VMWare 5.0 U1 is now supported. Do you know if 5.1 is supported as IBM have released it? Can anyone confirm it works?
  • SystemAdmin
    SystemAdmin
    4779 Posts

    Re: Unable to attach DS3524 LUN to more than 2 ESXi hosts

    ‏2012-11-28T12:04:55Z  
    Sorry for bumping thread. I have the same issue. I see now VMWare 5.0 U1 is now supported. Do you know if 5.1 is supported as IBM have released it? Can anyone confirm it works?
    Sorry, this is for x3650 M4