IBM Support

VMware VMotion Network Interface Controller Configuration Guide - IBM BladeCenter and System x

Troubleshooting


Problem

When attempting to migrate Virtual Machines (VMs) between IBM servers running VMware ESX 4.x across a Virtual Local Area Network (VLAN) the blades may experience intermittent network failures if the VMotion VLANs are not properly configured.

Resolving The Problem

Source

RETAIN tip: H202775

Symptom

When attempting to migrate Virtual Machines (VMs) between IBM servers running VMware ESX 4.x across a Virtual Local Area Network (VLAN) the blades may experience intermittent network failures if the VMotion VLANs are not properly configured.

Affected configurations

The system may be any of the following IBM servers:

  • BladeCenter HS12, type 1916, any model
  • BladeCenter HS12, type 8014, any model
  • BladeCenter HS12, type 8028, any model
  • BladeCenter HS21 XM, type 1915, any model
  • BladeCenter HS21 XM, type 7995, any model
  • BladeCenter HS21, type 1885, any model
  • BladeCenter HS21, type 8853, any model
  • BladeCenter HS22, type 1936, any model
  • BladeCenter HS22, type 7870, any model
  • BladeCenter HS22V, type 1949, any model
  • BladeCenter HS22V, type 7871, any model
  • BladeCenter HX5, type 7872, any model
  • BladeCenter HX5, type 7873, any model
  • BladeCenter LS21, type 7971, any model
  • BladeCenter LS22, type 7901, any model
  • BladeCenter LS41, type 7972, any model
  • BladeCenter LS42, type 7902, any model
  • System x3200 M3, type 7327, any model
  • System x3200 M3, type 7328, any model
  • System x3250 M3, type 4251, any model
  • System x3250 M3, type 4252, any model
  • System x3250 M3, type 4261, any model
  • System x3400 M2, type 7836, any model
  • System x3400 M2, type 7837, any model
  • System x3400 M3, type 7378, any model
  • System x3400 M3, type 7379, any model
  • System x3400, type 7973, any model
  • System x3400, type 7974, any model
  • System x3400, type 7975, any model
  • System x3400, type 7976, any model
  • System x3500 M3, type 7380, any model
  • System x3500, type 7977, any model
  • System x3550 M2, type 4198, any model
  • System x3550 M2, type 7946, any model
  • System x3550 M3, type 4254, any model
  • System x3550 M3, type 7944, any model
  • System x3550, type 1013, any model
  • System x3550, type 1913, any model
  • System x3550, type 7978, any model
  • System x3620 M3, type 7376, any model
  • System x3630 M3, type 7377, any model
  • System x3650 M2, type 4199, any model
  • System x3650 M2, type 7947, any model
  • System x3650 M3, type 4255, any model
  • System x3650 M3, type 7945, any model
  • System x3650, type 1914, any model
  • System x3650, type 7979, any model
  • System x3690 X5, type 7147, any model
  • System x3690 X5, type 7148, any model
  • System x3690 X5, type 7149, any model
  • System x3690 X5, type 7192, any model
  • System x3755 M3, type 7164, any model
  • System x3755, type 7163, any model
  • System x3850 M2, type 7141, any model
  • System x3850 M2, type 7144, any model
  • System x3850 M2, type 7233, any model
  • System x3850 X5, type 7143, any model
  • System x3850 X5, type 7145, any model
  • System x3850 X5, type 7146, any model
  • System x3850 X5, type 7191, any model
  • System x3850, type 8863, any model
  • System x3850, type 8864, any model
  • System x3950 E, type 8879, any model
  • System x3950 X5, type 7145, any model

The system is configured with at least one of the following:

  • VMware ESX Server 4.0, any Update
  • VMware ESX Server 4.1, any Update

This tip is not option specific.

Note: This does not imply that the network operating system will work under all combinations of hardware and software.

Please see the compatibility page for more information: http://www.ibm.com/systems/info/x86servers/serverproven/compat/us/

Workaround

Here are the proper steps for VMotion configuration:

  1. Install the license file, including the VMotion license.
  2. VMotion requires a VMotion-enabled network to function.

    Note: Although it is not required, it is strongly recommended that VMotion have a dedicated Network Interface Controller (NIC).
    Regardless of whether or not a NIC can be dedicated for VMotion, a port must be enabled for VMotion.

  3. Launch the VI3 Client and click on one of the ESX hosts that should have VMotion enabled.
  4. Once the host is selected click on the Configuration tab.
  5. Click on the link Networking inside of the box labeled "Hardware."
  6. Click on the Add Networking... link in the upper right-hand corner of the VI3 client.
  7. Select VMKernel for the connection type and click Next.
  8. If there is a dedicated NIC available to VMotion then select Create a virtual switch, otherwise select an existing vSwitch and click Next.
  9. On the next screen, label the port group VMotion and click on the checkbox that says Use this port group for VMotion.

    Note: Do not fill out the VLAN ID field or VMKernel Default Gateway field. Fill out the Internet Protocol (IP) Address, Subnet Mask fields.

  10. Click Next to continue and then click Finish to create the port group.

The above steps should be repeated for each host that will have VMs migrated to or from it.

Now that both licensing and the VMotion networks are configured, it is possible to migrate VMs from one host to another.

Additional information

For a VMotion event to be successful the following must be true:

  • The VM cannot be connected to an internal vSwitch.
  • The VM cannot be connected to a CD-ROM or diskette drive that is using an ISO or floppy image stored on a drive that is local to the host server.
  • The VM's affinity must not be set, i.e., binding it to physical Central Processing Unit (CPU)(s).
  • The VM must not be clustered with another VM (using a cluster service like the Microsoft Cluster Service (MSCS)).
  • The two ESX servers involved must both be using (the same!) shared storage.
  • The two ESX servers involved must be connected via Gigabit Ethernet (or better).
  • The two ESX servers involved must have access to the same physical networks.
  • The two ESX servers involved must not have virtual switch port groups that are labeled the same.
  • The two ESX servers involved must have compatible CPUs. (See support on Intel and AMD).

If any of the above conditions are not met, VMotion is not supported and will not start.

The simplest way to test these conditions is to attempt a manual VMotion event. This is accomplished by right-clicking on VM in the VI3 client and clicking on Migrate... The VI3 client will ask to which host this VM should be migrated. When a host is selected, several validation checks are performed. If any of the above conditions are true, then the VI3 client will halt the VMotion operation with an error.

Document Location

Worldwide

Operating System

BladeCenter:VMware ESX Server 3

BladeCenter:VMware ESX Server 4

System x:VMware ESX Server 3

System x:VMware ESX Server 4

[{"Type":"HW","Business Unit":{"code":"BU056","label":"Miscellaneous"},"Product":{"code":"HW21Q","label":"BladeCenter HS22"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"LOB18","label":"Miscellaneous LOB"}},{"Type":"HW","Business Unit":{"code":"BU056","label":"Miscellaneous"},"Product":{"code":"HW22E","label":"BladeCenter->BladeCenter HS21"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"LOB18","label":"Miscellaneous LOB"}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW22F","label":"BladeCenter->BladeCenter LS21"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW22G","label":"BladeCenter->BladeCenter LS41"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU056","label":"Miscellaneous"},"Product":{"code":"HW22I","label":"BladeCenter->BladeCenter HS21 XM"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"LOB18","label":"Miscellaneous LOB"}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW22K","label":"BladeCenter->BladeCenter HS12"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"LOB18","label":"Miscellaneous LOB"}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW22V","label":"BladeCenter->BladeCenter LS22"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW22W","label":"BladeCenter->BladeCenter LS42"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW232","label":"BladeCenter->BladeCenter HS22V"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW233","label":"BladeCenter->BladeCenter HX5"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"LOB57","label":"Power"}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW314","label":"System x->System x3850"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"HW316","label":"System x->System x3950 E"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW317","label":"System x->System x3500"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW318","label":"System x->System x3550"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW319","label":"System x->System x3650"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW321","label":"System x->System x3400"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW324","label":"System x->System x3755"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW332","label":"System x->System x3850 M2"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HW337","label":"System x->System x3100"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWX10","label":"System x->System x3400 M2"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWX30","label":"System x->System x3550 M2"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWX40","label":"System x->System x3650 M2"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWX50","label":"System x->System x3200 M3"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWX60","label":"System x->System x3250 M3"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWX70","label":"System x->System x3400 M3"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWX80","label":"System x->System x3500 M3"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWX90","label":"System x->System x3550 M3"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXA0","label":"System x->System x3650 M3"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXB0","label":"System x->System x3690 X5"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXC0","label":"System x->System x3850 X5"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXD0","label":"System x->System x3950 X5"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXG0","label":"System x->System x3620 M3"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXH0","label":"System x->System x3630 M3"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}},{"Type":"HW","Business Unit":{"code":"BU016","label":"Multiple Vendor Support"},"Product":{"code":"HWXJ0","label":"System x->System x3755 M3"},"Platform":[{"code":"PF032","label":"VM"}],"Line of Business":{"code":"","label":""}}]

Document Information

Modified date:
18 April 2023

UID

ibm1MIGR-5087497

Page Feedback