Knowledge Base

Search the Knowledge Base:
Products:
Search In:
 

Sample configuration of EtherChannel / Link aggregation with ESX 3.x and Cisco /HP switches.

Purpose

This article focuses on concepts, limitations, and sample configuration of Link aggregation / NIC Teaming / LACP / Ether-Channel connectivity between ESX 3.x Server and a Physical Network Switch, in particular, Cisco and HP.

Resolution

The following explains link aggregation concepts:
  • EtherChannel:is a port trunking (link aggregation is Cisco's term) technology used primarily on Cisco switches. It allows grouping several physical Ethernet links to create one logical Ethernet link for the purpose of providing fault-tolerance and high-speed links between switches, routers, and servers. An Ether-Channel can be created from between two and eight active Fast Ethernet, Gigabit Ethernet, or 10 Gigabit Ethernet ports, with an additional one to eight inactive (failover) ports which become active as the other active ports fail. 
  • LACP or IEEE 802.3ad:The Link Aggregation Control Protocol (LACP) is included in IEEE specification as a method to control the bundling of several physical ports together to form a single logical channel. LACP allows a network device to negotiate an automatic bundling of links by sending LACP packets to the peer (directly connected device that also implements LACP). 
The following are EtherChannel supported scenarios:
  • One IP to many IP connections. (Host A making two connection sessions to Host B and C)
  • Many IP to many IP connections. (Host A and B multiple connection sessions to Host C,D, and etc)

    Note: One IP to one IP connections over multiple NIC is not supported. (Host A one connection session to Host B uses only one NIC)
  • Compatible with all ESX VLAN configuration modes: VST, EST, and VGT. For more information on these modes, see Configuring VLANs in an ESX Server environment (1003806).
  • Supported Cisco configuration:  EtherChannel Mode ON – (Enable Etherchannel only)
  • Supported HP configuration: Trunk Mode
  • Supported switch Aggregation algorithm: IP-SRC-DST short for (IP-Source-Destination)
  • Supported Virtual Switch NIC Teaming mode: IP HASH 
  • Lower model Cisco switches may have MAC-SRC-DST set by default and may require additional configuration. See the following article for additional information:  http://www.cisco.com/en/US/tech/tk389/tk213/technologies_tech_note09186a0080094714.shtml

The following is a Cisco EtherChannel sample configuration: 

interface Port-channel1
 switchport
 switchport access vlan 100
 switchport mode access
 no ip address
!
interface GigabitEthernet1/1
 switchport
 switchport access vlan 100
 switchport mode access
 no ip address
 channel-group 1 mode on
!

ESX Server and Cisco switch sample topology and configuration:


 


Run the following command to verify EtherChannel loadbalancing mode configuration: 
Switch# show etherchannel load-balance
EtherChannel Load-Balancing Configuration:
        src-dst-ip
        mpls label-ip 
EtherChannel Load-Balancing Addresses Used Per-Protocol:
Non-IP: Source XOR Destination MAC address
  IPv4: Source XOR Destination IP address
  IPv6: Source XOR Destination IP address
  MPLS: Label or IP


Switch#show etherchannel summary
Flags:  D - down        P - bundled in port-channel
        I - stand-alone s - suspended
        H - Hot-standby (LACP only)
        R - Layer3      S - Layer2
        U - in use      f - failed to allocate aggregator
        M - not in use, minimum links not met
        u - unsuitable for bundling
        w - waiting to be aggregated
Number of channel-groups in use: 2
Number of aggregators:           2
Group  Port-channel  Protocol    Ports
------+-------------+-----------+--------------------------
1      Po1(SU)          -        Gi1/15(P)  Gi1/16(P)
2      Po2(SU)          -        Gi1/1(P)   Gi1/2(P)


Switch#show etherchann protocol
                Channel-group listing:
                -----------------------
Group: 1
----------
Protocol:   -  (Mode ON)
Group: 2
----------
Protocol:   -  (Mode ON)


HP Switches Sample Configuration

The following configuration is specific to HP switches: 

  • HP switches supports only two modes of LACP, ACTIVE, and PASSIVE while ESX does not support either LACP mode currently.
  • Set HP Switch port mode to TRUNKto accomplish static link aggregation with ESX. 
  • TRUNK Modeof HP switch ports are the only supported aggregation method compatible with ESX 3.X  NIC teaming mode IP hash.

Configuring loadbalancing within the Virtual Infrastructure Client

To configure vSwitch properties for loadbalancing:

  1. Highlight the ESX Server host.
  2. Click the Configuration tab.
  3. Click the Networking link.
  4. Click Properties.
  5. Highlight the virtual switch in the Ports tab and click Edit.
  6. Click the NIC Teaming tab.
  7. From the Load Balancing dropdown, choose Route based on ip hash.
  8. Verify that there are two or more network adapters listed under Active Adapters.
 

Feedback

Rating: 1 - Lowest 2 3 4 5 - Highest (20 Ratings)   

Did this article help you?
This article resolved my issue.
This article did not resolve my issue.
This article helped but additional information was required to resolve my issue.
What can we do to improve this information? (2000 or fewer characters)
Submit
Rating: 1 - Lowest 2 3 4 5 - Highest (20 Ratings)   
Actions
  • KB Article: 1004048
  • Updated: Sep 9, 2009
  • Products:
    VMware ESX
  • Product Versions:
    VMware ESX 3.0.x
    VMware ESX 3.5.x