Knowledge Base
Sample configuration of EtherChannel / Link aggregation with ESX 3.x and Cisco /HP switches.
Purpose
This article focuses on concepts, limitations, and sample configuration of Link aggregation / NIC Teaming / LACP / Ether-Channel connectivity between ESX 3.x Server and a Physical Network Switch, in particular, Cisco and HP.
Resolution
- EtherChannel:is a port trunking (link aggregation is Cisco's term) technology used primarily on Cisco switches. It allows grouping several physical Ethernet links to create one logical Ethernet link for the purpose of providing fault-tolerance and high-speed links between switches, routers, and servers. An Ether-Channel can be created from between two and eight active Fast Ethernet, Gigabit Ethernet, or 10 Gigabit Ethernet ports, with an additional one to eight inactive (failover) ports which become active as the other active ports fail.
- LACP or IEEE 802.3ad:The Link Aggregation Control Protocol (LACP) is included in IEEE specification as a method to control the bundling of several physical ports together to form a single logical channel. LACP allows a network device to negotiate an automatic bundling of links by sending LACP packets to the peer (directly connected device that also implements LACP).
- EtherChannel vs. 802.ad: EtherChannel and IEEE 802.3ad standards are very similar and accomplish the same goal. There are a few differences between the two, other than EtherChannel is Cisco proprietary and 802.3ad is an open standard.
- For additional information regarding Cisco EtherChannel, see http://www.cisco.com/en/US/tech/tk389/tk213/technologies_tech_note09186a0080094714.shtml
- One IP to many IP connections. (Host A making two connection sessions to Host B and C)
- Many IP to many IP connections. (Host A and B multiple connection sessions to Host C,D, and etc)
Note: One IP to one IP connections over multiple NIC is not supported. (Host A one connection session to Host B uses only one NIC)
- Compatible with all ESX VLAN configuration modes: VST, EST, and VGT. For more information on these modes, see Configuring VLANs in an ESX Server environment (1003806).
- Supported Cisco configuration: EtherChannel Mode ON – (Enable Etherchannel only)
- Supported HP configuration: Trunk Mode
- Supported switch Aggregation algorithm: IP-SRC-DST short for (IP-Source-Destination)
- Supported Virtual Switch NIC Teaming mode: IP HASH
- Lower model Cisco switches may have MAC-SRC-DST set by default and may require additional configuration. See the following article for additional information: http://www.cisco.com/en/US/tech/tk389/tk213/technologies_tech_note09186a0080094714.shtml
The following is a Cisco EtherChannel sample configuration:
interface Port-channel1
switchport
switchport access vlan 100
switchport mode access
no ip address
!
interface GigabitEthernet1/1
switchport
switchport access vlan 100
switchport mode access
no ip address
channel-group 1 mode on
!
ESX Server and Cisco switch sample topology and configuration:
Run the following command to verify EtherChannel loadbalancing mode configuration:
Switch# show etherchannel load-balance
EtherChannel Load-Balancing Configuration:
src-dst-ip
mpls label-ip
EtherChannel Load-Balancing Addresses Used Per-Protocol:
Non-IP: Source XOR Destination MAC address
IPv4: Source XOR Destination IP address
IPv6: Source XOR Destination IP address
MPLS: Label or IP
Switch#show etherchannel summary
Flags: D - down P - bundled in port-channel
I - stand-alone s - suspended
H - Hot-standby (LACP only)
R - Layer3 S - Layer2
U - in use f - failed to allocate aggregator
M - not in use, minimum links not met
u - unsuitable for bundling
w - waiting to be aggregated
Number of channel-groups in use: 2
Number of aggregators: 2
Group Port-channel Protocol Ports
------+-------------+-----------+--------------------------
1 Po1(SU) - Gi1/15(P) Gi1/16(P)
2 Po2(SU) - Gi1/1(P) Gi1/2(P)
Switch#show etherchann protocol
Channel-group listing:
-----------------------
Group: 1
----------
Protocol: - (Mode ON)
Group: 2
----------
Protocol: - (Mode ON)
HP Switches Sample Configuration
The following configuration is specific to HP switches:
- HP switches supports only two modes of LACP, ACTIVE, and PASSIVE while ESX does not support either LACP mode currently.
- Set HP Switch port mode to TRUNKto accomplish static link aggregation with ESX.
- TRUNK Modeof HP switch ports are the only supported aggregation method compatible with ESX 3.X NIC teaming mode IP hash.
Configuring loadbalancing within the Virtual Infrastructure Client
To configure vSwitch properties for loadbalancing:
-
Highlight the ESX Server host.
-
Click the Configuration tab.
-
Click the Networking link.
-
Click Properties.
-
Highlight the virtual switch in the Ports tab and click Edit.
-
Click the NIC Teaming tab.
-
From the Load Balancing dropdown, choose Route based on ip hash.
-
Verify that there are two or more network adapters listed under Active Adapters.
Actions