Loss of network connectivity on some Sun servers using NVIDIA network controller
Details
Some Sun servers such as Sun Fire X2200 M2, Sun Fire X4100 M2, Sun Fire X4200 M2, Sun Blade X6220, and other Sun servers using NVIDIA network controllers for the built-in Ethernet interfaces running ESX 3.0.x and ESX 3.5.X may experience loss of network connectivity due to a hardware problem in the network controller.
Solution
If the Server experiences the issue discussed in the details section, there two ways to resolve the issue.
If you are running anything prior to ESX 3.5 Update 4
If you running ESX 3.0.X/ESX 3.5/ESX 3.5 U1/U2/U3, upgrade to ESX 3.5 U4 orif you are already running ESX 3.5 Update 4:
Enable the timer interrupt by adding the parameter vmk_enable_timer_irq=1 when loading the forcedeth driver. vmk_enable_timer_irq can be set by using the standard mechanisms for enabling options in kernel modules.
If you are loading the module from the command line, run the following command:
Note: esxcfg-module -s overwrites any previous options that have been set. Be sure to first perform an esxcfg-module -g forcedeth. This provides which options, if any, are already set for the forcedeth driver. You can then append them to the options provided by esxcfg-module -s.
Note: This fix might cause slight performance degradation.
If you do not want to upgrade to ESX 3.5 Update 4
On the X2200 M2
Do not use the Ethernet interfaces labeled NET2 and NET3. Use the interfaces labeled NET0 and NET1, or use network interfaces on network option cards.
To disable the NVidia network interface controllers NET2 and NET3:
During the BIOS Power On and Self Test (POST) process at system boot, press F2 or Ctrl+E to enter the BIOS setup menu.
Click the Advanced tab
Click the Onboard Device Configuration entry
Make sure the entry for 'NVidia LAN1' is 'Disabled'
Make sure the entry for 'NVidia LAN2' is 'Disabled'
Save and Exit the BIOS Setup Screen
On the X4100 M2 and X4200 M2
Do not use the Ethernet interfaces labeled NET0 and NET1. Use the interfaces labeled NET2 and NET3, or use network interfaces on network option cards.
On the X6220
Do not use the Ethernet interfaces on the Network Express Module. Instead, disable the Network Express Module in the BIOS as described below and add a PCI Express Module to the system and use the network interfaces on the module.
To disable the forcedeth device driver, log in to the ESX Service Service Console and enter the following command:
vmkload_mod -u forcedeth
To disable the Network Express Module on the X6220:
During the BIOS Power On and Self Test (POST) process at system boot, press F2 or Ctrl+E to enter the BIOS setup menu.
On the Chipset tab, select Southbridge Configuration.
Set the MAC Interface item to disabled.
Set the IO4 Mac Interface item to disabled.
Press F10 to save your changes and continue booting the system.
