"Failed to start file system check on /dev/disk..." error on Photon OS based virtual appliances

search cancel

book

calendar_today

VMware Cloud Foundation VMware vCenter Server

Symptoms:

After rebooting a Photon OS based virtual appliance (vCenter Server Appliance for example), executing any commands on the shell (emergency mode) fails.
The appliance fails to start and and you see an error similar to:

[FAILED] Failed to start File System Check on /dev/dis...uuid/7986780-8987-
See 'systemctl status systemd-fsck-root.service' for details.
[DEPEND] Dependency failed for /sysroot.
[DEPEND] Dependency failed for Initrd Root File System.
[DEPEND] Dependency failed for Reload Configuration from the Real Root.

Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.

VMware Cloud Foundation 2.x
VMware vCenter Server 7.0.x
VMware vCenter Server Appliance 6.7.x
VMware vCenter Server Appliance 6.5.x

This issue occurs when there is a storage failure or power failure causing file inconsistencies.

To resolve this issue, scan and correct the filesystem:

Caution: Before proceeding, take a snapshot or backup of the affected virtual appliance.

Reboot the virtual appliance, and immediately after the OS starts, press e to open the GNU GRUB Edit Menu.
Locate the line that begins with the word linux.
Option 1
1. At the end of the line, add fsck.repair=yes then reboot the appliance. This will force the default filesystem check to auto-resolve any issues, and does not require emergency mode.
Option 2
1. At the end of the line, add systemd.unit=emergency.target
  Example:
2. Press F10 to continue booting.
3. Find the filesystems by running these commands:

Note: You will see the list of devices mounted with the disk uuid.

Run this command against the mount point that has issue:

e2fsck -y /dev/sda3

Note: The -y switch will fix the nodes automatically. Replace /dev/sda3 with the mount point that has the issue.
Power off the virtual appliance.
Power on the virtual appliance.

thumb_up Yes

thumb_down No