VMWare Virtual Center Errors
Yesterday I had a nasty case of Y-splitter failure (in future I’m just going to upgrade the PSU rather than go though this again) which caused all four of the 320Gb disks of a RAID5 array to suddenly disappear.
Windows didn’t like that and hung, VMware Virtual Center disliked it even more. Once I recovered the machine (ohhh AD was in a mess!) VMVC refused to launch and spewed some messages to the console. The sole purpose for this entry is to list the event log errors and list the solution so hopefully some one else out there won’t be in the dark.
The errors always happen in batches as follows:
[2376] [VpxdMutex] Locking InvtLock (5) conflicts with InvtHostBarrier (0)
[3372] (HY000) - [Microsoft][ODBC Microsoft Access Driver] Not a valid bookmark.
[3372] [ARCHIVER] Q: SELECT COUNT(*) FROM STATS_HOST_DATA WHERE HOST_ID=? AND HIST_ID=? AND COL_ID=? AND ROW_ID=?
[3372] [ARCHIVER] Failed to count stats. ODBC error=-1
[3372] [Vpxd] Initiating shutting down
[3352] [Vpxd] Shutting down…
[3352] [Vpxd] Shutting down now
The description for Event ID ( 1 ) in Source ( VMware Virtual Mount Service Extended ) cannot be found. The local computer may not have the necessary registry information or message DLL files to display messages from a remote computer. You may be able to use the /AUXSOURCE= flag to retrieve this description; see Help and Support for details. The following information is part of the event: vmount2 service stopped 1.5.2 build-32167.
Then the VMVC process hangs, it shows as ‘Started’ in the Services MMC but any connection attempts are met with an active refusal.
Taking the hint that a database was corrupted I made a copy of the Template / Uploads directory and bit the bullet; initiated the dreaded MSI Repair mode.
Answering ‘Yes’ to keeping the existing database followed by a swift reboot and all was working again.
One of the VMWare servers had hung (it was deploying from a template when this happened!) and had to be kill -9′d but after that all came up fine again.
Fun eh?