I've been seeing messages in my inbox the last couple of days about a degraded RAID array on this server. I haven't bothered to look into it because I'm busy.
Well, last night, there was a leap second added to the world. Java doesn't play nicely with leap seconds ( http://bugs.sun.com/...do?bug_id=4272347 ). Twitter was all sorts of astir with people complaining about their Linux systems going crazy due to the leap second. So when I ssh'ed into the server this morning, I saw a load of over 6 (that's bad, but not UBER-crazy. I've seen loads north of 140 before.) So I decided to reboot the server.
Bad idea.
After about 20 minutes of the server not responding to further SSH requests, I finally went upstairs, turned on the monitor and plugged in a keyboard. Black screen. Hmmm. Reboot via the power button. I finally figured out that I had to add "bootdegraded=true" to the GRUB boot configuration. But that's probably not a long-term solution.
So I need to figure out what the long-term solution IS.
Just keeping you up-to-date as to what the story is. There's no solution yet.