At approximately noon (Central US time) our monitor systems detected an issue on the server “jonah”. After a quick check of the server by our technicians it was determined to be a hardware issue. Our hardware ninjas immediately sprang into action to pinpoint the issue.
The issue at first appeared to be power supply related. After a swap of parts that was determined to not be the case. The ninjas then determined the fastest path to recovery was to move to a backup server. The hard drives from the non-functioning server were swapped into the backup system. The system was then placed back into the rack and brought on-line.
The total down time for this hardware outage was slightly less than an hour. The hardware ninjas have now returned to the dojo awaiting their next mission.
Thanks for being on top of this guys, and for keeping us informed..great job!
We have three independent monitoring systems keeping an eye on the servers so we do our best to say on top of the issues when they occur.