Recovered from database Disaster / Corruption

by on January 25, 2007 · 2 comments· LAST UPDATED January 25, 2007

in

Earlier today monit reported Lighttpd webserver problem. Due to MySQL database corruption site was down for almost 2hrs.

We restored all data, again, without any loss of files or posts/articles except comment made after 24th Jan 2007! Entire site is roll-back to last good backup which was made on 23-Jan-2007.

Thanks to NAS backup.

As usual disaster strike at midnight (3AM):
mint-reports.png
(Traffic hit graph)

If you see any problem please write to me vivek ReMoVeMe AT nixCraft . COM.

TwitterFacebookGoogle+PDF versionFound an error/typo on this page? Help us!

{ 2 comments… read them below or add one }

1 Motin March 5, 2007 at 2:58 am

Do you use a good system to detect and get notified of disasters that you can recommend? I would sleep better if I could just check my e-mail after midnight…

Reply

2 nixCraft March 5, 2007 at 2:56 pm

I’m using Nagios, Munin, Monit and few custom made perl/shell scripts. You need to play with these tools all of them are quite effective.

Reply

Leave a Comment

Previous post:

Next post: