Recovered from database Disaster / Corruption

by on January 25, 2007 · 2 comments· Last updated January 25, 2007

Earlier today monit reported Lighttpd webserver problem. Due to MySQL database corruption site was down for almost 2hrs.

We restored all data, again, without any loss of files or posts/articles except comment made after 24th Jan 2007! Entire site is roll-back to last good backup which was made on 23-Jan-2007.

Thanks to NAS backup.

As usual disaster strike at midnight (3AM):
mint-reports.png
(Traffic hit graph)

If you see any problem please write to me vivek ReMoVeMe AT nixCraft . COM.



You should follow me on twitter here or grab rss feed to keep track of new changes.

Featured Articles:

{ 2 comments… read them below or add one }

1 Motin March 5, 2007 at 2:58 am

Do you use a good system to detect and get notified of disasters that you can recommend? I would sleep better if I could just check my e-mail after midnight…

Reply

2 nixcraft March 5, 2007 at 2:56 pm

I’m using Nagios, Munin, Monit and few custom made perl/shell scripts. You need to play with these tools all of them are quite effective.

Reply

Leave a Comment

You can use these HTML tags and attributes for your code and commands: <strong> <em> <ol> <li> <u> <ul> <blockquote> <pre> <a href="" title="">
What is 2 + 15 ?
Please leave these two fields as-is:
Solve the simple math so we know that you are a human and not a bot.



Previous post:

Next post: