Recovered from database Disaster / Corruption

by Vivek Gite on January 25, 2007 · 2 comments

Earlier today monit reported Lighttpd webserver problem. Due to MySQL database corruption site was down for almost 2hrs.

We restored all data, again, without any loss of files or posts/articles except comment made after 24th Jan 2007! Entire site is roll-back to last good backup which was made on 23-Jan-2007.

Thanks to NAS backup.

As usual disaster strike at midnight (3AM):
mint-reports.png
(Traffic hit graph)

If you see any problem please write to me vivek ReMoVeMe AT nixCraft . COM.

Featured Articles:

Share this with other sys admins!
Facebook it - Tweet it - Print it -

We're here to help you make the most of sysadmin work. So, subscribe!

{ 2 comments… read them below or add one }

1 Motin March 5, 2007

Do you use a good system to detect and get notified of disasters that you can recommend? I would sleep better if I could just check my e-mail after midnight…

Reply

2 nixcraft March 5, 2007

I’m using Nagios, Munin, Monit and few custom made perl/shell scripts. You need to play with these tools all of them are quite effective.

Reply

Leave a Comment

You can use these HTML tags and attributes for your code and commands: <strong> <em> <ol> <li> <u> <ul> <blockquote> <pre> <a href="" title="">
What is 12 + 15 ?
Please leave these two fields as-is:
Are you a human being? Solve the simple math so we know that you are a human and not a bot.



Previous post:

Next post: