Author Topic: Aug 08 Outage  (Read 13449 times)

0 Members and 1 Guest are viewing this topic.

Offline Darkgear

  • Tin Man
  • Administrator
  • Flashaholic
  • *
  • Posts: 1021
  • If I only had a brain...
    • View Profile
    • Darkgear.com
Aug 08 Outage
« on: September 05, 2008, 11:49:39 AM »
Info for those who wanna know what happened aug 27-sep5.

Aug 28th the forums started giving us these errors

: Table './flash30_FF1/smf1_sessions' was created with a different version of MySQL and cannot be read
/home/flash30/public_html/Sources/Load.php
2096

I figure its some kind of corruption so I check out the DBs and there are half a dozen tables locked and unreadable. I check the host network status page and they say all is OK.  So I start replacing files and rebuilding DBs and the corruption gets worse and worse.  I finally submit a trouble ticket to support on the 28th.  I ask them to restore a previous day backup from the 27th.  I get this reply.

Quote
It would be better for us to do this after we finish the current repairs. I'm not sure if you were alerted of this:

A flawed configuration of the cPanel on our shared servers has caused a malfunction in the Apache and PHP setups on them. We are currently working on this and it should be fixed soon. Please be patient during this time and all the problems should be fixed upon our completion.

After we finish this, we can safely restore your site.

So they did have a server configuration issue. :P  I tell them OK finish the repair then restore. They finish repairs to the cpanel and php config on the 30th and I'm nervous because they only keep backups for 3 days then they expire.  On the 1st they say the last backup they have is from aug 28th.  I tell them its OK to restore that one.  2 days later no restore and I get a phone call.  Tech says their backup system died and the manufacturer is overnighting them a part to fix it. Good news is that the 28th backup did not expire since the whole tape library went down.  Bad news is another day to wait.  Today(5th) another call to say the backup was fixed but the backup of our forum was incomplete.  Oh well.  So I just rebuilt the forum from scratch on another hosting site and painfully had to fix all the sql errors one by one manually.  Heh still only took a few hours to completely rebuild.  I guess I should have done that earlier.

Anyway, we're back. sorry for the downtime.

Best regards,
Randy







Offline Darkgear

  • Tin Man
  • Administrator
  • Flashaholic
  • *
  • Posts: 1021
  • If I only had a brain...
    • View Profile
    • Darkgear.com
Re: Aug 08 Outage
« Reply #1 on: September 05, 2008, 11:57:25 AM »
Forgot to say that in upgrading our forum we lost some features and gained some old ones(that were updated).  I also just changed the nameservers to the URL so it will be about 24 hours before all the routers catch up and access to this site is stable again.

The google member map is back
Arcade was updated

Still working on:
wiki
Lighthouse banner
profile comments
chess

Shop probably won't be back(no more clams)

Please let me know if you see anything amiss.

Randy

Offline Bullzeyebill

  • Senior Member
  • ****
  • Posts: 576
    • View Profile
Re: Aug 08 Outage
« Reply #2 on: September 05, 2008, 11:59:51 AM »
Thanks Randy for your efforts.

Bill

Offline Lips

  • Flashaholic
  • *****
  • Posts: 3290
  • Mighty Fine :>) - Tasha Nicole and Marisa Miller
    • View Profile
    • Paypal = vdcjr@comcast.net
Re: Aug 08 Outage
« Reply #3 on: September 05, 2008, 12:02:42 PM »



Thanks for your hard work Randy   :thumbup:



.
Fire Foxes FF4 in stock and ready to ship.
You can send me a PM me here at site or contact me directly at FireFoxes@comcast.net for information.
Prices and info at the top of this post:
http://flashlight-forums.com/index.php?topic=13795.0

Offline arewethereyetdad

  • Flashaholic
  • *****
  • Posts: 12649
  • 2008 National Champions
    • View Profile
Re: Aug 08 Outage
« Reply #4 on: September 05, 2008, 12:14:23 PM »
Randy, you da man!  Thanks a million for all the time and effort.  You saved the mothership!  Glad to be home again.   :D :thumbup:  :P

Offline griff

  • Senior Member
  • ****
  • Posts: 680
    • View Profile
Re: Aug 08 Outage
« Reply #5 on: September 05, 2008, 01:00:01 PM »
WELCOME BACK   mr Kotter
Too many to list!

Offline Rebel

  • Senior Member
  • ****
  • Posts: 649
  • with a cause
    • View Profile
Re: Aug 08 Outage
« Reply #6 on: September 05, 2008, 03:21:12 PM »
All my clams are gone, I'm ruined.  :'(  :P

Good to see the site back up and running though.
“The conscious and intelligent manipulation of the organized habits and opinions of the masses is an important element in democratic society. Those who manipulate this unseen mechanism of society constitute an invisible government which is the true ruling power of our country." - Edward Bernays

Offline arewethereyetdad

  • Flashaholic
  • *****
  • Posts: 12649
  • 2008 National Champions
    • View Profile
Re: Aug 08 Outage
« Reply #7 on: September 05, 2008, 04:39:33 PM »
As mentioned earlier, super job, Randy.  Hope you can get the lighthouse banner back.  :popcorn:

Offline starfiretoo

  • Junior Member
  • **
  • Posts: 84
  • What me worry?
    • View Profile
Re: Aug 08 Outage
« Reply #8 on: September 05, 2008, 08:08:19 PM »
Thanks and Goodjob! :thumbup:

Offline Hodsta

  • Full Member
  • ***
  • Posts: 356
    • View Profile
Re: Aug 08 Outage
« Reply #9 on: September 05, 2008, 09:33:57 PM »
Cheers to you - thanks - this URL is nothing without you :thumbup:

Offline BraddahBill

  • Flashaholic
  • *****
  • Posts: 1773
  • Lumens, don't know what it means, but I want some.
    • View Profile
Re: Aug 08 Outage
« Reply #10 on: September 05, 2008, 10:54:41 PM »
Randy you are da MAN!   :thumbup: :thumbup: :thumbup:




Bill

Offline regentag

  • Flashaholic
  • *****
  • Posts: 3845
    • View Profile
Re: Aug 08 Outage
« Reply #11 on: September 05, 2008, 11:06:47 PM »
You're an archangel, Darkgear!  :thumbup:
///rā'gən·täg

Offline aikiman44

  • Full Member
  • ***
  • Posts: 418
    • View Profile
Re: Aug 08 Outage
« Reply #12 on: September 06, 2008, 12:25:20 AM »
Top notch work. :thumbup:
Good to be back.
I said I liked it.  I didn't say I wanted to kiss it.
 - In a Lonely Place


Offline PoliceScannerMan

  • Moderator BatMan
  • Flashaholic
  • *****
  • Posts: 2310
    • View Profile
Re: Aug 08 Outage
« Reply #13 on: September 06, 2008, 01:51:11 AM »
tight work Randy, as usual.  Your behind the scenes work keep it going, we appreciate it!!
Proud member of "The Bulk Crowd™".
-PSM

Offline nolan

  • Newbie
  • *
  • Posts: 38
    • View Profile
Re: Aug 08 Outage
« Reply #14 on: September 06, 2008, 05:24:59 AM »
 :) :D :thumbup: 8) Glad to see the forum back up! Great Job!