Our server costs ~$56 per month to run. Please consider donating or becoming a Patron to help keep the site running. Help us gain new members by following us on Twitter and liking our page on Facebook!
Current time: August 9, 2026, 4:22 am
Atheist Forums › Site Specific › Announcements v
And...we are back up and running.

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Thread Modes
And...we are back up and running.
awty Offline
Send lawyers, guns, and money...
********
Religious Views: Yawn...
Posts: 18602
Threads: 154
Joined: July 10, 2013
Reputation: 65
#1
And...we are back up and running.
July 25, 2026 at 6:45 pm
Don't break the forum again.   Dodgy
What fresh hell can this be? - Dorothy Parker
Find
Reply
awty Offline
Send lawyers, guns, and money...
********
Religious Views: Yawn...
Posts: 18602
Threads: 154
Joined: July 10, 2013
Reputation: 65
#2
RE: And...we are back up and running.
July 25, 2026 at 6:46 pm
Send many thanks to Tiberius who came to the rescue...again.
What fresh hell can this be? - Dorothy Parker
Find
Reply
BrianSoddingBoru4 Offline
Power-Drunk Administrator
********
Religious Views: Headology
Posts: 51798
Threads: 564
Joined: July 24, 2013
Reputation: 109
#3
RE: And...we are back up and running.
July 25, 2026 at 7:19 pm
Glad the goat wasn’t wasted. 😜

Boru
‘I can’t be having with this.’ - Esmeralda Weatherwax
Find
Reply
AFTT47 Offline
Senior Member
****
Religious Views: Transhumanist
Posts: 3775
Threads: 136
Joined: January 19, 2015
Reputation: 30
#4
RE: And...we are back up and running.
July 25, 2026 at 7:50 pm
Given the past history of this forum and statements Tiberius made, I didn't think it would go away without warning but it was getting scary. Glad to see it back up.
Only two things are infinite, the universe and human stupidity, and I'm not sure about the former.

Albert Einstein
Find
Reply
Tiberius Offline
Question Everything.
********
Religious Views: Atheist
Posts: 14933
Threads: 684
Joined: August 25, 2008
Reputation: 142
#5
RE: And...we are back up and running.
July 25, 2026 at 8:11 pm
Basically one of the backup processes borked and stopped deleting old backup files, and also filled a log with errors. The combination of both of those caused the server to run out of diskspace, and then the database crashed.

Ordinarily, deleting the old files, clearing out the log, and restarting the database would have worked.

However once I did the first two, the server failed to start. Due to the crash, some data got corrupted. I got Claude Code to write some recovery scripts, which worked to first extract all the good data to a backup, then restore that data to a new database server. Thankfully the corrupted data wasn't actually anything critical, so I don't believe we lost anything of value.

Even if we had, we still had the last backup from the day before the database crashed (FYI, the forum gets backed up locally every morning). I designed some redundancies into the system, haha. But I'll work with the admins to figure out a plan going forward since we do need to upgrade some parts of the server in the future.
Find
Reply
zebo-the-fat Offline
Senior Member
****
Religious Views: Atheist
Posts: 3641
Threads: 182
Joined: April 29, 2012
Reputation: 24
#6
RE: And...we are back up and running.
July 26, 2026 at 12:29 am
Glad it's fixed, I'm currently traveling and thought it was maybe a problem with the hotel WiFi or maybe foreign phone systems 😃
The meek shall inherit the Earth, the rest of us will fly to the stars.

Never underestimate the power of very stupid people in large groups

Arguing with an engineer is like wrestling with a pig in mud ..... after a while you realise that the pig likes it!

Find
Reply
BrianSoddingBoru4 Offline
Power-Drunk Administrator
********
Religious Views: Headology
Posts: 51798
Threads: 564
Joined: July 24, 2013
Reputation: 109
#7
RE: And...we are back up and running.
July 26, 2026 at 5:48 pm
(July 25, 2026 at 8:11 pm)Tiberius Wrote: Basically one of the backup processes borked and stopped deleting old backup files, and also filled a log with errors. The combination of both of those caused the server to run out of diskspace, and then the database crashed.

Ordinarily, deleting the old files, clearing out the log, and restarting the database would have worked.

However once I did the first two, the server failed to start. Due to the crash, some data got corrupted. I got Claude Code to write some recovery scripts, which worked to first extract all the good data to a backup, then restore that data to a new database server. Thankfully the corrupted data wasn't actually anything critical, so I don't believe we lost anything of value.

Even if we had, we still had the last backup from the day before the database crashed (FYI, the forum gets backed up locally every morning). I designed some redundancies into the system, haha. But I'll work with the admins to figure out a plan going forward since we do need to upgrade some parts of the server in the future.

In my head, that sounded like ‘argle bargle worble whoosh’, but many thanks all the same.

Boru
‘I can’t be having with this.’ - Esmeralda Weatherwax
Find
Reply
The Valkyrie Offline
The last smile some will see...
********
Religious Views: Time to end them
Posts: 36007
Threads: 210
Joined: August 13, 2012
Reputation: 146
#8
RE: And...we are back up and running.
July 27, 2026 at 3:49 am
So, who am I holding accountable?

Playing Cluedo with my mum while I was at Uni:

"You did WHAT?  With WHO?  WHERE???"
Find
Reply
Jackalope Offline
Exiled
********
Religious Views: Absurdist
Posts: 31819
Threads: 205
Joined: July 19, 2011
Reputation: 141
#9
RE: And...we are back up and running.
July 27, 2026 at 5:14 am
Sorry, I was not in a position to do much, I have been at sea. When I get back home in a month, I'll work on some monitoring to ensure we don't get caught with our collective pants down again.
Find
Reply
BrianSoddingBoru4 Offline
Power-Drunk Administrator
********
Religious Views: Headology
Posts: 51798
Threads: 564
Joined: July 24, 2013
Reputation: 109
#10
RE: And...we are back up and running.
July 27, 2026 at 6:17 am
(July 27, 2026 at 3:49 am)The Valkyrie Wrote: So, who am I holding accountable?

Well, Nay_Sayer admitted to tripping over the power plug and getting the wires tangled. Do with this info what you will. Wink

Boru
‘I can’t be having with this.’ - Esmeralda Weatherwax
Find
Reply


Atheist Forums › Site Specific › Announcements v
And...we are back up and running.

Possibly Related Threads...
Thread Author Replies Views Last Post
  Everyone say a big "Welcome Back!" to Shell B, our new moderator! Tiberius 43 15914 May 7, 2018 at 10:01 pm
Last Post: brewer



Users browsing this thread: 1 Guest(s)