Downtime Update the fourth
Well, after some seriously late nights were starting to get back on top of things.
The good news is, it looks like weve only lost around 5,000 images. For a sense of scale, thats roughly equivalent to five days of uploads. Quite a few of these may actually have been lost ages ago - were seeing most of those lost being back in 2012. One of our devs, jspenguin, has an archive which should let us actually fill in most of the gaps in any case, so we may not even lose as many as that.
Weve finished extracting what we can from the failed disks on cadance, replaced it with a brand spanking new RAID1 array (which mirrors data to protect against faults) and a fresh ext4 filesystem, and now were moving data back from the (newly replaced and expanded) backup server where weve been storing everything and getting our stuff together.
This is now just a matter of waiting for a million files totalling a few hundred gigabytes to get shuffled back over to cadance. Once thats done, well recover what we can from jspenguins archive, delete what we really cant save, perform a reindex, spin up the sites internal components, test it all internally, make sure everything is happy and fault-free, then switch the site itself back on.
If youre going to Bronycon dont forget to check out the Derpibooru T-shirts below, and let us know if youd be interested in more Derpibooru merchandise by replying to this post! If you just want to outright support us, weve added a donation button in the sidebar of this Tumblr. As ever - we dont make money on Derpibooru, we spend all of our money on the servers!
Well continue to post updates as things progress here.
Love,
Clover