Crowdsourced Backups
Posted: May 27th, 2011, 11:55:57 pm
Hey there.
In case you didn't notice, there was kind of a giant super crash.
The main problem was that backups are tricky. Even if I set up automatic backups on the server, it's harddrives could fail. Even if I had them automatically downloaded to my laptop, it's off most of the time, or not on the internet. Even if I had it downloaded onto a desktop computer, some change might make it stop working and I might not know for months until something is wrong. All of these have been problems in the past.
I've decided to take a new approach, which I think will make things much easier if there's another crash like this one.
The process is this:
Every hour, staggered backups of much of the site's data are constructed, compressed, and encrypted with the most secure algorithms available and only retrievable with my own biometric information. It is set to expire in five years, which is long before technology is projected to advance enough to crack the information. it is then moved to an area accessible to everybody. Here: backups/
Download them. Or don't, whichever you prefer. But if you do, do it often. That way, no matter what, there will always be a very recent backup that I can use. If both of the server's disks exploded in a fire tomorrow, I'd be able to post on twitter to find someone who had the latest backup and get the site up in just a few hours, and nobody would miss more than an hour of pets or twenty-four hours of posts.
We will still use all of the usual backup methods, but this will be a last resort in the event that they fail, which is unlikely but always seems to happen anyways.
In case you didn't notice, there was kind of a giant super crash.
The main problem was that backups are tricky. Even if I set up automatic backups on the server, it's harddrives could fail. Even if I had them automatically downloaded to my laptop, it's off most of the time, or not on the internet. Even if I had it downloaded onto a desktop computer, some change might make it stop working and I might not know for months until something is wrong. All of these have been problems in the past.
I've decided to take a new approach, which I think will make things much easier if there's another crash like this one.
The process is this:
Every hour, staggered backups of much of the site's data are constructed, compressed, and encrypted with the most secure algorithms available and only retrievable with my own biometric information. It is set to expire in five years, which is long before technology is projected to advance enough to crack the information. it is then moved to an area accessible to everybody. Here: backups/
Download them. Or don't, whichever you prefer. But if you do, do it often. That way, no matter what, there will always be a very recent backup that I can use. If both of the server's disks exploded in a fire tomorrow, I'd be able to post on twitter to find someone who had the latest backup and get the site up in just a few hours, and nobody would miss more than an hour of pets or twenty-four hours of posts.
We will still use all of the usual backup methods, but this will be a last resort in the event that they fail, which is unlikely but always seems to happen anyways.