Crowdsourced Backups

Discuss MagiStream and site-related topics.
Post Reply
User avatar
Madd
Queen of Mean
Member of The Herbalist's Guild
CreaturesTrade
Posts: 1745
Joined: March 8th, 2009, 11:00:08 pm
Gender: Female

Crowdsourced Backups

Post by Madd »

Hey there.

In case you didn't notice, there was kind of a giant super crash.
The main problem was that backups are tricky. Even if I set up automatic backups on the server, it's harddrives could fail. Even if I had them automatically downloaded to my laptop, it's off most of the time, or not on the internet. Even if I had it downloaded onto a desktop computer, some change might make it stop working and I might not know for months until something is wrong. All of these have been problems in the past.

I've decided to take a new approach, which I think will make things much easier if there's another crash like this one.

The process is this:
Every hour, staggered backups of much of the site's data are constructed, compressed, and encrypted with the most secure algorithms available and only retrievable with my own biometric information. It is set to expire in five years, which is long before technology is projected to advance enough to crack the information. it is then moved to an area accessible to everybody. Here: backups/

Download them. Or don't, whichever you prefer. But if you do, do it often. That way, no matter what, there will always be a very recent backup that I can use. If both of the server's disks exploded in a fire tomorrow, I'd be able to post on twitter to find someone who had the latest backup and get the site up in just a few hours, and nobody would miss more than an hour of pets or twenty-four hours of posts.

We will still use all of the usual backup methods, but this will be a last resort in the event that they fail, which is unlikely but always seems to happen anyways.
I don't work here anymore but I do still have this egg

Image
User avatar
sammythethief
MagiStream Donor
Member of Society of the Trident Member of Artificer's Association Member of Preservationists Association
CreaturesTrade
Posts: 18199
Joined: September 4th, 2009, 11:42:58 am
Gender: Kraken
Location: The Inn of the Last Home

Re: Crowdsourced Backups

Post by sammythethief »

I will try to remember to download that backup daily.
It sounds like a sound idea to me (though I know absolutely nothing of the inner workings of running a website of this magnitude).

Thanks for everything, Tristan.
Image
Be kind.
ImageImageImageImageImage
Formerly MadameRed - same grumpy soul, new and improved theft!
Red's Daily Adoptable Nursery
Image-Free MagiStream Nursery
Image
Image
User avatar
Soleil
MagiStream Donor
Member of The Dark Brotherhood
CreaturesTrade
Posts: 15736
Joined: June 2nd, 2009, 9:22:18 pm
Gender: Female
Location: Vietnam

Re: Crowdsourced Backups

Post by Soleil »

If I can remember, I'll try to do it once or twice a week. I can't say I will remember XD hopefully others will though
Image
User avatar
Myrin
Member of The Herbalist's Guild Member of Artificer's Association Member of Preservationists Association
CreaturesTrade
Posts: 5509
Joined: July 6th, 2009, 9:16:33 pm
Gender: Kraken

Re: Crowdsourced Backups

Post by Myrin »

Count me in!

I wonder if something like Backblaze would work too? They advertize unlimited backup space for a low monthly fee, but dunno if they'd do servers like MS.

ImageImageImageImageImageImageImageImageImageImage

codes:
Spoiler

Code: Select all

[url=https://magistream.com/creature/14924532][img]https://magistream.com/img/14924532.gif[/img][/url][url=https://magistream.com/creature/14924533][img]https://magistream.com/img/14924533.gif[/img][/url][url=https://magistream.com/creature/14924526][img]https://magistream.com/img/14924526.gif[/img][/url][url=https://magistream.com/creature/14924527][img]https://magistream.com/img/14924527.gif[/img][/url][url=https://magistream.com/creature/14924528][img]https://magistream.com/img/14924528.gif[/img][/url][url=https://magistream.com/creature/14924529][img]https://magistream.com/img/14924529.gif[/img][/url][url=https://magistream.com/creature/14924530][img]https://magistream.com/img/14924530.gif[/img][/url][url=https://magistream.com/creature/14924531][img]https://magistream.com/img/14924531.gif[/img][/url]
My GPX+: Image
User avatar
ShenziSixaxis
MagiStream Donor
CreaturesTrade
Posts: 13619
Joined: July 10th, 2009, 12:05:34 am
Gender: Female

Re: Crowdsourced Backups

Post by ShenziSixaxis »

Done. :P

However, I don't see a file to be downloaded in the /forums area. o-O
morgainthe
MagiStream Donor
Member of Society of the Trident Member of Artificer's Association Member of Preservationists Association An icon depicting the element Void
CreaturesTrade
Posts: 415
Joined: August 28th, 2009, 10:56:47 pm
Gender: Female

Re: Crowdsourced Backups

Post by morgainthe »

done
my keep is open for gold mining. My creatures are not for sale.
User avatar
Revan
MagiStream Donor
Member of The Dark Brotherhood Member of Artificer's Association Member of Preservationists Association An icon depicting the element Void
CreaturesTrade
Posts: 7159
Joined: August 15th, 2009, 4:22:23 pm
Gender: Female
Location: Hibernating in a cave in cow country.

Re: Crowdsourced Backups

Post by Revan »

Stupid crappy slow internet... The files aren't downloading correctly for me. I hope it's okay if I just stick to saving all the tabs in my Keep directly onto my computer as internet files just so I know what I actually had in case another crash like this happens again.
Need hatchlings?
Come visit The Hatchery!

Free Lineages!

If you visit my Keep, beware. I hoard owls. I am not responsible for any pecked out eyeballs or loss of fingers that may occur.
Wishlist :orly:
User avatar
Jinzeiu
MagiStream Donor
Member of The Dark Brotherhood Member of Artificer's Association
CreaturesTrade
Posts: 6296
Joined: August 20th, 2009, 11:20:10 am
Gender: Female
Location: New York

Re: Crowdsourced Backups

Post by Jinzeiu »

I downloaded them about 2 hours ago.
Image
User avatar
GrowlingCupcake
MagiStream Donor
Member of The Dark Brotherhood Member of Artificer's Association
CreaturesTrade
Posts: 5625
Joined: July 19th, 2009, 7:28:47 am
Gender: Female
Location: In a teacup.

Re: Crowdsourced Backups

Post by GrowlingCupcake »

Will save them when I can, most likely every few days.
Working on getting back into things after a forced hiatus.
LTS: Shards at 50k each.
User avatar
Nahla
MagiStream Donor
Member of The Dark Brotherhood Member of Artificer's Association Member of Preservationists Association An icon depicting the element Void
CreaturesTrade
Posts: 8650
Joined: July 19th, 2009, 11:06:31 am
Gender: Female
Location: In the German Room with my lovely Companion Shiroko.

Re: Crowdsourced Backups

Post by Nahla »

I try to download every 2 days. :italian:
♥ Please click me ♥
Final Outpost: ImageImageImageImageImageImageImageImage
Magistream: ImageImageImageImageImageImage
Post Reply

Return to “Community Discussion”