Right now, I have around 20TB of data in redundant ZFS mirrors, so I am somewhat protected against any single drive failing. Critical data is backed up at various cloud providers, but that’s only a few gigs of all my data.

Looking at S3 pricing, It seems rather unfeasible to back up my data there or on the other “big” cloud providers, as it would cost me around $180 with AWS or half of that with backblaze.

How and where do you guys back up your data?

6 points
*

The amount of data I backup offsite is significantly less than 20 TB. Therefore, my answer to your question will probably not help you.

I store my offsite backups at rsync.net and in one of Hetzners Storage Boxes. For backups in general, I use Borg.

permalink
report
reply
2 points

Hetzner Storage Boxes seem much more affordable than AWS, thanks for the suggestion!

permalink
report
parent
reply
3 points

However, I would not use the storage boxes as the only backup. The offer has two disadvantages.

  • The boxes are regularly unavailable for some time due to maintenance work. But these maintenance times are announced in advance.

  • Hetzner does not specify what kind of RAID is used.

I therefore only use my box as an additional offsite backup and to swap out less important files.

permalink
report
parent
reply
5 points
*

The real question is how much of that data is irreplaceable. While I hoard like most of you I only off-site backup the hand full of TBs I can’t live without if there was a full system failure. It’s not the perfect solution but most of my hoarded data isn’t mission critical

EDIT: to answer your question though I use AWS glacier storage

permalink
report
reply
4 points

Apart from the few gigs of really private and self-made data, most of it would probably be replacable, it’s just a matter of how much work that would be. On the other hand, I wonder how much of my media collection I would actually miss were it to get lost.

I will look into AWS glacier, thank you.

permalink
report
parent
reply
2 points
*

Sounds like we have similar setups, and knowing that I’d highly recommend investing in automating as much of your current setup as possible so you can quickly get things back up and running with little to no interaction. Backing up configurations and library metadata might prove to be pretty useful in resurrecting a dead server.

Also rclone is going to be your best friend if you don’t already have that setup

permalink
report
parent
reply
1 point

The egress fees from glacier are astronomical. So if you ever need them you might just decide it’s worth re-downloading. Last I checked Wasabi seemed a better option, but higher priced per month of course.

permalink
report
parent
reply
1 point
*

My line of thinking is that radarr and sonarr are my backups. If the drives went boom then just have those two sync my library. It may take a couple weeks but I can live with that.

permalink
report
parent
reply
4 points

You could look into AWS Glacier or S3 Deep Storage tier. If you have 20TB stored that’s about $20/month(YMMV) which isn’t wonderful but that’s a lot of data so it’s understandable.

Being a cheapskate, if I can get something back or it’s not crucial it’s on a RAID array with snapshots, everything else is either encrypted Duplicati backups to Google Drive (Windows) or encrypted borg backups to Borgbase(Linux)

Borgbase is very reasonably priced and if you have a large storage space in GDrive due to having one of their other services it’s a good use of it.

permalink
report
reply
2 points

Hadn’t heard of borgbase before, I’ll check it out. Thanks.

permalink
report
parent
reply
4 points

I use Scaleway Glacier since I could actually afford to pull the data out, unlike S3.

permalink
report
reply
2 points
  • Backblaze B2 for my most important stuff. Encrypted of course
  • Backup HDDs and M-Discs stored at friend’s house
permalink
report
reply

datahoarder

!datahoarder@lemmy.ml

Create post

Who are we?

We are digital librarians. Among us are represented the various reasons to keep data – legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they’re sure it’s done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

We are one. We are legion. And we’re trying really hard not to forget.

– 5-4-3-2-1-bang from this thread

Community stats

  • 415

    Monthly active users

  • 197

    Posts

  • 1.5K

    Comments

Community moderators