Mirroring is not a backup.
Raid is not a backup.
Hard disks are not supposed to sit on a shelf unplugged for extended periods.
Fine. Now, how the hell do I backup my 5TB of photos? :-( :-(
Edit: Lots of fantastic information here
Is there any service that can burn my terabytes of data onto multiple copies on "made in japan taiyo yuden" CDR? :-)
I use git-annex. It understands the concept of wanting multiple copies of things, and keeps track of what is where (eg. S3, Glacier, some remote rsync server, or which of my many external drives). When I want something, it gets it for me (eg. by telling me which external drive to plug in).
Then, all I need to keep backed up is my git repository itself, which is tiny. I use Tarsnap for this, which means that I can keep previous snapshots without issue.
> Hard disks are not supposed to sit on a shelf unplugged for extended periods.
This works fine for me, when combined with some other method. Redundancy is key. And "git-annex fsck" checks a drive's integrity for me.
"git-annex is not a backup system. It may be a useful component of an archival system, or a way to deliver files to a backup system. For a backup system that uses git and that git-annex supports storing data in, see bup."
since you said you're using it effectively as a backup, could you please clarify what they mean, and what you mean?
I'm not using git-annex as a backup system. I use Tarsnap and my own tool ddar for backups.
I am using git-annex to archive specific large file collections that don't ever change (eg. photos and videos). By storing these collections appropriately in multiple redundant locations, and by also backing up my git-annex repository (using the backup tools above), I have effectively "backed up" my photos. They're as safe as any backup system can make them.
If you got one of the five drive boxes, you could dump 5 2TB drives into it, and likely have enough capacity to store all 5TB of photos, and be able to flip on the option to have two drives crash simultaneously without you losing any data. (you definitely lose space using them, as I have a 1TB and 2TB in mine right now and only have ~900GB available) If you're using a mac, it can even act as a Time Capsule so you can direct Time Machine to back up directly to it. (my wife and I do this, it tends to back up about once a day rather than every hour like Apple promises) Yes, I know it's expensive, but it's nice to know I have a local box (nothing in the cloud!) with all my (and my wife's) data backed up to it, where if a hard drive decides to go kaput, neither of us lose anything.
Also I'm not sure what (NAS) means, and I apologize if I sound like a salesman or something. Wasn't sure how to best describe a line of products made by a company without sounding like one. I was just trying to recommend a solution that I, personally, own and use to cover a pretty common case. And also feeds my slight paranoia of having a lot of my personal data and whatnot on someone else's servers.
This even more the case with the very large capacity disks you are mentioning here.
If you want more redundancy replace 2x 2x3TB drives with 2x NASes each with 3 drives in raid 5 or 4 drives in raid 1.
A lot depends on whether you're doing a backup or an archive; if it's a backup you'll be rotating the disks in periodically.
Or more realistically: batch-resize the photo's so that they are much smaller, and save that version of manageable size somewhere online as a last resort for when a disaster destroys all your current full-sized copies.
The main benefit compared to the others is the "unlimited" cloud backup space if you sign up for their cloud service.
I will check out crashplan.
I run it on my home NAS though so it's basically just set-and-forget, meaning that I don't have to remember to keep my Mac online. I just add my photos to the NAS share and it takes care of it from there.
We've been aware that our data and backup policies were lacking, and have been discussing ways to improve that. We have more than 500gb of work and client data that is highly valuable, and thousands of dollars in stock photos to boot.
Then one of our systems got hit by cryptodefense (the latest variant of cryptolocker). It encrypted the NAS drives faster than we could notice, and destroyed some 99% of our data. If it had been able to propagate to just 1 other system, which we did a nightly mirror of the NAS to, we'd have lost everything. Since then, we've been trying to set up backups to Amazon Glacier.
Don't underestimate the ease with which data loss can affect you. It could be a malicious link in a phishing email, a malicious attachment, bit rot, a natural disaster, or simple hardware failure. The cost of maintaining offsite backups is cheaper than recovering from data loss.
There is nothing wrong or unusual with being aware of our tongues.
There is nothing superior or powerful about others who make try to make us uncomfortable with ourselves.
This is nothing spooky, troubling or surprising about our breathing (as some similar posts elsewhere suggest "you are now breathing in manual mode. you just realized you have a skeleton.").
There is no reason to allow ourselves to experience any anxiety through becoming aware of our own bodies.
The only reason any of this "humor" works at all is because we are so thoroughly conditioned to have our minds focused outside of ourselves, on our work, on our needs and those society puts upon us that we rarely get to focus on ourselves and our bodies. And when we do, it's all too often because someone else is "rating" us or when we're trying to please others.
Let's all commit to dismissing false humor that suggests focusing attention on ourselves is anything but familiar, comfortable and impervious to psychological hijack by others.
I had an idea like that a few months ago after spending time with my family and my girlfriend's family. We need a simple page that explains in big images why:
1. chances are, you will lose your data
2. here's a one-click thing to make sure it doesn't happen
For 1, we can't use the word "data" because people won't connect emotionally with the concept. "Photos from your last summer vacation", "The video of your kid's first step" etc. would be more powerful.
For 2, I was looking for solutions that provide automatic, continuous and off-site backup that is easy to recover. Without any of these criteria, a backup strategy is effectively useless. (+ secure, affordable, etc. but these are extras).
I personally use and always recommend Backblaze for these reasons (one click install that just works and gets out of the way), but there might be other solutions.
Anyway, I'd love to see this project get somewhere, probably a GitHub page where people can contribute and provide 3-step tutorials for iCloud (so many people don't back up there iPhone when it's right there, baked in) and other platforms.
Interested? Get in touch: firstname.lastname@example.org
Pissed masses countered with "Backup Week", which still appears to be thinly veiled ad spread for backup companies.
What next? "Backup Month"? This is getting ridiculous.
Getting people to backup their files is important.
What's the problem?
Ever seen those "hosting provider ranking" sites that rank top entries purely based on the fees paid to them? That's you.
You want to fix this perception? Remove Sponsors, add complete listings of all notable backup products, invest time in reviewing them and allow ranking and comments. Then you will have something that would start to justify your preachy stance. Until then you are in just for a quick money grab and it's pretty damn obvious.
Also, providers have a legitimate incentive to help people. They may even like why they do what they do.
I'd love to use something like Tarsnap, but storing my ~80GB of data with them would cost $24/month plus $0.30 per gigabyte of bandwidth. And rsync.net is $0.10 per GB of storage, so that would be $8/month. (that price only when signing up through git-annex http://www.rsync.net/products/git-annex-pricing.html )
We did our best to invite all of the backup software companies (the more the merrier)! Better deals for customers means more people backing up! To participate, drop me a line at email@example.com.
A proper backup involves copies that cannot be modified after they are made (i.e. a snapshot after the backup has run if using disk, or for free on tape).
There's nothing special about an rsync/ssh solution that precludes the backup server from creating a read-only copy of each and any backup.
Having a video I could point people to, or even simple instructions for a specific way of backing up using Windows or OSX would be a more effective way of reminding people.
There are all kinds of local and cloud backup solutions out there that having a site which filtered through them would actually be great, but obviously outside the scope of the site which is more a friendly reminder to be aware and prepare.
So Backup Awareness Week is not associated with World Backup Day, but we support each other's goals of increasing awareness of the importance of regular backups.