My backup system was put to the test this last week. I had my main photography desktop, an Apple iMac, it’s time machine backup drive, and two other hard drives containing pictures of family, clients, and my recent trip to India. I also had a laptop, an Apple MacBookPro with client info, documents, and some miscellaneous pictures. So, was this a disaster, or an inconvenience? How well did my backup system work? Was I prepared?

The answer isn’t quite so clear cut. It wasn’t a disaster, but I found out I didn’t have a perfect system. Lets look at what happened, and what could be done differently.

So what backups do I still have? Didn’t they take my hard drives? Well, they did take a drive that was my time machine backup for that machine. I have no backup for that. I have lost several documents. I had PDF’s of client contracts, bank statements, time sheets from my computer coding jobs, eBooks, and other things. Many of these things I didn’t have a backup for. Some of these I can re download, but some like the client contracts, I only have a paper backup. Good job I have that, but for something that important, I really needed an off site backup.

As a side note: I do have a password on my login, but none of the data was in an encrypted volume. I hadn’t anticipated that I would lose my desktop. I figured a laptop, sure, but how would I lose my desktop? This ostrich head in the sand plan isn’t a plan.

So, did I have any off site backup? Yes. But my system needs work. The hard drives that were taken consist of my RAW files, and I had off site backup of those. They are manually mirrored drives. Every week or so (I have to admit that the time could grow) I would bring the drive home from a remote location and use RSYNC to mirror the data, and then bring the drive back. I have family pictures in one off site location, and client RAW images in another. Problems with this: it relies on my getting the drives to and from home manually. I was also only syncing RAW files. That was all that was on those drives. I didn’t have off site backup for my other documents.

The laptop I got lucky on. I have a wireless backup through time machine to a Apple Time Capsule. It is not in the open, and wasn’t taken. I just got a new laptop, and was able to pull in the data from that time machine backup. I don’t keep as much on the laptop however, partly as a way to minimize loss if stolen. But at least it was up an running quickly.

I was also somewhat lucky in that I have a NAS. It was not taken, as it was not out in the open. This should be a spot that I keep much of my documents, but I still haven’t set something up to get data here easily, or automatically. It is really there so that other computers on my home network can share data. If I don’t need to share it, I haven’t been putting it there. Also, this set of drives is raided, but not remotely backed up.

So, do I have all my photography data? Sort of. There are three types of images in my system. The RAW files, the lightroom ‘developed’ files, and photoshop adjusted files. There is also other data in lightroom catalogs, and things like presets, and export and print presets are not saved in regular lightroom catalog backups.

I did have backups of my catalogs. There were also on my external drives, and I had a fairly recent version on my off site backup, so we were good there. But was it good enough? I had to postpone two client meetings where they wanted to order images, but I didn’t know what I had, and couldn’t show them the images on a computer. I didn’t have them with out my RAW images, and a Lightroom catalog, and LR3 to process them. What would have helped? Having jpeg copies of all my ‘finished’ client images. I will get back to that.

The last bit of my system is finished PDF files. Well, some of them are with my Lightroom RAW files. When I head to photoshop from Lightroom, the PSD (or TIFF) gets stored in the same folder. But, I have (had) some photoshop files that are composites, or HDR’s, or other images that didn’t start with Lightroom. Because they were not getting saved with my RAW files, they were only on my desktop (and the time machine backup that disappeared) and not synced to an off site backup drive.

As well, the presets that I had developed my self, and others that I had downloaded are gone. Same as the PDF files, no off site backups. I had recently read on the lightroom blog about syncing those to dropbox, but didn’t get around to doing that.

Ok, so what have I learned, and what can I do different? First of all, nothing at home (or an office/studio) should be considered safe. You need to have an offsite backup of everything. Just having a backup at the same location is not enough. It protects you from drive failure, but it will not protect you from theft, or a worse disaster like a fire. So how do we get all this data protected off site?

Well, lets look at where we can put our data. First would be a service like Mozy, or Carbonite (PC mag review). There are issues with using these for lots and lots of RAW files. First, they take a long long time to sync up. Second, they can get expensive. Mozy home might be free for 2gig, but move to the pro package or get 500gig of photos, and it starts to add up. I don’t think that it is a cost effective solution for a working pro and their RAW files. These systems are set up for home users with a few gig, not someone with lots and lots of gigs.

How about what ever web site you use? For example, I have a service with a web host and run my own blog, I could just put my RAW files there right? Well, look into the TOS. Most say that you can only put files there that are in support of the web site. Backups are not allowed. Hmmm… Well, how about Photoshelter? I have a Photoshelter account. How about putting full size RAW files there. Looked at their prices for add on data storage? Yikes. (Plans) I started putting full size images up there at first. Sounded like a good backup, but I was filling up my space too quickly. So, I have another idea. First, I am not sold on Photoshelter. It doesn’t work perfectly for selling events and weddings anyway. I am thinking of switching to Smugmug. One of the things they offer is unlimited storage of jpegs. So, what I am thinking is that I will export full size images of everything that I put up there, and I would put up images for every client, even if I didn’t intend to send them there. That way I always have a full size finished image backed up on the internet somewhere. I wouldn’t have been stuck like I was this week needing both my raw files and a light room catalog. I would always have images I can review with clients.

Ok, so having client images readily available is a good thing, but I don’t want to lose my raw images. I think that I will still need to follow my manual sync, off site strategy for these images. It is just too much data, and too expensive to save RAW files to the cloud. I just need to be more diligent about the backups.

Ok, what about the other documents? That is what I think I will use something like Mozy home for. I won’t have multi hundreds of gigs for regular documents. This will be an affordable use of these cloud services. This is where the presets and things should be synced. The other photoshop files need to get saved to the same drive I have my RAW files on so that they will get synced to an off site backup. Ok, so how about my NAS? It provides a great way to share documents on my network, store video, music, and provide local backup of files, but to get it backed up would be a lot of data. It will need to be a combination of manual off site hard drives for video and music, and then making sure that everything stored on the network is also on backed up into the cloud service from the computer I was using. The NAS can’t be the only location I have those files.

So, the biggest thing I learned was that I need to have off site backup for everything. That can get expensive. The solution is to figure out how to use hard drives manually, home cloud services, and a better thought out plan to make sure that everything is getting backed up.

What do you think? Are you backing everything up off site? What’s your strategy? What do you think of mine?

This time I want something that doesn’t consume as much power, can be powered on and off easily, is fairly small, I can swap drives on it, does Raid 1 (mirroring), and doesn’t fry eggs on the top of the case.

Options. Not many. I looked at the Buffalo Linkstation Pro Duo, but it only ships in a dual drive configuration, and the 2 TB version seems way too expensive (Amazon $510). You get soaked on the drive cost here. The 1 TB version is two 500GB drives for $265. That is $245 to add another TB. (Without subtracting the cost of the other two drives).

I like the looks of the Netgear ReadyNAS Duo, and it ships with one drive and one open bay. For 500GB, Amazon wants $344, and I would have to replace 2 drives. For the 1 TB version the unit jumps to $617. Yikes. I am still 1 TB short of a mirror. Netgear has other 4 bay versions too, but they get even more expensive. Way more.

I suppose there is always the Drobo. It is a 4 bay solution. Not exactly a mirror, but some sort of wacky internal proprietary solution that provides redundancy. Amazon has this for $349 with no drives, but I would still need to add the Drobo Share to make it a NAS for $195. While a lot of photographers use this solution tied to one computer, I am not sure I like it as a NAS.

Lets try to add this up. First, drives. Newegg and Amazon’s stock of 1 TB drives seems to vary quite a bit. You can get Seagate and Western Digital drives from $179 to $240. I will just use $200 for now. Millage will vary. End price is a NAS with 2 TB total.

• Linkstation 1TB : $265 + 2x$200 = $665
• Linkstation 2TB : $510
• ReadyNAS 500GB : $344 + 2x$200 = $744
• ReadyNAS 1TB: $617 + $200 = $817
• Drobo : $349 + $195 + 2x$200 = $944

So, it looks like out of the box the Linkstation 2TB was the cheapest after all. I do have some concerns about the Linkstation. The unit needs to be disassembled to replace a drive, and I hear that it is not the fastest device.  $500 plus right now sounds like a whole lot of cabbage.

I suppose that trying to find a new motherboard that my existing processor and memory could fit into that would have onboard SATA ports would be another idea to explore. Without the external card, maybe the machine could boot up properly. Still, I think that it uses too much power. Maybe someday I will get a Kill-A-Watt and find out for sure.

So, with a trip coming up in July, I thought I would test it out. From a short trip to Rochester MN last weekend, I had some images on my laptop. (I hadn’t deleted the cards before getting the images to the main computer though) I copied the masters to the portable, then imported them into Aperture from the external drive. Oops. Several garbled images. Reformated the drive and I tried again. Same thing, different images. Dead drive, or housing. Guess I am going shopping.

First add some more space to the volume:
# lvextend -L +1G /dev/vgnas/pictures

Then tell ext3 about the extra space.
# resize2fs /dev/vgnas/pictures

Thats it. I did it live, without unmounting. I then went back to my rsync command, and it continued right where it left off. Sometimes I really like linux.

The thing that is really interresting about Scott and my solutions, is that there are a lot of similarities. But mine cost a lot less.

His first step is to save on location to an Epson P-500 (link). That would be cool. I have looked at those wistfully before. I don’t have anything comparable. I don’t travel as much as he does, so I just have to put in my empty card and go from there.

I do have a laptop and a small backup drive (just one) that I can use pretty much as he did to get the images off the cards. Most of the time I go straight to my main computer though.

On the main computer, I use Aperture to import my picures. But I don’t store them in my Library, I store them on a location on my hard drive by year, by reference in the Library. This means I know exactly where the pictures are, and I can use other tools to back them up.

First, I am also useing Time Machine. I use this to backup everything on this computer, and have a seperate drive (also stores my video collecion) that I use Apertures Vaults system to backup the Library.

I also have a backup system. Mine is not a Drobo (link). Mine is a older networked compter that lives under the stairs running Ubuntu that has a couple of drives in a RAID 1 mirrored configuration. I run a script from the command line to rsync the photos. This coppies only the new photos.

rsync –exclude=”.*” -ave ssh /Users/xxxx/Pictures/Aperture\ Masters/ xxxx@xx.xx.xx.xx:/media/pictures

I need to get that command into something automated, because I can go several days without doing a backup.

Ok, so now I have the pictures on a NAS, which means they are backed up, and, they are available on any machine I have via NFS and Samba. (Mac, Windows, Linux)

I also wanted to get some offsite storage. I thought about using an online backup site, but they are slow to get images up there, and I have less control. What was cheaper, was to buy two identical external hard drives, and use a system of rsync and physically rotating the drives to my work location. When I do the rotation, once a week when I remember, I do the rsync, then bring the drive from home to work, then bring the work one home.

This is the command I use with the drive, mounted at /mnt/freeAgent, plugged into my NAS:

rsync –exclude=”.*” –modify-window=2 -avh /mnt/pictures /mnt/freeAgent

At one time I could have my pictures on my Mac, my Time Machine backup, my raided NAS, and my two backup drives. 6 drives. A little redundant, if I follow my procedure.