Add support for AWS Glacier about duplicity-backup.sh HOT 6 CLOSED

Hi @rubyvrooom,

duplicity-backup is only a wrapper script for duplicity, which is the software that actually performs the backup.
Support of different backends (like AWS S3 or Glacier) is the job of duplicity (see http://bazaar.launchpad.net/~duplicity-team/duplicity/0.6-series/files/head:/duplicity/backends/).

In this script you can use any backend that duplicity already supports. Supposing that duplicity will support Glacier in the future, for this script it's only a matter of changing the DEST parameter in the config file.

For suggesting duplicity's devs implement support of Glacier you should try there : https://launchpad.net/duplicity

from duplicity-backup.sh.

@rubyvrooom, just FYI:
https://bugs.launchpad.net/duplicity/+bug/1039511

from duplicity-backup.sh.

yup, saw that. thanks. new to the space.

from duplicity-backup.sh.

Just a short update on that:

Amazon annouced the "Archiving Amazon S3 Data to Amazon Glacier" Feature:
http://aws.typepad.com/aws/2012/11/archive-s3-to-glacier.html

So you are able to define a "lifecycle rule" to archive objects from S3 to Glacier automatically

from duplicity-backup.sh.

Sorry to beat a dead horse, but given that duplicity seems not to have support or Glacier, which make sense actually, should this script provide it?

It would be awesome at list to generate the commands necessary to create lifecycle rules that one could execute himself and warn/mark when one archive resides in glacier.

We handle time and lifecycle rules already...other ideas and hints are welcome, I would love to have something like duply.

Maybe we can reopen this issue @zertrin?

from duplicity-backup.sh.

Sorry but I think this is out of scope for this script.

Glacier is really a different approach to file storage and there is no easy way of automating all of it, even less so in a simple bash script.

Implementing all the needed logic to manage Glacier already looks like the job for a dedicated tool (and I'm persuaded that there is some already available).

This script only cares about facilitating usage of duplicity. As long duplicity doesn't support Glacier as a backend (and I don't see it coming any time soon), there is nothing we can do here.

The example you linked just uses S3 buckets with a manually defined lifecycle rule "Configuration: Archive to the Glacier Storage Class 1 days after the object's creation date.". You can do the same already with our wrapper, that's just configuration on AWS side.

from duplicity-backup.sh.