MongoDB backups support. about backup HOT 12 CLOSED

FYI here is some info on recommended ways to do backups in mongodb: http://www.mongodb.org/display/DOCS/Backups

If you have any questions, don't hesitate to get in touch.

from backup.

Looks like mongodump might be the best option just to get something going.

from backup.

I agree. I've been busy with a project a while back and mongodump is actually a very simple utility to get this done. I'll see if I can find the time to look at this.

from backup.

I'm working on this now and will have a patch shortly (in the next 2-5 days). FYI

from backup.

Woah mate! That's AWESOME. I am merging your changes as we speak and will release all the stuff I have up until now that was in .pre as a full release.

Take your time on MongoDB, whenever you're ready let me know and I'll add it and release a new gem as that is a huge addition! Thanks again for your work! :)

from backup.

np! I needed it. I'll have some stuff checked into my branch here shortly

http://github.com/skippy/backup/tree/mongo

it was simple to add mongo (not finished yet, but getting there!), however, I needed the ability to add streaming ability for s3. The s3 gem doesn't support streaming, which means it loads everything into memory. I wasn't trying very large files but I can't spare 3gb of ram every time I need to do a backup. So I converted to aws-s3. The good thing is that because of the code structure it was very easy to do. But let me know if this is ok... if you were attached to the s3 gem for a particular reason, just let me know?

from backup.

Sounds good! The thing is, we used to use the aws-s3 gem but it did not support EEUU/European buckets. There was need for that by particular Backup users so we made the switch to the s3 gem simply to accomplish that.

However, storing everything that it's going t send in memory is crazy, and aws-s3 is the only gem that supports this? Any idea if AWS-S3 now supports buckets, other than the US only?

Thanks again m8!

from backup.

good to know! I'll take a look and check it out.

from backup.

I fixed this and it is in my mongo branch (which isn't ready). I moved over to fog, which a few people recommended to me; it is fast, streams, simple, and it supports regions. so far so good.

from backup.

Oh! I heard about this one a while ago! It's supposed to be like a single interface for various cloud servers right?

That might be even better to use instead of 2 separate gems (s3 and cloudfiles)?

Then we could also implement it for the Cloud Files storage method.

But hey that sounds super good man, thanks for that, that'd once again be a great addition!

from backup.

it can be used for cloudfiles, though I haven't converted that over (as I don't use that service). do you want me to go ahead and do the optional gem change that is in issue #39 or should we leave that for later?

from backup.

We can leave it for later. First get the S3 thing working I'd say :)

from backup.