amorton / cassback Goto Github PK
View Code? Open in Web Editor NEWBackup tool for Apache Cassandra based on https://github.com/synack/tablesnap
License: BSD 3-Clause "New" or "Revised" License
Backup tool for Apache Cassandra based on https://github.com/synack/tablesnap
License: BSD 3-Clause "New" or "Revised" License
Fresh install using PIP:
root@v1:/var/www/bin/cassandra# pip install backup/
Unpacking ./backup
Running setup.py egg_info for package from file:///var/www/bin/cassandra/backup
Downloading/unpacking boto>=2.2 (from cassback==0.1.1)
Downloading boto-2.8.0.tar.gz (743Kb): 743Kb downloaded
Running setup.py egg_info for package boto
warning: no files found matching 'boto/mturk/test/*.doctest'
warning: no files found matching 'boto/mturk/test/.gitignore'
Downloading/unpacking watchdog>=0.6. (from cassback==0.1.1)
Downloading watchdog-0.6.0.tar.gz (76Kb): 76Kb downloaded
Running setup.py egg_info for package watchdog
no previously-included directories found matching 'docs/source/_themes/.git*'
Downloading/unpacking pytz>=2012j (from cassback==0.1.1)
Downloading pytz-2013b.tar.gz (331Kb): 331Kb downloaded
Running setup.py egg_info for package pytz
warning: no files found matching '*.pot' under directory 'pytz'
warning: no previously-included files found matching 'test_zdump.py'
Downloading/unpacking PyYAML>=3.09 (from watchdog>=0.6.->cassback==0.1.1)
Downloading PyYAML-3.10.zip (364Kb): 364Kb downloaded
Running setup.py egg_info for package PyYAML
Downloading/unpacking argh>=0.8.1 (from watchdog>=0.6.->cassback==0.1.1)
Downloading argh-0.23.1.tar.gz
Running setup.py egg_info for package argh
Downloading/unpacking pathtools (from watchdog>=0.6.->cassback==0.1.1)
Downloading pathtools-0.1.2.tar.gz
Running setup.py egg_info for package pathtools
Installing collected packages: boto, watchdog, pytz, cassback, PyYAML, argh, pathtools
Running setup.py install for boto
warning: no files found matching 'boto/mturk/test/*.doctest'
warning: no files found matching 'boto/mturk/test/.gitignore'
changing mode of build/scripts-2.7/sdbadmin from 644 to 755
changing mode of build/scripts-2.7/elbadmin from 644 to 755
changing mode of build/scripts-2.7/cfadmin from 644 to 755
changing mode of build/scripts-2.7/s3put from 644 to 755
changing mode of build/scripts-2.7/fetch_file from 644 to 755
changing mode of build/scripts-2.7/launch_instance from 644 to 755
changing mode of build/scripts-2.7/list_instances from 644 to 755
changing mode of build/scripts-2.7/taskadmin from 644 to 755
changing mode of build/scripts-2.7/kill_instance from 644 to 755
changing mode of build/scripts-2.7/bundle_image from 644 to 755
changing mode of build/scripts-2.7/pyami_sendmail from 644 to 755
changing mode of build/scripts-2.7/lss3 from 644 to 755
changing mode of build/scripts-2.7/cq from 644 to 755
changing mode of build/scripts-2.7/route53 from 644 to 755
changing mode of build/scripts-2.7/cwutil from 644 to 755
changing mode of build/scripts-2.7/instance_events from 644 to 755
changing mode of build/scripts-2.7/asadmin from 644 to 755
changing mode of build/scripts-2.7/glacier from 644 to 755
changing mode of build/scripts-2.7/mturk from 644 to 755
changing mode of /usr/local/bin/asadmin to 755
changing mode of /usr/local/bin/bundle_image to 755
changing mode of /usr/local/bin/cfadmin to 755
changing mode of /usr/local/bin/cq to 755
changing mode of /usr/local/bin/cwutil to 755
changing mode of /usr/local/bin/elbadmin to 755
changing mode of /usr/local/bin/fetch_file to 755
changing mode of /usr/local/bin/glacier to 755
changing mode of /usr/local/bin/instance_events to 755
changing mode of /usr/local/bin/kill_instance to 755
changing mode of /usr/local/bin/launch_instance to 755
changing mode of /usr/local/bin/list_instances to 755
changing mode of /usr/local/bin/lss3 to 755
changing mode of /usr/local/bin/mturk to 755
changing mode of /usr/local/bin/pyami_sendmail to 755
changing mode of /usr/local/bin/route53 to 755
changing mode of /usr/local/bin/s3put to 755
changing mode of /usr/local/bin/sdbadmin to 755
changing mode of /usr/local/bin/taskadmin to 755
Running setup.py install for watchdog
no previously-included directories found matching 'docs/source/_themes/.git*'
Installing watchmedo script to /usr/local/bin
Running setup.py install for pytz
warning: no files found matching '*.pot' under directory 'pytz'
warning: no previously-included files found matching 'test_zdump.py'
Running setup.py install for cassback
Installing cassback script to /usr/local/bin
Running setup.py install for PyYAML
checking if libyaml is compilable
gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/usr/include/python2.7 -c build/temp.linux-x86_64-2.7/check_libyaml.c -o build/temp.linux-x86_64-2.7/check_libyaml.o
build/temp.linux-x86_64-2.7/check_libyaml.c:2:18: fatal error: yaml.h: No such file or directory
compilation terminated.
libyaml is not found or a compiler error: forcing --without-libyaml
(if libyaml is installed correctly, you may need to
specify the option --include-dirs or uncomment and
modify the parameter include_dirs in setup.cfg)
Running setup.py install for argh
Running setup.py install for pathtools
Successfully installed boto watchdog pytz cassback PyYAML argh pathtools
Cleaning up...
Result of running cassback:
root@v1:/var/www/bin/cassandra# cassback --endpoint local --backup-base /var/lib/cassandra/backup backup
Traceback (most recent call last):
File "/usr/local/bin/cassback", line 9, in <module>
load_entry_point('cassback==0.1.1', 'console_scripts', 'cassback')()
File "/usr/local/lib/python2.7/dist-packages/cassback/scripts.py", line 114, in cassback_main
init_logging(args)
File "/usr/local/lib/python2.7/dist-packages/cassback/scripts.py", line 104, in init_logging
level=getattr(logging, args.log_level))
File "/usr/lib/python2.7/logging/__init__.py", line 1519, in basicConfig
hdlr = FileHandler(filename, mode)
File "/usr/lib/python2.7/logging/__init__.py", line 897, in __init__
StreamHandler.__init__(self, self._open())
File "/usr/lib/python2.7/logging/__init__.py", line 916, in _open
stream = open(self.baseFilename, self.mode)
IOError: [Errno 2] No such file or directory: '/var/log/cassback/cassback.log'
Solved with the following:
root@v1:/var/www/bin/cassandra# mkdir /var/log/cassback
Hi,
Wanted to ask this on #cassandra-ops, but facing issues getting on to the IRC channel. So, thought will ask for advice here. Will appreciate any help.
I filed issue #3 about not being to install via pip. I tried the setup install and that works. I am trying to back up with an endpoint of S3. That fills up /tmp when it is making back ups. Is there some configuration I can use to clean up /tmp after the back up is done? Is there an issue with /tmp building up? I have a keyspace with a couple of hundred column families and the /tmp space builds up.
Hi,
Got errors when trying to pip install cassback. Will appreciate any help.
Here is my output
$ sudo pip install cassback
Downloading/unpacking cassback
Could not find any downloads that satisfy the requirement cassback
No distributions at all found for cassback
Storing complete log in /home/ubuntu/.pip/pip.log
/usr/bin/pip run on Sun Feb 16 23:08:54 2014
Downloading/unpacking cassback
Getting page http://pypi.python.org/simple/cassback
Could not fetch URL http://pypi.python.org/simple/cassback: HTTP Error 404: Not Found
Will skip URL http://pypi.python.org/simple/cassback when looking for download links for cassback
Getting page http://pypi.python.org/simple/
URLs to search for versions for cassback:
Also tried cassback/ like mentioned in documentation and got
$ sudo pip install cassback/
Exception:
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 126, in main
self.run(options, args)
File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 195, in run
InstallRequirement.from_line(name, None))
File "/usr/lib/python2.7/dist-packages/pip/req.py", line 98, in from_line
return cls(req, comes_from, url=url)
File "/usr/lib/python2.7/dist-packages/pip/req.py", line 38, in init
req = pkg_resources.Requirement.parse(req)
File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 2582, in parse
reqs = list(parse_requirements(s))
File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 2507, in parse_requirements
line, p, specs = scan_list(VERSION,LINE_END,line,p,(1,2),"version spec")
File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 2475, in scan_list
raise ValueError("Expected "+item_name+" in",line,"at",line[p:])
ValueError: ('Expected version spec in', 'cassback/', 'at', '/')
Storing complete log in /home/ubuntu/.pip/pip.log
OSError: [Errno 18] Invalid cross-device link
Installed cassback according to the instructions. When I am running the backup command -
cassback --endpoint s3 --aws-key xx --aws-secret xx --bucket-name cassandra-backup backup --include-system --cassandra_data_dir=/mnt/cassandra/data/
I get the following error. Let me know if this can be fixed.
Error:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/cassback-0.1.1-py2.7.egg/cassback/scripts.py", line 126, in cassback_main
rv, out = sub_command()
File "/usr/local/lib/python2.7/dist-packages/cassback-0.1.1-py2.7.egg/cassback/subcommands/backup_subcommand.py", line 119, in call
watcher.start()
File "/usr/local/lib/python2.7/dist-packages/cassback-0.1.1-py2.7.egg/cassback/subcommands/backup_subcommand.py", line 254, in start
enqueue=not(self.ignore_existing))
File "/usr/local/lib/python2.7/dist-packages/cassback-0.1.1-py2.7.egg/cassback/subcommands/backup_subcommand.py", line 286, in _maybe_queue_file
with file_util.FileReferenceContext(file_path) as file_ref:
File "/usr/local/lib/python2.7/dist-packages/cassback-0.1.1-py2.7.egg/cassback/file_util.py", line 142, in enter
os.link(self._source_path, stable_path)
OSError: [Errno 18] Invalid cross-device link
Thanks,
Amey
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.