Code Monkey home page Code Monkey logo

cassback's People

Contributors

amorton avatar jeremygrosser avatar mheffner avatar thekad avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

cassback's Issues

New install via pip, missing /var/log/cassback/cassback.log

Fresh install using PIP:

root@v1:/var/www/bin/cassandra# pip install backup/
Unpacking ./backup
  Running setup.py egg_info for package from file:///var/www/bin/cassandra/backup

Downloading/unpacking boto>=2.2 (from cassback==0.1.1)
  Downloading boto-2.8.0.tar.gz (743Kb): 743Kb downloaded
  Running setup.py egg_info for package boto

    warning: no files found matching 'boto/mturk/test/*.doctest'
    warning: no files found matching 'boto/mturk/test/.gitignore'
Downloading/unpacking watchdog>=0.6. (from cassback==0.1.1)
  Downloading watchdog-0.6.0.tar.gz (76Kb): 76Kb downloaded
  Running setup.py egg_info for package watchdog

    no previously-included directories found matching 'docs/source/_themes/.git*'
Downloading/unpacking pytz>=2012j (from cassback==0.1.1)
  Downloading pytz-2013b.tar.gz (331Kb): 331Kb downloaded
  Running setup.py egg_info for package pytz

    warning: no files found matching '*.pot' under directory 'pytz'
    warning: no previously-included files found matching 'test_zdump.py'
Downloading/unpacking PyYAML>=3.09 (from watchdog>=0.6.->cassback==0.1.1)
  Downloading PyYAML-3.10.zip (364Kb): 364Kb downloaded
  Running setup.py egg_info for package PyYAML

Downloading/unpacking argh>=0.8.1 (from watchdog>=0.6.->cassback==0.1.1)
  Downloading argh-0.23.1.tar.gz
  Running setup.py egg_info for package argh

Downloading/unpacking pathtools (from watchdog>=0.6.->cassback==0.1.1)
  Downloading pathtools-0.1.2.tar.gz
  Running setup.py egg_info for package pathtools

Installing collected packages: boto, watchdog, pytz, cassback, PyYAML, argh, pathtools
  Running setup.py install for boto

    warning: no files found matching 'boto/mturk/test/*.doctest'
    warning: no files found matching 'boto/mturk/test/.gitignore'
    changing mode of build/scripts-2.7/sdbadmin from 644 to 755
    changing mode of build/scripts-2.7/elbadmin from 644 to 755
    changing mode of build/scripts-2.7/cfadmin from 644 to 755
    changing mode of build/scripts-2.7/s3put from 644 to 755
    changing mode of build/scripts-2.7/fetch_file from 644 to 755
    changing mode of build/scripts-2.7/launch_instance from 644 to 755
    changing mode of build/scripts-2.7/list_instances from 644 to 755
    changing mode of build/scripts-2.7/taskadmin from 644 to 755
    changing mode of build/scripts-2.7/kill_instance from 644 to 755
    changing mode of build/scripts-2.7/bundle_image from 644 to 755
    changing mode of build/scripts-2.7/pyami_sendmail from 644 to 755
    changing mode of build/scripts-2.7/lss3 from 644 to 755
    changing mode of build/scripts-2.7/cq from 644 to 755
    changing mode of build/scripts-2.7/route53 from 644 to 755
    changing mode of build/scripts-2.7/cwutil from 644 to 755
    changing mode of build/scripts-2.7/instance_events from 644 to 755
    changing mode of build/scripts-2.7/asadmin from 644 to 755
    changing mode of build/scripts-2.7/glacier from 644 to 755
    changing mode of build/scripts-2.7/mturk from 644 to 755
    changing mode of /usr/local/bin/asadmin to 755
    changing mode of /usr/local/bin/bundle_image to 755
    changing mode of /usr/local/bin/cfadmin to 755
    changing mode of /usr/local/bin/cq to 755
    changing mode of /usr/local/bin/cwutil to 755
    changing mode of /usr/local/bin/elbadmin to 755
    changing mode of /usr/local/bin/fetch_file to 755
    changing mode of /usr/local/bin/glacier to 755
    changing mode of /usr/local/bin/instance_events to 755
    changing mode of /usr/local/bin/kill_instance to 755
    changing mode of /usr/local/bin/launch_instance to 755
    changing mode of /usr/local/bin/list_instances to 755
    changing mode of /usr/local/bin/lss3 to 755
    changing mode of /usr/local/bin/mturk to 755
    changing mode of /usr/local/bin/pyami_sendmail to 755
    changing mode of /usr/local/bin/route53 to 755
    changing mode of /usr/local/bin/s3put to 755
    changing mode of /usr/local/bin/sdbadmin to 755
    changing mode of /usr/local/bin/taskadmin to 755
  Running setup.py install for watchdog

    no previously-included directories found matching 'docs/source/_themes/.git*'
    Installing watchmedo script to /usr/local/bin
  Running setup.py install for pytz

    warning: no files found matching '*.pot' under directory 'pytz'
    warning: no previously-included files found matching 'test_zdump.py'
  Running setup.py install for cassback

    Installing cassback script to /usr/local/bin
  Running setup.py install for PyYAML
    checking if libyaml is compilable
    gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/usr/include/python2.7 -c build/temp.linux-x86_64-2.7/check_libyaml.c -o build/temp.linux-x86_64-2.7/check_libyaml.o
    build/temp.linux-x86_64-2.7/check_libyaml.c:2:18: fatal error: yaml.h: No such file or directory
    compilation terminated.

    libyaml is not found or a compiler error: forcing --without-libyaml
    (if libyaml is installed correctly, you may need to
     specify the option --include-dirs or uncomment and
     modify the parameter include_dirs in setup.cfg)

  Running setup.py install for argh

  Running setup.py install for pathtools

Successfully installed boto watchdog pytz cassback PyYAML argh pathtools
Cleaning up...

Result of running cassback:

root@v1:/var/www/bin/cassandra# cassback --endpoint local --backup-base /var/lib/cassandra/backup backup
Traceback (most recent call last):
  File "/usr/local/bin/cassback", line 9, in <module>
    load_entry_point('cassback==0.1.1', 'console_scripts', 'cassback')()
  File "/usr/local/lib/python2.7/dist-packages/cassback/scripts.py", line 114, in cassback_main
    init_logging(args)
  File "/usr/local/lib/python2.7/dist-packages/cassback/scripts.py", line 104, in init_logging
    level=getattr(logging, args.log_level))
  File "/usr/lib/python2.7/logging/__init__.py", line 1519, in basicConfig
    hdlr = FileHandler(filename, mode)
  File "/usr/lib/python2.7/logging/__init__.py", line 897, in __init__
    StreamHandler.__init__(self, self._open())
  File "/usr/lib/python2.7/logging/__init__.py", line 916, in _open
    stream = open(self.baseFilename, self.mode)
IOError: [Errno 2] No such file or directory: '/var/log/cassback/cassback.log'

Solved with the following:

root@v1:/var/www/bin/cassandra# mkdir /var/log/cassback

Cleaning up /tmp

Hi,

Wanted to ask this on #cassandra-ops, but facing issues getting on to the IRC channel. So, thought will ask for advice here. Will appreciate any help.

I filed issue #3 about not being to install via pip. I tried the setup install and that works. I am trying to back up with an endpoint of S3. That fills up /tmp when it is making back ups. Is there some configuration I can use to clean up /tmp after the back up is done? Is there an issue with /tmp building up? I have a keyspace with a couple of hundred column families and the /tmp space builds up.

Could not pip install cassback

Hi,

Got errors when trying to pip install cassback. Will appreciate any help.

Here is my output
$ sudo pip install cassback
Downloading/unpacking cassback
Could not find any downloads that satisfy the requirement cassback
No distributions at all found for cassback
Storing complete log in /home/ubuntu/.pip/pip.log

pip.log has

/usr/bin/pip run on Sun Feb 16 23:08:54 2014
Downloading/unpacking cassback
Getting page http://pypi.python.org/simple/cassback
Could not fetch URL http://pypi.python.org/simple/cassback: HTTP Error 404: Not Found
Will skip URL http://pypi.python.org/simple/cassback when looking for download links for cassback
Getting page http://pypi.python.org/simple/
URLs to search for versions for cassback:

  • http://pypi.python.org/simple/cassback/
    Getting page http://pypi.python.org/simple/cassback/
    Could not fetch URL http://pypi.python.org/simple/cassback/: HTTP Error 404: Not Found
    Will skip URL http://pypi.python.org/simple/cassback/ when looking for download links for cassback
    Could not find any downloads that satisfy the requirement cassback
    No distributions at all found for cassback
    Exception information:
    Traceback (most recent call last):
    File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 126, in main
    self.run(options, args)
    File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 223, in run
    requirement_set.prepare_files(finder, force_root_egg_info=self.bundle, bundle=self.bundle)
    File "/usr/lib/python2.7/dist-packages/pip/req.py", line 948, in prepare_files
    url = finder.find_requirement(req_to_install, upgrade=self.upgrade)
    File "/usr/lib/python2.7/dist-packages/pip/index.py", line 152, in find_requirement
    raise DistributionNotFound('No distributions at all found for %s' % req)
    DistributionNotFound: No distributions at all found for cassback

Also tried cassback/ like mentioned in documentation and got

$ sudo pip install cassback/
Exception:
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 126, in main
self.run(options, args)
File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 195, in run
InstallRequirement.from_line(name, None))
File "/usr/lib/python2.7/dist-packages/pip/req.py", line 98, in from_line
return cls(req, comes_from, url=url)
File "/usr/lib/python2.7/dist-packages/pip/req.py", line 38, in init
req = pkg_resources.Requirement.parse(req)
File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 2582, in parse
reqs = list(parse_requirements(s))
File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 2507, in parse_requirements
line, p, specs = scan_list(VERSION,LINE_END,line,p,(1,2),"version spec")
File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 2475, in scan_list
raise ValueError("Expected "+item_name+" in",line,"at",line[p:])
ValueError: ('Expected version spec in', 'cassback/', 'at', '/')

Storing complete log in /home/ubuntu/.pip/pip.log

Error when backing up to S3

OSError: [Errno 18] Invalid cross-device link

Installed cassback according to the instructions. When I am running the backup command -

cassback --endpoint s3 --aws-key xx --aws-secret xx --bucket-name cassandra-backup backup --include-system --cassandra_data_dir=/mnt/cassandra/data/

I get the following error. Let me know if this can be fixed.

Error:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/cassback-0.1.1-py2.7.egg/cassback/scripts.py", line 126, in cassback_main
rv, out = sub_command()
File "/usr/local/lib/python2.7/dist-packages/cassback-0.1.1-py2.7.egg/cassback/subcommands/backup_subcommand.py", line 119, in call
watcher.start()
File "/usr/local/lib/python2.7/dist-packages/cassback-0.1.1-py2.7.egg/cassback/subcommands/backup_subcommand.py", line 254, in start
enqueue=not(self.ignore_existing))
File "/usr/local/lib/python2.7/dist-packages/cassback-0.1.1-py2.7.egg/cassback/subcommands/backup_subcommand.py", line 286, in _maybe_queue_file
with file_util.FileReferenceContext(file_path) as file_ref:
File "/usr/local/lib/python2.7/dist-packages/cassback-0.1.1-py2.7.egg/cassback/file_util.py", line 142, in enter
os.link(self._source_path, stable_path)
OSError: [Errno 18] Invalid cross-device link

Thanks,
Amey

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.