Code Monkey home page Code Monkey logo

cassandra.vision's Introduction

cassandra.vision

Tools for Offline Cassandra log and nodetool output analysis via ELK/FEK (Elastic, Logstash, Filebeat & Kibana) and Visual analysis of TableStats/CFStats using Excel.

These tools are for offline cluster monitoring. If you are looking online cluster monitoring, check out Cassandra.toolkit instead.

Table of Contents:

Overview

What is Offline Log Analysis?

Sometimes it is preferable to do "online log analysis", which is where you collect logs and metrics on a live cluster and monitor using Kibana, Grafana or some other dashboard. However, there are situations where this is not possible or preferable and you want to grab some logs, put them in a tarball, and ingest into your dashboard, often running in a separate host. We call this "offline log analysis".

Getting Started

Cassandra.vision provides three different tools for offline analysis. Combined, these tools can collect and visualize log files and nodetool command output, so that you can easily see what's going on with your cluster without having to install anything on your Cassandra nodes.

The main tool is "Cassandra Analyzer", which also runs commands from the other two tools, "TableAnalyzer" and "NodeAnalyzer". However, "TableAnalyzer" and "NodeAnalyzer" can also be ran on their own as standalone tools.

Click on the links below to begin.

Tool Description
Cassandra Analyzer A tool to collect log files and nodetool output from your Cassandra cluster into a tarball and ingest the logs so they can be visualized using our prebuilt Kibana dashboard. These python scripts also run commands from TableAnalyzer and NodeAnalyzer (see below) and includes results in the tarball. After running this, you will be able to either view your logs in the Kibana dashboard, perform data model review using the formatted spreadsheet generated by TableAnalyzer, or take the tarball that was collected and run other types of analytics. screenshot
TableAnalyzer A tool for analyzing Cassandra (CFStats/TableStats) output that visualizes variance in metrics between nodes. We use TableAnalyzer to generate a conditionally-formatted spreadsheet that can be used to perform data model review. Although TableAnalyzer can be ran as part of Cassandra Analyzer it can also be ran on its own. table-analyzer-diagram-03.png
NodeAnalyzer A quick and dirty tool to grab all the information for a specific node using nodetool and tarzip it into a tarball. Although NodeAnalyzer can be ran as part of Cassandra Analyzer it can also be ran on its own. screenshot

cassandra.vision's People

Contributors

ameerajmal111 avatar anomnaco avatar dbapramod882 avatar dipanshah avatar ionolaru avatar nice-monkey avatar privatebrycehao avatar ryanquey avatar xingh avatar

Stargazers

 avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.