Code Monkey home page Code Monkey logo

redshift_console's Introduction

Redshift Console

Redshift Console's goal is to be the tool to monitor and manage a Redshift cluster. The first release has basic tools to monitor running queries, WLM queue and your tables/schemas.

After over a year of managing our Redshift cluster with a collection of scripts and queries, we decided to bundle this into a more user friendly tool that can be used by a wider audience. This project also aims to uncover all the useful information hidden in Redshift's Developer Guide (such as the table design status query).

Screenshots

Features

  • Inflight queries view with option to cancel any query and view related alerts (when available; from STL_ALERT_EVENT_LOG).
  • WLM queue view.
  • Schemas view with additional information for each table including: total size (rows/MB), unsorted area size, is the table properly distributed and more.
  • Load errors (aggregated view) from the past 24h, based on STL_LOAD_ERRORS

Roadmap

This project is safe for usage, but still in its early stage (version 0.1). Future versions will include:

  • Loads - Progress of current operations and history of recent ones.
  • Vacuum status.
  • SNS/CloudWatch integration to show metrics and events from AWS' console.
  • Proactive notifications re. important events in the system: long running queries, problems, changes to the schema, dangerous levels of unsorted areas and more.

We are always happy to receive feedback and suggestions, especially if they are accompanied by a pull request.

Usage

You can either use the PyPI package or the docker image.

PyPI

  1. The easiest way to install the project is from pypi:
$ pip install redshift-console
  1. Settings are set from environment variables. The main setting to set is the connection string to your Redshift cluster: (make sure the user has sufficient permissions)
$ export REDSHIFT_CONNECTION_STRING='user= password= host= port= dbname='
  1. Start the server:

    $ redshift-console runserver
    Starting server on port 5000 (debug mode: False).

Docker

 $ docker run -e REDSHIFT_CONNECTION_STRING="user= password= host= port=5439 dbname=" -p 5000:5000 everythingme/redshift_console
 Starting server on port 5000 (debug mode: False).

Authors

Arik Fraimovich and Oren Itamar.

redshift_console's People

Contributors

arikfr avatar lenguyenthedat avatar michaelloewenstein avatar

Watchers

James Cloos avatar Ashish Dubey avatar Deepu T Philip avatar Satyam Krishna avatar Nand kishore Sharma avatar Apoorva Aggarwal avatar John Sushant Sundharam avatar  avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.