Code Monkey home page Code Monkey logo

canary's Introduction

Canary

Monitoring Service for Openstack Taskflow's Jobboards

How does it work?

Task-ception

Canary is used to monitor other job-boards. The results are posted to MongoDB.

The dashboard uses meteor.js and will update in realtime, detecting changes in the MongoDB.

Console Scripts

canary-producer

Canary's own producer process that posts jobs to Canary's jobboard

canary-worker

Canary's conductor which pulls jobs off Canary's jobboard, to query paths submitted to it (using Taskflow) and post to cassandra with a timestamp

canary-server

Canary's WSGI server that serves job counts and corresponding jobs, over the period of last x seconds (which is set as interval under canary.conf)

Dashboard

From the /dashboard folder, run:

$ export MONGO_URL=mongodb://localhost:27017/canary
$ meteor 

API

The API is optional. Usually the canary-producer is run via cron.

GET v1.0/jobs?path=/taskflow/jobs/myawesomejobs
  

HTTP/1.0 200 OK
Date: Fri, 27 Mar 2015 14:45:13 GMT
Server: WSGIServer/0.1 Python/2.7.6
content-type: application/json; charset=utf-8

[
    {
        "job_count": 1,
        "jobs": [
            {
                "_backend": {
                    "connection": "zookeeper"
                },
                "_book": null,
                "_book_data": {
                    "name": "myawesomeservice-2db7c7fb-e3d4-4602-8658-2c0ec0736b50",
                    "uuid": "81d22b6c-d11e-4c41-8e05-e423385a0ddc"
                },
                "_created_on": "2015-03-27T10:28:07.951000",
                "_details": {
                    "store": {
                        "awesome": "sauce",
                    }
                },
                "_lock_path": "/taskflow/jobs/myawesomejobs/job0000000042.lock",
                "_name": "myawesomeservice-2db7c7fb-e3d4-4602-8658-2c0ec0736b50",
                "_node_not_found": false,
                "_path": "/taskflow/jobs/myawesomejobs/job0000000042",
                "_root": "/taskflow/jobs/myawesomejobs/",
                "_sequence": 42,
                "status": "CLAIMED",
                "_uuid": "d76816c3-db93-4b66-8272-637b114a84e9"
            },
        ]
    }
]

canary's People

Contributors

bentwire avatar bryansd avatar sriram-mv avatar tonytan4ever avatar val2k avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

canary's Issues

Dockerize All The Things!

Add docker-compose files and Dockerfiles for spinning up a complete Canary environment. This will make it easier and quicker to have all the components up and running.

make canary-producer a python service

Instead of running canary-producer via cron, make it a service that runs on its own and post jobs at configured intervals.

This allows the service to be better monitored etc as cron is hard to monitor.

Cassandra Connection Pooling

Currently Every request to cassandra, involves creating a new connection and tearing it down.
This should be implemented such that, cassandra connections are established at startup of canary-server, and the same connection is re-used during different requests.

Meteor Database

Currently meteor is caching the remote database locally. This causes the page to do weird things on a refresh as it replays all the events. We should not cache the data locally.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.