Code Monkey home page Code Monkey logo

thecodeteam / scaleio-framework Goto Github PK

View Code? Open in Web Editor NEW
26.0 13.0 6.0 4.71 MB

The ScaleIO Framework implements an Apache Mesos Framework to manage the lifecycle of ScaleIO, a scale-out software-based block storage platform.

License: Apache License 2.0

Shell 0.51% Go 57.00% Protocol Buffer 34.94% HTML 1.48% CSS 5.99% JavaScript 0.08%
mesos scaleio-framework scaleio storage-platform go containers dell-emc docker kubernetes mesos-framework

scaleio-framework's Introduction

ScaleIO Framework for Apache Mesos

logo

The ScaleIO Framework deploys Dell EMC ScaleIO as a simplified task in Apache Mesos. All the required components to consume and provision storage volumes from a ScaleIO cluster are automatically deployed and configured on the Mesos Agents. This creates an automated mechanism to have a fully configured and reliable persistent storage solution for containers running on Apache Mesos.

Key Features

  • Installs required components on existing Mesos Agents to consume and provision ScaleIO storage volumes
  • On-boards new Agent nodes with "native" access to ScaleIO volumes
  • All Agent nodes are configured to be highly available so failed applications can be restarted on other Agent nodes while preserving their data using REX-Ray as a container runtime volume driver
  • Additional storage can be added to the ScaleIO cluster to expand capacity

What it does

Container runtime schedulers need to be integrated with every aspect of available hardware resources, including persistent storage. When requesting resources for an application the scheduler gets offers for CPU, RAM and disk.

To be able to offer persistent storage in a scalable way, the ScaleIO Framework installs and configures all necessary ScaleIO, a Software-based Storage Platform, components along with all the "glue" to connect Mesos and ScaleIO to service applications requiring persistent storage.

Documentation Docs

You will find complete documentation for ScaleIO-Framework at scaleio-framework.readthedocs.org, including licensing and support information. Documentation provided at RTD is based on the latest stable build. The /.docs directory in this repo will refer to the latest or specific commit.

Road map / TBDs

The current release highlights the capabilities of combining Software Defined Storage with a platform that offers 2-layer scheduling. Subsequent versions will add significantly more features.

  • Add CoreOS support
  • Add ability to provision an entire ScaleIO cluster and include the MDM management nodes from initialization
  • Allow more customization of the ScaleIO deployment
  • Manage entire life cycle (upgrades, maintenance, etc) of all nodes in the ScaleIO cluster
  • Manages health of a ScaleIO cluster by monitoring for critical events (Performance, Almost Full, etc)

Support

Please file bugs and issues on the Github issues page for this project. This is to help keep track and document everything related to this repo. For general discussions and further support, join the {code} by Dell EMC Community slack team. The code and documentation are released with no warranties or SLAs and are intended to be supported through a community driven process.

scaleio-framework's People

Contributors

kacole2 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

scaleio-framework's Issues

Deploy of ScaleIO Using Higher Level of Abstraction

Using parameters like Rack ID, Row, and etc, automatically deploy ScaleIO such that specific details of how ScaleIO is deployed are hidden from the user without performing the default "everything in huge group" but still having data available (fault domains). This is compromise between full autopilot and completely user-defined deployment as seen in issue #82.

Investigate (and Implement) User Defined Deployment

Through user-defined attributes on Mesos Agent nodes, we want to define a mechanism in which a user can declare the persona of a given Agent node. These attributes include:

  • SDS or/and SDC
  • Protection Domain
  • Storage Pool (and what devices contribute said pool)

Initial thoughts are to define using Mesos Agent attributes. Need to investigate this how these attributes are surfaced to scheduler/executor.

Add code metrics

Add badges for golang metrics... codecov, docs, go report, etc

Monitoring for ScaleIO

Add in monitoring for ScaleIO events, status, and etc. Think performance, capacity, and etc.

Cloud Me!

Add in some AWS goodness. It's a secret. Trust us!

NOTE: This does not mean add in support for AWS since the Framework already supports AWS, GCE, and all other clouds.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.