Code Monkey home page Code Monkey logo

refarch-ml-ops's Introduction

ML Operationalization Starter Kit for ML Operationalization

Contents

  1. ML Operationalizarion
  2. Cloud Pak For Data - A Platform for Operationalizing Models
  3. ML Ops Starter Kit
  4. ML Ops Starter Kit Projects
  5. Where to use ML Ops Starter Kit Projects
  6. ML Ops Starter Kit Roadmap
  7. Contents of the Repository
  8. How to get Started with this Starter Kit
  9. Contributors

ML Operationalization

ML Operationalization refers to operationalization of Machine Learning Models for production use and realizing business value out of those Models.

ML Operationalization covers standard ML Lifecycle (CRISP-DM) overlayed with Continuous Integration/Nontinuous Development paradigm. It covers Data Priovisioning & Governance, Data Preparation for Model Development, Model Development, Model Validation & Governance, Infusing Model's Insight in Application and Model Monitoring overlayed with Continuous Integration/Nontinuous Development paradigm.

For more infornation on conceptual view of ML Operationalization please check Operationalizing AI

Cloud Pak For Data - A Platform for Operationalizing Models

Next let us discuss about IBM Cloud Pak For Data. It is a platform to accelerate journey to AI to transform business operation with an open, extensible data and AI platform that runs on any cloud.

For detailed information about Cloud Pak For Data please check here

ML Ops Starter Kit

ML Ops Starter Kit is an End 2 End framework to help one get started with ML Operationalization. It right now uses components of Cloud Pak For Data. However, can be customised for any other Open Source of Propreitory Infrastructure too.

ML Ops Starter Kit Projects

ML Ops Start Kit contains a set of Get Started Projects. Each Project has Instructions, Code/Notebooks, and Data packaged together in a single asset (.zip file) that can be imported as new 'Project' in Cloud Pak For Data project in a single click.

Each Get Started project supports a specific Machine Learning framework. Right now there are 3 Get Started projects supporting + Scikit Learn, + Spark MLLib + AutoAI + More frameworks; R, Tensore Flow/Keras, SPSS Modeler, etc; are coming soon.

Where to use ML Ops Starter Kit Projects

  • As a Starter Creating End to End Demo aligned with ML Ops challenges/requirements of new/prospective clients of CPD
  • Enablement
  • Development of industry specific demos/ assets using Cloud Pak for Data

ML Ops Starter Kit works on any Cloud Pak For Data cluster (that has necessary components) including Cloud Pak For Data Experience

ML Ops Starter Kit can be used for othet environments too in Public Cloud, Private Cloud or Hybrid Environment

ML Ops Starter Kit Roadmap

Roadmap of ML Ops Starter Kit -

  • Wave 1 (on CPD 2.5)

    • ML Ops covering Data Preparation, Model Development, Model Deployment & Consumption, and Model Monitoring
    • Using 3 Machine Learning Model development Frameworks โ€“ AutoAI, Scikit Learn and SparkMlLib
    • Covers following components of Cloud Pak for Data - Data Connections, Watson Studio (Data Refinery, Notebooks, Auto AI, Spark/Analytics Engine), Watson Machine Learning and Watson Open Scale
  • Wave 2 (on CPD 2.5)

    • ML Ops including Data Provisioning and Governance using Watson Knowledge Catalog
    • Basic CI/CD using CAM API and Notebook based Jobs
  • Wave 3 (on CPD 3.0)

    • End to End ML Ops covering including Model Validation using Watson Open Scale and Virtualized Data Provisioning using Data Virtualization
    • Advanced CI/CD using Jenkins and Github (using CLI)
    • Configuring Open Scale using API
    • Additional ML Frameworks โ€“ R, Tensor Flow/Keras, Others

Contents of the Repository

  • A set of Get Started Projects which can be imported to Cloud Pak For Data for End to End ML Operationalization.
  • Supporting Assets
    • Best Practices and Guidelines
    • Short Video on ML Ops using Cloud Pak For Data
    • Video on Detailed steps of ML Ops process using Cloud Pak For Data
    • Reference Architecture

How to get Started with this Starter Kit

  • If you have some environment of Cloud Pak For Data start with that. Or get your access to free edition of Cloud Pak For Data cluster
  • Go to Projects folder of this Repository. Select the Project you want to use. Start with the project with Auto AI as that can help you establish an end to end flow in few Hrs. Right now we have 1 project using Auto AI. We are adding more projects soon.
  • Go to Supporting Assets folder of this Repository. There you would get other relevant documentations needed by you for ML Ops

Contributors

Please contact me for any questions.

refarch-ml-ops's People

Contributors

sourav-mazumder avatar skwatra1992 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.