Code Monkey home page Code Monkey logo

ram_project_ds_prod's Introduction

Data Science in Production Project

Starting Commands

$ git init
$ git branch -M main
$ git remote add origin https://github.com/mohamedelmesawy/RAM_Project_DS_PROD.git
$ dvc init
$ git status
$ git commit -m "initialize repo"


$ dvc remote add -d dvc-RAM-remote gdrive://1vSVT0oq6I4rb6Ho2AzQMKQ7Z6X_nUwqy/data
$ cat .dvc/config
$ git commit .dvc/config -m "configure remote storage"

Create data Directory

$ mkdir data
$ copy file to data folder
$ ls ./data
$ dvc add ./data/Mall_Customers.csv


$ cat ./data/Mall_Customers.csv.dvc
$ git add data/Mall_Customers.csv.dvc data/.gitignore
$ git commit -m "data: track"
$ git tag -a 'v1' -m "raw data"
$ git push origin main --tags
$ dvc push

Updating the Data Source [Removing lines from CSV]

$ dvc add ./data/Mall_Customers.csv
$ git add ./data/Mall_Customers.csv.dvc
$ git tag -a 'v2' -m 'removed 50 lines'
$ git push origin main --tags
$ dvc push


$ git add .
$ git commit -m 'adding second version tag of csv'
$ git push origin main --tags


$ dvc remote add -d dvc-PC-remote '../../Remote_Data'
$ dvc remote list
$ git add .dvc/config
$ git commit -m 'adding another DVC_REPO'
$ git push origin

RUN the Project

# Clone this project
$ git clone https://github.com/mohamedelmesawy/RAM_Project_DS_PROD.git

# Start ML-FLow Server
$ mlflow ui

# Run the FLASK Linear Regression Application 
$ python ./main.py

# Run the ML Pipeline [GIT + DVC + MLFlow] 
$ python ./ML_Pipeline.py

screen_01

screen_02

screen_03

screen_04

ram_project_ds_prod's People

Contributors

mohamedelmesawy avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.