Code Monkey home page Code Monkey logo

aws-sagemaker-demo's Introduction

AWS SageMaker Example

This is the source code for the Medium article https://medium.com/weareservian/machine-learning-on-aws-sagemaker-53e1a5e218d9

Before successfully runing this code, you may need to fill in your personal configurations (e.g. S3 bucket name)

Pre-requisite

  • Python3
  • AWS SDK
  • Docker
  • Terraform (optional)

Setup AWS resources

cd terraform
terraform init # for the first time
terraform apply
terraform output --json > ../sagemaker/cloud_config.json
cd ..

Generate Demo data

python data/generate.py --output data/data.csv

Test in local environment

python sagemaker/jobsubmit.py --local

Invocate Local endpoint

curl --location --request POST '127.0.0.1:8080/invocations' \
     --header 'Content-Type: application/json' \
     --data-raw '[[1,2,3,4,5,6,7,8,19,10],[1,2,3,4,5,6,7,8,9,10]]'

Upload data to s3 bucket

aws s3 cp data/data.csv s3://$(cd terraform && terraform output s3bucket)/

Submit to AWS cloud

python sagemaker/jobsubmit.py

Invocate Remote endpoint

python sagemaker/invoke.py

Clean up Cloud environment

cd terraform
terraform destroy
cd ..

aws-sagemaker-demo's People

Contributors

xg1990 avatar xg-servian avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.