vb100 / deploy-ml-mlflow-aws Goto Github PK
View Code? Open in Web Editor NEWDeploying Models to Production with Mlflow and AWS Sagemaker
Deploying Models to Production with Mlflow and AWS Sagemaker
Hey!
Thanks for writing such a great repo/tutorial. I have a bug that I've been running into and I just want to double check to see if this error can be replicated.
Everything in local dev worked great, however, when I run mlflow sagemaker build-and-push-container
it errors out while building the image. This is what my terminal outputs:
2022/05/04 16:08:26 INFO mlflow.models.docker_utils: Building docker image with name mlflow-pyfunc
/var/folders/lq/lsnfm94n6nz7c620fmmrc66m0000gn/T/tmp4gdhfybo/
/var/folders/lq/lsnfm94n6nz7c620fmmrc66m0000gn/T/tmp4gdhfybo//Dockerfile
#1 [internal] load build definition from Dockerfile
#1 sha256:0aff1a6db93cddddd900609dc967466cef6c4646d6f4d2a3742c4939bb56f89f
#1 transferring dockerfile: 1.46kB 0.0s done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 sha256:b3a96a9ddc6030c978a03e686657b21aae568ebeca14e7f93fce1243d291149b
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/ubuntu:18.04
#3 sha256:fbbba859d4013c87b395abe2d64c63aab916412a50c1cc26385876cb51f47d98
#3 DONE 0.8s
#4 [ 1/11] FROM docker.io/library/ubuntu:18.04@sha256:d21b6ba9e19feffa328cb3864316e6918e30acfd55e285b5d3df1d8ca3c7fd3f
#4 sha256:3a06c08112d49851a1d4fe05b9314df85b1242611f7a66bcc1a5a266465f2184
#4 DONE 0.0s
#5 [ 2/11] RUN apt-get -y update && apt-get install -y --no-install-recommends wget curl nginx ca-certificates bzip2 build-essential cmake openjdk-8-jdk git-core maven && rm -rf /var/lib/apt/lists/*
#5 sha256:f12eec9f17a68c02e466a1313d066f9d933375da36865d53c708edb67672fe12
#5 CACHED
#6 [ 3/11] RUN curl -L https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh >> miniconda.sh
#6 sha256:c8fc1a8bfdafde605559a31818197daa6d32fd7748d070e66a126b2f2438c5f3
#6 CACHED
#7 [ 4/11] RUN bash ./miniconda.sh -b -p /miniconda; rm ./miniconda.sh;
#7 sha256:cabe41afd7f765b5ae911fc00f56a2acba2eda453d8ec7c86941583d417a8812
#7 CACHED
#8 [ 5/11] WORKDIR /opt/mlflow
#8 sha256:b66973830daee98637ee9e5a63421dfc8e14a25d7fdd4acbd9bf5a77833b3663
#8 CACHED
#9 [ 6/11] RUN pip install mlflow==1.18.0
#9 sha256:b217f3b9317faebbd61b9bbfa9b185e117249d78f6b2e3fe7bbe660146ae985d
#9 0.279 /bin/sh: 1: pip: not found
#9 ERROR: executor failed running [/bin/sh -c pip install mlflow==1.18.0]: exit code: 127
------
> [ 6/11] RUN pip install mlflow==1.18.0:
------
executor failed running [/bin/sh -c pip install mlflow==1.18.0]: exit code: 127
2022/05/04 16:08:27 INFO mlflow.sagemaker: Pushing image to ECR
/opt/anaconda3/envs/deploy_ml/lib/python3.6/site-packages/boto3/compat.py:88: PythonDeprecationWarning: Boto3 will no longer support Python 3.6 starting May 30, 2022. To continue receiving service updates, bug fixes, and security updates please upgrade to Python 3.7 or later. More information can be found here: https://aws.amazon.com/blogs/developer/python-support-policy-updates-for-aws-sdks-and-tools/
warnings.warn(warning, PythonDeprecationWarning)
2022/05/04 16:08:28 INFO mlflow.sagemaker: Pushing docker image mlflow-pyfunc to 354640567064.dkr.ecr.us-east-1.amazonaws.com/mlflow-pyfunc:1.18.0
2022/05/04 16:08:28 INFO mlflow.sagemaker: Executing: aws ecr get-login-password | docker login --username AWS --password-stdin 354640567064.dkr.ecr.us-east-1.amazonaws.com;
docker tag mlflow-pyfunc 354640567064.dkr.ecr.us-east-1.amazonaws.com/mlflow-pyfunc:1.18.0;
docker push 354640567064.dkr.ecr.us-east-1.amazonaws.com/mlflow-pyfunc:1.18.0
Login Succeeded
Error response from daemon: No such image: mlflow-pyfunc:latest
The push refers to repository [354640567064.dkr.ecr.us-east-1.amazonaws.com/mlflow-pyfunc]
An image does not exist locally with the tag: 354640567064.dkr.ecr.us-east-1.amazonaws.com/mlflow-pyfunc
Some information about what I'm running on:
List of packages in my deply_ml env on conda:
# Name Version Build Channel
alembic 1.4.1 pypi_0 pypi
boto3 1.22.5 pypi_0 pypi
ca-certificates 2022.4.26 hecd8cb5_0
certifi 2021.5.30 py36hecd8cb5_0
charset-normalizer 2.0.12 pypi_0 pypi
click 8.0.4 pypi_0 pypi
cloudpickle 2.0.0 pypi_0 pypi
databricks-cli 0.16.6 pypi_0 pypi
dataclasses 0.8 pypi_0 pypi
docker 5.0.3 pypi_0 pypi
entrypoints 0.4 pypi_0 pypi
flask 2.0.3 pypi_0 pypi
gitdb 4.0.9 pypi_0 pypi
gitpython 3.1.18 pypi_0 pypi
greenlet 1.1.2 pypi_0 pypi
gunicorn 20.1.0 pypi_0 pypi
idna 3.3 pypi_0 pypi
importlib-metadata 4.8.3 pypi_0 pypi
itsdangerous 2.0.1 pypi_0 pypi
jinja2 3.0.3 pypi_0 pypi
joblib 1.1.0 pypi_0 pypi
libcxx 12.0.0 h2f01273_0
libffi 3.3 hb1e8313_2
mako 1.1.6 pypi_0 pypi
markupsafe 2.0.1 pypi_0 pypi
mlflow 1.18.0 pypi_0 pypi
ncurses 6.3 hca72f7f_2
numpy 1.19.5 pypi_0 pypi
oauthlib 3.2.0 pypi_0 pypi
openssl 1.1.1n hca72f7f_0
packaging 21.3 pypi_0 pypi
pandas 1.1.5 pypi_0 pypi
pip 21.2.2 py36hecd8cb5_0
prometheus-client 0.14.1 pypi_0 pypi
prometheus-flask-exporter 0.20.1 pypi_0 pypi
protobuf 3.19.4 pypi_0 pypi
pyjwt 2.3.0 pypi_0 pypi
pyparsing 3.0.8 pypi_0 pypi
python 3.6.13 h88f2d9e_0
python-dateutil 2.8.2 pypi_0 pypi
python-editor 1.0.4 pypi_0 pypi
pytz 2022.1 pypi_0 pypi
querystring-parser 1.2.4 pypi_0 pypi
readline 8.1.2 hca72f7f_1
requests 2.27.1 pypi_0 pypi
scikit-learn 0.24.2 pypi_0 pypi
scipy 1.5.4 pypi_0 pypi
setuptools 58.0.4 py36hecd8cb5_0
six 1.16.0 pypi_0 pypi
smmap 5.0.0 pypi_0 pypi
sqlalchemy 1.4.36 pypi_0 pypi
sqlite 3.38.2 h707629a_0
sqlparse 0.4.2 pypi_0 pypi
tabulate 0.8.9 pypi_0 pypi
threadpoolctl 3.1.0 pypi_0 pypi
tk 8.6.11 h7bc2e8c_0
typing-extensions 4.1.1 pypi_0 pypi
urllib3 1.26.9 pypi_0 pypi
websocket-client 1.3.1 pypi_0 pypi
werkzeug 2.0.3 pypi_0 pypi
wheel 0.37.1 pyhd3eb1b0_0
xz 5.2.5 h1de35cc_0
zipp 3.6.0 pypi_0 pypi
zlib 1.2.12 h4dc903c_2
Thanks in advance!
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.