Code Monkey home page Code Monkey logo

deploy-ml-mlflow-aws's People

Contributors

vb100 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

deploy-ml-mlflow-aws's Issues

mlflow sagemaker build-and-push-container gives executor failed running exit code 127

Hey!

Thanks for writing such a great repo/tutorial. I have a bug that I've been running into and I just want to double check to see if this error can be replicated.

Everything in local dev worked great, however, when I run mlflow sagemaker build-and-push-container it errors out while building the image. This is what my terminal outputs:

2022/05/04 16:08:26 INFO mlflow.models.docker_utils: Building docker image with name mlflow-pyfunc
/var/folders/lq/lsnfm94n6nz7c620fmmrc66m0000gn/T/tmp4gdhfybo/
/var/folders/lq/lsnfm94n6nz7c620fmmrc66m0000gn/T/tmp4gdhfybo//Dockerfile
#1 [internal] load build definition from Dockerfile
#1 sha256:0aff1a6db93cddddd900609dc967466cef6c4646d6f4d2a3742c4939bb56f89f
#1 transferring dockerfile: 1.46kB 0.0s done
#1 DONE 0.0s

#2 [internal] load .dockerignore
#2 sha256:b3a96a9ddc6030c978a03e686657b21aae568ebeca14e7f93fce1243d291149b
#2 transferring context: 2B done
#2 DONE 0.0s

#3 [internal] load metadata for docker.io/library/ubuntu:18.04
#3 sha256:fbbba859d4013c87b395abe2d64c63aab916412a50c1cc26385876cb51f47d98
#3 DONE 0.8s

#4 [ 1/11] FROM docker.io/library/ubuntu:18.04@sha256:d21b6ba9e19feffa328cb3864316e6918e30acfd55e285b5d3df1d8ca3c7fd3f
#4 sha256:3a06c08112d49851a1d4fe05b9314df85b1242611f7a66bcc1a5a266465f2184
#4 DONE 0.0s

#5 [ 2/11] RUN apt-get -y update && apt-get install -y --no-install-recommends          wget          curl          nginx          ca-certificates          bzip2          build-essential          cmake          openjdk-8-jdk          git-core          maven     && rm -rf /var/lib/apt/lists/*
#5 sha256:f12eec9f17a68c02e466a1313d066f9d933375da36865d53c708edb67672fe12
#5 CACHED

#6 [ 3/11] RUN curl -L https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh >> miniconda.sh
#6 sha256:c8fc1a8bfdafde605559a31818197daa6d32fd7748d070e66a126b2f2438c5f3
#6 CACHED

#7 [ 4/11] RUN bash ./miniconda.sh -b -p /miniconda; rm ./miniconda.sh;
#7 sha256:cabe41afd7f765b5ae911fc00f56a2acba2eda453d8ec7c86941583d417a8812
#7 CACHED

#8 [ 5/11] WORKDIR /opt/mlflow
#8 sha256:b66973830daee98637ee9e5a63421dfc8e14a25d7fdd4acbd9bf5a77833b3663
#8 CACHED

#9 [ 6/11] RUN pip install mlflow==1.18.0
#9 sha256:b217f3b9317faebbd61b9bbfa9b185e117249d78f6b2e3fe7bbe660146ae985d
#9 0.279 /bin/sh: 1: pip: not found
#9 ERROR: executor failed running [/bin/sh -c pip install mlflow==1.18.0]: exit code: 127
------
 > [ 6/11] RUN pip install mlflow==1.18.0:
------
executor failed running [/bin/sh -c pip install mlflow==1.18.0]: exit code: 127
2022/05/04 16:08:27 INFO mlflow.sagemaker: Pushing image to ECR
/opt/anaconda3/envs/deploy_ml/lib/python3.6/site-packages/boto3/compat.py:88: PythonDeprecationWarning: Boto3 will no longer support Python 3.6 starting May 30, 2022. To continue receiving service updates, bug fixes, and security updates please upgrade to Python 3.7 or later. More information can be found here: https://aws.amazon.com/blogs/developer/python-support-policy-updates-for-aws-sdks-and-tools/
  warnings.warn(warning, PythonDeprecationWarning)
2022/05/04 16:08:28 INFO mlflow.sagemaker: Pushing docker image mlflow-pyfunc to 354640567064.dkr.ecr.us-east-1.amazonaws.com/mlflow-pyfunc:1.18.0
2022/05/04 16:08:28 INFO mlflow.sagemaker: Executing: aws ecr get-login-password | docker login  --username AWS  --password-stdin 354640567064.dkr.ecr.us-east-1.amazonaws.com;
docker tag mlflow-pyfunc 354640567064.dkr.ecr.us-east-1.amazonaws.com/mlflow-pyfunc:1.18.0;
docker push 354640567064.dkr.ecr.us-east-1.amazonaws.com/mlflow-pyfunc:1.18.0
Login Succeeded
Error response from daemon: No such image: mlflow-pyfunc:latest
The push refers to repository [354640567064.dkr.ecr.us-east-1.amazonaws.com/mlflow-pyfunc]
An image does not exist locally with the tag: 354640567064.dkr.ecr.us-east-1.amazonaws.com/mlflow-pyfunc

Some information about what I'm running on:

  • 13in Macbook Pro M1 2020
  • 16GB of Memory
  • Python v. 3.6.13

List of packages in my deply_ml env on conda:

# Name                    Version                   Build  Channel
alembic                   1.4.1                    pypi_0    pypi
boto3                     1.22.5                   pypi_0    pypi
ca-certificates           2022.4.26            hecd8cb5_0
certifi                   2021.5.30        py36hecd8cb5_0
charset-normalizer        2.0.12                   pypi_0    pypi
click                     8.0.4                    pypi_0    pypi
cloudpickle               2.0.0                    pypi_0    pypi
databricks-cli            0.16.6                   pypi_0    pypi
dataclasses               0.8                      pypi_0    pypi
docker                    5.0.3                    pypi_0    pypi
entrypoints               0.4                      pypi_0    pypi
flask                     2.0.3                    pypi_0    pypi
gitdb                     4.0.9                    pypi_0    pypi
gitpython                 3.1.18                   pypi_0    pypi
greenlet                  1.1.2                    pypi_0    pypi
gunicorn                  20.1.0                   pypi_0    pypi
idna                      3.3                      pypi_0    pypi
importlib-metadata        4.8.3                    pypi_0    pypi
itsdangerous              2.0.1                    pypi_0    pypi
jinja2                    3.0.3                    pypi_0    pypi
joblib                    1.1.0                    pypi_0    pypi
libcxx                    12.0.0               h2f01273_0
libffi                    3.3                  hb1e8313_2
mako                      1.1.6                    pypi_0    pypi
markupsafe                2.0.1                    pypi_0    pypi
mlflow                    1.18.0                   pypi_0    pypi
ncurses                   6.3                  hca72f7f_2
numpy                     1.19.5                   pypi_0    pypi
oauthlib                  3.2.0                    pypi_0    pypi
openssl                   1.1.1n               hca72f7f_0
packaging                 21.3                     pypi_0    pypi
pandas                    1.1.5                    pypi_0    pypi
pip                       21.2.2           py36hecd8cb5_0
prometheus-client         0.14.1                   pypi_0    pypi
prometheus-flask-exporter 0.20.1                   pypi_0    pypi
protobuf                  3.19.4                   pypi_0    pypi
pyjwt                     2.3.0                    pypi_0    pypi
pyparsing                 3.0.8                    pypi_0    pypi
python                    3.6.13               h88f2d9e_0
python-dateutil           2.8.2                    pypi_0    pypi
python-editor             1.0.4                    pypi_0    pypi
pytz                      2022.1                   pypi_0    pypi
querystring-parser        1.2.4                    pypi_0    pypi
readline                  8.1.2                hca72f7f_1
requests                  2.27.1                   pypi_0    pypi
scikit-learn              0.24.2                   pypi_0    pypi
scipy                     1.5.4                    pypi_0    pypi
setuptools                58.0.4           py36hecd8cb5_0
six                       1.16.0                   pypi_0    pypi
smmap                     5.0.0                    pypi_0    pypi
sqlalchemy                1.4.36                   pypi_0    pypi
sqlite                    3.38.2               h707629a_0
sqlparse                  0.4.2                    pypi_0    pypi
tabulate                  0.8.9                    pypi_0    pypi
threadpoolctl             3.1.0                    pypi_0    pypi
tk                        8.6.11               h7bc2e8c_0
typing-extensions         4.1.1                    pypi_0    pypi
urllib3                   1.26.9                   pypi_0    pypi
websocket-client          1.3.1                    pypi_0    pypi
werkzeug                  2.0.3                    pypi_0    pypi
wheel                     0.37.1             pyhd3eb1b0_0
xz                        5.2.5                h1de35cc_0
zipp                      3.6.0                    pypi_0    pypi
zlib                      1.2.12               h4dc903c_2

Thanks in advance!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.