Docker Installation Issue about llm-guard HOT 4 CLOSED

I used this command on my Mac

docker run -p 8000:8000 -d -e DEBUG='true' -e XFORMERS_MORE_DETAILS=1 laiyer/llm-guard-api:latest

And got this response

Digest: sha256:63d4a3a440e7f3335da507c03a76a8da2202d1d1a9605c1ae8a5100d68e334c1
Status: Downloaded newer image for laiyer/llm-guard-api:latest
d6fe92d1e3a7e336c1ea3b37456656343d5753db31ec04b0453b31513880b064

Then launched the container and after some time of loading all the models, it worked.

On the other question, I put it on the list for the next version. Thanks for the suggestion.

from llm-guard.

Hey @h0n33badg3rc0d3 ,
Thanks for submitting the issue.

30 minutes ago, we released the new version (v0.3.0) to the docker. It uses Python 3.11. I checked on my Macbook Pro M1Pro today.

Can you please try again to pull the new image and run it?

from llm-guard.

Latest push doesn't seem to help. Interestingly, even when i delete the prior image and then re-pull, i get the same image I had 11 hours ago. The hash of the latest image I pull matches the hash on hub.docker too-- 63d4a3a440e7f3335da507c03a76a8da2202d1d1a9605c1ae8a5100d68e334c1

On a different note, are you able to create an image for linux/amd64 architecture too?

from llm-guard.

Hey @h0n33badg3rc0d3 , I added images for 2 types of architectures https://hub.docker.com/repository/docker/laiyer/llm-guard-api/tags?page=1&ordering=last_updated

from llm-guard.