Comments (6)
D'oh! I am a big dummy. The Dockerfile is in fact right there. I will try editing it.
from willow-inference-server.
According to https://packages.ubuntu.com/jammy/zstd the zstd
package depends on liblz4-1
. I changed the offending line in the Dockerfile to:
apt-get install -y liblz4-1 && rm -rf /var/lib/apt/lists/*
and that seems to have resolved the problem
from willow-inference-server.
apt-get (of course) installs necessary dependencies by default so I have no idea what the problem was there. More than likely you had some transient network connectivity issue because when you can't connect to Ubuntu mirrors it's definitely not a WIS issue - we haven't even really done anything yet.
You're also probably better served (at this point) using/testing the wisng
branch for WIS. Our first (imminent) stable release will be based on that.
from willow-inference-server.
@kristiankielhofner Thank you!
When I tried apt-get install -y zstd
locally outside of the docker context, it worked fine - I suspect that the base docker image, nvcr.io/nvidia/tensorrt:22.12-py3
, has something funky in the /etc/sources
, where it is able to find liblz4-1
but not zstd
.
from willow-inference-server.
I suspect others may run into this in the future; for now, I'm happy to close.
from willow-inference-server.
Except that it does work for all of the people who have installed WIS before you. I do it several times a day :).
Additionally, installing liblz4-1 eliminated your error but it's actually the wrong lib. LZ4 is a different compression algorithm, the dependant lib for zstd
is libzstd1. Installing liblz4-1 does nothing other than occupy storage space.
When you try to use zstd
inside of the container (as we do in occasional places) it will fail because the binary and dependant lib isn't actually installed.
from willow-inference-server.
Related Issues (20)
- flake8: logger.debug broken over multiple lines HOT 1
- Run "bare metal"? HOT 1
- Running in SystemD for boot startup HOT 3
- Error during install.sh HOT 3
- wis server unresponsive. HOT 12
- Unable to start server (CUDNN_STATUS_NOT_INITIALIZED) HOT 6
- LLM installation issue HOT 3
- Merge default settings with custom settings
- WIS Server CPU Mode - Model returns "you." only HOT 7
- WIS on WSL with GPU - Windows Firewall handling HOT 1
- Updated Willow (though WAS) and also WIS on server. HOT 10
- [Feature] Support Chatbot to use other LLM models such as ChatGLM-6B HOT 19
- Allow to specify the location of TLS certificate and host name to use. HOT 5
- Error when running download_models.sh HOT 9
- Ubuntu Dependency Script is throwing repository errors, no longer runs successfully HOT 3
- WIS installation failed with ./deps/ubuntu.sh HOT 3
- WIS returned HTTP error: 500 HOT 3
- WIS restart HOT 6
- current versions of grpcio/protobuf crash chatbot/utils.sh install 13B HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from willow-inference-server.