Comments (1)
Hi @GDegrove,
I suspect the fundamental issue is that the model is built for Python 3.11 but the MLServer version is running Python 3.8. It should be possible to resolve this by using a newer version of Python for MLServer itself, or alternatively by using dependency versions compatible with Python 3.8.
I believe this happens because when MLServer spawns worker processes, these use the same Python version as the main process, which is whatever that version of MLServer was built with. The Conda environment is added to the system path, but does not change the Python version of the already running process using that system path.
from mlserver.
Related Issues (20)
- Mlserver timeout for long requests HOT 2
- Ability to serve swagger doc dependencies from the mlserver instance or use a custom CDN
- Install `fugashi`, `unidic`, `unidic-lite`, and `ipadic` as dependencies to MLServer HuggingFace to support hosting Japanese language models HOT 3
- Examples/clarification over using OpenTelemetry tracing in MLServer
- gRPC fails with inferred f16 numpy array HOT 1
- ML Server with GRPC
- Adaptive batching leads to parameters being cut off HOT 5
- InferenceRequests with Tensor of Tensors does not decode properly
- `mlserver build` fails if requirements.txt includes a git path
- Can't get metrics: `ValueError: env prometheus_multiproc_dir is not set or not a directory` HOT 1
- Select GPU to be used for each worker on parallel inference
- pydantic.errors.PydanticImportError: `BaseSettings` has been moved to the `pydantic-settings` package HOT 2
- [BUG]: Kafka Message cannot be serialized to JSON when dict contains bytes HOT 1
- Schema enforcement error when using `PandasCodec` inference request HOT 3
- where InferenceRequest init?
- gRPC async server looses track of `_futures`
- Inference parameters are not passed to the predict function in MLFlow runtime
- Does MLServer support Skops?
- Docs specify Pandas DataFrame Codec input shapes incorrectly.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mlserver.