Comments (6)
aarnphm
commented on May 14, 2024
Hey there, what is the version of openllm you are using?
from openllm.
aarnphm
commented on May 14, 2024
Can you also show the output of openllm models --show-available?
from openllm.
bharath-krishna
commented on May 14, 2024
Hello, I am also facing the similar issue, I am using version v0.1.12
I ran command
openllm build flan-t5 --model-id google/flan-t5-large
and it failed with error
bentoml.exceptions.NotFound: Bento 'google-flan-t5-large-service:2d6503cbe79448e511312ba3377a9cde16a2135a' is not found in BentoML store <osfs '/home/.../bentoml/bentos'>
and here is the output of openllm models --show-available command.
Please help me how to resolve this issue.
from openllm.
aarnphm
commented on May 14, 2024
Oh sorry, this is a hindsight on my part. I will release a quick patch fix for this
from openllm.
aarnphm
commented on May 14, 2024
Hey all, Please try out with the latest change, hopefully I have smoothen all rough edges
from openllm.
aarnphm
commented on May 14, 2024
I have fixed this on main
from openllm.
Related Issues (20)
- bug: cannot load local model by model-id
- bug: Output text from CompletionChunk is different with tokenizer.decode HOT 7
- bug: microsoft/phi-2 hangs on macos i7
- bug: Linux Mint: The Service throws errors when getting model-requests HOT 1
- Docker image for version 0.4.41 not built
- bug: when use backend=pt in normal or adapter mode,RuntimeError: Exception caught during generation: Failed to parse JSON from SSE message:(vllm is ok) HOT 2
- bug: 'torch.dtype' object has no attribute 'lower'
- running out of memory
- bug: Inference fails for `docker run` with `google/flan-t5-large` model with `pytorch` on CPU HOT 1
- bug: block GPU HOT 1
- Add a gradio demo for the python sdk section
- Why change prompt_token_ids depending on encoder_decoder
- bug: RuntimeError: Exception caught during generation: Response payload is not completed
- bug: [WARNING] [api_server:llm-llama-service:3] Timed out waiting for runner to be ready
- Unable to fetch models.
- bug: Not able to work with locally downloaded model
- How to modify the port number?
- How to load a model offline HOT 1
- bug: "Failed to parse JSON from SSE message" error HOT 3
- bug: AttributeError in Phi-2 Model Initialization Using BentoML OpenLLM Docker Container HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from openllm.