Comments (5)
The llama_cpp_python package is broken.
llama-cpp-python==0.2.44 works but 0.2.50 fails with the same error outside of ComfyUI. I'm not sure which version started the breakage. Latest is always picked up for install.
lcpp_version = latest_lamacpp()
But you can install it yourself and it will ignore installing latest it looks like:
imported = package_is_installed("llama-cpp-python") or package_is_installed("llama_cpp")
from comfyui_vlm_nodes.
are you sure this node is from VLM nodes? can you send me the workfow picture?
https://github.com/ceruleandeep/ComfyUI-LLaVA-Captioner it can be from this nodes?
from comfyui_vlm_nodes.
This is the solution for me. By now there is a llama-cpp-python==0.2.52 that works.
The llama_cpp_python package is broken. llama-cpp-python==0.2.44 works but 0.2.50 fails with the same error outside of ComfyUI. I'm not sure which version started the breakage. Latest is always picked up for install.
lcpp_version = latest_lamacpp()
But you can install it yourself and it will ignore installing latest it looks like:
imported = package_is_installed("llama-cpp-python") or package_is_installed("llama_cpp")
from comfyui_vlm_nodes.
I didnt even know I got installed that addon.
However the comfyui workflow was stopping by LLava Sampler Simple which is identified as one of VLM_nodes.
Thank you
are you sure this node is from VLM nodes? can you send me the workfow picture?
https://github.com/ceruleandeep/ComfyUI-LLaVA-Captioner it can be from this nodes?
from comfyui_vlm_nodes.
This is the solution for me. By now there is a llama-cpp-python==0.2.52 that works.
Great! That's the first version that fixes it with this commit: abetlen/llama-cpp-python@8383a9e
from comfyui_vlm_nodes.
Related Issues (20)
- Import "server" could not be resolved HOT 1
- MoonDream2 Error HOT 13
- MoonDream2 .gguf support
- Node is not generating new answers each time HOT 1
- I-quants incompatibility? HOT 2
- Cannot load model on Windows embedded python HOT 1
- Import failed HOT 1
- The VRAM usage is too high and cannot be released. HOT 1
- Can't install VLM nodes in ComfyUI HOT 14
- ChatMuscian Error HOT 1
- Suggestion: wave_form/sample_rate to vhs_audio
- GPU not utilized with standard llama-cpp-python HOT 1
- Error using xcomposer: Can't move a model that's been offloaded (delete this please)
- Get Keywords bug HOT 2
- Moondream error after installing VLM nodes HOT 2
- IMPORT FAILED in ComfyUI HOT 1
- Structured Output breaking. HOT 6
- LLaVA++ HOT 1
- ValueError("Prompt exceeds n_ctx") # TODO: Fix HOT 2
- RuntimeError: Failed to load shared library 'D:\AI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\llama_cpp\llama.dll
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from comfyui_vlm_nodes.