Comments (4)
hydai
commented on June 6, 2024
https://huggingface.co/TheBloke/Llama-2-13B-chat-GGML/discussions/23
Looks like your nvcc is too old. I guess the only solution is to upgrade the nvcc & nvidia driver.
from wasmedge.
hydai
commented on June 6, 2024
From the official developer forums:
It indicates a mismatch between driver and compilation toolchain. Not having any other details (GPU in use, CUDA version in use from nvcc --version, GPU driver version) from you, I can’t be specific. My recommendation (based on the 11.2 in your cub path) would be to update your driver to the latest one available for your GPU. If your driver is less 460.39, I would update your driver.
Sounds like updating the driver is the only solution to fix it.
from wasmedge.
hydai
commented on June 6, 2024
@alabulei1 Please check if this issue still needs to be fixed.
from wasmedge.
alabulei1
commented on June 6, 2024
Since WasmEdge now supports CUDA 12.1, problem is solved. Thanks!
from wasmedge.
Related Issues (20)
- bug: `--nn-preload` option doesn't work with the latest version of WasmEdge (v0.13.5) HOT 8
- Support TLS2 HOT 1
- feat: Remove the extension support in the installer
- bug: Unknown warning option when building on Apple Clang
- feat: Implementing Coredump for Post-Mortem Debugging in WebAssembly HOT 9
- feat: Enabling WasmEdge AOT mode execution in the proxy-wasm integration
- feat: Enabling LLM fine tuning in the WASI-NN PyTorch plugin HOT 2
- feat: Enabling LLM fine tuning in the WASI-NN ggml plugin HOT 3
- Can't install WasmEdge with wasmedge_rustls plugin (tested on Fedora and Ubuntu) HOT 5
- question: Possibility of simplifying running AI model-specific wasm Workloads with Embedded Configuration HOT 4
- feat: Crun + GGML plugin tracking issue HOT 13
- feat: Provide CUDA 11.3 pre-built ggml plugin HOT 1
- feat: Support `--main-gpu` in the ggml plugin
- feat: Support `--tensor-split` in the ggml plugin
- How can I run wasmedge on Windows11 with GGML plugin HOT 2
- Bug: (WASI) Failed to create directory with trailing backslash HOT 3
- bug: Can't install Rust TLS plugin on Mac OS HOT 11
- feat: Support auto-detect CUDA version for the ggml plugin in the installer
- bug: Remove `._*.*` files on macOS in the installer HOT 1
- Building WASM from source on android HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from wasmedge.