Comments (6)
Same problem here, the exectution stops in the ggml_type_sizef
function on the vxorps %xmm0,%xmm0,%xmm0
instruction. I suppose this is because I'm running this on a very low-end CPU which doesn't support the AVX(?) instructions. Perhaps this is a bug in the ggml
library, in the code for differentiating CPU features.
from gpt4all.
@Netherdrake you need AVX support for this particular instruction. Then you need AVX2 too (see issue 82). Since your CPU supports it you need to somehow pass that too through your VM software.
from gpt4all.
Perhaps this is a bug in the
ggml
library, in the code for differentiating CPU features.
Looks like you are right. See my other reply. This code is basically "return true;". CPU features are decided in compile-time, and not run-time.
from gpt4all.
I have a similar issue in another project (privateGPT), and here is my solution as a reference.
My environment is CPU E5-2680v4 + PVE VM. The root case is application code cannot execute avx/avx2 instructions and crashes. We have two directions to deal with:
[Not lucky]
If CPU doesnot
support avx/avx2, then refer to https://tech.amikelive.com/node-887/how-to-resolve-error-illegal-instruction-core-dumped-when-running-import-tensorflow-in-a-python-program/[Lucky]
If CPU does support avx/avx2, but VM has no avx/avx2 flags, then simply pass avx/avx2 flags into VM.
My issue fits solution (2), and from the problem statement above, the CPU "AMD Epyc 7313" supports avx/avx2, the only issue is VM has no correct CPU flags, it could fit into solution (2). I don't know which VM provider you are using, may need to pass the flags accordingly.
- For KVM: https://superuser.com/questions/1467225/how-to-make-the-kvm-enable-cpu-flags-sse4-2-to-the-guest
- For PVE, simply change the processor type to
host
and restart VM, ref: https://forum.proxmox.com/threads/avx2-and-avx-flags-on-vm.87808/
Hope it helps a little.
from gpt4all.
anyone running vm on windows check this article out
https://stackoverflow.com/questions/65780506/how-to-enable-avx-avx2-in-virtualbox-6-1-16-with-ubuntu-20-04-64bit
from gpt4all.
Stale
from gpt4all.
Related Issues (20)
- [Feature] Ctrl+F to search text inside a discussion
- bug
- v2.7.5 Windows Local and Server Model both use Llama 3 Instruct, program crash HOT 1
- [Feature] indicate the max context size of each model in the download list ?
- [Feature] check the compatibility of a hugging face model before fully downloading it ?
- Idk what this is honestly HOT 1
- Python Bindings: Model no longer kept in cache HOT 2
- Reliable crash test in 2.7.5 and 2.8.0pre1 HOT 3
- Python bindings: add possibility to clear history of a chat_session HOT 4
- "availableGPUDevices: built without Kompute" error when installed via pip on macOS M2 HOT 2
- [Feature] Ability to populate previous chat history when using chat_session() HOT 7
- 增加对Intel ARC A770显卡推理支持 HOT 2
- Ver. 2.7.4 nad Ver. 2.8.0 pre not starting gui on Windows HOT 2
- API service response data missing
- Building GPT4all from source - Windows - Qt.dll errors HOT 11
- Is there a WebUI available? HOT 1
- Need `#include <algorithm>` to build `gpt4all-backend/llamamodel.cpp`
- Windows 11. Nothing happens HOT 7
- GPT4All 2.8.0 client crashes instantly when adding a populated "Local docs" folder HOT 3
- Is it possible to make the "Stop Generating" button stop everything?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gpt4all.