Comments (2)
bachittle
commented on June 2, 2024
I figured out the issue. The project must compile in Release mode, it does not work in Debug. Is this something that can or should be fixed or documented? Sometimes it is useful to compile things in Debug mode. I will close issue.
from gemma.cpp.
jan-wassenberg
commented on June 2, 2024
Glad you've found the issue. With SIMD code, unfortunately debug builds are about 100x slower and thus not usable. The minimum optimization flags required are for inlining. Personally, I get more value from asan and msan builds; we also enable our debug-only asserts there.
from gemma.cpp.
Related Issues (20)
- Using mingw64 build on windows 10 fails HOT 3
- Weights converted from PyTorch don't seem to work properly HOT 2
- Seeking feedbacks for python wrapper of gemma.cpp HOT 3
- Is the format of output Markdown? HOT 2
- Failed on raspberry pi OS (64bit) HOT 6
- TODO (**Optimize, potentially using new VQSort PartialSort**) HOT 1
- again:Cached compressed weights does not exist yet gemma HOT 5
- Implement arch changes
- Have there been any performance comparisons between gemma.cpp and llama.cpp? HOT 3
- Mismatch between expected 1024000 and actual 1024512 KiB size. HOT 1
- Any more fine example or user-guide for CodeGemma?
- How can I get the compiled static executable binary file in linux platform? HOT 2
- Near-term roadmap HOT 3
- Use a MatMul implementation over MatVec for Prefill Computations HOT 2
- Paligemma Support HOT 1
- Error during build process HOT 1
- Compile error on visual studio build, array size exceed HOT 2
- gemma.exe does not respond no matter how long you wait. HOT 3
- Crash in Attention() with huge input HOT 13
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gemma.cpp.