Comments (4)
austinvhuang
commented on June 7, 2024
1
@purefire adding an export script is a high priority to unlock model variations / fine tuning. Please chime in #11 on the source format that would be most useful.
Hi @julien-c 👋 :)
from gemma.cpp.
julien-c
commented on June 7, 2024
interested as well!
from gemma.cpp.
jan-wassenberg
commented on June 7, 2024
It's the same model but this repo cannot use those weight formats directly. We have an internal export script that transforms other formats into our simple blob format, but this is not yet ready for production/open-sourcing.
Please comment on #11, which discusses which input formats would be useful.
We do not use Rocm, this repo is currently CPU-only, see #18.
from gemma.cpp.
austinvhuang
commented on June 7, 2024
Consolidating weight export discussions to the issue #11 . We're working on making a script available soon - feel free to chime in with further comments there. Thanks!
from gemma.cpp.
Related Issues (20)
- Using mingw64 build on windows 10 fails HOT 3
- Weights converted from PyTorch don't seem to work properly HOT 2
- Seeking feedbacks for python wrapper of gemma.cpp HOT 3
- Is the format of output Markdown? HOT 2
- Failed on raspberry pi OS (64bit) HOT 6
- TODO (**Optimize, potentially using new VQSort PartialSort**) HOT 1
- again:Cached compressed weights does not exist yet gemma HOT 5
- Implement arch changes
- Have there been any performance comparisons between gemma.cpp and llama.cpp? HOT 3
- Mismatch between expected 1024000 and actual 1024512 KiB size. HOT 1
- Any more fine example or user-guide for CodeGemma?
- How can I get the compiled static executable binary file in linux platform? HOT 2
- Near-term roadmap HOT 3
- Use a MatMul implementation over MatVec for Prefill Computations HOT 2
- Paligemma Support HOT 1
- project does not work as submodule HOT 2
- Error during build process HOT 1
- Compile error on visual studio build, array size exceed HOT 2
- gemma.exe does not respond no matter how long you wait. HOT 3
- Crash in Attention() with huge input HOT 13
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gemma.cpp.