Comments (4)
imWildCat
commented on May 25, 2024
10
Download models from here: https://huggingface.co/nyanko7/LLaMA-7B
We have to organize these files according to the project convention:
models
├── 7B
│ ├── consolidated.00.pth
│ └── params.json
├── checklist.chk
└── tokenizer.model
from llama.cpp.
al03
commented on May 25, 2024
3
Download models from here: https://huggingface.co/nyanko7/LLaMA-7B
from llama.cpp.
jlei523
commented on May 25, 2024
Same.
I can't perform this step.
ls ./models
65B 30B 13B 7B tokenizer_checklist.chk tokenizer.model
➜ llama.cpp git:(master) cd models
➜ models git:(master) 65B 30B 13B 7B tokenizer_checklist.chk tokenizer.model
zsh: command not found: 65B
from llama.cpp.
xndai
commented on May 25, 2024
Works now. Thanks.
from llama.cpp.
Related Issues (20)
- Gibberish response from server and main exits on M1 macstudio ultra with gpu (cpu ok) HOT 2
- Looking for help for using llama.cpp with Phi3 model and LoRA
- Add metadata override and also generate dynamic default filename when converting gguf HOT 1
- how can i modify the setting,make it answer in Chinese by default HOT 6
- Support for Consistency Large Language Models? HOT 5
- Add support for mistral Dutch and Armenian models: Tweeties/tweety-7b-dutch-v24a and Tweeties/tweety-7b-armenian-v24a
- Should we add an autolabeler for PR? HOT 2
- Messy CUDA graph error output on mixtral/MoE models HOT 6
- selects too many cores by default on orange pi 5 (2x slower) HOT 2
- Train For Language Translation HOT 2
- llamacpp --prompt-cache-all < -- more than a year passed and still is not fully implemented
- Can't run the program HOT 8
- BF16 prompt processing has half the performance compared to F16 and F32 von AMD Ryzen Embedded V3000 (Zen 3)
- third party applications are overwhelmingly slow for subsequent prompt evaluation compared to examples/main and examples/server HOT 2
- Expanding Swift Package Functionality HOT 2
- Build error at server.cpp: undefined reference to `json_schema_to_grammar HOT 8
- Native Intel IPEX-LLM Support HOT 10
- quantize: command not found HOT 2
- Server: completion_probabilities (tok_str and prob) seem to be broken HOT 8
- LLaVA-NeXT-Video-34B
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llama.cpp.