Comments (1)
My bad. I thought of everything except that the module was corrupted.
from llama.cpp.
Related Issues (20)
- Feature Request: Add Paligemma support HOT 1
- Bug: multithreading for requests,model infer service failed
- Bug: GGML_ASSERT: ggml.c:12793: ne2 == ne02 zsh: abort ./finetune --model-base --train-data ./Llama3-8B-Chinese-Chat-fintune/111.tx
- Bug: get-wikitext-103.sh seems not working HOT 2
- Bug: apparent pre-tokenization hash collision in get_vocab_base_pre() function in convert-hf-to-gguf.py script? Llama3 8B is mapped to smaug-bpe instead of llama-bpe
- Bug: CUDA error: out of memory - Phi-3 Mini 128k prompted with 20k+ tokens on 4GB GPU HOT 27
- Support for MatMul free LLMs
- ci : self-hosted runner issue
- Bug: convert-hf-to-gguf.py fails for Gemma models
- Bug: Qwen2 BOS token?
- Feature Request: Add VideoLLaMA2 support
- Bug: flash attention produces corrupt output with batched generation HOT 6
- Bug: The "server" provided web-ui chat seems to sometimes not properly quote "<" ">" charaters in its HTML output. HOT 1
- Bug: Fatal signal 11 (SIGSEGV) on Google Pixel 8 (dart) HOT 2
- Bug: missing option `--vocab-type bpe` in `convert-hf-to-gguf.py` HOT 3
- Any idea of PyramidKV?
- Bug: Outdated documentation of train-text-from-scratch
- converting phi-3-small error. HOT 7
- Bug: convert-hf-to-gguf.py on Gemma model ValueError: Duplicated key name 'tokenizer.chat_template' HOT 3
- Bug: Error while converting BERT to GGUF: Can not map tensor 'bert.embeddings.LayerNorm.beta'
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llama.cpp.