Bug: missing option `--vocab-type bpe` in `convert-hf-to-gguf.py` about llama.cpp HOT 3 CLOSED

Hi, that's not a bug. convert-hf-to-gguf.py automatically detects which vocab should be used based on model. There's no need for --vocab-type anymore.

I'll fix the readme.

from llama.cpp.

@cmp-nct Yup, convert-hf-to-gguf-update.py is a bit of a pain for models with new tokenizers. I replied in more details in #7599, but you can still use examples/convert-legacy-llama.py which is old convert.py script. We should add some sort of option for this though. I agree. I'll take a look at that tomorrow.

from llama.cpp.

Hi, that's not a bug. convert-hf-to-gguf.py automatically detects which vocab should be used based on model. There's no need for --vocab-type anymore.

I'll fix the readme.

Struggling with the same issue, trying to convert the minicpm-2.5 model which is dynamically generated (like llava-surgery) during the pre-conversion process. Forcing the tokenizer/model type should be an option available

In the same process I also got an error to trust remote code during get_vocab_base - from_pretrained()

from llama.cpp.