converting phi-3-small error. about llama.cpp HOT 7 OPEN

same problem here, was really hoping this would work with my fine tune as i switch to newer models but no luck

from llama.cpp.

notebook that shows the problem:
https://colab.research.google.com/drive/1GSlcZFE_kokYRFAqL81jVVZm04IbX5L6?usp=sharing

from llama.cpp.

I got past that, convert script works with L3 model but the quantize script stopped working today. Colab.

!./llama.cpp/quantize /content/models/"model".gguf "model"-q6_k.gguf q6_k

/bin/bash: line 1: ./llama.cpp/quantize: No such file or directory

from llama.cpp.

I got past that, convert script works with L3 model but the quantize script stopped working today. Colab.

!./llama.cpp/quantize /content/models/"model".gguf "model"-q6_k.gguf q6_k

/bin/bash: line 1: ./llama.cpp/quantize: No such file or directory

that's because now quantize is called llama-quantize.

from llama.cpp.

I got past that, convert script works with L3 model but the quantize script stopped working today. Colab.

How? With the same colab notebook? Did you change something?

from llama.cpp.

I tried again but I got the same result!

git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
pip install -r requirements.txt
pip install ./gguf-py/
python convert-hf-to-gguf.py --outtype f16 --outfile /content/Phi-3-small-128k-instruct.f16.gguf /content/Phi-3-small-128k-instruct

same as before.

INFO:hf-to-gguf:Loading model: Phi-3-small-128k-instruct
ERROR:hf-to-gguf:Model Phi3SmallForCausalLM is not supported

from llama.cpp.

the same error , Local or https://huggingface.co/spaces/ggml-org/gguf-my-repo

from llama.cpp.