How to convert this model to GGUF?

#2
by degot - opened

Hello, I tried llama.cpp/convert_hf_to_gguf.py , but it gives error : Can't map tensor

Unsloth AI org

Hello, I tried llama.cpp/convert_hf_to_gguf.py , but it gives error : Can't map tensor

We uploaded the GGUF's here: https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-32B-GGUF

Are these GGUF's bnb ?! dynamic quants.

Sign up or log in to comment