[Bug] Q5 causes an error while loaded via LlamaCPP
#4
by
ArgentumWalker
- opened
Hi! I'm trying to load Lumimaid-v0.2-8B.q5_k_m.gguf checkpoint via LlamaCPP and getting the following error:
llama_model_load: error loading model: done_getting_tensors: wrong number of tensors; expected 292, got 291
llama_load_model_from_file: failed to load model
I've tried to clear cache and download it again, yet still getting the same error. Do anyone know how to fix it?