llama.cpp error
#1
by
matthieudelaro
- opened
Hi,
Thanks for the model. Sharing here an error for the next users, which is produced when loading the model with LM Studio 0.2.31 running on an Apple M3 :
"llama.cpp error: 'check_tensor_dims: tensor 'blk.0.ffn_down.weight' has wrong shape; expected 14336, 5120, got 5120, 14336, 1, 1'"
Have a good day,
Did you get any solution for this?
I eventually fixed this by reshaping the tensors, but I found out the model was incoherent. I think the model is actually very different from Nemo, and that simply converting it won't work.
Does this text only gguf mean I can't give an image?
same, running on macbook m3 with lm studio