Oddly doesn't work in LM Studio
#1
by
Pomni
- opened
The model is incorrectly detected as GPT-Neo-X, LM Studio gives out an unsupported architecture warning, and trying to load it gives out an "unsupported architecture" error. This affects both the static and imatrix quants. Hope this can be fixed!
it is gptneox, so it's not incorrectly detected. and nothing i can do will make it supported - you need an udated lm studio version that supports this model. in the meantime, you could use llama ore koboldcpp, both of which support this model.
mradermacher
changed discussion status to
closed