What preset can be used on LM Studio to avoid errors ?
When using Gemma 2 models in my LM Studio I get a Terrible error, it goes fine, but after some time begins to write nonsenses, parts of words on each line. What preset could avoid that ? Thanks.
My lm Studio version: The latest one for windows 10.
Make sure you're using a recently updated version of the model, looks like you're using mradermacher's conversion which was made before some of the latest llama.cpp tokenizer fixes for gemma 2.
You can try mine here: https://huggingface.co/bartowski/Tiger-Gemma-9B-v1-GGUF
Make sure you're using a recently updated version of the model, looks like you're using mradermacher's conversion which was made before some of the latest llama.cpp tokenizer fixes for gemma 2.
You can try mine here: https://huggingface.co/bartowski/Tiger-Gemma-9B-v1-GGUF
Thank you, Bartowski, I'll try it too and bring a new report. 🙏👍❤️
Bartowski, using the latest version on LM Studio didn't improve, even without system prompt. It begins fine, but some 3 or 4 messages later, it does that. This happens with all Gemma models in LM Studio, latest version, perhaps it's not your fault. 🙏👍❤️