These models that use rope behave very weird (dumb) with default settings of 32768 in latest Oobabooga text generation webui.
5
#6 opened over 1 year ago
by
CR2022
I really need help with Templates? How to interpret and use them?
5
#5 opened over 1 year ago
by
Goldenblood56
Free and ready to use openchat_3.5-GGUF model as OpenAI API compatible endpoint
1
#4 opened over 1 year ago
by
limcheekin
Llama.cpp's Server crashes when input is long
#3 opened over 1 year ago
by
Mihaiii
Weird issues with the local model, but not with the online demo
4
#2 opened over 1 year ago
by
sleepyjoecheated
Prints only reply but when asked something extra it hangs
14
#1 opened over 1 year ago
by
Pumba2