Transformers
GGUF
llama

It's impossible to use normally.

#1
by Anonimus12345678902 - opened

At least on Silly Tavern. By default it writes incoherent nonsense. You need to customize it very precisely, on github there was one person explaining exactly what numbers to set so that the model would at least more or less work. In general, in my opinion, this is a degraded version of a good model "vicuna 13b v 1.3" I do not recommend this model (v1.5).

Sign up or log in to comment