Using the new gguf quant method may result in a worse overall performance than that of the old gguf quants.
1
#2 opened 11 months ago
by
TheYuriLover
Is th GGUF model compatible with llama.cpp?
1
#1 opened 11 months ago
by
victorx98