Question about 4 bit GGML

#1
by srwill - opened

Hello! I apologize in advance, do not consider the request for impudence, but could you upload a quantized model in 4-bit in GGML format?

Thanks to Melbourne, which converted this interesting model to ggml, the issue is resolved.

srwill changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment