Wow thanks

#1
by Yuma42 - opened

Thank you for the iquants of my models. But I would like to point you to my best models, the ones which you quantized are more experimental and I expect them to perform worse.

This one should be my best model:
https://huggingface.co/Yuma42/KangalKhan-RawRuby-7B

And these two might also be interesting:
https://huggingface.co/Yuma42/KangalKhan-RawEmerald-7B
https://huggingface.co/Yuma42/KangalKhan-Ruby-7B-Fixed

If you would quant them, I could link them to your quants, I just made Q4S quants for them.

(just to clarify i made static i-quants of them, not imatrix i-quants, btw. I can also make imatrix ones, but I usually only do so when explicitly requested)

Anyway, sure, I'll be happy to add those. They should be available within a few hours. Don't hesitate to tell me about any future models you would like quants for.

mradermacher changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment