Larger quants please
#1
by
YokaiKoibito
- opened
All the reasonable options up to nearly 192GB would be useful in my case, other people will of course be interested in other sizes.
IQ3_XXS: 157.7 GB made with llama.cpp version b3484 ready
All the reasonable options up to nearly 192GB would be useful in my case, other people will of course be interested in other sizes.
IQ3_XXS: 157.7 GB made with llama.cpp version b3484 ready