Thanks!
#1
by
KeyboardMasher
- opened
Thank you for IQ4_XS with importance matrix!
At the limit of the possible it fits into 16 GB GPU with 2048 context size, just enough to be useful!
Thank you for IQ4_XS with importance matrix!
At the limit of the possible it fits into 16 GB GPU with 2048 context size, just enough to be useful!