How many tokens/s on a single 3090 card?
#5 opened 3 months ago
by
Avos0001
IQ4_XS not working, same issue as with IQ3_M and Q5_K_M
#4 opened 4 months ago
by
L285348120816
Q5_K_M nonsensical/broken output in LM Studio 0.2.31
#3 opened 5 months ago
by
L285348120816
EXL2 Quant
1
#2 opened 5 months ago
by
invictus1
IQ3_M quant busted, IQ3_XXS okay
10
#1 opened 5 months ago
by
anxcat