How did you quantised this model?
1
#3 opened 8 months ago
by
Saksham54
4-bit quantization
#2 opened 10 months ago
by
ibalampanis
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/DnSHgVo4nbusnIbuPuXpF.jpeg)
This quant gives a terrifying output
3
#1 opened 12 months ago
by
alexcardo